ML Case

Create a model to find bad sellers on the Facebook marketplace. How would you assess if your model is working? How would you track progress and success?

Data Scientist

Amazon

Meta

Coupang

Fiverr

Did you come across this question in an interview?

Answers

Anonymous

2.8Fair
Offline metric: roc-auc or recall (note high class imbalance)
Online (business) metric: lower number of complains after solution introduction 
  • What steps would you take to create a model that detects fraudulent sellers on {company} Marketplace? How do you plan to evaluate its effectiveness and monitor its progress over time?
  • Could you walk me through your strategy for identifying and weeding out bad actors on the {company} marketplace? How will you measure the success of your model, and what metrics will you use to track its progress?
  • How would you build a model to detect problematic sellers on the {company} marketplace? What methods would you use to evaluate its accuracy and measure its progress?
  • What's your plan for developing an algorithm that can pinpoint bad sellers on {company} Marketplace? How do you plan to evaluate its effectiveness and keep track of its performance over time?
  • Can you outline your strategy for detecting and removing bad actors on {company}'s Marketplace? How will you assess the accuracy and progress of your model?
  • What steps would you take to create a reliable model for detecting bad sellers on the {company} marketplace? How do you plan to track its performance and determine its effectiveness?
  • How would you go about building an algorithm that can detect fraudulent sellers on {company} Marketplace? How do you plan to evaluate its accuracy and measure its progress over time?
  • Can you explain your plan for identifying bad actors on the {company} marketplace? How will you measure the accuracy of your model and track its progress?
  • What's your approach for developing a model that can filter out bad sellers on {company} Marketplace? How will you assess its effectiveness, and what methods will you use to monitor its progress?
  • Can you explain your approach for identifying bad sellers on the {company} marketplace? How will you measure the accuracy of your model and track its progress?
  • Create a model to find bad sellers on the Facebook marketplace. How would you assess if your model is working? How would you track progress and success?
Try Our AI Interviewer

Prepare for success with realistic, role-specific interview simulations.

Try AI Interview Now

Interview question asked to Data Scientists interviewing at Meta, Coupang, Fiverr and others: Create a model to find bad sellers on the Facebook marketplace. How would you assess if your model is working? How would you track progress and success?.