StatisticalMetrics and Experimentation

You want to test a change that alters comment sorting in a subreddit, but users participate in multiple subreddits and may share posts across them. How do you choose the unit of randomization and analysis to handle interference on the social graph?

Also asked as "Walk me through your approach to switchback testing versus cluster randomization when evaluating a new comment ranking algorithm."

Was asked at

Practice this question with AI

First session is free - no credit card required.

Go Premium

More interviews, more skills, more success.

Practice More Questions

Interview question asked to Data Scientists interviewing at ClassPass, Shopify, Envoy and other companies. Original question asked: You want to test a change that alters comment sorting in a subreddit, but users participate in multiple subreddits and may share posts across them. How do you choose the unit of randomization and analysis to handle interference on the social graph?.