Walk me through the root cause analysis for an SRM of 52/48 in an experiment. Under what conditions would you still accept the 3% retention improvement?

1 answer published. Last candidate submission on Jul 30 2026, 4:56pm PDT. Interview question asked to Data Scientists interviewing at MongoDB, Razorpay, Digit and other companies. Original question asked: Walk me through the root cause analysis for an SRM of 52/48 in an experiment. Under what conditions would you still accept the 3% retention improvement?. Question last reported by a candidate interviewing at Discord for a Data Scientist interview on Jun 6 2026, 2:24pm PDT.