Analytics Case

What would be your course of action if observe the number of notifications sent has dropped by 15%

Data Scientist

Square

Meta

Asana

Headspace

CrowdStrike

Course Hero

Did you come across this question in an interview?

Loading step...

Answers

Anonymous

4Strong
Clarify
  • All notifications from Facebook or related to specific feature or product?
  • Notifications sent via app or sent via email have reduced?
  • What time frame was the 15% drop for?
  • Are there any other metrics with unexpected drops?
  • Why is it important?
Let us say email notifications from FB to users about all FB products & features have reduced over a month by 15%. Notifications are important because they cause people to log in more frequently.
Question - Has there been a change in the algorithm used to generate notifications?
Let us assume no, there has not been.
Validation -
I would firstly trend total notifications, DAU, Total daily number of users to whom  notifications are sent for the past 3 months. I would check if I see the decline mentioned and if I understand the metric definition correctly.
Let us assume that I do see a 15% decline in total notifications sent. the decline is not sudden but gradual. This indicates it is less likely to be a bug or data drop.
I'd like to investigate further by slicing the total Notifications trend created above by country, users with less than 50 friends, 50-200, 200+ and check if some group behaves abnormal.
Hypothesis -
Let us consider why the decline could be? Notifications come from activity of other users or groups in a users network. Maybe the overall content creation has gone down, there by feeding the notification algorithm less input.
Am I thinking about this the right way?
Adding to the above trends I started exploring, I'd like to trend total number of posts generated over the same time period of 3 months.
Another segment to consider is the number of notifications broken out by origination - were they notifications about friend's activity, posts on groups, marketplace activity, reels, friend requests, videos.
Looking at all these trends, I might get a pointer on what is going on.
Say, I see notifications have dipped in the US but steady in other major geos. I may also see a dip in marketplace notifications.
When I filter all above created visuals to just US, I may see that marketplace notifications were the ones that were the contributor.
At this point, I would talk to engineering & PMs to check if they know of anything going on with marketplace. Maybe there is a new feature being tested or launched which is interfering with triggering notifications from there.

Anonymous

3.6Strong
I will take the input form customers and ask them if they would like to opt for 1)No notifications 2) Archived notifications (once per day or per week or per month) - This should help me reducing some traffic to notifications as people generally find too fine granular notifications intruding and its fair to expect that atleast 20-30% customers might opt out of it.
  • What would be your course of action if observe the number of notifications sent has dropped by 15%
  • What steps would you take if you noticed a drop of 15% in the number of notifications being sent?
  • Can you explain what you would do if there was a decrease of 15% in the number of notifications being sent?
  • If you witnessed a 15% reduction in the number of notifications sent, what course of action would you take?
  • What would be your response if you saw a 15% decline in the number of notifications being sent?
  • How would you address a 15% decrease in the amount of notifications being sent?
  • Given that the amount of notifications being sent has decreased by 15%, what would you do?
  • What plans do you have in store for a 15% drop in the number of notifications sent?
  • In the event of a 15% decrease in the number of notifications being sent, what would be your plan of action?
  • How would you handle a 15% reduction in the amount of notifications being sent?
  • Please describe how you would handle a 15% decrease in the number of notifications being sent?
Try Our AI Interviewer

Prepare for success with realistic, role-specific interview simulations.

Try AI Interview Now

Interview question asked to Data Scientists interviewing at Swiggy, Expedia, Headspace and others: What would be your course of action if observe the number of notifications sent has dropped by 15%.