How would you architect a real-time, low-latency anomaly detection system to monitor millions of incoming API calls in a production environment?

Interview question asked to Data Scientists interviewing at Viber, Deloitte, TripAdvisor and other companies. Original question asked: How would you architect a real-time, low-latency anomaly detection system to monitor millions of incoming API calls in a production environment?.