Build a system for large-scale web crawling.

Interview question asked to Machine Learning Engineers, Engineering Managers, Technical Program Managers and other roles interviewing at Instamojo, trivago, GlobalBees and others: Build a system for large-scale web crawling..