Explain what is meant by the terms "parametric" and "non-parametric" in statistics, and describe the key differences between these two approaches?

Interview question asked to Data Scientists interviewing at Venmo, Novartis, Rackspace and others: Explain what is meant by the terms "parametric" and "non-parametric" in statistics, and describe the key differences between these two approaches?.