How do Gradient Descent algorithms relate to deep learning models, and in what ways do they aid in model training?

Interview question asked to Machine Learning Engineers interviewing at Palantir Technologies, Nubank, IBM and others: How do Gradient Descent algorithms relate to deep learning models, and in what ways do they aid in model training?.