Can you explain how Support Vector Machine works?

Free for the first 3 answer contributors

Interview question asked to Machine Learning Engineers interviewing at Cruise, HubSpot, eToro and others: Can you explain how Support Vector Machine works?.