What do you think are the most difficult part(s) of software product management

Interview question asked to Product Managers interviewing at ADP, Comscore, Sumo Logic and others: What do you think are the most difficult part(s) of software product management.