Midtown vs Downtown Living

I’ll be moving to Toronto (30s M) and undecided between living in the core (I’m thinking Roncesvalles/Annex) and Midtown (Yonge-Eng).

I do like Midtown as you have most of what you need in one spot - but I do enjoy downtown activities a lot (be it events, bars, live concerts, social events) - that’s why I also like downtown west - so I’m not in a longer commute to activities I want to go to.

I want the ease and of everything being in one place in downtown - does an area like that exist?

What are people’s thoughts of downtown west vs midtown living.