In my day, having children and following a career in Intervention were really discouraged.
I do believe that if you are passionate about your sub-specialty then you will overcome all odds.
Medical training itself is hard and a strong support network both inside and outside of work is incredibly important.