AITA for using the women's bathroom

​ So for context, I'm a 20 year old transgender man in Canada and I've been on hormone treatment for 2 years. I often have a facial hair, deep voice all that, and look like a guy aside from my short height. After a year of hormone treatment my mom told me I shouldn't be using the women's bathroom because I'll scare little girls and make women uncomfortable. I kinda just brushed this off and told her I dont feel I pass well enough to go in the men's bathroom and I can't use a urinal so I'm not going in there. Last weekend I was out all day with my boyfriend and had to use the Walmart bathroom, when I came out, he asked me why I always go in the women's bathroom and said it was weird. I told him what I told my mom and he asked me what the point of even transitioning is if I'm just gonna out myself like that and keep using women's spaces. I just changed the subject and ignored it once again. I do this at work as well but I try to be really secretive about it and go when no one's in there but I've been caught a few times and just awkwardly ran out when female co workers saw me. Honestly, I just dont think I look like a guy because I'm 5'2. I never get misgendered by people but I feel like they can tell I'm trans and are just trying to be nice. I know it would be illegal for me to use the men's bathroom in America but I'm Canadian. I think I may be a little selfish for only considering my own comfort when going in the women's bathroom. I'm just too scared to use the men's and I don't know if I ever will, but what do you guys think? AITA?