Boyfriend calls me ditzy

I have adhd and Me and my boyfriend have been having issues, his anger has been one of them. We are at breaking point, because of this I’m considering having to break it off. Today we talked about why he gets angry. And I brung up him thinking I was dumb. I said do you really? He couldn’t even answer the question, he hesitated. He said “I’m trying to make it sound nice, but you are really ditzy most the time, your brain is thinks differently, it’s wired differently, your special” then he said but your my special girl which idk how to feel. He also told his friend I’m ditzy and that it’s the cause of him getting annoyed. He’s told me I need to think more in arguments and it genuinely frustrates him. He’s said it to me multiple times that I need to think more.