[Acne] bumps after moisturizing

​ (28 M) I noticed that after I got into moisturizing my skin I started getting bumps like infected hair follicles. I mostly get them on my legs but I have one on my arm now. Just curious if this is a common occurrence. I use cerave intense moisturizing cream and then layer with baby oil.