Was having a similar issue. Now I dont know exactly which of the following did something, which didn't or if they all did something but this is what I did to fix my issues (and mine was actual gyno induced from a 5 week anadrol cycle lmao)

Raloxifene 60mg ED for 4 weeks
Aromasin 25mg split 12 hours apart ED for 2 weeks, then 12.5mg ED for 2 weeks
Caber 0.25mg E3D for 4 weeks
Zinc Picolinate 150mg split 3 x a day (still doing this)
P-5-P 150mg split 3 x a day (still doing this)
Calcium D-Glucarate 1500mg split 3 x a day (still doing this)
Also stopped pinching and feeling my nipples which caused extra irritation and sensitivity
Didn't have any dairy products whatsoever, diet was extremely clean, also cutting and lots of cardio

Nipples look perfectly normal, and keep in mind I did this while being on 300mg Test P and 450 Tren A EW