I had exactly the same issue after I installed my lift (OME springs + Bilsteins + clevis) but it was just on the passenger side. I suspect the stock upper control arm was hitting the spring but I could never see any evidence of contact?? Anyway, I installed some RRO upper control arms a couple of weeks ago which solved the problem and the ride seems more refined - a very worthwhile upgrade IMHO. Also, I don't cringe every time I look at the angle of the balljoints any more
My only concern is that I'm now just outside of the alignment specs for camber and caster. Camber is maxed as negative as possible at about +3/8 degree. It feels fine but I'd prefer if it were 0 degrees (as the springs sag over time I'm hoping it will get there). I don't know if the JBA UCAs would allow for in-spec alignment or not. The only reason I went with RRO was because of the non-proprietary ball joints (Moog) and bushings (Mopar). Anyway, those are your options so I'd recommend you do your research and pull the trigger on one of those - it'll hurt a little but best $400 you'll ever spend.