How do I get units to actually path around each other?

My units move in rectangle formations to each other, head on. Good vs bad, RTS style. When they finally meet, the units in the back row kind of slide around the edges of their friendly units and eventually hit enemies while facing their target enemy the whole time. This is with RVO controller on.

How do I actually make them path around their friendly units and not look at the unit? I think part of the issue is that all of the seekers are drawing one single line and they try to slide around their friendlies to that way point. I need them to seek around each other instead.