Update:
I searched around and found this post: RVO and Path not working well together where it says the RVOCollider isn’t design to affect pathing. I then try to use the DynamicGridObstacle, but it doesn’t seem to work with a CapsuleCollider (it is not a simple Bound). I am going to try out just using a box collider and see what the quality of the pathfinding would be.