Hi
Try out the 4.3.9 beta. In the beta local avoidance uses burst so all the data exists in native arrays. The lightweight rvo script now uses burst as well.
See https://www.arongranberg.com/astar/documentation/dev_4_3_9_08deafd2/simulatorburst.html#simulationData
and https://www.arongranberg.com/astar/documentation/dev_4_3_9_08deafd2/rvosimulator.html#GetSimulator
var sim = RVOSimulator.active.GetSimulator() as SimulatorBurst;
sim.currentSimulationData.position[0] = new float3(0,0,0);
One issue might be that currently the order of the data might change if agents are removed.
You can experiment with it and let me know what you would need in order to achieve your use case.