When using gizmos as documented (MonoBehaviourGizmos, override DrawGizmos), they only draw (in the scene view) while in play mode. Tested in 2020.1.3f1, URP
Edit: Upon further inspection, this seems to only happen to me on my ancient macbook pro, but not Windows 10.