Remote switch - SureFire X300 Handgun Weaponlight Remote Tailcap Switch

I purchased this back in December 2023 for my Sig Sauer p320 that I use for work. I run a Safariland 6360-7502 holster and have no issues with running the Surefire X300.

Overall, installation was quick and easy. The switch works as advertised, so no problem there. The issue that I ran into is that it is extremely difficult to remove the gun out of the holster due to the being no gap between the switch and the holster. So what happens when I go to draw the gun, is that the rubber on the switch rubs against the holster which binds up the gun.
I like the idea, but I'll be using this on one of my range/home guns. Not for work.