I was able to figure this out today, but it sure wasn't fun to deal with
This is something that should probably get fixed, as if you don't know it's happening then it can be harder to figure out. The only reason I figured out how to fix it was searching and finding the same problem in the Discord server.
Luckily I found something from danwillm that said to delete the vrsettings (C:\Program Files (x86)\Steam\config\steamvr.vrsettings) and so I did then validated the files, and now it seems to be working, and if I was to disable the left hand again, it stops working.