It’d be really nice if the Joy-Con had a hold switch like most portable music players.  I disconnect mine from the system when traveling and don’t think I’ve ever opened my bag and not seen them flashing.  I could see it significantly improving the controllers’ lifespan.

There is no secret. If you really want to complete The Witcher, you’ll do it. My guess is that it hasn’t “grabbed” you, and that’s okay.