Just wondering, are you using 'bookworm' OS on the Pi? Last info I read on 'bookworm' was that it had problems. Just for S&G maybe try the previous version of OS, and I can't remember offhand what it is called. I would try another SD card and a new install with the older OS. The SD because if it does not work, then you can unplug the test and re-install what you have now, without starting over. I seem to remember reading something about the OS turning things off and there was a way to disable that function. It seems to me it was wifi that got turned off but maybe it also has something to do with other connected devices. It truly seems counterproductive to have some application built into the OS that disables devices.
[Edited Message Follows]
It turned out to be just luck, and after a few hours of operation the mouse was lost again.
So further testing got more confusing. I left direwolf running for several hours without issue using the cm108. However, once I opened up flrig and fldigi on the same pi5, the mouse gets lost very quickly. I also observed the default audio out volume control works as expected before running direwolf. This default audio is my 7300, which works fine with fldigi etc. I leave it set to 100% and attenuate tx audio in fldigi/wsjtx etc. If I start fldigi first, then open direwolf, the tx audio for fldigi stops working correctly, and the default audio slider drops to zero. If I try to raise the slider, as soon as I let go it rapidly drops back to zero (weird!). Sometimes I can't even get to the slider before the mouse is lost. I'm starting to lose hope for this pi5 working out the way I wanted (a pi to do handle all of my ham stuff at home). Based on my latest observations, it seems I could setup a second pi to do just direwolf/xastir and be fine. Hoping I can figure this out. Still monitoring if anyone has other things to try.
