I get exactly the same type/pattern of interference show up on the TinySA/PC software when I have the TinySA's own little aerial on the unit and the unit plugged into the PC with comms running - it picks up the USB noise from the USB lead it would seem (Erik pointed me to this being the problem when I first noticed it).
I think a good quality fully screened USB lead from TinySA to PC might help (not tried it yet). I do know that moving the antenna away from the TinySA and USB lead fixes the problem for me.