Hi Alex,
I use soap at the car wash but I think it’s the hot water that does the trick. Just be careful not to crease the belts. I hang them on the floor mat clips and do it in thirds so not to crease them.
If you remember I have my belts on rounded hangers in the shop. I let them dry on that. Also hang new belts on those for a day before putting them in the machine.