I also use the colour coded signals & have not really noticed much of a performance hit. I have had instances where connected signals still stay highlighted in colour. Usually simply selecting the signal is enough to correct it. Re-opening the file also clears down the colours. Like you Lincoln never annoying enough to pursue any further.
-s