Congratulations! 600mV is the threshold to trigger the VOX. However, about 50mV is the point to overdrive NE602 per KD1JV. That's why I recommend a modification to improve IMD. Rule of thumb for acceptable IMD: Decrease the audio input until you find the RF output becomes about half.
Thanks,
Adam