I've done similar things in the past, some even work with a Nano VNA, within reason...
The secret I found in the immdiate past work life, is to "Calibrate" / "Normalise" with the test cables first (especially the one from the Source Port.)? Before investigating odd DUT's, to get a representive reading.