I? have had a lot of experience testing coin cells, and I don't think the open-circuit voltage is deceptive.? It is higher than the voltage under load, of course, but if it's reading 3.2 V open circuit, the coin cell is good and the problem lies elsewhere. You could substitute another one just in case -- easier than getting a new tester.
