The first thing to get ahead is to make sure that your facing leaves as smooth a surface with the smallest "bump".
Next, have the right sizes of center drill.? For the tiny holes being mentioned, you need center drills from 0000 to 00.
In the US, Shars Tool sells these, $8 - 9 each.