Drill press is fine, the holes don't need to be precisionly located. Using dividers is fine too. I'm not sure if your chuck is a front or rear mount (mounting screws). If front mount you could use a transfer punch. I'm assuming it's a plain back chuck that's rear mount. In that case transfer screws would be a good method. Can also make them yourself.
In this case I personally would make the backplate register a close fit, or fairly close fit, make your mounting holes, then turn down for "tap-tru".