Ok, so it turned out that using NTP to reset the clock on the Raspberry Pi was not one of my greatest ideas for this project.
NTP is for real computing, where high accuracy is required and small errors need to be slowly tuned out.
My requirements for this bird box project are for a step-change correction each time the system boots up, which may be several times per day. Accuracy is just not important.