Even using waypoints there is usually a little drift. If it's a particularly long leg, I've ended up around 3km off course by the middle of the leg. But you always reach the exact spot of the waypoint in the end, even if you take a
very slightly curved route to it.
I actually like that it's not 100% accurate and that I don't travel in a dead straight line for hundreds of kilometres.