How about Identity theft (as recently happened with the Veterans Administration), unwanted targeted marketing, or somebody selling your name to illegal immigrants who will pose as you and use your identity to live their life and commit crimes?
You aren't worried about any of that?
Or even worse, what if somebody makes a mistake on your records. Can you imagine navigating that god-awful beauracracy and all those hoops and red-tape just to get it fixed?
Suppose somebody in the government doesn't like you? What if that someone really wanted to screw up your life? What better way to do it than by flagging your name for all sorts of fun things that you never did! Or, g-d forbid, the government uses certain criteria against you to label you a "dangerous" individual and round you up for "re-education"? It's not outside the realms of possibility.
Have I made my point yet?