No, it isn't, as you rightfully point out. I see parallels between your approach to life and "career" and mine. I'm probably at least 20 years ahead of you on that trajectory, and I can tell you that I didn't regret a thing.

If I remember a graduation address of Steve Jobs correctly, he made this point, too. He said that in the end, you "connect the dots" and you'll see that the interests you pursued shaped nicely into a product or skill that provides the freedom you sought.