Has anyone here just left everything behind impulsively?

I actually have. I graduated college, and about a week later moved 400 miles away, making the decision about two hours before I'd began packing. Well, it's been a year and I just recently moved back. The experience was worth everything. I learned that nothing is worth doing if you don't truly love it. So I would say go with with you desire, because even if you make money and become someone famous or powerful at the risk of losing happiness then you really are further behind than when you began.