Passion or no passion, people get paid for translating their ideas and abilities into services or goods that others value enough to pay for.
This process of other people paying you as a reward for creating value has nothing to do with how good or bad you feel about your work (unless those feelings affect your quality of service). If you’re not particularly passionate about what you do, people will still pay you if you solve their problems. If you love what you do, people will be unmotivated to pay you if they don’t see obvious connections between what you do and what they want. Following your passion only has economic value if it motivates you to think about your passion in terms of serving others.
If by “follow your passion,” all you mean is “make time for the things you love,” then go for it. We all need hobbies, recreational activities, and other affinities.
But if by “follow your passion,” you mean “make a successful career out of doing something you really enjoy,” then you should probably keep the following in mind:
If you want to make money doing what you love, be prepared to spend a lot of time thinking about what other people love.
Following your passion wont get you paid unless by “follow” you mean “work very hard at developing unique and useful skills that will allow you to create economic value for other people who are interested in similar things.”
No one is interested in giving you their hard-earned money just because you’re having lots of fun. But if you insist on whistling while you work, people will be more than happy to let you as long as you’re equally insistent on creating value for them.