One spends eight, ten, twelve hours of the day working; add to that the time that you invest in commuting and thinking about work. What does all that do to you? Consider that.
If money helps you get a suitable environment for yourself, only then money has some practical value; otherwise money is just a number. It’s a psychological device man uses to fool himself.
You don’t have to choose between your job and entrepreneurship. Choose between the true and the false. Choose between peace and restlessness. Let that be the deciding factor.