There is a subtle pleasure in worrying. Surely you are stealing time away from work so that you can indulge in worries and anxieties and fancies of all kinds.
The opposite of this self-centered worry is immersion in action. Immerse yourself in the right action, and then where is the space and the time to worry?