Do not try to brand or categorize actions. Look at the actor.
Saying yes might be the holiest deed ever performed; saying no might be the holiest deed ever done. Saying A can be the holiest of actions; saying A can be the vilest of deeds. Going towards the left might be the most pious activity; going towards the right might be the most pious activity. Depends on the actor. Depends on what you are doing there.
Nothing is right or wrong, holy or unholy, good or bad, virtuous or demeaning by itself. It all depends on the actor behind the action.