My 3GS had this problem. I think it was a common fault. My 4G is very stiff however. Perhaps there is a fault with yours?
Do you have a case? I as because looking at the case I have, due to the thickness of it the mute switch is sunk in slightly instead of being slightly sticking out. Perhaps getting a similar case would solve your problem...?