​Any one else scared of taking credit card payments because the customer can dispute it??

I run a service based business. We work on houses, and provide repairs. I’m always paranoid about accepting credit cards because I’ve heard stories of dead beat clients disputing the charges with their cc company and getting the charge reversed. Is this a reasonable fear??