Probably. But if there is a written contract, that question cannot be answered without looking closely at the terms. If you are going to cancel, the sooner the better. You want to try to cancel before the contractor goes out and starts buying supplies or passing up on other jobs because he thinks he's going to be working on your pool. If that happens, he has a stronger case that your failure to go though with the contract damaged him.