If a contractor buys materials but you don’t want him to do the job can they sue

Anyone can sue anyone. The issue is whether a lawsuit would succeed. This depends on:

1) The terms of the written contract, if there is one; or,

2) If there is no written contract, whether the contractor reasonably relied on your verbal agreement, and purchased materials, and they cannot be returned without economic loss.