How do I hold the contractor accountable for repairs to damage they caused if I can’t withhold progress payments?

The contract states “Such alleged damage will not allow customer to delete, delay, or alter payment schedule of the contract.” There is only a small amount due and I’m concerned the contractor will deny responsibility of the damage.