Oh yeah. I knew I was forgetting something as I was writing down. Yes, you do need to provide the contract with your client(s).
Also, the tax document is sometimes requested. I heard from other freelancers. So I would just provide that upfront so they don't ask for more info. I would put in the customer invoice/statements as more secure proof.