If I record a payment, will the client receive a copy of the receipt?

If you are Capturing a Payment, yes, the client will receive an email notification with a link to print the receipt.

If you are Recording an Offline Payment, no, the client will not receive a notification.