Some countries allow you to have two passports. Many do not. In the US, you must submit your old passport to receive a new one then both are returned with the old one inactivated.
Your old passport will be returned along with the new one. Usually the old one will have the sides clipped or a hold punched through it to deactivate it. Immigration can transfer the visa to the new passport