Yes, but your physical money turns into electronic money until the time you request it back as cash-out, by which time it turns back into physical money.
Please be aware that in more than 99.9999999999999999% of cases you don't get back the exactly same coins and bills that you deposited.
**********
*****
*****
*****
9% of cases you don't get back the exactly same coins and bills that you deposited.
For your physical cash to stay physical and identical at all times you can use a piggy bank.