the Bangkok Bank up in Pai does it over the counter for Visa Debit no issues - all you need is a passport and to be withdrawing a minimum of 10k. The only caveat is they won't do withdrawals for foreigners in the mornings during high season. I assume it varies branch to branch.
If you take your passport to a Thai bank and are planning to withdraw over 10,000THB, they should do you a cash advance with your overseas bank card at no extra cost. Can't speak for your exchange rate or bank specific fees, personally I use a Wise card that's fee free.