no you don't have to, nor should you, spend 3 days anywhere if you cross a land border. Plenty of people cross the border and walk straight back again every single day. The Poipet border is the border where you're most likely to have issues doing that but even then you don't need to, nor should you, spend 3 day there before returning to Thailand.