Get the child a passport as soon as you can. They won't need a visa until or if they enter Thailand after leaving for the first time. As others have said, they can enter as visa exempt and then overstay as there is no fine or ban for kids overstaying. However they do get an overstay stamp in their passport.