Can I stay in Thailand until my non-B visa expires if my work permit expires earlier?

When your visa expires is irrelevant. You used it to get in to Thailand and as it’s a Non B single entry it is now finished.

What matters is the “allowed to stay until” stamp you got. If that’s what you are referring to when you say 4th November then that’s when you can stay until, regardless that you are no longer working.

If you had an “extension of stay” stamp that you got from a local immigration office then when the reason for the extension stops so does your ability to stay unless you switch to any other type of stamp. From what you wrote I’m guessing this isn’t the case.

Your permission to stay in Thailand is directly related to your work permit, once your work ends the reason for staying ends. Unless you are on the original 90 day non b Visa, if you have an extension you must leave or find another way to stay.

If you are still on the original visa you can stay until it expires