This is intentional and expected behavior. Email data will be moved to the Deleted Items when purged from a folder, but folders will not.

why this behavior?

Wouldn't it have been better to have the user ask what they want to do?

Already there is an alert, you could ask the user if he wants to permanently delete the folder or move it to the deleted items

I post a proposal

This has always felt like a bug or design fault