To delete a folder, first navigate to your folder in the Materials section.
Next, make sure that the folder is empty. If your folder has content in it, you will need to click on the material.
You can then either move the material using the dropdown, or delete the material altogether.
Once that's done, click on the name of the folder at the top of your page.
Lastly, click on the Delete button.