To delete a folder, just click on the checkbox beside it and then on the Delete button. When deleting a folder, all content within it will be removed as well.
While folders are great for organizing your material, you may need to delete some eventually. This article covers how to remove them.