The software that came with the camera lets you browse the card when your camera is connected. You should be able to select all and delete all.
Your camera should have a delete all function in the menu.
Windows explorer should be able to browse your memory card when it is connected to your PC or when your memory card is inserted in a card reader. It functions like any other external drive then, where you can select files and delete them.