In Catalog -> Categories, you will see a tree list of categories if you have already defined categories. Click the category that you wish to delete. You will be shown the detail about the category and action buttons on the bottom. Click "Show Products in Category" button and will be shown a list of products in this category.