I was never really happy with the way WooCommerce shows both categories and products in the same list. Therefor I created a little plugin to split the two lists. It’s important that you DON’T ask WooCommerce to “Show categories and products” in the Customizing Tab. Set it to the default “Show products” and the separate listing for categories will automatically be added.
The frontend is by default in English, but is also available in German, Spanish, Danish and Russian. POT included for easy translation with Poedit, WPML or Polylang.