I have a folder that contains some sort of loop and then itself and then itself, etc. They seem to be empty folders but I can't delete them in windows (it counts the folders in to the millions). Any tips on how to get rid of it?

Use midnight commander from the command line.  When you look at the folder name via MC, you'll probably notice that there's some foreign characters in the name which is messing windows up.