I had to re-import my MP3s to recreate my library in iTunes. Unfortunately, I imported my iTunes Music directory with the "copy to libary" option set. Removing them was simple. Just do a search for file names ending with 1.mp3. iTunes just appends a space and a number before the file extension.
This doesn't really find duplicate files in your library if they came from different sources. Sorry if the title mislead you.