Use Remove Duplicates to remove all duplicate colors from the color map and make every color unique.
Colors > Remove Duplicates