Improve speed for "exclude duplicates" on import

Improve duplicate detection algorithm. Lightroom CC is almost instant for large imports. Capture One takes 1-2s per image which is generally unusable.