How to find duplicate video files

Duplicate video files (exact copies of a file stored in different folders ) not only occupy unnecessary disk space, but also makes it harder to have an organized video collection.

Additionally if you add meta data to only one copy of the video, that data is not shared with the other duplicate files.

Fast Video Cataloger has a quick and easy tool to help you find duplicate videos, wherever they lie in your catalog.

When you have a large video collection it is pretty likely you eventually will end up with multiple copies of the same video stored in different folders or on different disks.

How do you end up with duplicate video files?

There are many ways this can happen. Perhaps you downloaded the same file twice, moved video files from a digital camera more than once (just to be sure… we’ve all done it!), renamed a video file and then didn’t know you already had a file and so on.

How to find and clean duplicate video files

From Fast video cataloger ( https://videocataloger.com/download/ ) select File then Repair. The Repair window will open, click on the “Check duplicate” tab to get to the find duplicate videos tool.

Selecting the repair tool

Selecting the repair tool

The Find duplicate video tool in fast video cataloger works on all videos you have in a catalog so there will be no need to pick the folders to search for, the program already knows where all videos are stored.

Selecting the find duplicate video tab

Selecting the find duplicate video tab

From the find duplicate window tab, click the Start button to start scanning your entire video catalog for duplicate video files. The time this takes depemds on how many videos you have in your catalog and how many of them are duplicate.

How Fast video cataloger finds duplicate files

When Fast video cataloger tries to find duplicate video files it first check the length of the video, as this will rule out most videos as duplicates. It then checks the size of the video files in bytes.

Both of these operations are quite fast, but for all videos that are the same size and the same video length, the program needs to do a much more thorough check to make sure the videos are really the exact same video file only in different locations.

Scanning for duplicate video files

Scanning for duplicate video files

To do this check it calculates a 256 bit checksum based on the whole video file. To calculate this checksum, the program needs to read every single byte of the video file, and that can take some time for large video files. The checksum is then stored in your catalog, so each file will only need to have the checksum calculated one. This also means that you can close the program and it will resume the next time where it left off. And if you have scanned for duplicates at some time, it will be quicker carrying out the next scan after you have added more files to your catalog.

The algorithm used to calculate and to compare videos is the same used by several cryptocurrencies like Bitcoin. The risk that the program will say that two different files are the same by mistake as a result of the same checksum being generated from different video files is virtually non existing. Or to put it into context with an example:

A mass-murderer space rock happens about once every 30 million years on average. This leads to a probability of such an event occurring in the next second to about 10-15. That’s 45 orders of magnitude more probable than the collision.”

And the extra check for the size and video length reduce this risk even further.

Since the program needs access to the actual video files to be able to compare the videos, you need to make sure that external USB drivers are connected if required. If the video file is not available the program will simply ignore it, to check for missing files use the repair video tool instead.

What to do with the duplicate video files?

When the program has found the duplicate videos you get a list of the duplicates find. Click on each entry and the program will list all duplicates it found, click on the duplicate file you want to keep.

Selecting which video file to keep.

Selecting which video file to keep.

When you have gone through the list and selected the files to keep, click the Merge Videos button.

File description, ratings and obviously the path and filename will be kept for the one video file you select to keep. The keywords and actors from the other copies will be merged to the catalog entry for the one file you keep.

Duplicate videos have been merged

Duplicate videos have been merged

When the merge is complete, the duplicate files will be deleted.

The new duplicate video file finder tool makes it easier to keep your video collection ordered.

If you have not already, go to the download page and download fast video cataloger.

Fast Video Cataloger 3.5 available for download

Fast Video Cataloger 3.5 is now available for download

The 3.50 update is free for all customers and you can use your original registration information. We have lots of minor improvements and bug fixes as usual and there has been a focus on performance and workflow that should make a few common operations faster and more streamlined.

New Attract windows

In the 3.50 version we introduced three new windows in a new category that I would like to call “Attract Windows”. The purpose of the attract windows are to cycle through content automatically from your video catalog. Just like with all other windows you can decide to use these windows, just close them or use them in specific layouts. My hope is that the attract window is a new inspiring way to enjoy your video catalog, perhaps to get inspiration.

  • The Actor attract window cycles through actors one by one.
  • The Cover attract window cycles though covers and/or companion images one by one
  • The Attract Video Wall is a new video wall window that plays a video wall for a few seconds ( that you set from preferences) and then switches the videos to a new set of random videos.

For each attract window you can right click to get options to go to editable versions of the content.

New find duplicate videos tools

A new tool to find duplicate video files was introduced. This tools makes it effortless to clean out duplicate videos from your catalog and optionally delete them and save some space on your disks. You can find the tool as a tab in the Repair windows.

Other bug fixes

You can now set volume even if a video is not playing. Also, the scale of the volume control is now much better and the whole slider is used.

General performance improvements. This one is hard to prove and explain but you will find that some operations, for example keywording, is much faster.

Fixed a bunch of issues with disappearing windows that required layout reset to reappear.

Other general improvements

Star rating in the video detail list instead of a drop down list, save a click every time you rate a video.

The About box now show video catalog statistics.

Video file size and date modified in the add video dialog and detail list. This is good if you only want to add large files to a catalog if you have an sd and an hd version of a file, or if you only want to add the last touched file.

Added a Right click option to sync file organizer to video. This is good to have if you don’t have the automatic sync turned on. The automatic sync can cause performance issues if you have videos on powered down disk drives.

Right click option to remove a video file from disk and from catalog. You could do this before from the file organizer but since this is a pretty common thing to do when cleaning up a catalog, we added a menu option for it.

Option to show/hide horizontal video details horizontal scrollbar. With more columns a scrollbar is good to have but it does take screenspace. This might sound like a small thing and it is, but I have had emails from users that wants it there and users that hate that it is there. So now everyone can set it up as they like it.

Copy from actors, just right click the actor portrait to copy it into the clipboard. Might be useful if you edit portrait in Photoshop or another image editing program.

Support to enter multiple keywords at once with , separation.

Added message when you switch between layouts to make it more clear that you did switch to a new layout. Remember that you can set name to the layouts as well from the preferences.

And much more…  Download and test from http://videocataloger.com/download/