Image sequence - remove duplicate frames

6 replies [Last post]
Rob James
Offline
Joined: Jun 26 2001

Does anybody know a way of removing duplicate frames from an image sequence and renumbering it subsequently?

I have several huge image sequences (png or TGA or TIFF to taste) with duplicate frames spread throughout. I need to remove the dupes and renumber so that I can import them into an editor for further editing. I could do this manually, but life is too short to go through several sequences of 4k frames.

Rob The picture is only there to keep the sound in sync

David J
Offline
Joined: Nov 23 2000

There are several good file renamers around. None I have found is truly intuitive, but TheRename seems to work pretty well for me.

On the other hand, maybe the native Windows XP facility will suffice? See http://graphicssoft.about.com/cs/renamers/ht/renamexp.htm

Rob James
Offline
Joined: Jun 26 2001

Thanks David, the XP method will do fine. To be honest the renaming is the relatively easy bit, extracting the dupe frames is the challenge. I cannot use file size since they are all very similar and there is a danger of removing wanted frames. I need something that actually looks at the content to determine if two files are the same.

Rob The picture is only there to keep the sound in sync

David J
Offline
Joined: Nov 23 2000

I don't know of any automatic duplicate frame detectors, but file sizes might be a clue if the images are compressed (eg JPG).

Depending on where they came from, EXIF date//time might be another giveaway. If this applies, a renamer (eg TheRename) that allows you to set the file time/date to match the EXIF data might be helpful.

Otherwise, if you show the sequence as a slide show in a suitable application (Irfan view, for example) you should be able visually to see which images are the same as the previous one as you step through.

Rob James
Offline
Joined: Jun 26 2001

Hi David, I found an AE script which sort of does the job, however, I think it is based on file size and it lost half the wanted material. I gave in and removed the dupes manually in the NLE. Only took about five hours :(

Rob The picture is only there to keep the sound in sync

johnd
Offline
Joined: Mar 8 2009

Resurecting and old thread here. Like rob I'm looking out for software that is able to automatically detect and remove duplicate frames.
I am using avisynth scripts to enhance cine film I have transfered but these scripts only work where there are no duplicate frames.
I have been removing these manually but it is labourious. There seems to be some scripts to remove every third frame (which is roughly what I am trying to do) but these are automatic and will often remove a non duplicated frame.

Rob James
Offline
Joined: Jun 26 2001

Never did find an answer other than removing the offending frames manually. Would love to hear if the intervening time has produced a suitable tool.

Rob The picture is only there to keep the sound in sync