Tin Eye for your hard drive. Sort of...

footfootfoot · 01-17-2011, 08:44 PM

I'm trying out this new duplicate image finder software that appears to work like TinEye-- it looks at the pixels rather than file name or hash. It is scanning my drive now. It's been about an hour and it has scanned 14,000 out of 24,000 images and found 3700 similars. I am guessing it doesn't "see" RAW files, but it does "see" DNG so there's a case for DNG conversion as a matter of course in asset management.

I'll report back when the thing is done and let you know how well it works and how useful it is. Having something like this working with picasa or lightroom would be hella awesome.

awesome duplicate photo finder

footfootfoot · 01-17-2011, 09:48 PM

OK
notes so far:
Took 1:45 to scan 24,354 jpgs and bmp. didn't scan gif, raw or psd files. It found 5626 duplicates and rated their similarity from 1% to 100% Pretty good, but gave 14% accuracy to the same image where one version was full sized and the other was 750x500. Conversely it gave 100% accuracy to two adjacent frames where the images were clearly different. So it seems to weight size more heavily than image information.

There is a confirm delete button and an acknowledgement of delete button and no provision for multiple selections so numerous deleting is a chore.

It only compares two images at a time, not sure what happens when you have five versions of the same image.
You can't save a search, so the next time I do this I have to allow for nearly two hours to scan my drive.

xoxoxoBruce · 01-18-2011, 01:52 PM

Sounds a little cumbersome for 24k images, but might be ok for a couple k.

Flint · 01-18-2011, 10:50 PM

You gonna organize your files better from now on?

footfootfoot · 01-19-2011, 08:34 AM

I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.
I promise I will name all my files and put them in the proper folder.

Pete Zicato · 01-19-2011, 09:14 AM

I can tell you from experience that filing only helps. It does not eliminate the problem.

The major issue is the fallacy of categorization. There isn't anything that fits in only one category.

Shawnee123 · 01-19-2011, 09:26 AM

Tin Eye? Tin Eye?

Braceface!

Clodfobble · 01-19-2011, 01:10 PM

Quote:

Originally Posted by Pete Zicato

The major issue is the fallacy of categorization. There isn't anything that fits in only one category.

Y'all are weird. I organize by the date the photo was taken, which is part of the filename. Each month gets a folder, and that folder is named by a descriptive list of what's inside, like "01-2011 - Snowballs, Grandma's house, D's Birthday, Birds."

glatt · 01-19-2011, 01:15 PM

Date is easiest by far. It's how we live our lives. We steadily march through time. Organizing your pictures this way tells a story.

Pete Zicato · 01-19-2011, 02:54 PM

Quote:

Originally Posted by Clodfobble

Y'all are weird. I organize by the date the photo was taken, which is part of the filename. Each month gets a folder, and that folder is named by a descriptive list of what's inside, like "01-2011 - Snowballs, Grandma's house, D's Birthday, Birds."

Right. That works. Until you have a photo of a snowball fight at Grandma's House on D's Birthday. And there were birds in the background. Now what?

I realize that this is an uncommon occurrence. But it is well to remember that the uncommon does occur from time to time.

Shawnee123 · 01-19-2011, 03:06 PM

Were the birds falling to the ground, dead?

xoxoxoBruce · 01-19-2011, 03:13 PM

Quote:

Originally Posted by Clodfobble

Y'all are weird. I organize by the date the photo was taken, which is part of the filename. Each month gets a folder, and that folder is named by a descriptive list of what's inside, like "01-2011 - Snowballs, Grandma's house, D's Birthday, Birds."

Quote:

Originally Posted by glatt

Date is easiest by far. It's how we live our lives. We steadily march through time. Organizing your pictures this way tells a story.

You're dealing with family snapshots, 3foot is a photographer. He's got all sorts of photos taken by him, and others, for reference, fun, and occasional profit. That's why he's dealing with 24k+.

Clodfobble · 01-19-2011, 05:16 PM

Quote:

Originally Posted by Pete Zicato

Until you have a photo of a snowball fight at Grandma's House on D's Birthday. And there were birds in the background. Now what?

Nothing changes. It still goes in the January of 2011 folder, and it's extra easy because the name of the folder doesn't even need anything appended to it.

Perry Winkle · 01-20-2011, 10:17 AM

My wife uses Lightroom (I think) to organize her photos. It lets her tag (like a category/folder but many-to-many) and create sets of photos.

She's using it to put together a photo album DVD of our wedding pictures. It looks pretty slick to me.

Pete Zicato · 01-20-2011, 10:17 AM

Quote:

Originally Posted by Clodfobble

Nothing changes. It still goes in the January of 2011 folder, and it's extra easy because the name of the folder doesn't even need anything appended to it.

I see. I read it too quick and thought you had subfolders.

Still falls into the fallacy of categorization, though. That's how I have ours set up as well, 'cause I think that's about the best you can do in practical terms. But when I went to make a slideshow of Zing1 for her graduation, I had to go through all the folders looking for pictures of her.

01-17-2011, 08:44 PM	#1
footfootfoot To shreds, you say? Join Date: Aug 2004 Location: in the house and on the street-how many, many feet we meet! Posts: 18,449	Tin Eye for your hard drive. Sort of... I'm trying out this new duplicate image finder software that appears to work like TinEye-- it looks at the pixels rather than file name or hash. It is scanning my drive now. It's been about an hour and it has scanned 14,000 out of 24,000 images and found 3700 similars. I am guessing it doesn't "see" RAW files, but it does "see" DNG so there's a case for DNG conversion as a matter of course in asset management. I'll report back when the thing is done and let you know how well it works and how useful it is. Having something like this working with picasa or lightroom would be hella awesome. awesome duplicate photo finder __________________ The internet is a hateful stew of vomit you can never take completely seriously. - Her Fobs

01-17-2011, 09:48 PM	#2
footfootfoot To shreds, you say? Join Date: Aug 2004 Location: in the house and on the street-how many, many feet we meet! Posts: 18,449	OK notes so far: Took 1:45 to scan 24,354 jpgs and bmp. didn't scan gif, raw or psd files. It found 5626 duplicates and rated their similarity from 1% to 100% Pretty good, but gave 14% accuracy to the same image where one version was full sized and the other was 750x500. Conversely it gave 100% accuracy to two adjacent frames where the images were clearly different. So it seems to weight size more heavily than image information. There is a confirm delete button and an acknowledgement of delete button and no provision for multiple selections so numerous deleting is a chore. It only compares two images at a time, not sure what happens when you have five versions of the same image. You can't save a search, so the next time I do this I have to allow for nearly two hours to scan my drive. __________________ The internet is a hateful stew of vomit you can never take completely seriously. - Her Fobs

01-18-2011, 01:52 PM	#3
xoxoxoBruce The future is unwritten Join Date: Oct 2002 Posts: 71,105	Sounds a little cumbersome for 24k images, but might be ok for a couple k. __________________ The descent of man ~ Nixon, Friedman, Reagan, Trump.

01-18-2011, 10:50 PM	#4
Flint Snowflake Join Date: Mar 2006 Location: Dystopia Posts: 13,136	You gonna organize your files better from now on? __________________ **************** There's a level of facility that everyone needs to accomplish, and from there it's a matter of deciding for yourself how important ultra-facility is to your expression. ... I found, like Joseph Campbell said, if you just follow whatever gives you a little joy or excitement or awe, then you're on the right track. . . . . . . . . . . . . . . . . . . . . . . . . . . Terry Bozzio**

01-19-2011, 08:34 AM	#5
footfootfoot To shreds, you say? Join Date: Aug 2004 Location: in the house and on the street-how many, many feet we meet! Posts: 18,449	I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. I promise I will name all my files and put them in the proper folder. __________________ The internet is a hateful stew of vomit you can never take completely seriously. - Her Fobs

01-19-2011, 09:14 AM	#6
Pete Zicato Turns out my CRS is a symptom of TMB. Join Date: Jan 2010 Location: Chicago suburbs Posts: 2,916	I can tell you from experience that filing only helps. It does not eliminate the problem. The major issue is the fallacy of categorization. There isn't anything that fits in only one category. __________________ Talk nerdy to me.

01-19-2011, 09:26 AM	#7
Shawnee123 Why, you're a regular Alfred E Einstein, ain't ya? Join Date: Jun 2006 Posts: 21,206	Tin Eye? Tin Eye? Braceface! __________________ A word to the wise ain't necessary - it's the stupid ones who need the advice. --Bill Cosby

01-19-2011, 01:15 PM	#9
glatt ™ Join Date: Jul 2003 Location: Arlington, VA Posts: 27,717	Date is easiest by far. It's how we live our lives. We steadily march through time. Organizing your pictures this way tells a story.

01-19-2011, 03:06 PM	#11
Shawnee123 Why, you're a regular Alfred E Einstein, ain't ya? Join Date: Jun 2006 Posts: 21,206	Were the birds falling to the ground, dead? __________________ A word to the wise ain't necessary - it's the stupid ones who need the advice. --Bill Cosby

01-20-2011, 10:17 AM	#14
Perry Winkle Esnohplad Semaj Ton Join Date: Feb 2005 Location: A little south of sanity Posts: 2,259	My wife uses Lightroom (I think) to organize her photos. It lets her tag (like a category/folder but many-to-many) and create sets of photos. She's using it to put together a photo album DVD of our wedding pictures. It looks pretty slick to me.

Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)