Find fields & stores near you!
Find fields and stores
Zipcode
PbNation News
PbNation News
Community Focus
Community Focus

Reply
 
Thread Tools
Old 08-20-2011, 10:10 PM #1
justavillain
I've got nothing
 
justavillain's Avatar
 
Join Date: May 2005
Location: Sparta, Michigan
justavillain is a Supporting Member
justavillain is one of the top 500 posters on PbNation
justavillain is a top reviewer
duplicates of files in a massive database

I have a 30+gb database of military knowledge. It has well over 10000 files in it. there is tons of folders and there are a lot of duplicates in this database. Is there an easier way of getting rid of these doubles other than by hand file by file?
__________________
1/24 A. Co. Fallen Marine Memorial

Sgt USMC infantry
Firefighter/emt basic
justavillain is offline   Reply With Quote
Old Sponsored Links Remove Advertisement
Advertisement
Old 08-20-2011, 10:17 PM #2
Oedipus
god save captain slow
 
Oedipus's Avatar
 
Join Date: Dec 2005
Location: Butts
Oedipus supports DLX Technology
What kind of database?
Oedipus is offline   Reply With Quote
Old 08-21-2011, 05:02 PM #3
justavillain
I've got nothing
 
justavillain's Avatar
 
Join Date: May 2005
Location: Sparta, Michigan
justavillain is a Supporting Member
justavillain is one of the top 500 posters on PbNation
justavillain is a top reviewer
It's more of a collection than a database. Its a ton of forms, powerpoints, and pdfs
__________________
1/24 A. Co. Fallen Marine Memorial

Sgt USMC infantry
Firefighter/emt basic
justavillain is offline   Reply With Quote
Old 08-21-2011, 05:09 PM #4
zellthemedic
GRAAAAAAA
 
zellthemedic's Avatar
 
Join Date: Apr 2007
Location: NAS Oceana, VA
zellthemedic helped look for balloons
zellthemedic is playing at Living Legends III
zellthemedic owns a Planet Eclipse Ego
zellthemedic is for the Gunfight
zellthemedic has achieved Level 3 in PbNation Pursuit
Are they of the same filename/type?
__________________
After dark OT:T GDT crew: More RAM than the Himalayas
OT:T:G: We sometimes like gaming, but not really -- but we really like zombies

UNITED STATES NAVY
zellthemedic is offline   Reply With Quote
Old 08-22-2011, 12:13 AM #5
CameronY
*907*
 
CameronY's Avatar
 
Join Date: May 2003
Location: Anchorage, AK
CameronY is a Supporting Member
 has been a member for 10 years
CameronY supports our troops
CameronY is one of the top 1000 posters on PbNation
Legal?
__________________
Originally Posted by BigP
"When I get to heaven, Saint Peters going to say, how did you earn
your living boy, how did you earn your way?...And I replied with a
whole lot of anger, I earned my living as an Airborne Ranger..""
Originally Posted by ZeroOrDie913
"just did some more research. both were a 1 time release, in what was basically a dick measuring contest to make the strongest beer ever."

My Feedback
CameronY is offline   Reply With Quote
Old 08-22-2011, 08:39 AM #6
Murph1329
 
 
Murph1329's Avatar
 
Join Date: Feb 2008
Location: Hoover, AL
Quote:
Originally Posted by justavillain View Post
I have a 30+gb database of military knowledge. It has well over 10000 files in it. there is tons of folders and there are a lot of duplicates in this database. Is there an easier way of getting rid of these doubles other than by hand file by file?

group by having count > 1
__________________
'98 STO
10/14'' Dye Stainless | AKALMP tornado valve
Evolution bolt | Evolution Roller Sear
ANS Jackhammer | Rex Kit
STO RAM | Air America Black Ice | Shocktech LPC
pic
Forum defeat is admitted when one resorts to grammatical insults -me
We all live with a mark of sin, no man's is greater than another's in his own mind. -me
Murph1329 is offline   Reply With Quote
Old 08-22-2011, 01:18 PM #7
Jinjiro
 
 
Join Date: May 2003
Location: Rochester, NY
 has been a member for 10 years
I haven't used it, but a quick Google search came up with this:
http://www.bigbangenterprises.de/en/doublekiller/
Jinjiro is offline   Reply With Quote
Reply


Thread Tools

Posting Rules
Forum Jump