Mercurial > dedupe

annotate scripts/STATEMENTS @ 115:404795616b1e default tip

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
Added a lot of common files to ignore
author Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
date Sat, 25 Mar 2017 17:43:57 +0100
parents 3951f6d27219
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
112
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
1 #!/bin/bash
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
2
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
3 DUPLICATES_STATEMENT="SELECT path FROM (SELECT * FROM files WHERE checksum IN (SELECT checksum FROM (SELECT checksum, COUNT(*) as num FROM files ${PREFIX} GROUP BY checksum) WHERE num >= 2)) ${PREFIX}"
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
4
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
5 #SELECT_STATEMENT="SELECT hex(checksum),size,path FROM (SELECT * FROM files WHERE checksum IN (SELECT checksum FROM (SELECT checksum, COUNT(*) as num FROM files ${PREFIX} GROUP BY checksum) WHERE num >= 2)) ${PREFIX} ORDER BY size;"
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
6
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
7 SELECT_STATEMENT="SELECT hex(checksum),size,path FROM files WHERE path IN (${DUPLICATES_STATEMENT}) ORDER BY size;"
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
8
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
9 DUPLICATES_STATISTICS_STATEMENT="SELECT count(*) as TotalDuplicates,sum(size) as TotalDuplicatesSize FROM files WHERE path IN (${DUPLICATES_STATEMENT})"
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
10
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
11 TOTAL_STATISTICS_STATEMENT="SELECT count(*) as TotalFiles,sum(size) as TotalSize FROM files"
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
12
3951f6d27219 Add various useful scripts. Refactor out SQL-statements.
Tom Fredrik Blenning Klaussen <bfg@bfgconsult.no>
parents:
diff changeset
13 STATISTICS_STATEMENT="SELECT * FROM (${DUPLICATES_STATISTICS_STATEMENT}),(${TOTAL_STATISTICS_STATEMENT});"