X-Git-Url: https://www.fleuret.org/cgi-bin/gitweb/gitweb.cgi?p=finddup.git;a=blobdiff_plain;f=finddup.1;h=896cc88a4090a8fc9e85f965bd52424d56d60c8e;hp=7eb9b768eceb7f511812b7c2afe40a9087cd011c;hb=HEAD;hpb=6b25e023b7d5805fe5d3f7d342729ffb718a0784 diff --git a/finddup.1 b/finddup.1 index 7eb9b76..896cc88 100644 --- a/finddup.1 +++ b/finddup.1 @@ -10,7 +10,7 @@ finddup \- Find files common to two directories (or not) .SH "SYNOPSIS" -\fBfinddup\fP [OPTION]... [DIR1 [[and:|not:]DIR2]] +\fBfinddup\fP [OPTION]... [DIR-OR-FILE1 [[and:|not:]DIR-OR-FILE2]] .SH "DESCRIPTION" @@ -21,7 +21,8 @@ one as default. With two directories, it prints either the files common to both DIR1 and DIR2 or, with the `not:' prefix, the ones present in DIR1 and not in DIR2. The `and:' prefix is assumed by default and necessary only if -you have a directory name starting with `not:'. +you have a directory name starting with `not:'. Files are handled like +directories containing a single file. This command compares files by first comparing their sizes, hence goes reasonably fast. @@ -60,6 +61,9 @@ do not show the file group IDs \fB-t\fR, \fB--time-sort\fR sort files in each group according to the modification times .TP +\fB-q\fR, \fB--trim-first\fR +do not print the first file in each group +.TP \fB-p\fR, \fB--show-progress\fR show progress information in stderr .TP @@ -91,7 +95,7 @@ file content. Here are the things I tried, which did not help at all: (1) Computing md5s on the whole files, which is not satisfactory because files are -often not read entirely, hence the md5s can not be properly computed, +often not read entirely, hence the md5s cannot be properly computed, (2) computing XORs of the first 4, 16 and 256 bytes with rejection as soon as one does not match, (3) reading files in parts of increasing sizes so that rejection could be done with only a small fraction read @@ -101,7 +105,7 @@ when possible, (4) using mmap instead of open/read. The format of the output should definitely be improved. Not clear how. -Their could be some fancy option to link two instances of the command +There could be some fancy option to link two instances of the command running on different machines to reduce network disk accesses. This may not help much though. @@ -114,6 +118,14 @@ List duplicated files in directory ./blah/, show a progress bar, ignore empty files, and ignore files and directories starting with a dot. +.B finddup -qtg + +.fi +List all files which are duplicated in the current directory, do not +show the oldest in each each group of identical ones, and do not show +group numbers. This is what you could use to list what files to +remove. + .P .B finddup sources not:/mnt/backup