A fast duplicate file detector that uses SHA256 hashing to find identical files anywhere on your filesystem. Uses a two-pass strategy: first groups files by size (cheap), then hashes only same-size candidates (expensive). Reports wasted disk space. Respects hidden file skipping, depth limits, and minimum size thresholds. Essential for reclaiming disk space in large photo, backup, or document collections.
FilesystemUtilityDeduplicationCLI
Features
- Two-pass dedup: size grouping (fast) then SHA256 hashing (accurate)
- Reports wasted disk space in MB per duplicate group
- Minimum file size filter (-s)
- Directory depth limits (-d, -D)
- Colour-coded output with group summaries
Flags
| Long | Short | Description |
|---|---|---|
| --version | -V | Show version and license |
| --min-size | -s | Minimum file size (e.g. 1KB, 1MB) |
| --min-depth | -d | Minimum directory depth |
| --max-depth | -D | Maximum directory depth |
| --hidden | — | Include hidden files and directories |
| --quiet | -q | Suppress progress output |
Usage
terminal
$ dupes .
$
$ dupes --min-size 1MB ~/photos
$
$ dupes ~/documents ~/backups
Dependencies
sha2 and walkdir crates — single Rust binary, no runtime needed
Install
$ curl -LO https://labs.stech-sol.com/downloads/dupes/0.1.0/dupes_linux_amd64
$ chmod +x dupes_linux_amd64
$ sudo mv dupes_linux_amd64 /usr/local/bin/dupes
About
Downloads
Verify integrity
SHA256 checksums