Changelog for
duperemove-0.14.1-2.11.x86_64.rpm :
* Sun Nov 26 2023 Michael Vetter
- Update to 0.14.1:
* file_scan: satisfy clang CFI
* file_scan: walk_dir: improve rootfs support
* dbfile: get_duplicate_files: exclude inlined files before looking for duplicates
* filerec: fiemap_scan_extent: fix typo: we must check the return from get_extent
* Sun Nov 19 2023 Michael Vetter - Update to 0.14:
* Batching has been reimplemented on top of the dedupe_seq.
* The \"scan\" phase has been reimplemented (see 8264336 for details).
* Filesystem locking has been implemented. See f3947e9 for details.
* Fri Sep 29 2023 Michael Vetter - Update to 0.13:
* Add a new dedupe option: [no]rescan_files. It will increase performance in some use cases.
* New behaviors from v0.12 has been consolidated. Extent-based lookup is always enabled, as is fiemap. The v2 hashfile is no longer supported.
* Hashfile are now updated after deduplication, to reflect the new physical offsets. This avoid (re)deduplicating extents in some cases.
* Partial mode has been enhanced to support batching. The overall performance of this mode (which was previously known as \"block-based mode\") has been improved.
* All files are now open in readonly mode.
* Hashfile version has been increased to reflect the new database behaviors. Previous hashfiles are not compatible.
* Always compute a hash for the entire file. This let us deduplicate same files easily, regardless of their extents mappings.
* Deduplicating only parts of a file can be disabled using the [no]only_whole_files dedupe option.
* Hashfiles with unsupported features or hash algorithm are now recreated transparently. Migration of the old content is not implemented.
* Relative exclude patterns are no longer silently ingested. Such patterns are now rebuilt on top of the current working directory.
* Batching is now set to 1024 by default.
* Thu Sep 14 2023 pgajdosAATTsuse.com- build for 15
* Mon Jul 17 2023 Michael Vetter - Update to 0.12:
* Duplication lookup is now based on extents. This leads to a massive increase of the performances. Block-based lookup is still possible via --dedupe-options=partial.
* Following that change, a new hashfile format has been introduced. Previous hashfile format is still supported when extents lookup are disabled, this is not recommended.
* Batching has been implemented. When enabled with the -B option, duperemove will run the deduplication phase every scanned files. This is meant to help running duperemove on large dataset, with small blocksize, or on memory-constrained systems.
* All hash algorithm has been removed and replaced by xxh128. This variant is as robust as murmur3 while being faster. Choosing a hash function via the --hash option has been removed. Hashfiles built with other algorithm must be removed.
* Thu Feb 03 2022 Michael Vetter - Update to 0.11.3:
* Increase open file limit. (#269)
* Create hash database file with 600 permission for improved security. (#262)
* Read more data per pread, for v2 hashfile format this reduces the overall number of syscalls made which in turns results in better performance.
* Fix truncated file handling, eliminating a an infinite loop case. (#255)
* Thu Nov 05 2020 Nikolay Borisov - Update to v0.11.2 - Improved detection of hyperthreading - Multiple minor fixes and cleanups - Updated xxhash algorithm to latest release - Fixed extent collision handling - Fix overflow scanning in extents
* Sun Jun 14 2020 Martin Pluskal - Fix building with gcc10
* Tue Dec 04 2018 mfashehAATTsuse.com- Use source tarball from github
* Fri Nov 30 2018 mfashehAATTsuse.com- Update to v0.11.1 - Add \'quiet\' mode - duperemove will only print errors and a short summary of any dedupe. - Revert block dedupe default, it is causing excessive fragmentation on users systems.