Changelog for python310-fsspec-2024.3.1-70.11.noarch.rpm :

* Mon Mar 25 2024 Dirk Müller - update to 2024.3.1:
* allow override of expand in open()
* root handling in local file paths, fix for windows
* coroutines throttle to stream pool rather than batches
* write transactions in simplecache
* allow deep nested refs in referenceFS/parquet
* Fixes bug (#1476) that made open_files ignore expand=False
* remove extra calling mapper contains
* connection retry for SMB
* zip64 should be on is allowZip64 is
* Fri Mar 08 2024 Ben Greiner - Update to 2024.2.0 [#]# Enhancements
* add 9P known implementation (#1513)
* allow TqdmCallback subclassing (#1497, 1480)
* callbacks/branching kwargs handling and scopes (#1496, 1495, 1460)
* add aluuxioFS to known implementations (#1469)
* implement pipe_file for dirFS (#1465) [#]# Fixes
* infer compression for .lzma files (#1514)
* fix append to categorical/parquet references (#1510)
* allow for FTP servers that list with leading \"total\" line (#1503)
* convert FTP failure to FileNotFound (#1494)
* out of order reference fix (#1492)
* retry \"backoff\" response for DBFS (#1491)
* referenceFS case for scalar arrays (#1487)
* fix create_parents for SFTP (#1484)
* fix local .ls() on files (#1479)
* allow Path and similar in _expand_path (#1475)
* make lazy references editable (#1468)
* fix eq for abstract buffered files (#1466)
* fit tqdm cleanup (#1463)
* fix passing kwargs from cached file to underlying FS (#1462) [#]# Other
* fix tests for supports_empty_directories=False (#1512)
* don\'t read references in init for referenceFS (#1521)
* code cleaning (#1518, 1502, 1499, 1493, 1481)
* pass through \"replication\" for HDFS (#1486)
* record more info for HTTP info() (#1483)
* add timeout argument to githubFS (#1473)
* add more security pars to webHDFS (#1472)- Skip testing python39: no longer supported since ipython 8.19 (via notebook)
* Fri Jan 12 2024 pgajdosAATTsuse.com- have a possibility to not use pyarrow for testing [bsc#1218592]
* Sat Dec 16 2023 Dirk Müller - update to 2023.12.2:
* top-level glob in ZIP (#1454)
* append mode on local ZIP files/truncate (#1449)
* restrict \":\" as protocol marker to data: (#1452)
* sftp relative paths (#1451)
* http encoding in HTTP FS put_file (#1450)
* Thu Dec 07 2023 Dirk Müller - update to 2023.12.1:
* Remove trailing \"/\" from directory names in zipFS (#1445)
* allow HTTP size guess in more circumstances (#1440)
* allow kwargs passed to GUI to be dict (#1437)
* transaction support for writing via a cache FS (#1434)
* make cached FSs work better with async backends (#1429)
* allow FSs to set their transaction implementation (#1424)
* add dataFS (#1421, 1415)
* allow basic auth in webHDFS (#1409)
* in referenceFS, maintain order when some keys are omitted in cat (#1436)
* nested subdirectory listing in referenceFS (#1433)
* allow \"=\" in webHDF paths (#1428)
* fix file mode to consistent \"r+b\" format (#1426)
* pass on kwargs in HTTP glob (#1422)
* allow Path in can_be_local and open_local (#1419, #1418)
* fix parent for cachedFS (#1413)
* \"ends\" list in _cat_ranges was incorrect (#1402)
* Tue Nov 14 2023 Ondřej Súkup - update to 2023.10.0
* alias \"local://\" to \"file://\" (#1381)
* get size of file cache (#1377)
* stop unexpected kwargs for SMB (#1391)
* dos formatting (#1383)
* small optimisations in referenceFS (#1393)
* define ordering behaviour for entrypoints (#1389)
* add LazyReferenceMapper to API docs (#1378)
* Thu Oct 05 2023 Dirk Müller - update to 2023.9.2:
* revert #1358: auto_mkdir in open() (#1365)
* code style updates (#1373, 1372, 1371, 1370, 1369, 1364)
* update CI setup (#1386)- 2023.9.1
* #1353, save file cache metadata in JSON
* #1352, remove some unnecessary list iterations
* #1361, re-allow None for default port for SMB
* #1360, initialising GUI widget FS with kwargs
* #1358, pass auto_mkdir vi url_to_fs again
* #1354, auto delete temp cache directory- 2023.9.0
* #1346, add ocilake protocol
* #1345, implement async-sync and async-async generic cp and rsync
* #1344, add lakefs protocol
* #1337 add goatcounter to docs
* #1323, 1328, add xethub protocol
* #1320, in HTTP, check content-encoding when getting length
* #1303, add on_error in walk
* #1302, add dirfs attribute to mappers
* #1293, configure port for smb
* #1349, don\'t reorder paths in bulk ops if source and dest are both lists
* #1333, allow mode=\"x\" in get_fs_token_paths
* #1324, allow generic to work with complex URLs
* #1316, exclude bytes-cache kwargs in url_to_fs
* #1314, remote utcnow/utcfromtimestamp
* #1311, dirFS\'s protocol
* #1305, use get_file rather than get in file caching
* #1295, allow bz2 to be optional
* #1340, 1339, 1329 more bulk ops testing
* #1326, 1296 separate out classes in file caching for future enhancements
* Wed Jul 05 2023 Ben Greiner - Update to 2023.6.0 [#] Enhancements
* #1259, add maxdepth fo cp/get/put
* #1263, allow dir modification during walk()
* #1264, add boxfs to registry
* #1266, optimise referenceFS lazy lookups, especially for writing parquet
* #1287, 1288 \"encoding\" for FTP [#] Fixes
* #1273, (re)allow reading .zstd reference sets
* #1275, resource.error for win32
* #1278, range reads in dbfs
* #1282, create parent directories in get_file
* #1283, off-by-one in reference block writing
* #1286, strip protocol in local rm_file [#] Other
* #1267, async bulk tests
* #1268, types and mypy
* #1277, 1279, drop outdated forms io.open, IOError
* Tue May 30 2023 Dirk Müller - update to 2023.5.0:
* #1236, allow writing ReferenceFS references directly to parquet
* #1255, copy of glob to single output directory
* #1254, non-recursive copy of directory (no-op)
* #1253, cleanup fix on close of ZIP FS
* #1250, ignore dirs when copying list of files
* #1249, don\'t error on register without clobber is registering same thing again
* #1245, special case for other_files and relative path
* Other
* #1248, add test harness into released wheel package
* #1247, docs and tests around common bulk file operations
* 2023.4.0
* #1225, comprehensive docs of expected behaviour of cp/get/put and tests
* #1216, test harness for any backend
* #1224, small fixes in reference and dask FSs
* #1218, mv is no-op when origin and destination are the same
* #1217, await in AbstractStreamedFile
* #1215, docbuild fixes
* #1214, unneeded maxdepth manipulation in expand_path
* #1213, pyarros and posixpath related test fixes
* #1211, BackgroundBlockCache: keep a block longer if not yet used
* #1210, webHDFS: location parameter
* Other
* #1241, add HfFileSystem to registry
* #1237, register_implementation clobber default changes to False
* #1228, \"full\" and \"devel\" installation options
* #1227, register_cache and reporting collision
* #1221, docs about implementations and protocols
* Sun Apr 02 2023 Ben Greiner - migrate to PEP517- Enable pyarrow tests- Reenable distributed test for python311
* Fri Mar 24 2023 Ben Greiner - Update to 2023.3.0 [#]# Enhancements
* #1201, add directory FS to the registry and constructable from URLs
* #1194, allow JSON for setting dict-like kwargs in the config
* #1181, give arrow FS proper place in the registry
* #1178, add experimental background-thread buffering cache
* #1162, make ZipFS writable [#]# Fixes
* #1202, fix on_error=\"omit\" when using caching\'s cat
* #1199, 1163, get/put/cp consistency and empty directories
* #1197, 1183 use bytes for setting value on mapper using numpy
* #1191, clean up open files in spec get_file
* #1164, pass on kwargs correctly to http [#]# Other
* #1186, make seekable=True default for pyarrow files
* #1184, 1185, set minimum python version to 3.8- Release 2023.1.0 [#]# Enhancements
* experimental DFReferenceFileSystem (#1157, 1138)
* pyarrow seeking (#1154)
* tar thread safety (#1132)
* fsid method (#1122) [#]# Fixes
* ReferenceFS order fix (#1158)
* fix du and maxdepth (#1128, 1151)
* http ranges (#1141) [#]# Other
* coverage on referenceFS (#1133, 1123)
* docs (#1152, 1150)
* remove code duplication in unchain (#1143, 1156, 1121)- Skip testing distributed for Python 3.11: no numba yet
* Sat Nov 19 2022 Ben Greiner - Update to 2022.11.0 [#]# Enhancements
* Speed up FSMap._key_to_str (#1101)
* Add modified/created to Memory and Arrow (#1096)
* Clear expired cache method (#1092)
* Allow seekable arrow file (#1091)
* Allow append for arrow (#1089)
* recursive for sftp.get (#1082)
* topdown arg to walk() (#1081) [#]# Fixes
* fix doc warnings (#1106, #1084)
* Fix HDFS _strip_protocol (#1103)
* Allow URLs with protocol for HDFS (#1099)
* yarl in doc deps (#1095)
* missing await in genericFS.cp (#1094)
* explicit IPv4 for test HTTP server (#1088)
* sort when merging ranges for referenceFS (#1087) [#]# Other
* Check that snappy is snappy (#1079)
* Fri Oct 28 2022 Yogalakshmi Arunachalam - Update to 2022.10.0 Enhancements
* referenceFS consolidates reads in the same remote file (#1063)
* localfs: add link/symlink/islink (#1059)
* asyncfs: make mirroring methods optional (#1054)
* local: info: provide st_ino and st_nlink from stat (#1053)
* arrow_hdfs replaces hdfs (#1051)
* Add read/write_text (#1047)
* Add pipe/cat to genericFS (#1038) Fixes
* SSH write doesn’t return number of bytes (#1072)
* wrap flush method for LocalFileOpened (#1070)
* localfs: fix support for pathlib/os.PathLike objects in rm (#1058)
* don’t get_file remote FTP directory (#1056)
* fix zip write to remote (#1046)
* fix zip del following failed init (#1040) Other
* add asynclocalfs to the registry (#1060)
* add DVCFileSystem to the registry (#1049)
* add downstream tests (#1037)
* Don’t auto-close OpenFiles (#1035)
* Fri Oct 14 2022 Ben Greiner - Don\'t test with python-s3fs: It is pinning aiobotocore which does not play well with a rolling distro gh#fsspec/s3fs#615, gh#aio-libs/aiobotocore#971
* Wed Sep 28 2022 Yogalakshmi Arunachalam - Update to 2022.8.2
* don’t close OpenFile on del (#1035)- Update to 2022.8.1
* revert #1024 (#1029), with strciter requirements on OpenFile usage- Update to 2022.8.0 Enhancements
* writable ZipFileSystem (#1017)
* make OpenFile behave like files and remove dynamic closer in .open() (#1024)
* use isal gunzip (#1008) Fixes
* remove strip from _parent (#1022)
* disallow aiohttp prereleases (#1018)
* be sure to close cached file (#1016)
* async rm in reverse order (#1014)
* expose fileno in LocalFileOpener (#1010, #1005)
* remove temp files with simplecache writing (#1006)
* azure paths (#1003) copy dircache keys before iter- Update to 2022.7.1 Fixes
* Remove fspath from LocalFileOpener (#1005)
* Revert 988 (#1003)- Update to 2022.7.0 Enhancements
* added fsspec-xrootd implementation to registry (#1000)
* memory file not to copy bytes (#999)
* Filie details passed to FUSE (#972) Fixes
* Return info for root path of archives (#996)
* arbitrary kwargs passed through in pipe_file (#993)
* special cases for host in URLs for azure (#988)
* unstrip protocol criterion (#980)
* HTTPFile serialisation (#973) Other
* Show erroring path in FileNotFounds (#989)
* Reference file info without searching directory tree (#985)
* Truncate for local files (#975)
* Wed Jun 29 2022 Ben Greiner - Update ot 2022.5.0 Enhancements
* mutable ReferenceFS (#958) Fixes
* Make archive FSs not cachable (#966)
* glob fixes (#961)
* generic copy with unknown size (#959)
* zstd open (#956)
* empty archive file (#954)
* tar chaining (#950, 947)
* missing exceptions in mapper (#940) Other
* update registry (#852)
* allow None cache (#942)
* mappers to remember init arguments (#939)
* cache docstrings (#933)
* Mon Apr 04 2022 John Paul Adrian Glaubitz - Update to 2022.3.0 Enhancements
* tqdm example callback with simple methods (#931, 902)
* Allow empty root in get_mapper (#930)
* implement real info for reference FS (#919)
* list known implementations and compressions (#913) Fixes
* git branch for testing git backend (#929)
* maintaine mem FS\'s root (#926)
* kargs to FS in parquet module (#921)
* fix on_error in references (#917)
* tar ls consistency (#9114)
* pyarrow: don\'t decompress twice (#911)
* fix FUSE tests (#905)
* Tue Feb 22 2022 Matej Cepl - Update to 2022.02.0: - reference FS performance - directory/prefix FS - FUSE - iteration in threads - OpenFiles slicing - drop py36
* Mon Jan 24 2022 Ben Greiner - Update to 2022.1.0
* Fix blocks cache metadata (#746)
* Fix default SMB port (#853)
* Fix caching fixes (#856, 855)
* Fix explicit close for http files (#866)
* Fix put_file to continue when no bytes (#869, 870)
* temporary files location (#851, 871)
* async abstract methods (#858, 859, 860)
* md5 for FIPS (#872)
* remove deprecated pyarrow/distutils (#880, 881)- Update flavored requirements: python36 no longer exists, python-distributed does not support python310 yet.
* Fri Dec 24 2021 Ben Greiner - Release 2021.11.1 Enhancements
* allow compression for fs.open (#826)
* batch more async operations (#824)
* allow github backend for alternate URL (#815)
* speec up reference filesystem (#811) Fixes
* fixes for parquet functionality (#821, 817)
* typos and docs (#839, 833, 816)
* local root (#829) Other
* remove BlockSizeError for http (#830)- Release 2021.11.0 Enhancement
* parquet-specific module and cache type (#813, #806) Fixes
* empty ranges (#802, 801, 803)
* doc typos (#791, 808)
* entrypoints processing (#784)
* cat in ZIP (#789) Other
* move to fsspec org
* doc deps (#786, 791)- Release 2021.10.1 Fixes
* Removed inaccurate ZipFileSystem.cat() override so that the base class\' version is used (#789)
* fix entrypoint processing (#784)
* case where no blocks of a block-cache have yet been loaded (#801)
* don\'t fetch empty ranges (#802, 803) Other
* simplify doc deps (#786, 791)- Release 2021.10.0 Fixes
* only close http connector if present (#779)
* hdfs strip protocol (#778)
* fix filecache with check_files (#772)
* put_file to use _parent (#771) Other
* add kedro link (#781)- Release 2021.09.0 Enhancement
* http put from file-like (#764)
* implement webhdfs cp/rm_file (#762)
* multiple (and concurrent) cat_ranges (#744) Fixes
* sphinx warnings (#769)
* lexists for links (#757)
* update versioneer (#750)
* hdfs updates (#749)
* propagate async timeout error (#746)
* fix local file seekable (#743)
* fix http isdir when does not exist (#741) Other
* ocifs, arrow added (#754, #765)
* promote url_to_fs to top level (#753)
* Tue Sep 21 2021 Ben Greiner - Update to 2021.8.1
* HTTP get_file/put_file APIs now support callbacks (#731)
* New HTTP put_file method for transferring data to the remote server (chunked) (#731)
* Customizable HTTP client initializers (through passing get_client argument) (#731, #701)
* Support for various checksum / fingerprint headers in HTTP info() (#731)
* local implementation of rm_file (#736)
* local speed improvements (#711)
* sharing options in SMB (#706)
* streaming cat/get for ftp (#700)
* check for remote directory when putting (#737)
* storage_option update handling (#734(
* await HTTP call before checking status (#726)
* ftp connect (#722)
* bytes conversion of times in mapper (#721)
* variable overwrite in WholeFileCache cat (#719)
* http file size again (#718)
* rm and create directories in ftp (#716, #703)
* list of files in async put (#713)
* bytes to dict in cat (#710)- Drop fsspec-pr710-bytesreturn.patch merged upstream
* Mon Aug 23 2021 Ben Greiner - Add fsspec-pr710-bytesreturn.patch in order to fix zarr
* gh#intake/filesystem_spec#710
* gh#zarr-developers/zarr-python#812
* Sun Aug 08 2021 Ben Greiner - Update to version 2021.07.0
* no release notes- Release 2021.06.1
* Introduce fsspec.asyn.fsspec_loop to temporarily switch to the fsspec loop. (#671)
* support list for local rm (#678)
* error when local mkdir twice (#679)
* fix local info regression for pathlike (#667)
* link to wandbfs (#664)- Release 2021.06.0
* Better testing and folder handling for Memory (#654)
* Negative indexes for cat_file (#653)
* optimize local file listing (#647)
* FileNoteFound in http and range exception subclass (#649, 646)
* async timeouts (#643, 645)
* stringify path for pyarrow legacy (#630)
* The fsspec.asyn.get_loop() will always return a loop of a selector policy (#658)
* add helper to construct Range headers for cat_file (#655)
* Thu May 20 2021 Ben Greiner - Update to 2021.05.0
* Enable listings cache for HTTP filesystem (#560)
* Fold ZipFileSystem and LibArchiveFileSystem into a generic implementation and add new TarFileSystem (#561)
* Use throttling for the ``get``/``put`` methods of ``AsyncFileSystem``.- Release 2021.04.0
* Major changes: calendar versioning
* better link and size finding for HTTP (#610, %99)
* link following in Local (#608)
* ReferenceFileSystem dev (#606, #604, #602)
* Fix: drop metadata dep (#605)
* Thu Apr 15 2021 Ben Greiner - Update to version 0.9
* avoid nested sync calls by copying code (#581, #586, docs #593)
* release again for py36 (#564, #575)
* logging in mmap cacher, explicitly close files (#559)
* make LocalFileOpener an IOBase (#589)
* better reference file system (#568, #582, #584, #585)
* first-chunk cache (#580)
* sftp listdir (#571)
* http logging and fetch all (#551, #558)
* doc: entry points (#548)
* get_mapper for caching filesystems (#559)
* fix cross-device file move (#547)
* store paths without trailing \"/\" for DBFS (#557)
* errors that happen on _initiate_upload when closing the AbstractBufferedFile will now be propagated (#587)
* infer_compressions with upper case suffix ($595)
* file initialiser errors (#587)
* CI fix (#563)
* local file commit cross-device (#547)- Version 0.8.7
* fix error with pyarrow metadata for some pythons (#546)- Version 0.8.6
* Add dbfs:// support (#504, #514)
* don\'t import pyarrow (#503)
* update entry points syntax (#515)
* ci precommit hooks (#534)
* random appending of a directory within the filesystems find() method (#507, 537)
* fix git tests (#501)
* fix recursive memfs operations (#502)
* fix recorsive/maxdepth for cp (#508)
* fix listings cache timeout (#513)
* big endian bytes tests (#519)
* docs syntax (#535, 524, 520, 542)
* transactions and reads (#533)- Don\'t test with distributed on python36 -- not available anymore
* Mon Feb 22 2021 Ben Greiner - Update python36 requirements. Don\'t try to test nonexistent optional python36-numpy and -panel
* Mon Jan 04 2021 Benjamin Greiner - Test in _multibuild in order to break build dependency cycles