|
|
|
|
Changelog for python310-fsspec-2024.3.1-69.10.noarch.rpm :
* Mon Mar 25 2024 Dirk Müller - update to 2024.3.1: * allow override of expand in open() * root handling in local file paths, fix for windows * coroutines throttle to stream pool rather than batches * write transactions in simplecache * allow deep nested refs in referenceFS/parquet * Fixes bug (#1476) that made open_files ignore expand=False * remove extra calling mapper contains * connection retry for SMB * zip64 should be on is allowZip64 is * Fri Mar 08 2024 Ben Greiner - Update to 2024.2.0 [#]# Enhancements * add 9P known implementation (#1513) * allow TqdmCallback subclassing (#1497, 1480) * callbacks/branching kwargs handling and scopes (#1496, 1495, 1460) * add aluuxioFS to known implementations (#1469) * implement pipe_file for dirFS (#1465) [#]# Fixes * infer compression for .lzma files (#1514) * fix append to categorical/parquet references (#1510) * allow for FTP servers that list with leading \"total\" line (#1503) * convert FTP failure to FileNotFound (#1494) * out of order reference fix (#1492) * retry \"backoff\" response for DBFS (#1491) * referenceFS case for scalar arrays (#1487) * fix create_parents for SFTP (#1484) * fix local .ls() on files (#1479) * allow Path and similar in _expand_path (#1475) * make lazy references editable (#1468) * fix eq for abstract buffered files (#1466) * fit tqdm cleanup (#1463) * fix passing kwargs from cached file to underlying FS (#1462) [#]# Other * fix tests for supports_empty_directories=False (#1512) * don\'t read references in init for referenceFS (#1521) * code cleaning (#1518, 1502, 1499, 1493, 1481) * pass through \"replication\" for HDFS (#1486) * record more info for HTTP info() (#1483) * add timeout argument to githubFS (#1473) * add more security pars to webHDFS (#1472)- Skip testing python39: no longer supported since ipython 8.19 (via notebook) * Fri Jan 12 2024 pgajdosAATTsuse.com- have a possibility to not use pyarrow for testing [bsc#1218592] * Sat Dec 16 2023 Dirk Müller - update to 2023.12.2: * top-level glob in ZIP (#1454) * append mode on local ZIP files/truncate (#1449) * restrict \":\" as protocol marker to data: (#1452) * sftp relative paths (#1451) * http encoding in HTTP FS put_file (#1450) * Thu Dec 07 2023 Dirk Müller - update to 2023.12.1: * Remove trailing \"/\" from directory names in zipFS (#1445) * allow HTTP size guess in more circumstances (#1440) * allow kwargs passed to GUI to be dict (#1437) * transaction support for writing via a cache FS (#1434) * make cached FSs work better with async backends (#1429) * allow FSs to set their transaction implementation (#1424) * add dataFS (#1421, 1415) * allow basic auth in webHDFS (#1409) * in referenceFS, maintain order when some keys are omitted in cat (#1436) * nested subdirectory listing in referenceFS (#1433) * allow \"=\" in webHDF paths (#1428) * fix file mode to consistent \"r+b\" format (#1426) * pass on kwargs in HTTP glob (#1422) * allow Path in can_be_local and open_local (#1419, #1418) * fix parent for cachedFS (#1413) * \"ends\" list in _cat_ranges was incorrect (#1402) * Tue Nov 14 2023 Ondřej Súkup - update to 2023.10.0 * alias \"local://\" to \"file://\" (#1381) * get size of file cache (#1377) * stop unexpected kwargs for SMB (#1391) * dos formatting (#1383) * small optimisations in referenceFS (#1393) * define ordering behaviour for entrypoints (#1389) * add LazyReferenceMapper to API docs (#1378) * Thu Oct 05 2023 Dirk Müller - update to 2023.9.2: * revert #1358: auto_mkdir in open() (#1365) * code style updates (#1373, 1372, 1371, 1370, 1369, 1364) * update CI setup (#1386)- 2023.9.1 * #1353, save file cache metadata in JSON * #1352, remove some unnecessary list iterations * #1361, re-allow None for default port for SMB * #1360, initialising GUI widget FS with kwargs * #1358, pass auto_mkdir vi url_to_fs again * #1354, auto delete temp cache directory- 2023.9.0 * #1346, add ocilake protocol * #1345, implement async-sync and async-async generic cp and rsync * #1344, add lakefs protocol * #1337 add goatcounter to docs * #1323, 1328, add xethub protocol * #1320, in HTTP, check content-encoding when getting length * #1303, add on_error in walk * #1302, add dirfs attribute to mappers * #1293, configure port for smb * #1349, don\'t reorder paths in bulk ops if source and dest are both lists * #1333, allow mode=\"x\" in get_fs_token_paths * #1324, allow generic to work with complex URLs * #1316, exclude bytes-cache kwargs in url_to_fs * #1314, remote utcnow/utcfromtimestamp * #1311, dirFS\'s protocol * #1305, use get_file rather than get in file caching * #1295, allow bz2 to be optional * #1340, 1339, 1329 more bulk ops testing * #1326, 1296 separate out classes in file caching for future enhancements * Wed Jul 05 2023 Ben Greiner - Update to 2023.6.0 [#] Enhancements * #1259, add maxdepth fo cp/get/put * #1263, allow dir modification during walk() * #1264, add boxfs to registry * #1266, optimise referenceFS lazy lookups, especially for writing parquet * #1287, 1288 \"encoding\" for FTP [#] Fixes * #1273, (re)allow reading .zstd reference sets * #1275, resource.error for win32 * #1278, range reads in dbfs * #1282, create parent directories in get_file * #1283, off-by-one in reference block writing * #1286, strip protocol in local rm_file [#] Other * #1267, async bulk tests * #1268, types and mypy * #1277, 1279, drop outdated forms io.open, IOError * Tue May 30 2023 Dirk Müller - update to 2023.5.0: * #1236, allow writing ReferenceFS references directly to parquet * #1255, copy of glob to single output directory * #1254, non-recursive copy of directory (no-op) * #1253, cleanup fix on close of ZIP FS * #1250, ignore dirs when copying list of files * #1249, don\'t error on register without clobber is registering same thing again * #1245, special case for other_files and relative path * Other * #1248, add test harness into released wheel package * #1247, docs and tests around common bulk file operations * 2023.4.0 * #1225, comprehensive docs of expected behaviour of cp/get/put and tests * #1216, test harness for any backend * #1224, small fixes in reference and dask FSs * #1218, mv is no-op when origin and destination are the same * #1217, await in AbstractStreamedFile * #1215, docbuild fixes * #1214, unneeded maxdepth manipulation in expand_path * #1213, pyarros and posixpath related test fixes * #1211, BackgroundBlockCache: keep a block longer if not yet used * #1210, webHDFS: location parameter * Other * #1241, add HfFileSystem to registry * #1237, register_implementation clobber default changes to False * #1228, \"full\" and \"devel\" installation options * #1227, register_cache and reporting collision * #1221, docs about implementations and protocols * Sun Apr 02 2023 Ben Greiner - migrate to PEP517- Enable pyarrow tests- Reenable distributed test for python311 * Fri Mar 24 2023 Ben Greiner - Update to 2023.3.0 [#]# Enhancements * #1201, add directory FS to the registry and constructable from URLs * #1194, allow JSON for setting dict-like kwargs in the config * #1181, give arrow FS proper place in the registry * #1178, add experimental background-thread buffering cache * #1162, make ZipFS writable [#]# Fixes * #1202, fix on_error=\"omit\" when using caching\'s cat * #1199, 1163, get/put/cp consistency and empty directories * #1197, 1183 use bytes for setting value on mapper using numpy * #1191, clean up open files in spec get_file * #1164, pass on kwargs correctly to http [#]# Other * #1186, make seekable=True default for pyarrow files * #1184, 1185, set minimum python version to 3.8- Release 2023.1.0 [#]# Enhancements * experimental DFReferenceFileSystem (#1157, 1138) * pyarrow seeking (#1154) * tar thread safety (#1132) * fsid method (#1122) [#]# Fixes * ReferenceFS order fix (#1158) * fix du and maxdepth (#1128, 1151) * http ranges (#1141) [#]# Other * coverage on referenceFS (#1133, 1123) * docs (#1152, 1150) * remove code duplication in unchain (#1143, 1156, 1121)- Skip testing distributed for Python 3.11: no numba yet * Sat Nov 19 2022 Ben Greiner - Update to 2022.11.0 [#]# Enhancements * Speed up FSMap._key_to_str (#1101) * Add modified/created to Memory and Arrow (#1096) * Clear expired cache method (#1092) * Allow seekable arrow file (#1091) * Allow append for arrow (#1089) * recursive for sftp.get (#1082) * topdown arg to walk() (#1081) [#]# Fixes * fix doc warnings (#1106, #1084) * Fix HDFS _strip_protocol (#1103) * Allow URLs with protocol for HDFS (#1099) * yarl in doc deps (#1095) * missing await in genericFS.cp (#1094) * explicit IPv4 for test HTTP server (#1088) * sort when merging ranges for referenceFS (#1087) [#]# Other * Check that snappy is snappy (#1079) * Fri Oct 28 2022 Yogalakshmi Arunachalam - Update to 2022.10.0 Enhancements * referenceFS consolidates reads in the same remote file (#1063) * localfs: add link/symlink/islink (#1059) * asyncfs: make mirroring methods optional (#1054) * local: info: provide st_ino and st_nlink from stat (#1053) * arrow_hdfs replaces hdfs (#1051) * Add read/write_text (#1047) * Add pipe/cat to genericFS (#1038) Fixes * SSH write doesn’t return number of bytes (#1072) * wrap flush method for LocalFileOpened (#1070) * localfs: fix support for pathlib/os.PathLike objects in rm (#1058) * don’t get_file remote FTP directory (#1056) * fix zip write to remote (#1046) * fix zip del following failed init (#1040) Other * add asynclocalfs to the registry (#1060) * add DVCFileSystem to the registry (#1049) * add downstream tests (#1037) * Don’t auto-close OpenFiles (#1035) * Fri Oct 14 2022 Ben Greiner - Don\'t test with python-s3fs: It is pinning aiobotocore which does not play well with a rolling distro gh#fsspec/s3fs#615, gh#aio-libs/aiobotocore#971 * Wed Sep 28 2022 Yogalakshmi Arunachalam - Update to 2022.8.2 * don’t close OpenFile on del (#1035)- Update to 2022.8.1 * revert #1024 (#1029), with strciter requirements on OpenFile usage- Update to 2022.8.0 Enhancements * writable ZipFileSystem (#1017) * make OpenFile behave like files and remove dynamic closer in .open() (#1024) * use isal gunzip (#1008) Fixes * remove strip from _parent (#1022) * disallow aiohttp prereleases (#1018) * be sure to close cached file (#1016) * async rm in reverse order (#1014) * expose fileno in LocalFileOpener (#1010, #1005) * remove temp files with simplecache writing (#1006) * azure paths (#1003) copy dircache keys before iter- Update to 2022.7.1 Fixes * Remove fspath from LocalFileOpener (#1005) * Revert 988 (#1003)- Update to 2022.7.0 Enhancements * added fsspec-xrootd implementation to registry (#1000) * memory file not to copy bytes (#999) * Filie details passed to FUSE (#972) Fixes * Return info for root path of archives (#996) * arbitrary kwargs passed through in pipe_file (#993) * special cases for host in URLs for azure (#988) * unstrip protocol criterion (#980) * HTTPFile serialisation (#973) Other * Show erroring path in FileNotFounds (#989) * Reference file info without searching directory tree (#985) * Truncate for local files (#975) * Wed Jun 29 2022 Ben Greiner - Update ot 2022.5.0 Enhancements * mutable ReferenceFS (#958) Fixes * Make archive FSs not cachable (#966) * glob fixes (#961) * generic copy with unknown size (#959) * zstd open (#956) * empty archive file (#954) * tar chaining (#950, 947) * missing exceptions in mapper (#940) Other * update registry (#852) * allow None cache (#942) * mappers to remember init arguments (#939) * cache docstrings (#933) * Mon Apr 04 2022 John Paul Adrian Glaubitz - Update to 2022.3.0 Enhancements * tqdm example callback with simple methods (#931, 902) * Allow empty root in get_mapper (#930) * implement real info for reference FS (#919) * list known implementations and compressions (#913) Fixes * git branch for testing git backend (#929) * maintaine mem FS\'s root (#926) * kargs to FS in parquet module (#921) * fix on_error in references (#917) * tar ls consistency (#9114) * pyarrow: don\'t decompress twice (#911) * fix FUSE tests (#905) * Tue Feb 22 2022 Matej Cepl - Update to 2022.02.0: - reference FS performance - directory/prefix FS - FUSE - iteration in threads - OpenFiles slicing - drop py36 * Mon Jan 24 2022 Ben Greiner - Update to 2022.1.0 * Fix blocks cache metadata (#746) * Fix default SMB port (#853) * Fix caching fixes (#856, 855) * Fix explicit close for http files (#866) * Fix put_file to continue when no bytes (#869, 870) * temporary files location (#851, 871) * async abstract methods (#858, 859, 860) * md5 for FIPS (#872) * remove deprecated pyarrow/distutils (#880, 881)- Update flavored requirements: python36 no longer exists, python-distributed does not support python310 yet. * Fri Dec 24 2021 Ben Greiner - Release 2021.11.1 Enhancements * allow compression for fs.open (#826) * batch more async operations (#824) * allow github backend for alternate URL (#815) * speec up reference filesystem (#811) Fixes * fixes for parquet functionality (#821, 817) * typos and docs (#839, 833, 816) * local root (#829) Other * remove BlockSizeError for http (#830)- Release 2021.11.0 Enhancement * parquet-specific module and cache type (#813, #806) Fixes * empty ranges (#802, 801, 803) * doc typos (#791, 808) * entrypoints processing (#784) * cat in ZIP (#789) Other * move to fsspec org * doc deps (#786, 791)- Release 2021.10.1 Fixes * Removed inaccurate ZipFileSystem.cat() override so that the base class\' version is used (#789) * fix entrypoint processing (#784) * case where no blocks of a block-cache have yet been loaded (#801) * don\'t fetch empty ranges (#802, 803) Other * simplify doc deps (#786, 791)- Release 2021.10.0 Fixes * only close http connector if present (#779) * hdfs strip protocol (#778) * fix filecache with check_files (#772) * put_file to use _parent (#771) Other * add kedro link (#781)- Release 2021.09.0 Enhancement * http put from file-like (#764) * implement webhdfs cp/rm_file (#762) * multiple (and concurrent) cat_ranges (#744) Fixes * sphinx warnings (#769) * lexists for links (#757) * update versioneer (#750) * hdfs updates (#749) * propagate async timeout error (#746) * fix local file seekable (#743) * fix http isdir when does not exist (#741) Other * ocifs, arrow added (#754, #765) * promote url_to_fs to top level (#753) * Tue Sep 21 2021 Ben Greiner - Update to 2021.8.1 * HTTP get_file/put_file APIs now support callbacks (#731) * New HTTP put_file method for transferring data to the remote server (chunked) (#731) * Customizable HTTP client initializers (through passing get_client argument) (#731, #701) * Support for various checksum / fingerprint headers in HTTP info() (#731) * local implementation of rm_file (#736) * local speed improvements (#711) * sharing options in SMB (#706) * streaming cat/get for ftp (#700) * check for remote directory when putting (#737) * storage_option update handling (#734( * await HTTP call before checking status (#726) * ftp connect (#722) * bytes conversion of times in mapper (#721) * variable overwrite in WholeFileCache cat (#719) * http file size again (#718) * rm and create directories in ftp (#716, #703) * list of files in async put (#713) * bytes to dict in cat (#710)- Drop fsspec-pr710-bytesreturn.patch merged upstream * Mon Aug 23 2021 Ben Greiner - Add fsspec-pr710-bytesreturn.patch in order to fix zarr * gh#intake/filesystem_spec#710 * gh#zarr-developers/zarr-python#812 * Sun Aug 08 2021 Ben Greiner - Update to version 2021.07.0 * no release notes- Release 2021.06.1 * Introduce fsspec.asyn.fsspec_loop to temporarily switch to the fsspec loop. (#671) * support list for local rm (#678) * error when local mkdir twice (#679) * fix local info regression for pathlike (#667) * link to wandbfs (#664)- Release 2021.06.0 * Better testing and folder handling for Memory (#654) * Negative indexes for cat_file (#653) * optimize local file listing (#647) * FileNoteFound in http and range exception subclass (#649, 646) * async timeouts (#643, 645) * stringify path for pyarrow legacy (#630) * The fsspec.asyn.get_loop() will always return a loop of a selector policy (#658) * add helper to construct Range headers for cat_file (#655) * Thu May 20 2021 Ben Greiner - Update to 2021.05.0 * Enable listings cache for HTTP filesystem (#560) * Fold ZipFileSystem and LibArchiveFileSystem into a generic implementation and add new TarFileSystem (#561) * Use throttling for the ``get``/``put`` methods of ``AsyncFileSystem``.- Release 2021.04.0 * Major changes: calendar versioning * better link and size finding for HTTP (#610, %99) * link following in Local (#608) * ReferenceFileSystem dev (#606, #604, #602) * Fix: drop metadata dep (#605) * Thu Apr 15 2021 Ben Greiner - Update to version 0.9 * avoid nested sync calls by copying code (#581, #586, docs #593) * release again for py36 (#564, #575) * logging in mmap cacher, explicitly close files (#559) * make LocalFileOpener an IOBase (#589) * better reference file system (#568, #582, #584, #585) * first-chunk cache (#580) * sftp listdir (#571) * http logging and fetch all (#551, #558) * doc: entry points (#548) * get_mapper for caching filesystems (#559) * fix cross-device file move (#547) * store paths without trailing \"/\" for DBFS (#557) * errors that happen on _initiate_upload when closing the AbstractBufferedFile will now be propagated (#587) * infer_compressions with upper case suffix ($595) * file initialiser errors (#587) * CI fix (#563) * local file commit cross-device (#547)- Version 0.8.7 * fix error with pyarrow metadata for some pythons (#546)- Version 0.8.6 * Add dbfs:// support (#504, #514) * don\'t import pyarrow (#503) * update entry points syntax (#515) * ci precommit hooks (#534) * random appending of a directory within the filesystems find() method (#507, 537) * fix git tests (#501) * fix recursive memfs operations (#502) * fix recorsive/maxdepth for cp (#508) * fix listings cache timeout (#513) * big endian bytes tests (#519) * docs syntax (#535, 524, 520, 542) * transactions and reads (#533)- Don\'t test with distributed on python36 -- not available anymore * Mon Feb 22 2021 Ben Greiner - Update python36 requirements. Don\'t try to test nonexistent optional python36-numpy and -panel * Mon Jan 04 2021 Benjamin Greiner - Test in _multibuild in order to break build dependency cycles
|
|
|