icechunk - v0.2.15

What's Changed

• Allow to run Rust tests with logs by @paraseba in https://github.com/earth-mover/icechunk/pull/918
• Commit learns how to rebase in case of conflict by @paraseba in https://github.com/earth-mover/icechunk/pull/920
• Bump the rust-dependencies group with 5 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/923
• Credential refresh can be initialized with the first set of credentials by @paraseba in https://github.com/earth-mover/icechunk/pull/921
• Release version 0.2.15 by @paraseba in https://github.com/earth-mover/icechunk/pull/926

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.14...v0.2.15

Climate Change - Climate Data Standards - Rust
Published by paraseba about 2 months ago

icechunk - v0.2.14

What's Changed

• Bump the rust-dependencies group with 2 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/909
• Add example using Icechunk to model bank transfers by @paraseba in https://github.com/earth-mover/icechunk/pull/913
• Honor storage settings during repo creation by @paraseba in https://github.com/earth-mover/icechunk/pull/916
• Release version 0.2.14 by @paraseba in https://github.com/earth-mover/icechunk/pull/917

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.13...v0.2.14

Climate Change - Climate Data Standards - Rust
Published by paraseba about 2 months ago

icechunk - v0.2.13

What's Changed

• Bump the rust-dependencies group with 2 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/897
• Add example to exercise high read concurrency by @paraseba in https://github.com/earth-mover/icechunk/pull/896
• Update configuration.md to clarify caching by @rabernat in https://github.com/earth-mover/icechunk/pull/899
• S3 Storage supports setting storage class by @paraseba in https://github.com/earth-mover/icechunk/pull/903
• More randomness for test repo prefixes by @paraseba in https://github.com/earth-mover/icechunk/pull/905
• Skip bytes logging in object_store by @dcherian in https://github.com/earth-mover/icechunk/pull/906
• Release version 0.2.13 by @paraseba in https://github.com/earth-mover/icechunk/pull/907

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.12...v0.2.13

Climate Change - Climate Data Standards - Rust
Published by paraseba 2 months ago

icechunk - v0.2.12

What's Changed

• Add expiration to stateful test by @dcherian in https://github.com/earth-mover/icechunk/pull/868
• Update pyo3. by @paraseba in https://github.com/earth-mover/icechunk/pull/885
• Rust integration tests can run in more object stores. by @paraseba in https://github.com/earth-mover/icechunk/pull/884
• Log errors during listing and deleting of objects by @paraseba in https://github.com/earth-mover/icechunk/pull/886
• Disallow tag/branch creation with non-existing snapshot by @paraseba in https://github.com/earth-mover/icechunk/pull/888
• Fail when creating Storage for Tigris using s3_compatible by @paraseba in https://github.com/earth-mover/icechunk/pull/889
• Fix Diff python typing by @mpiannucci in https://github.com/earth-mover/icechunk/pull/890
• Add chunk container repr, fix test dataset by @dcherian in https://github.com/earth-mover/icechunk/pull/893
• Better Debug instances and repr methods. by @paraseba in https://github.com/earth-mover/icechunk/pull/891
• Update sample-datasets page by @dcherian in https://github.com/earth-mover/icechunk/pull/887
• Use dask array native reduction by @fjetter in https://github.com/earth-mover/icechunk/pull/864
• Release version v0.2.12 by @paraseba in https://github.com/earth-mover/icechunk/pull/894

New Contributors

• @fjetter made their first contribution in https://github.com/earth-mover/icechunk/pull/864

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.11...v0.2.12

Climate Change - Climate Data Standards - Rust
Published by paraseba 2 months ago

icechunk - v0.2.11

What's Changed

• Small docs polish by @dcherian in https://github.com/earth-mover/icechunk/pull/856
• Add expiration/GC notebook by @dcherian in https://github.com/earth-mover/icechunk/pull/857
• Update GC docstrings by @dcherian in https://github.com/earth-mover/icechunk/pull/858
• Add optional default commit metadata to Repository by @mpiannucci in https://github.com/earth-mover/icechunk/pull/860
• Add upstream dev CI by @dcherian in https://github.com/earth-mover/icechunk/pull/862
• Uncomment delete_branch in stateful repo ops test by @dcherian in https://github.com/earth-mover/icechunk/pull/866
• Fix bug in expiration that creates a commit loop by @paraseba in https://github.com/earth-mover/icechunk/pull/869
• Fix repo serialization with default commit metadata by @mpiannucci in https://github.com/earth-mover/icechunk/pull/863
• expire_ref can now edit snapshot pointed by refs by @paraseba in https://github.com/earth-mover/icechunk/pull/870
• Bump the rust-dependencies group across 1 directory with 3 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/872
• Fix ref delete during ref expiration by @paraseba in https://github.com/earth-mover/icechunk/pull/873
• Add logging to GC and expiration by @paraseba in https://github.com/earth-mover/icechunk/pull/874
• Add lookup_snapshot by @dcherian in https://github.com/earth-mover/icechunk/pull/876
• Remove cache entries during GC by @dcherian in https://github.com/earth-mover/icechunk/pull/875
• One more GC bugfix by @dcherian in https://github.com/earth-mover/icechunk/pull/878
• Release version 0.2.11 by @paraseba in https://github.com/earth-mover/icechunk/pull/879

New Contributors

• @norlandrhagen made their first contribution in https://github.com/earth-mover/icechunk/pull/848

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.8...v0.2.11

Climate Change - Climate Data Standards - Rust
Published by paraseba 3 months ago

icechunk - v0.2.8

What's Changed

• Fix some cargo-deny issues (and a test) by @paraseba in https://github.com/earth-mover/icechunk/pull/824
• docs: Fix rendering of tab by @ianhi in https://github.com/earth-mover/icechunk/pull/823
• fix(lib.rs): Python CLI issues 0 exit code when using --help by @DahnJ in https://github.com/earth-mover/icechunk/pull/818
• Bump the rust-dependencies group across 1 directory with 9 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/825
• Upgrade to rustc 1.85.0 and edition=2024 by @paraseba in https://github.com/earth-mover/icechunk/pull/832
• Update dependencies by @paraseba in https://github.com/earth-mover/icechunk/pull/840
• Update ERA5 public data; add to R2. by @dcherian in https://github.com/earth-mover/icechunk/pull/817
• New total_chunks_storage function by @paraseba in https://github.com/earth-mover/icechunk/pull/841
• Don't do multipart uploads for chunks by @paraseba in https://github.com/earth-mover/icechunk/pull/845
• Release version 0.2.8 by @paraseba in https://github.com/earth-mover/icechunk/pull/846

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.7...v0.2.8

Climate Change - Climate Data Standards - Rust
Published by paraseba 3 months ago

icechunk - v0.2.7

What's Changed

• Release version 0.2.7 by @paraseba in https://github.com/earth-mover/icechunk/pull/814

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.6...v0.2.7

Climate Change - Climate Data Standards - Rust
Published by paraseba 3 months ago

icechunk - v0.2.6

What's Changed

• Add force_path_style S3 config to force path-style addressing by @dcherian in https://github.com/earth-mover/icechunk/pull/805
• Initial support for tigris consistency by @paraseba in https://github.com/earth-mover/icechunk/pull/806
• Better Tigris description in design doc by @paraseba in https://github.com/earth-mover/icechunk/pull/811
• Warn about concurrent Repo creation by @rabernat in https://github.com/earth-mover/icechunk/pull/803
• cli by @paraseba in https://github.com/earth-mover/icechunk/pull/812
• docs: Add warnings about potential deadlock when opening a repository from processes by @relativityhd in https://github.com/earth-mover/icechunk/pull/809
• Release version 0.2.6 by @paraseba in https://github.com/earth-mover/icechunk/pull/813

New Contributors

• @relativityhd made their first contribution in https://github.com/earth-mover/icechunk/pull/809

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.5...v0.2.6

Climate Change - Climate Data Standards - Rust
Published by paraseba 3 months ago

icechunk - v0.2.5

What's Changed

• Support nested allow_pickling contexts by @dcherian in https://github.com/earth-mover/icechunk/pull/790
• Bump the rust-dependencies group with 12 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/792
• Start of executable docs by @ianhi in https://github.com/earth-mover/icechunk/pull/777
• Set fallback region by @dcherian in https://github.com/earth-mover/icechunk/pull/797
• Support for read-only Storage by @paraseba in https://github.com/earth-mover/icechunk/pull/798
• Garbage collection results expose number of bytes deleted by @paraseba in https://github.com/earth-mover/icechunk/pull/799
• Release version 1.0rc1 by @paraseba in https://github.com/earth-mover/icechunk/pull/800
• Release version 0.2.5 by @paraseba in https://github.com/earth-mover/icechunk/pull/801

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.4...v0.2.5

Climate Change - Climate Data Standards - Rust
Published by paraseba 3 months ago

icechunk - v0.2.4

What's Changed

• [Docs] Remove note about s3 express zone by @mpiannucci in https://github.com/earth-mover/icechunk/pull/784
• Add multi-processing write example by @dcherian in https://github.com/earth-mover/icechunk/pull/779
• Windows test by @paraseba in https://github.com/earth-mover/icechunk/pull/669
• Release prep for 0.2.4 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/788

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.3...v0.2.4

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 4 months ago

icechunk - v0.2.3

What's Changed

• Export gcs_refreshable_credentials in __init__.py by @lindseynield in https://github.com/earth-mover/icechunk/pull/776
• Add icechunk.print_debug_info() and Issue Templates by @ianhi in https://github.com/earth-mover/icechunk/pull/753
• Make repositories pickelable by @mpiannucci in https://github.com/earth-mover/icechunk/pull/778
• Add repr for Storage by @mpiannucci in https://github.com/earth-mover/icechunk/pull/782
• Update changelog for 0.2.3 release by @mpiannucci in https://github.com/earth-mover/icechunk/pull/783

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.2...v0.2.3

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 4 months ago

icechunk - v0.2.2

What's Changed

• Fix: Check for clean prefix hides access errors by @paraseba in https://github.com/earth-mover/icechunk/pull/766
• Only write content-type if the object store accepts metadata by @paraseba in https://github.com/earth-mover/icechunk/pull/769
• feat: unify API on snapshot_id by @DahnJ in https://github.com/earth-mover/icechunk/pull/770
• readonly_session("main", as_of=...) to open a branch at a timestamp by @paraseba in https://github.com/earth-mover/icechunk/pull/768
• doc: fix wrong name in docstrings by @ianhi in https://github.com/earth-mover/icechunk/pull/775
• Add support for get_credentials callable in gcs_storage by @lindseynield in https://github.com/earth-mover/icechunk/pull/774
• Release prep for 0.2.2 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/771

New Contributors

• @DahnJ made their first contribution in https://github.com/earth-mover/icechunk/pull/770
• @lindseynield made their first contribution in https://github.com/earth-mover/icechunk/pull/774

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.1...v0.2.2

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 4 months ago

icechunk - v0.2.1

What's Changed

• Add optional overrides for nonconforming object stores by @paraseba in https://github.com/earth-mover/icechunk/pull/763
• Release version 0.2.1 by @paraseba in https://github.com/earth-mover/icechunk/pull/765

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.2.0...v0.2.1

Climate Change - Climate Data Standards - Rust
Published by paraseba 4 months ago

icechunk - v0.2.0

What's Changed

• Docs: fix errors in quickstart by @ianhi in https://github.com/earth-mover/icechunk/pull/727
• Add ERA5 demo dataset / Benchmarks on coiled by @dcherian in https://github.com/earth-mover/icechunk/pull/684
• Add optional object store backend for s3 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/728
• Add Virtual and Configuration docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/720
• Update xarray.md by @NicWayand in https://github.com/earth-mover/icechunk/pull/732
• Skip sharding codec in test by @paraseba in https://github.com/earth-mover/icechunk/pull/735
• Repository.readonly_session default by @paraseba in https://github.com/earth-mover/icechunk/pull/737
• Benchmarks incremental improvements by @dcherian in https://github.com/earth-mover/icechunk/pull/740
• Update xarray and zarr docs by @ianhi in https://github.com/earth-mover/icechunk/pull/739
• Remote benchmark tweaks by @dcherian in https://github.com/earth-mover/icechunk/pull/741
• Flatbuffers for serialization by @paraseba in https://github.com/earth-mover/icechunk/pull/733
• Fix getsize benchmark by @dcherian in https://github.com/earth-mover/icechunk/pull/742
• Python's Repository.ancestry now returns an iterator by @paraseba in https://github.com/earth-mover/icechunk/pull/751
• Treat zarr metadata as a blob (mostly) by @paraseba in https://github.com/earth-mover/icechunk/pull/749
• DOC: update contributing instructions by @ianhi in https://github.com/earth-mover/icechunk/pull/748
• Switch to conditional PUT for branch updates by @paraseba in https://github.com/earth-mover/icechunk/pull/755
• Fix for storage test by @mpiannucci in https://github.com/earth-mover/icechunk/pull/760
• Fix bug in clean prefix detection by @paraseba in https://github.com/earth-mover/icechunk/pull/761
• New API to set multiple virtual chunk refs at once by @paraseba in https://github.com/earth-mover/icechunk/pull/757
• Release version 0.2.0 by @paraseba in https://github.com/earth-mover/icechunk/pull/758

New Contributors

• @ianhi made their first contribution in https://github.com/earth-mover/icechunk/pull/727
• @NicWayand made their first contribution in https://github.com/earth-mover/icechunk/pull/732

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.1.3...v0.2.0

Climate Change - Climate Data Standards - Rust
Published by paraseba 4 months ago

icechunk - v0.1.3

What's Changed

• Change yml dependency by @paraseba in https://github.com/earth-mover/icechunk/pull/704
• Don't write dimension_names to JSON if null by @dcherian in https://github.com/earth-mover/icechunk/pull/709
• Add GCS Refreshable Credentials by @mpiannucci in https://github.com/earth-mover/icechunk/pull/687
• Icechunk learns how to do diff and status by @paraseba in https://github.com/earth-mover/icechunk/pull/711
• diff and status return richer information by @paraseba in https://github.com/earth-mover/icechunk/pull/715
• Diff should not include changes applied in the from commit by @paraseba in https://github.com/earth-mover/icechunk/pull/719
• Add static bearer token auth for GCS by @mpiannucci in https://github.com/earth-mover/icechunk/pull/721
• Release 0.1.3 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/722

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.1.2...v0.1.3

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 4 months ago

icechunk - v0.1.2

What's Changed

• Add Storage specific docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/666
• Optionally expire refs when runing snapshot expiration by @paraseba in https://github.com/earth-mover/icechunk/pull/673
• Add conda-forge badge & installation instructions for conda by @andersy005 in https://github.com/earth-mover/icechunk/pull/674
• Better Storage errors by @paraseba in https://github.com/earth-mover/icechunk/pull/680
• Add multithreaded test by @paraseba in https://github.com/earth-mover/icechunk/pull/678
• Add example code for tigris by @dcherian in https://github.com/earth-mover/icechunk/pull/688
• Fix preload manifest regexes by @paraseba in https://github.com/earth-mover/icechunk/pull/692
• Better error reporting and logs by @paraseba in https://github.com/earth-mover/icechunk/pull/689
• Add logging to complex operations by @paraseba in https://github.com/earth-mover/icechunk/pull/693
• Expose spec version to python by @paraseba in https://github.com/earth-mover/icechunk/pull/696
• Faster getsize_prefix by @paraseba in https://github.com/earth-mover/icechunk/pull/697
• Faster exists method in the Store by @paraseba in https://github.com/earth-mover/icechunk/pull/701
• Add --skip-setup flag to benchmarks runner by @dcherian in https://github.com/earth-mover/icechunk/pull/699
• Release version 0.1.2 by @paraseba in https://github.com/earth-mover/icechunk/pull/695

New Contributors

• @andersy005 made their first contribution in https://github.com/earth-mover/icechunk/pull/674

Full Changelog: https://github.com/earth-mover/icechunk/compare/v0.1.1...v0.1.2

Climate Change - Climate Data Standards - Rust
Published by paraseba 4 months ago

icechunk - icechunk-v0.1.1

What's Changed

• Update sample datasets documentation by @paraseba in https://github.com/earth-mover/icechunk/pull/662
• [Docs] remove GitHub pages build by @jhamman in https://github.com/earth-mover/icechunk/pull/661
• Fix credential fetcher deserialization by @paraseba in https://github.com/earth-mover/icechunk/pull/671
• Release version 0.1.1 by @paraseba in https://github.com/earth-mover/icechunk/pull/672

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0...v0.1.1

Climate Change - Climate Data Standards - Rust
Published by paraseba 4 months ago

icechunk - icechunk-v0.1.0

What's Changed

• Tag delete design document by @paraseba in https://github.com/earth-mover/icechunk/pull/621
• Experimental support for Tigris by @paraseba in https://github.com/earth-mover/icechunk/pull/625
• Icechunk learns how to delete tags. by @paraseba in https://github.com/earth-mover/icechunk/pull/626
• Fix storage doc string by @abarciauskas-bgse in https://github.com/earth-mover/icechunk/pull/628
• doc: build docs on readthedocs by @jhamman in https://github.com/earth-mover/icechunk/pull/254
• Uncache history by @paraseba in https://github.com/earth-mover/icechunk/pull/635
• Expiration algorithm design document by @paraseba in https://github.com/earth-mover/icechunk/pull/631
• Implement expiration of snapshots by @paraseba in https://github.com/earth-mover/icechunk/pull/636
• Update some notebooks to latest syntax by @mpiannucci in https://github.com/earth-mover/icechunk/pull/639
• Fix bug in manifest splitting by @dcherian in https://github.com/earth-mover/icechunk/pull/642
• Python expiration and GC by @paraseba in https://github.com/earth-mover/icechunk/pull/641
• Snapshot timestamp checks by @paraseba in https://github.com/earth-mover/icechunk/pull/643
• Update rand dependency by @paraseba in https://github.com/earth-mover/icechunk/pull/644
• Implement Python's Repository.async_ancestry by @paraseba in https://github.com/earth-mover/icechunk/pull/645
• Remove some cruft from the on disk datastuctures by @paraseba in https://github.com/earth-mover/icechunk/pull/647
• Update store tests for zarr 3.0.2 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/655
• Add First Pass at Version Control Docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/650
• Fetch initialized chunks by @paraseba in https://github.com/earth-mover/icechunk/pull/651
• Require opt-in to pickling writable Sessions and Stores. by @dcherian in https://github.com/earth-mover/icechunk/pull/652
• Fix pickling tests by @dcherian in https://github.com/earth-mover/icechunk/pull/657
• Enable Rust-ci workflow on python changes by @paraseba in https://github.com/earth-mover/icechunk/pull/658
• Implement manifest preloading by @paraseba in https://github.com/earth-mover/icechunk/pull/649
• Fix benchmarks for zarr 3.0.2 by @dcherian in https://github.com/earth-mover/icechunk/pull/656
• Don't create a repository unless its prefix is empty by @paraseba in https://github.com/earth-mover/icechunk/pull/659
• Manifest split design document by @paraseba in https://github.com/earth-mover/icechunk/pull/593
• Upgrade xarray.to_icechunk and related docs by @dcherian in https://github.com/earth-mover/icechunk/pull/633
• Release version 0.1.0 by @paraseba in https://github.com/earth-mover/icechunk/pull/660

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.15...icechunk-v0.1.0

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 4 months ago

icechunk - icechunk-v0.1.0-alpha.15

What's Changed

• Better binary format constants by @paraseba in https://github.com/earth-mover/icechunk/pull/588
• Fix link to Arraylake version control docs by @hendrikmakait in https://github.com/earth-mover/icechunk/pull/587
• Mechanism to deserialize different spec versions by @paraseba in https://github.com/earth-mover/icechunk/pull/589
• group.array -> create_array by @paraseba in https://github.com/earth-mover/icechunk/pull/597
• Get repository config by @paraseba in https://github.com/earth-mover/icechunk/pull/594
• Bump serde_json from 1.0.135 to 1.0.137 in the rust-dependencies group by @dependabot in https://github.com/earth-mover/icechunk/pull/596
• Evict asset caches based on size by @paraseba in https://github.com/earth-mover/icechunk/pull/595
• Fix codespell by @dcherian in https://github.com/earth-mover/icechunk/pull/607
• Fix error on: from icechunk import * by @paraseba in https://github.com/earth-mover/icechunk/pull/603
• Benchmark with pytest-benchmark by @dcherian in https://github.com/earth-mover/icechunk/pull/552
• Efficient getsize in the Zarr store by @paraseba in https://github.com/earth-mover/icechunk/pull/605
• Sync docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/612
• Better defaulting mechanism for configuration by @paraseba in https://github.com/earth-mover/icechunk/pull/613
• Generate one manifest per array by @paraseba in https://github.com/earth-mover/icechunk/pull/598
• Release 0.1.0-alpha.13 by @paraseba in https://github.com/earth-mover/icechunk/pull/614
• Release 0.1.0-alpha.14 by @paraseba in https://github.com/earth-mover/icechunk/pull/615
• Release 0.1.0-alpha.15 by @paraseba in https://github.com/earth-mover/icechunk/pull/617

New Contributors

• @hendrikmakait made their first contribution in https://github.com/earth-mover/icechunk/pull/587

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.12...icechunk-v0.1.0-alpha.15

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 5 months ago

icechunk - icechunk-v0.1.0-alpha.12

What's Changed

• Add tests to check no double asset download by @paraseba in https://github.com/earth-mover/icechunk/pull/568
• Wait for azurite container before workflow by @paraseba in https://github.com/earth-mover/icechunk/pull/569
• Disallow deleting main branch by @paraseba in https://github.com/earth-mover/icechunk/pull/571
• Add validate_container argument to set_virtual_ref by @paraseba in https://github.com/earth-mover/icechunk/pull/573
• Better ancestry interface by @paraseba in https://github.com/earth-mover/icechunk/pull/574
• Mutable python config by @paraseba in https://github.com/earth-mover/icechunk/pull/577
• Add helper Repository.reopen by @paraseba in https://github.com/earth-mover/icechunk/pull/578
• More time for docker to initialize by @paraseba in https://github.com/earth-mover/icechunk/pull/580
• Split and download virtual chunks using concurrent requests by @paraseba in https://github.com/earth-mover/icechunk/pull/579
• Concurrently download bytes by @paraseba in https://github.com/earth-mover/icechunk/pull/582
• Some initial work towards better python repr by @paraseba in https://github.com/earth-mover/icechunk/pull/584
• Release 0.1.0-alpha-12 by @paraseba in https://github.com/earth-mover/icechunk/pull/586

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.11...icechunk-v0.1.0-alpha.12

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 5 months ago

icechunk - icechunk-v0.1.0-alpha.11

What's Changed

• Azure blob suppport object store by @redcliff in https://github.com/earth-mover/icechunk/pull/561
• Metadata files download performance by @paraseba in https://github.com/earth-mover/icechunk/pull/562
• Solve deadlock exposed by python threads by @paraseba in https://github.com/earth-mover/icechunk/pull/563
• Bump the rust-dependencies group with 6 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/566
• Azurite initialization in docker by @paraseba in https://github.com/earth-mover/icechunk/pull/564
• Release prep by @mpiannucci in https://github.com/earth-mover/icechunk/pull/567

New Contributors

• @redcliff made their first contribution in https://github.com/earth-mover/icechunk/pull/561

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.10...icechunk-v0.1.0-alpha.11

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 5 months ago

icechunk - icechunk-v0.1.0-alpha.10

What's Changed

• Re-implement list_dir by @dcherian in https://github.com/earth-mover/icechunk/pull/528
• Update object_store version, add s3 object_store test by @mpiannucci in https://github.com/earth-mover/icechunk/pull/532
• Fix FromEnv for gcs storage by @mpiannucci in https://github.com/earth-mover/icechunk/pull/534
• Store learns to delete_dir by @dcherian in https://github.com/earth-mover/icechunk/pull/489
• Use multiple concurrent requests to download manifests by @paraseba in https://github.com/earth-mover/icechunk/pull/535
• Update dependencies by @paraseba in https://github.com/earth-mover/icechunk/pull/545
• Load and save repo config from python by @paraseba in https://github.com/earth-mover/icechunk/pull/542
• Manifest compression by @paraseba in https://github.com/earth-mover/icechunk/pull/540
• Fix stateful repo ops test by @dcherian in https://github.com/earth-mover/icechunk/pull/546
• Release by @paraseba in https://github.com/earth-mover/icechunk/pull/550
• Binary format design doc by @paraseba in https://github.com/earth-mover/icechunk/pull/549
• Sync with zarr 3.0 rc-2 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/544
• Binary file format evolution support by @paraseba in https://github.com/earth-mover/icechunk/pull/551
• Fetch chunks using concurrent requests by @paraseba in https://github.com/earth-mover/icechunk/pull/553
• Unpin zarr & xarray by @dcherian in https://github.com/earth-mover/icechunk/pull/555
• Release prep by @mpiannucci in https://github.com/earth-mover/icechunk/pull/557

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.8...icechunk-v0.1.0-alpha.10

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 5 months ago

icechunk - icechunk-v0.1.0-alpha.8

What's Changed

• Run checks on lock file changes by @paraseba in https://github.com/earth-mover/icechunk/pull/451
• Bump to Zarr3b3 by @dcherian in https://github.com/earth-mover/icechunk/pull/454
• Speedup python CI by @dcherian in https://github.com/earth-mover/icechunk/pull/425
• Set store to writeable after creating a branch by @dcherian in https://github.com/earth-mover/icechunk/pull/455
• Temporarily fix virtual tests by @mpiannucci in https://github.com/earth-mover/icechunk/pull/463
• Better deletion tracking in ChangeSet by @dcherian in https://github.com/earth-mover/icechunk/pull/457
• Wire up Zarr stateful tests by @dcherian in https://github.com/earth-mover/icechunk/pull/437
• Persistent configuration by @paraseba in https://github.com/earth-mover/icechunk/pull/465
• Error when chunk coordinates are invalid by @emacollins in https://github.com/earth-mover/icechunk/pull/395
• Virtual chunk containers by @paraseba in https://github.com/earth-mover/icechunk/pull/472
• Virtual chunks design document by @paraseba in https://github.com/earth-mover/icechunk/pull/436
• API Refactor by @mpiannucci in https://github.com/earth-mover/icechunk/pull/470
• Update documentation for new API and rename writeable_session to writable_session by @mpiannucci in https://github.com/earth-mover/icechunk/pull/479
• Update version control notebook (fixes doc build) by @mpiannucci in https://github.com/earth-mover/icechunk/pull/480
• Repository config overriding by @paraseba in https://github.com/earth-mover/icechunk/pull/481
• Python learns to rebase and report conflicts by @mpiannucci in https://github.com/earth-mover/icechunk/pull/485
• Python config design doc by @paraseba in https://github.com/earth-mover/icechunk/pull/488
• Add design doc for rebase and commit python api improvements by @mpiannucci in https://github.com/earth-mover/icechunk/pull/483
• Refine Ref APIs on Repository by @mpiannucci in https://github.com/earth-mover/icechunk/pull/499
• Refactor how we initialize and configure storage and repos by @paraseba in https://github.com/earth-mover/icechunk/pull/497
• [python] Add conflicted chunk report out on RebaseFailedError by @mpiannucci in https://github.com/earth-mover/icechunk/pull/495
• Python library learns how to use virtual chunk containers by @paraseba in https://github.com/earth-mover/icechunk/pull/502
• Canonicalize local fs object store by @mpiannucci in https://github.com/earth-mover/icechunk/pull/501
• Virtual chunk location inspection by @paraseba in https://github.com/earth-mover/icechunk/pull/504
• Python can now set checksums for virtual chunk refs by @paraseba in https://github.com/earth-mover/icechunk/pull/508
• Bump jinja2 from 3.1.4 to 3.1.5 in /docs in the pip group across 1 directory by @dependabot in https://github.com/earth-mover/icechunk/pull/509
• Join RepositoryConfig and StoreConfig by @paraseba in https://github.com/earth-mover/icechunk/pull/507
• Bring 'test_can_read_old' test back to life by @paraseba in https://github.com/earth-mover/icechunk/pull/511
• Add committing to stateful test actions by @dcherian in https://github.com/earth-mover/icechunk/pull/466
• Create specific credential types for each object store by @paraseba in https://github.com/earth-mover/icechunk/pull/512
• Add stateful testing for version control ops by @dcherian in https://github.com/earth-mover/icechunk/pull/453
• Implement credentials refresh by @paraseba in https://github.com/earth-mover/icechunk/pull/517
• Fix reset_branch op in stateful test by @dcherian in https://github.com/earth-mover/icechunk/pull/521
• Fix s3 prefix issue by @paraseba in https://github.com/earth-mover/icechunk/pull/525
• Add support for Google Cloud Storage by @mpiannucci in https://github.com/earth-mover/icechunk/pull/503
• Update dask_write.py to the new API by @paraseba in https://github.com/earth-mover/icechunk/pull/527
• Add docstrings by @paraseba in https://github.com/earth-mover/icechunk/pull/529
• 0.1.0-alpha.8 release preparation by @paraseba in https://github.com/earth-mover/icechunk/pull/530
• Fix rust library release action by @paraseba in https://github.com/earth-mover/icechunk/pull/531

New Contributors

• @emacollins made their first contribution in https://github.com/earth-mover/icechunk/pull/395

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.7...icechunk-v0.1.0-alpha.8

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 5 months ago

icechunk - Icechunk 0.1.0 alpha 7

What's Changed

• Add Xarray Backends tests; fix list_prefix bug by @dcherian in https://github.com/earth-mover/icechunk/pull/423
• Add some rebase test assertions by @paraseba in https://github.com/earth-mover/icechunk/pull/431
• Allow overwriting existing groups and arrays by @dcherian in https://github.com/earth-mover/icechunk/pull/433
• Update versions and changelogs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/434
• Update python-ci.yaml by @mpiannucci in https://github.com/earth-mover/icechunk/pull/435

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.6...icechunk-v0.1.0-alpha.7

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 6 months ago

icechunk - Icechunk 0.1.0 alpha 6

What's Changed

• fix: chunks from different arrays are mixed during commit by @paraseba in https://github.com/earth-mover/icechunk/pull/421
• Update changelogs, bump version numbers by @mpiannucci in https://github.com/earth-mover/icechunk/pull/426
• Make pyproj readme record match cargo by @mpiannucci in https://github.com/earth-mover/icechunk/pull/427
• Fix sdist readme packaging error by @mpiannucci in https://github.com/earth-mover/icechunk/pull/429

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.5...icechunk-v0.1.0-alpha.6

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 7 months ago

icechunk - Icechunk 0.1.0 alpha 5

What's Changed

• Skip confirmation in rust release by @paraseba in https://github.com/earth-mover/icechunk/pull/307
• Set committer for rust release by @paraseba in https://github.com/earth-mover/icechunk/pull/308
• Update virtual dataset python docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/312
• Update xarray.md by @jhamman in https://github.com/earth-mover/icechunk/pull/316
• Read-Only mode when checking out snapshot or tag by @dcherian in https://github.com/earth-mover/icechunk/pull/313
• Node ids are random not sequential by @paraseba in https://github.com/earth-mover/icechunk/pull/319
• Error when checking out invalid snapshot ID by @dcherian in https://github.com/earth-mover/icechunk/pull/317
• [chore] Switch pyo3 async out for pyo3 async runtimes by @mpiannucci in https://github.com/earth-mover/icechunk/pull/351
• Update overview.md by @mdsumner in https://github.com/earth-mover/icechunk/pull/353
• Update configuration.md by @mdsumner in https://github.com/earth-mover/icechunk/pull/354
• Fix python lint action by @mpiannucci in https://github.com/earth-mover/icechunk/pull/355
• Fix example NOAA dataset by @jbusecke in https://github.com/earth-mover/icechunk/pull/358
• Fix pickling of stores by @dcherian in https://github.com/earth-mover/icechunk/pull/349
• Update to pyo3 0.22 by @kylebarron in https://github.com/earth-mover/icechunk/pull/362
• Change KeyNotFound error to use python builtin KeyError by @mpiannucci in https://github.com/earth-mover/icechunk/pull/365
• Rust Icechunk learns how to collect garbage by @paraseba in https://github.com/earth-mover/icechunk/pull/368
• Delete extra constants by @paraseba in https://github.com/earth-mover/icechunk/pull/370
• Simplify Python binding of StorageConfig by @kylebarron in https://github.com/earth-mover/icechunk/pull/371
• More control for merging stores together by @mpiannucci in https://github.com/earth-mover/icechunk/pull/361
• Fix broken link by @rabernat in https://github.com/earth-mover/icechunk/pull/379
• Sync with zarr python 3 beta 2 by @mpiannucci in https://github.com/earth-mover/icechunk/pull/388
• Linting with ruff by @dcherian in https://github.com/earth-mover/icechunk/pull/394
• Wire up Zarr property tests EAR-1189 by @dcherian in https://github.com/earth-mover/icechunk/pull/68
• Update roadmap documentation by @paraseba in https://github.com/earth-mover/icechunk/pull/398
• Set store to read only after unpickling by @dcherian in https://github.com/earth-mover/icechunk/pull/405
• Bump tornado from 6.4.1 to 6.4.2 in /docs in the pip group across 1 directory by @dependabot in https://github.com/earth-mover/icechunk/pull/406
• codespell action upgrade by @paraseba in https://github.com/earth-mover/icechunk/pull/407
• Add transaction logs and basic conflict resolution by @paraseba in https://github.com/earth-mover/icechunk/pull/403
• Update CI linting checks by @dcherian in https://github.com/earth-mover/icechunk/pull/415
• Add to_icechunk for xarray by @dcherian in https://github.com/earth-mover/icechunk/pull/357
• Bump the rust-dependencies group with 15 updates by @dependabot in https://github.com/earth-mover/icechunk/pull/410
• Add nice docstring for icechunk.dask.store_dask by @dcherian in https://github.com/earth-mover/icechunk/pull/417
• Upgrade pyo3 to 0.23, sync changelogs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/413

New Contributors

• @mdsumner made their first contribution in https://github.com/earth-mover/icechunk/pull/353
• @kylebarron made their first contribution in https://github.com/earth-mover/icechunk/pull/362

Full Changelog: https://github.com/earth-mover/icechunk/compare/icechunk-v0.1.0-alpha.4...icechunk-v0.1.0-alpha.5

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 7 months ago

icechunk - 0.1.0-alpha.4

What's Changed

• Use absolute URL for logo in readme by @jhamman in https://github.com/earth-mover/icechunk/pull/253
• [DOCS] Add Virtual Ref Documentation and tutorial by @mpiannucci in https://github.com/earth-mover/icechunk/pull/240
• Sync examples with api by @mpiannucci in https://github.com/earth-mover/icechunk/pull/257
• Add placeholder for version control and remove concurrency section by @rabernat in https://github.com/earth-mover/icechunk/pull/256
• Add Sample Dataset to Docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/259
• Add top-level contributing page by @rabernat in https://github.com/earth-mover/icechunk/pull/258
• Add basic Rust page by @rabernat in https://github.com/earth-mover/icechunk/pull/255
• Add maps to examples by @mpiannucci in https://github.com/earth-mover/icechunk/pull/260
• Update README by @rabernat in https://github.com/earth-mover/icechunk/pull/261
• Update contributing headings by @rabernat in https://github.com/earth-mover/icechunk/pull/262
• Typo fix jbusecke by @jbusecke in https://github.com/earth-mover/icechunk/pull/268
• Fix stale link in readme to spec by @asinghvi17 in https://github.com/earth-mover/icechunk/pull/269
• Unify both of Sebastiáns in mailmap by @yarikoptic in https://github.com/earth-mover/icechunk/pull/270
• Create .gitattributes to change linguist accounting by @mpiannucci in https://github.com/earth-mover/icechunk/pull/271
• Add codespell support (config, workflow to detect/not fix) and make it fix few typos by @yarikoptic in https://github.com/earth-mover/icechunk/pull/267
• correct ref to spec.md by @rbavery in https://github.com/earth-mover/icechunk/pull/275
• Add performance notebooks by @rabernat in https://github.com/earth-mover/icechunk/pull/242
• fix(docs): Docs postlaunch fixes by @digitaltopo in https://github.com/earth-mover/icechunk/pull/278
• [Docs] correct module calls to match imports by @callumrollo in https://github.com/earth-mover/icechunk/pull/281
• [Docs] add note for requirements of tutorial data download by @callumrollo in https://github.com/earth-mover/icechunk/pull/282
• [Docs] correct output dimensions in xr example by @callumrollo in https://github.com/earth-mover/icechunk/pull/283
• [Docs] Improve virtual ref docs by @mpiannucci in https://github.com/earth-mover/icechunk/pull/284
• Introduce Store::list_dir_items by @paraseba in https://github.com/earth-mover/icechunk/pull/286
• ByteRange can do last n bytes now by @paraseba in https://github.com/earth-mover/icechunk/pull/285
• Release 0.1.0-alpha.3 to the Rust world by @paraseba in https://github.com/earth-mover/icechunk/pull/287
• GHA workflow to release Rust by @paraseba in https://github.com/earth-mover/icechunk/pull/288
• Update python ci by @mpiannucci in https://github.com/earth-mover/icechunk/pull/289
• Install cargo release by @paraseba in https://github.com/earth-mover/icechunk/pull/290
• Add changelogs by @paraseba in https://github.com/earth-mover/icechunk/pull/291
• Minor changes to virtual docs by @abarciauskas-bgse in https://github.com/earth-mover/icechunk/pull/293
• Add missing permission to python release action by @mpiannucci in https://github.com/earth-mover/icechunk/pull/295
• remove awaits in icechunk notebook by @jhamman in https://github.com/earth-mover/icechunk/pull/298
• README minor tune up: syntax and other very minor typos etc by @yarikoptic in https://github.com/earth-mover/icechunk/pull/300
• Implement branch reset functionality by @paraseba in https://github.com/earth-mover/icechunk/pull/301
• Fix non-conformant "attributes" metadata by @LDeakin in https://github.com/earth-mover/icechunk/pull/303
• update zarr pin to v3.0.0b1 by @jhamman in https://github.com/earth-mover/icechunk/pull/302
• Bump actions/checkout from 2 to 4 in the actions group by @dependabot in https://github.com/earth-mover/icechunk/pull/305
• Version 0.1.0-alpha.4 release updates by @mpiannucci in https://github.com/earth-mover/icechunk/pull/306

New Contributors

• @jbusecke made their first contribution in https://github.com/earth-mover/icechunk/pull/268
• @asinghvi17 made their first contribution in https://github.com/earth-mover/icechunk/pull/269
• @yarikoptic made their first contribution in https://github.com/earth-mover/icechunk/pull/270
• @rbavery made their first contribution in https://github.com/earth-mover/icechunk/pull/275
• @callumrollo made their first contribution in https://github.com/earth-mover/icechunk/pull/281
• @LDeakin made their first contribution in https://github.com/earth-mover/icechunk/pull/303

Full Changelog: https://github.com/earth-mover/icechunk/compare/0.1.0-alpha.2-python...icechunk-v0.1.0-alpha.4

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 8 months ago

icechunk - Python 0.1.0 Alpha 2

What's Changed

• Reorganize docs and create blank pages by @rabernat in https://github.com/earth-mover/icechunk/pull/207
• FAQ by @rabernat in https://github.com/earth-mover/icechunk/pull/196
• Updates to overview page by @rabernat in https://github.com/earth-mover/icechunk/pull/206
• Update quickstart and add empty configuration page by @rabernat in https://github.com/earth-mover/icechunk/pull/210
• feat(docs): Update structure by @digitaltopo in https://github.com/earth-mover/icechunk/pull/219
• feat(docs): Automatic docs deployments by @digitaltopo in https://github.com/earth-mover/icechunk/pull/220
• fix(docs): Update docs deployment ci by @digitaltopo in https://github.com/earth-mover/icechunk/pull/222
• docs: add content to xarray page by @jhamman in https://github.com/earth-mover/icechunk/pull/217
• All python repo methods are sync now by @paraseba in https://github.com/earth-mover/icechunk/pull/218
• chore(ci): Ignore docs folder for python and rust CI by @digitaltopo in https://github.com/earth-mover/icechunk/pull/223
• chore(docs); Fix poetry install by @digitaltopo in https://github.com/earth-mover/icechunk/pull/224
• drop MIT license by @jhamman in https://github.com/earth-mover/icechunk/pull/225
• Add Apache 2.0 license by @rabernat in https://github.com/earth-mover/icechunk/pull/215
• Improve docstrings in IcechunkStore by @paraseba in https://github.com/earth-mover/icechunk/pull/238
• Update spec by @paraseba in https://github.com/earth-mover/icechunk/pull/227
• Fix virtual test by linking to permanent objects by @mpiannucci in https://github.com/earth-mover/icechunk/pull/241
• [DOCS] FAQ: More accurate description of relationship to VirtualiZarr by @TomNicholas in https://github.com/earth-mover/icechunk/pull/239
• chore(ci): Adjust when we ignore checks from running by @digitaltopo in https://github.com/earth-mover/icechunk/pull/229
• Update xarray tutorial by @jhamman in https://github.com/earth-mover/icechunk/pull/243
• feat(docs): Show cookie consent message by @digitaltopo in https://github.com/earth-mover/icechunk/pull/228
• add CNAME to docs dir by @jhamman in https://github.com/earth-mover/icechunk/pull/245
• fix typo in xarray url by @jhamman in https://github.com/earth-mover/icechunk/pull/244
• chore(docs): update icechunk logo in the readme by @digitaltopo in https://github.com/earth-mover/icechunk/pull/231
• update ci path filters by @jhamman in https://github.com/earth-mover/icechunk/pull/247
• chore(docs): Move spec into docs by @digitaltopo in https://github.com/earth-mover/icechunk/pull/226
• Fix/doc cname by @jhamman in https://github.com/earth-mover/icechunk/pull/246
• fix(docs): update homepage badges by @digitaltopo in https://github.com/earth-mover/icechunk/pull/230
• feat(docs): Add blog post link to announcement banner by @digitaltopo in https://github.com/earth-mover/icechunk/pull/232
• fix(docs): Show primary sidebar menu even with tabs by @digitaltopo in https://github.com/earth-mover/icechunk/pull/233
• remove extra CNAME file by @jhamman in https://github.com/earth-mover/icechunk/pull/248
• feat:(docs) Add animated logo by @digitaltopo in https://github.com/earth-mover/icechunk/pull/249
• [DOCS] Configuration page by @mpiannucci in https://github.com/earth-mover/icechunk/pull/236
• fix(docs): tweak logo size by @digitaltopo in https://github.com/earth-mover/icechunk/pull/250
• feat(docs): Cube Hover effects & ice movement by @digitaltopo in https://github.com/earth-mover/icechunk/pull/251

Full Changelog: https://github.com/earth-mover/icechunk/compare/0.1.0-alpha.1-python...0.1.0-alpha.2-python

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 8 months ago

icechunk - Python 0.1.0-alpha.1

Initial python alpha release

Climate Change - Climate Data Standards - Rust
Published by mpiannucci 8 months ago