You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fast path for nested DictionaryArray casting #10247 [arrow]
parquet/arrow: reading multiple nested columns fails with "Not all children array length are the same!" when a list continues across DataPageV2 page boundary #10243 [parquet]
Add product aggregate kernel to arrow-rs #10150 [arrow]
fix: write error for dbg output of out of range timestamps #10130 [arrow] (Jefffrey)
[Variant] VariantArray field API naming #10124 (sdf-jkl)
feat(arrow_array): add helper function to create MapArray from Vec<Option<Vec<(Key, Option<Value>)>>> for tests #10123 [arrow] [arrow-flight] (rluvaton)
perf(arrow-ipc): Add writer benchmarks for dictionaries #10122 [arrow] (JakeDern)
feat: add OffsetBuffer::subtract to allow to shift offsets by value #10120 [arrow] (rluvaton)
fix: Buffer::into_mutable return error instead of panic for converting owned sliced when not start at 0 and fix returned Mutable length #10118 [arrow] (rluvaton)
chore: update Bytes visibility to correctly reflect the actual visibility #10115 [arrow] (rluvaton)
fix(parquet_derive): support raw identifiers as column names #10113 (cbmixx)
No successful run was found on develop (17b190b) during the generation of this report, so 4e7d718 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
58→5958→59Warning
Some dependencies could not be looked up. Check the Dependency Dashboard for more information.
Release Notes
apache/arrow-rs (arrow-cast)
v59.2.0Compare Source
Full Changelog
Enhancements
parquet-indexwork with column paths by @korowa in #10330Float16by @Glatzel in #10343variant_to_arrowMaptype support by @sdf-jkl in #10307Bug fixes
valuemandatory field forVariantArray/ShreddingStateby @sdf-jkl in #10318GenericByteViewArray::gc()drops inline views on the multi-buffer slow path by @adriangb in #10287b64_encodereject invalid UTF-8 from misbehavingEngineimpls by @bit2swaz in #10324MapArraywith nullable key field by @rluvaton in #10272ArrayData::try_newon bad input even whenforce_validatefeature is on by @rluvaton in #10282Performance improvements
RowSelectioncan be backed by aBooleanBufferby @haohuaijin in #10141write_allinstead ofio::copy(adapts #10052) by @adriangb in #10353Documentation updates
Miscellaneous
object_storeintegration by @brancz in #10354RowSelection::iterby @haohuaijin in #10450arrow_reader/selectioninto smaller modules by @haohuaijin in #10434v59.1.0Compare Source
Full Changelog
Implemented enhancements:
DictionaryArraycasting #10247 [arrow]DataTypeparsing #10146 [arrow]VariantArrayfield API naming #10093StructArray::field_APIs symmetric toStructArray::column_ones #10092 [arrow]MapArray#10047 [arrow]variant_to_arrowDictionary/REEtype support #10013Fixed bugs:
Buffer::into_mutableis not consistent regarding sliced data and can lead to panics #10117 [arrow]Documentation updates:
concat_batches#10178 (2010YOUY01)Performance improvements:
skip_validationto arrow-flight) #10206 [arrow] [arrow-flight] (Rich-T-kid)concat_elementsByteViewArray concatenation #10161 [arrow] (pepijnve)Closed issues:
FromBytestrait andBitReader::get_batch#10164 [parquet]Merged pull requests:
ArrayDatawith directArrayconstruction inarrow-row#10229 [arrow] (Jefffrey)concat_elements_dyn#10222 [arrow] (pepijnve)merge_kernelsbenchmark panic due to not wrapping withScalar#10199 [arrow] (Jefffrey)cargo updateto bump quinn #10181 (Jefffrey)ArrayDatawith directArrayconstruction in take kernels #10176 [arrow] (liamzwbao)i128toIntervalMonthDayNanofor MonthDayNano type #10171 [arrow] (Jefffrey)--lockedwhen cargo installingcargo-audit#10170 (Jefffrey)FromPyArrowonVec<T>: allow any iterable for input #10155 (Tpt)VariantArrayBuilder#10152 (sdf-jkl)VariantArrayfield API naming #10124 (sdf-jkl)Vec<Option<Vec<(Key, Option<Value>)>>>for tests #10123 [arrow] [arrow-flight] (rluvaton)MapArrayin lengths kernel #10121 [arrow] (rluvaton)OffsetBuffer::subtractto allow to shift offsets by value #10120 [arrow] (rluvaton)Buffer::into_mutablereturn error instead of panic for converting owned sliced when not start at 0 and fix returned Mutable length #10118 [arrow] (rluvaton)Bytesvisibility to correctly reflect the actual visibility #10115 [arrow] (rluvaton)StructArray::field_APIs symmetric toStructArray::column_ones #10110 [arrow] (sdf-jkl)ReaderArgs#10089 [parquet] (HippoBaro)mainreference in page-roundtrip test comment #10072 [parquet] (adriangb)filter_null_maskintoFilterPredicate::filter_nulls#10049 [arrow] (alamb)VariantBuildervalues check #10016 (sdf-jkl)UUIDextension type metadata for Parquet writer #10015 (sdf-jkl)* This Changelog was automatically generated by github_changelog_generator
v59.0.0: arrow 59.0.0Compare Source
Changelog
59.0.0 (2026-06-04)
Full Changelog
Breaking changes:
From<Vec<_>>impls withTryFroms forFixedSizeBinaryArray#10019 [parquet] [arrow] (quantumish)LogicalTypeserialization code #9997 [parquet] (etseidl)BloomFilterPropertiesfpp/ndv private with accessors #9969 [parquet] (CuteChuanChuan)CompressionCodecThrift enum for Parquet metadata #9864 [parquet] (etseidl)BorrowedShreddingState#9791 (sdf-jkl)likekernels inarrow-string#9674 [arrow] (AdamGS)Implemented enhancements:
from_ffi/ArrowArrayStreamReader#10028 [arrow]LogicalTypeenum to macro generated version #9995 [parquet]DatePart1-indexed variants #9964 [arrow]FixedSizeBinaryArrays #9906 [arrow]BorrowedShreddingState#9790Fixed bugs:
FixedSizeBinaryArrayimplementsFrom<Vec<&[u8]>>etc despite conversion being fallible #10018 [parquet] [arrow]tonic@0.14.6#9938 [parquet] [arrow] [arrow-flight]Documentation updates:
58.3.0or58.2.1(May 2026) #9859BitWriter#9949 [parquet] (alamb)BitReader#9948 [parquet] (alamb)Performance improvements:
ArrayDatawith directArrayconstruction in filter kernels #9986 [arrow] (liamzwbao)bool_valfrom Parquet ThriftFieldIdentifier#9945 [parquet] (etseidl)Closed issues:
fused_inline_view_columnsfield fromBatchCoalescerif possible #10055Uuidextension type fails to deserialize whenARROW:extension:metadatais an empty string #10000 [arrow]Archery test With other arrows-binary_view Rust producing, .NET consuming#9989 [arrow]AnyRunArraytrait #9909 [arrow]57.3.1(May 2026) #9858 [arrow]56.2.1(May 2026) #9857 [arrow]arrow-stringhas a lot of macro-generated deprecated kernels inlike.rs#9675 [arrow]Merged pull requests:
flightbenchmark before blocking #10070 [arrow] [arrow-flight] (Rich-T-kid)align_buffers()infrom_ffi, remove redundant call fromarrow-pyarrow#10030 [arrow] (mbutrovich)arrow_writerbenchmarks #10021 [parquet] (adriangb)Configuration
📅 Schedule: (UTC)
* 0-3 * * 1#2,1#4)🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.
🔕 Ignore: Close this PR and you won't be reminded about these updates again.
This PR was generated by Mend Renovate. View the repository job log.