Repository navigation
Update duckdb and arrow - #103
Merged
Merged
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #103 +/- ##
=======================================
Coverage 92.01% 92.01%
=======================================
Files 13 13
Lines 2491 2491
=======================================
Hits 2292 2292
Misses 199 199 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR contains the following updates:
=60.0.0→=60.1.0=60.0.0→=60.1.0v1.20000.0→v1.20000.1Release Notes
apache/arrow-rs (arrow)
v60.1.0Compare Source
Full Changelog
Security fixes
Enhancements
BatchCoalescer::push_batch_interleavedby @Rich-T-kid in #11519ArrayReaderandArrayIteratorconcepts by @kylebarron in #11161PageIndexdecoder toParquetMetaDataPushDecoderandParquetMetaDataReaderby @etseidl in #11438ArrayData::slicedto avoid allocations when slicing owned ArrayData by @memosmorgan in #11433i256::wrapping_div_remandi256::checked_div_remby @mbutrovich in #11425ArrayData::from_pyarrowby @Rich-T-kid in #10894PageIndexProviderby @etseidl in #11031FFI_ArrowArrayStreamby @kylebarron in #11125Sbbf::estimated_fppto expose the bloom filter FPP estimate by @adriangb in #11088Bug fixes
ArrayDataequality by @ump45nose in #11642UnionFieldswhen deserializing by @ump45nose in #11638UnionFields::from_itershould validate input by @Jefffrey in #11533ArrayData::validate_valuesfor union types by @Jefffrey in #11534FixedSizeBinarydictionaries as FLBA by @HippoBaro in #11262variant_getfor non-nullable field by @neilconway in #11356takeoutput capacity for sliced lists by @neilconway in #11360GenericByteArray::into_builderby @neilconway in #11311PrimitiveRunBuilderwas buggy afterfinishby @neilconway in #11326PrimitiveArray::into_builderby @neilconway in #11321PrimitiveDictionaryBuilderdiscard type params by @neilconway in #11327PrimitiveArray::into_builderby @neilconway in #11310ByteArrayDecoderPlain::readcan silently fail to read the correct number of values by @etseidl in #11222Performance improvements
i256by a single word with a reciprocal on 64-bit targets other than x86_64 by @mbutrovich in #11580SlicesIterator::nextby @haohuaijin in #11646i32,u32,i64,u64,f32,f64min_max calculation by @rluvaton in #11523PushBuffersrelease and clear cost independent of the buffer count by @adriangb in #11459i256magnitudes below 2^128 with oneu128division by @mbutrovich in #11530PrimitiveArray::unaryby @mbutrovich in #11525div_rem_wrappinganddiv_rem_checkedtoArrowNativeTypeOpby @mbutrovich in #11528multiply_fixed_pointby @mbutrovich in #11526MaskCursorselections in 64-bit words by @haohuaijin in #11510divvalue that overflows when scaled by @mbutrovich in #11479RowSelectionintersection and union by @haohuaijin in #11390date_partfor timestamp values without timezones by @neilconway in #11187Date32,Time32,Time64by @neilconway in #11199count,nth,nth_backandlastforRowsIterby @rluvaton in #11230regexp_matchby @neilconway in #11274ArrayDatawith directArrayconstruction in concat by @liamzwbao in #10377RowSelection::and_thenfor dense masks by @haohuaijin in #10968BMIwhen supported) by @devanbenz in #10136Documentation updates
BitChunks::chunkby @alamb in #11214DecoderFactoryby @alamb in #10897MapArray::keysandvaluesby @neilconway in #11145duckdb/duckdb-rs (duckdb)
v1.20000.1Compare Source
Highlights
stream_arrownow yieldsResult<RecordBatch>and returns fetch errors (interrupts, cast errors, I/O) instead of panicking (#664)duckdb-neo:#[derive(AsDuckDB)]maps Rust structs toSTRUCTvalues and vectors, with cached child writers for faster writes.ListandArrayare now appendable (#928)v2.0.0instead of a development version (#918), static extensions link with GNU ld (#923), bundled sources unpack into a stable, content-addressed directory sosccache hits survive target-dir changes (#924), and CI now checks the bundled DuckDB version against the pin (#922)
NaiveDateTime/DateTime<Utc>no longer panics (#926)BindInfo::get_config_optionexposes DuckDB settings to table functions (#912)d54cbbe3df)duckdbArrowStreamis no longer an alias ofArrowand yieldsResult<RecordBatch>instead ofRecordBatch(#664). Code likestmt.stream_arrow([])?.collect::<Vec<RecordBatch>>()must becomecollect::<Result<Vec<_>>>()?.query_arrowandArroware unchanged.duckdb-neo(experimental)LogicalTypeIDandDuckDBErrorare now Rust enums instead of aliases of the FFI enums. UseLogicalTypeID::Integerinstead ofDUCKDB_V2_LOGICAL_TYPE_ID_INTEGER, andDuckDBError::InputInvalidinsteadof
DUCKDB_V2_ERROR_INPUT_INVALID(#921)i128/u128vectors are read and written throughHugeInt/UHugeInt; value conversion fori128/u128is unchanged (#921)VectorElement::Internalnow takes a lifetime (type Internal<'a>), andVectorWriterhas a single lifetime parameter (#921)StructSchema,StructValue,StructWriteandStructRoware removed. DeriveAsDuckDBfor typed structs, or useget_value_slow/write_value_slowfor schemas only known at runtime (#928)ListandArraywrites require the child size up front (#928)Upgrade notes
v2.0.0rather thanv2.0.0-dev88614. Native extensions stamped for the old development version must be rebuilt (#918).What's Changed
duckdb_register_static_extensionsinside lib.rs, so ld finds it by @okruitho in #923Issues fixed
bundled(cc backend):undefined reference to duckdb_register_static_extensionson Linux/GNU ld (#920)bundled: sources unpacked intoOUT_DIRmake sccache miss whenever the build hash or target dir changes (#919)NaiveDateTimeorDateTime<Utc>panics (#925)stream_arrowpanics when fetching a chunk fails (#916, partially:query_arrowstill panics)New Contributors
Full Changelog: duckdb/duckdb-rs@v1.20000.0...v1.20000.1
Configuration
📅 Schedule: (in timezone Australia/Brisbane)
🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.
♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.
👻 Immortal: This PR will be recreated if closed unmerged. Get config help if that's undesired.
This PR was generated by Mend Renovate. View the repository job log.