Apache Arrow Go v18.3.1-rc0

18.3.1 RC0

v18.3.0

What's Changed

• chore: Bump golang.org/x/sync from 0.11.0 to 0.12.0 by @dependabot in #308
• chore: Bump golang.org/x/net from 0.35.0 to 0.36.0 by @dependabot in #313
• feat(arrow/array): convert RecordReader and iterators by @zeroshade in #314
• refactor(arrow/array): replace some codegen with generics by @zeroshade in #315
• chore: Bump golang.org/x/tools from 0.30.0 to 0.31.0 by @dependabot in #317
• chore: Bump github.com/golang/snappy from 0.0.4 to 1.0.0 by @dependabot in #316
• feat(parquet/pqarrow): Add SeekToRow for RecordReader by @zeroshade in #321
• fix: go's atomic operations require 64bit alignment in structs on ARM by @sahib in #323
• feat(arrow/compute): implement "is_in" function by @zeroshade in #319
• fix(parquet/pqarrow): fix propagation of FieldIds for nested fields by @zeroshade in #324
• Fix: Handle null values in PlainFixedLenByteArrayEncoder gracefully by @singh1203 in #320
• fix(parquet/pqarrow): fix definition levels with non-nullable lists by @zeroshade in #325
• chore: Bump actions/upload-artifact from 4.6.1 to 4.6.2 by @dependabot in #331
• chore: Bump actions/setup-go from 5.3.0 to 5.4.0 by @dependabot in #332
• chore: Bump actions/download-artifact from 4.1.9 to 4.2.1 by @dependabot in #333
• chore: fix macOS Go 1.24 CI by @lidavidm in #334
• chore: Bump gonum.org/v1/gonum from 0.15.1 to 0.16.0 by @dependabot in #328
• chore: Bump google.golang.org/protobuf from 1.36.5 to 1.36.6 by @dependabot in #330
• chore: Bump actions/setup-python from 5.4.0 to 5.5.0 by @dependabot in #338
• feat(parquet/metadata): bloom filter implementation by @zeroshade in #336
• feat(parquet): Write/Read bloom filters from files by @zeroshade in #341
• fix: move from atomic.(Add|Load|Store) to atomic.Int64{} by @sahib in #326
• chore: Bump golang.org/x/sync from 0.12.0 to 0.13.0 by @dependabot in #347
• fix(parquet/file): restore goroutine safety for reader by @zeroshade in #343
• chore: Bump google.golang.org/grpc from 1.71.0 to 1.71.1 by @dependabot in #346
• chore: Bump golang.org/x/sys from 0.31.0 to 0.32.0 by @dependabot in #345
• chore: Enable GitHub discussions on arrow-go repository by @raulcd in #353
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.9.0 to 3.9.1 by @dependabot in #355
• chore: Bump golang.org/x/tools from 0.31.0 to 0.32.0 by @dependabot in #356
• Compress: add MarshalText and UnmarshalText by @jdemeyer in #357
• chore: Bump google.golang.org/grpc from 1.71.1 to 1.72.0 by @dependabot in #358
• fix(arrow/array): optional struct array with required field by @zeroshade in #359
• feat(parquet/schema): initial variant logical type by @zeroshade in #352
• chore: Bump actions/setup-python from 5.5.0 to 5.6.0 by @dependabot in #363
• chore: Bump actions/download-artifact from 4.2.1 to 4.3.0 by @dependabot in #364
• chore(arrow): remove most lock copies by @zeroshade in #362
• Fix panic when WriteDataPage fails by @ashishnegi in #366
• GH-46087: [FlightSQL] Allow returning column remarks in FlightSQL's CommandGetTables by @mateuszrzeszutek in #361
• chore: Bump golang.org/x/sys from 0.32.0 to 0.33.0 by @dependabot in #367

New Contributors

• @sahib made their first contribution in #323
• @jdemeyer made their first contribution in #357
• @ashishnegi made their first contribution in #366
• @mateuszrzeszutek made their first contribution in #361

Full Changelog: v18.2.0...v18.3.0

Apache Arrow Go v18.3.0-rc0

What's Changed

• chore: Bump golang.org/x/sync from 0.11.0 to 0.12.0 by @dependabot in #308
• chore: Bump golang.org/x/net from 0.35.0 to 0.36.0 by @dependabot in #313
• feat(arrow/array): convert RecordReader and iterators by @zeroshade in #314
• refactor(arrow/array): replace some codegen with generics by @zeroshade in #315
• chore: Bump golang.org/x/tools from 0.30.0 to 0.31.0 by @dependabot in #317
• chore: Bump github.com/golang/snappy from 0.0.4 to 1.0.0 by @dependabot in #316
• feat(parquet/pqarrow): Add SeekToRow for RecordReader by @zeroshade in #321
• fix: go's atomic operations require 64bit alignment in structs on ARM by @sahib in #323
• feat(arrow/compute): implement "is_in" function by @zeroshade in #319
• fix(parquet/pqarrow): fix propagation of FieldIds for nested fields by @zeroshade in #324
• Fix: Handle null values in PlainFixedLenByteArrayEncoder gracefully by @singh1203 in #320
• fix(parquet/pqarrow): fix definition levels with non-nullable lists by @zeroshade in #325
• chore: Bump actions/upload-artifact from 4.6.1 to 4.6.2 by @dependabot in #331
• chore: Bump actions/setup-go from 5.3.0 to 5.4.0 by @dependabot in #332
• chore: Bump actions/download-artifact from 4.1.9 to 4.2.1 by @dependabot in #333
• chore: fix macOS Go 1.24 CI by @lidavidm in #334
• chore: Bump gonum.org/v1/gonum from 0.15.1 to 0.16.0 by @dependabot in #328
• chore: Bump google.golang.org/protobuf from 1.36.5 to 1.36.6 by @dependabot in #330
• chore: Bump actions/setup-python from 5.4.0 to 5.5.0 by @dependabot in #338
• feat(parquet/metadata): bloom filter implementation by @zeroshade in #336
• feat(parquet): Write/Read bloom filters from files by @zeroshade in #341
• fix: move from atomic.(Add|Load|Store) to atomic.Int64{} by @sahib in #326
• chore: Bump golang.org/x/sync from 0.12.0 to 0.13.0 by @dependabot in #347
• fix(parquet/file): restore goroutine safety for reader by @zeroshade in #343
• chore: Bump google.golang.org/grpc from 1.71.0 to 1.71.1 by @dependabot in #346
• chore: Bump golang.org/x/sys from 0.31.0 to 0.32.0 by @dependabot in #345
• chore: Enable GitHub discussions on arrow-go repository by @raulcd in #353
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.9.0 to 3.9.1 by @dependabot in #355
• chore: Bump golang.org/x/tools from 0.31.0 to 0.32.0 by @dependabot in #356
• Compress: add MarshalText and UnmarshalText by @jdemeyer in #357
• chore: Bump google.golang.org/grpc from 1.71.1 to 1.72.0 by @dependabot in #358
• fix(arrow/array): optional struct array with required field by @zeroshade in #359
• feat(parquet/schema): initial variant logical type by @zeroshade in #352
• chore: Bump actions/setup-python from 5.5.0 to 5.6.0 by @dependabot in #363
• chore: Bump actions/download-artifact from 4.2.1 to 4.3.0 by @dependabot in #364
• chore(arrow): remove most lock copies by @zeroshade in #362
• Fix panic when WriteDataPage fails by @ashishnegi in #366
• GH-46087: [FlightSQL] Allow returning column remarks in FlightSQL's CommandGetTables by @mateuszrzeszutek in #361
• chore: Bump golang.org/x/sys from 0.32.0 to 0.33.0 by @dependabot in #367

New Contributors

• @sahib made their first contribution in #323
• @jdemeyer made their first contribution in #357
• @ashishnegi made their first contribution in #366
• @mateuszrzeszutek made their first contribution in #361

Full Changelog: v18.2.0-rc1...v18.3.0-rc0

v18.2.0

What's Changed

• fix(release): fix wrong upload path by @kou in #243
• chore: Bump google.golang.org/protobuf from 1.36.1 to 1.36.2 by @dependabot in #248
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.2.1 to 3.3.0 by @dependabot in #247
• chore: Bump actions/upload-artifact from 4.5.0 to 4.6.0 by @dependabot in #245
• fix(release): fix svn add command and add script to generate release notes by @zeroshade in #249
• fix(arrow/cdata): move headers into parent Go package by @zeroshade in #251
• chore: Bump google.golang.org/protobuf from 1.36.2 to 1.36.3 by @dependabot in #255
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.3.0 to 3.4.0 by @dependabot in #253
• chore: Add NOTICE.txt file by @singh1203 in #257
• chore: Bump google.golang.org/protobuf from 1.36.3 to 1.36.4 by @dependabot in #259
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.4.0 to 3.5.0 by @dependabot in #260
• chore: Bump actions/setup-go from 5.2.0 to 5.3.0 by @dependabot in #258
• chore: Bump google.golang.org/grpc from 1.69.2 to 1.70.0 by @dependabot in #262
• chore: Bump github.com/google/flatbuffers from 24.12.23+incompatible to 25.1.24+incompatible by @dependabot in #261
• chore: Update self-hosted arm runner to ubuntu-24.04-arm by @singh1203 in #268
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.5.0 to 3.6.0 by @dependabot in #272
• chore: Bump actions/setup-python from 5.3.0 to 5.4.0 by @dependabot in #266
• chore: Bump google.golang.org/protobuf from 1.36.4 to 1.36.5 by @dependabot in #270
• chore: Bump golang.org/x/tools from 0.29.0 to 0.30.0 by @dependabot in #273
• chore: Drop executable file bit of source files by @jas4711 in #274
• chore: Bump github.com/goccy/go-json from 0.10.4 to 0.10.5 by @dependabot in #264
• ci: update actions/cache by @zeroshade in #276
• fix(arrow/bitutil): fix bitmap ops on 32-bit platforms by @zeroshade in #277
• feat(internal/encoding): add Discard method to decoders by @zeroshade in #280
• feat(parquet/cmd/parquet_reader): Add command to dump the column and offset indices by @zeroshade in #281
• chore: Bump github.com/google/flatbuffers from 25.1.24+incompatible to 25.2.10+incompatible by @dependabot in #284
• fix(internal/utils): fix clobbering BP by @zeroshade in #288
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.6.0 to 3.7.0 by @dependabot in #287
• docs(license): update LICENSE.txt by @zeroshade in #290
• feat(parquet/file): Add SeekToRow for Column readers by @zeroshade in #283
• fix(parquet/pqarrow): propagate field id metadata for lists/maps by @zeroshade in #293
• feat: Add arrayApproxEqualString to handle null characters in string. by @singh1203 in #291
• feat(parquet): update comments for BufferedStreamEnabled by @joechenrh in #295
• chore: Bump actions/upload-artifact from 4.6.0 to 4.6.1 by @dependabot in #296
• chore: Bump github.com/klauspost/compress from 1.17.11 to 1.18.0 by @dependabot in #297
• chore: Bump github.com/hamba/avro/v2 from 2.27.0 to 2.28.0 by @dependabot in #285
• chore: Bump actions/download-artifact from 4.1.8 to 4.1.9 by @dependabot in #301
• fix(arrow/memory): Align allocations always by @lidavidm in #289
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.7.0 to 3.8.0 by @dependabot in #300
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.9 to 2.2.10 by @dependabot in #299
• feat(parquet): add byte buffer when disable buffered stream by @joechenrh in #302
• perf(overflow): Speed up overflow checks for small integers by @cbandy in #303
• chore: bump version by @zeroshade in #305
• fix(pqarrow): respect list element nullability during conversion by @zeroshade in #311
• chore(testing): Update testing submodules by @zeroshade in #312
• chore: Bump golang.org/x/sys from 0.30.0 to 0.31.0 by @dependabot in #309
• chore: Bump google.golang.org/grpc from 1.70.0 to 1.71.0 by @dependabot in #306
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.8.0 to 3.9.0 by @dependabot in #307

New Contributors

• @singh1203 made their first contribution in #257
• @jas4711 made their first contribution in #274
• @lidavidm made their first contribution in #289
• @cbandy made their first contribution in #303

Full Changelog: v18.1.0...v18.2.0

Apache Arrow Go v18.2.0-rc1

18.2.0 RC1

Apache Arrow Go v18.2.0-rc0

18.2.0 RC0

Apache Arrow Go v18.1.0

What's Changed

• GH-19: Add Code Of Conduct by @zeroshade in #161
• GH-22: Add issue template by @zeroshade in #163
• GH-26: Add Codeowners by @zeroshade in #160
• Bump github.com/hamba/avro/v2 from 2.26.0 to 2.27.0 by @dependabot in #166
• GH-41: [Array] Make String and Binary consistent by @zeroshade in #165
• fix(arrow/compute): fix scenario where prealloc output is missed by @zeroshade in #167
• fix: don't clobber saved frame pointer in arm64 assembly functions by @nsrip-dd in #170
• fix(parquet): Reading UUID columns by @zeroshade in #173
• fix(arrow/compute): compare kernels with UUID by @zeroshade in #174
• GH-23: Add PR template by @zeroshade in #164
• ci: add self-assignable issues by @zeroshade in #176
• feat(arrow/compute): Implement kernel for "not" function by @zeroshade in #178
• Bump actions/checkout from 4.2.1 to 4.2.2 by @dependabot in #179
• Bump actions/setup-python from 5.2.0 to 5.3.0 by @dependabot in #180
• fix(arrow/cdata): handle export struct with no fields by @zeroshade in #175
• Bump actions/setup-go from 5.0.2 to 5.1.0 by @dependabot in #181
• feat(arrow/compute): make is_nan dispatchable by @zeroshade in #177
• GH-20: Add CONTRIBUTING.md by @zeroshade in #162
• chore: Bump github.com/substrait-io/substrait-go from 1.1.0 to 1.2.0 by @dependabot in #183
• chore: Bump golang.org/x/sync from 0.8.0 to 0.9.0 by @dependabot in #189
• chore: Bump github.com/klauspost/cpuid/v2 from 2.2.8 to 2.2.9 by @dependabot in #188
• chore: Bump golang.org/x/tools from 0.26.0 to 0.27.0 by @dependabot in #186
• chore: bump google.golang.org/grpc from 1.67.1 to 1.68.0 by @zeroshade in #190
• feat(arrow/cdata): Add Implementation of Async C Data interface by @zeroshade in #169
• chore: Bump google.golang.org/protobuf from 1.35.1 to 1.35.2 by @dependabot in #192
• fix(arrow/memory/internal/cgoalloc): Remove usage of reflect.SliceHeader by @zeroshade in #194
• ci: update pkg-config to pkgconf on Homebrew by @zeroshade in #198
• ci: use correct GitHub Actions permission "contents" instead of "content" by @raulcd in #200
• feat(arrow/ipc): add functions to generate payloads by @zeroshade in #196
• fix(internal/json): add arrow_json_stdlib build tag by @toddtreece in #199
• chore: Bump github.com/stretchr/testify from 1.9.0 to 1.10.0 by @dependabot in #201
• feat(parquet/pqarrow): Add ForceLarge option by @zeroshade in #197
• chore: Bump golang.org/x/sys from 0.27.0 to 0.28.0 by @dependabot in #212
• chore: Bump golang.org/x/tools from 0.27.0 to 0.28.0 by @dependabot in #214
• chore: Bump google.golang.org/grpc from 1.68.0 to 1.68.1 by @dependabot in #213
• fix(parquet/metadata): fix default unsigned int statistics by @zeroshade in #210
• chore: bump github.com/goccy/go-json to v0.10.4 by @toddtreece in #218
• feat(parquet): Move footerOffset into FileMetaData by @joechenrh in #217
• chore: Bump actions/setup-go from 5.1.0 to 5.2.0 by @dependabot in #219
• chore: Bump github.com/pierrec/lz4/v4 from 4.1.21 to 4.1.22 by @dependabot in #220
• chore: Bump google.golang.org/grpc from 1.68.1 to 1.69.0 by @dependabot in #221
• feat(arrow/ipc): implement lazy loading/zero-copy for IPC files by @zeroshade in #216
• chore: Bump google.golang.org/protobuf from 1.35.2 to 1.36.0 by @dependabot in #222
• chore: Bump google.golang.org/protobuf from 1.36.0 to 1.36.1 by @dependabot in #226
• chore: Bump actions/upload-artifact from 4.4.3 to 4.5.0 by @dependabot in #228
• chore: Bump github.com/google/flatbuffers from 24.3.25+incompatible to 24.12.23+incompatible by @dependabot in #229
• chore: Bump google.golang.org/grpc from 1.69.0 to 1.69.2 by @dependabot in #227
• chore(arrow/compute/expr): upgrade substrait-go by @zeroshade in #234
• chore: Bump github.com/substrait-io/substrait-go/v3 from 3.2.0 to 3.2.1 by @dependabot in #237
• chore: Bump golang.org/x/tools from 0.28.0 to 0.29.0 by @dependabot in #235
• chore: Update the project URL in apache/arrow-go by @kou in #239
• chore: Enable Java integration test by @kou in #240
• feat(parquet): Add support for Page Indexes by @zeroshade in #223
• chore: bump version by @zeroshade in #241

New Contributors

• @nsrip-dd made their first contribution in #170
• @toddtreece made their first contribution in #199
• @joechenrh made their first contribution in #217

Full Changelog: v18.0.0...v18.1.0

v18.0.0

What's Changed

• GH-81: Enable delete branch on merge by @kou in #82
• GH-4: Update package name by @kou in #88
• GH-11: Add test CI: macOS by @kou in #86
• GH-2: Enable Dependabot by @kou in #91
• GH-15: Enable linter by @kou in #92
• Bump actions/setup-go from 5.0.0 to 5.0.2 by @dependabot in #93
• GH-100: Don't run CI jobs by Dependabot push by @kou in #101
• GH-102: Fix commit ID for actions/checkout v4.0.0 by @kou in #103
• Bump actions/checkout from 4.0.0 to 4.1.7 by @dependabot in #104
• GH-10: Add test CI: Windows by @kou in #90
• GH-5: Add test CI: Docker based by @kou in #105
• GH-6: Add test CI: i386 by @raulcd in #106
• Bump github.com/hamba/avro/v2 from 2.25.0 to 2.25.1 by @dependabot in #95
• Bump github.com/substrait-io/substrait-go from 0.7.0 to 0.8.0 by @dependabot in #96
• Bump gonum.org/v1/gonum from 0.15.0 to 0.15.1 by @dependabot in #97
• GH-16: Add Apache Rat CI by @kou in #113
• Bump golang.org/x/tools from 0.24.0 to 0.25.0 by @dependabot in #111
• GH-14: Add test CI: TinyGo by @kou in #112
• GH-7: Add test CI: Debian + CGO by @kou in #116
• GH-12: Add test CI: macOS + CGO by @raulcd in #118
• GH-9: Add test CI: Debian + CGO + Python by @raulcd in #117
• GH-13: Add test CI: Windows + MinGW by @raulcd in #119
• GH-107: Add test CI for arm Runners by @raulcd in #123
• GH-120: Add initial Decimal32/Decimal64 implementation by @zeroshade in #121
• [Parquet] Recover from panic in file reader by @zeroshade in #124
• MINOR: Bump CI test timeouts by @zeroshade in #128
• GH-21: Add release CI by @kou in #122
• GH-3: Update license information by @kou in #130
• GH-131: Don't use self-hosted arm runner on forks by @kou in #132
• GH-17: Add integration test CI by @kou in #129
• GH-134: Add Validity functions by @zeroshade in #135
• GH-140: Drop support for macOS 12 by @kou in #141
• Bump github.com/hamba/avro/v2 from 2.25.1 to 2.26.0 by @dependabot in #138
• GH-142: [Parquet] Fix inconsistency with total_byte_size by @zeroshade in #144
• Bump actions/checkout from 4.1.7 to 4.2.0 by @dependabot in #147
• MINOR: [Go] Bump github.com/apache/thrift from 0.20.0 to 0.21.0 by @dependabot in #146
• MINOR: [Go] Bump github.com/klauspost/compress from 1.17.9 to 1.17.10 by @dependabot in #145
• Bump google.golang.org/grpc from 1.65.0 to 1.67.1 by @dependabot in #148
• Bump google.golang.org/protobuf from 1.34.2 to 1.35.1 by @dependabot in #151
• Bump golang.org/x/tools from 0.25.0 to 0.26.0 by @dependabot in #154
• Bump actions/checkout from 4.2.0 to 4.2.1 by @dependabot in #155
• Bump actions/upload-artifact from 4.4.0 to 4.4.1 by @dependabot in #156
• Bump github.com/substrait-io/substrait-go from 1.0.1 to 1.1.0 by @dependabot in #152
• Bump github.com/klauspost/compress from 1.17.10 to 1.17.11 by @dependabot in #159
• Bump actions/upload-artifact from 4.4.1 to 4.4.3 by @dependabot in #157
• Bump github.com/andybalholm/brotli from 1.1.0 to 1.1.1 by @dependabot in #158
• GH-139: Add config to publish asf-site branch to go subdir by @raulcd in #149

New Contributors

• @kou made their first contribution in #82
• @raulcd made their first contribution in #106

Full Changelog: https://github.com/apache/arrow-go/commits/v18.0.0