Skip to content

[Feature Request]: Load arrow data #23684

@fengttt

Description

@fengttt

Is there an existing issue for the same feature request?

  • I have checked the existing issues.

Is your feature request related to a problem?

Describe the feature you'd like

Load data of Apache arrow format. Very much like #10162 for parquet data.

Note that arrow is a mainly designed as an in memory format -- most of the time people store data as parquet. However, arrow can be used to connect with OTHER system/libs. For example, after we connect with arrow, we can in theory connect with pandas (via a python container/rpc), then connect with other data formats with pandas dataframe. For example HDF5 format.

On the other hand, it is a big disappointment that arrow does not provide conversion lib directly for format like HDF5. (Or does it? Need to dive deeper).

Describe implementation you've considered

No response

Documentation, Adoption, Use Case, Migration Strategy

Additional information

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions