Skip to content

PyArrow support completeness with DataFrameClient #197

@santhoshramaraj

Description

@santhoshramaraj

PyArrow is supported as an efficient binary format (instead of json) to write data to a Data Frame Table through pa.RecordBatch()

nisystemlink-clients only support the PyArrow format for the client.append_table_data() but still require the user to define the table format manually and the data query methods also return in non-PyArrow formats.

When a user has data in PyArrow format, it is highly likely that the user expects a workflow to infer or replicate the columns and types from the PyArrow schema for consistency.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions