Skip to content

[Export] Export query results to Parquet files #40

@shirly121

Description

@shirly121

Is your feature request related to a problem? Please describe.
Query results need to be exported in Parquet format for integration with the big-data ecosystem (Spark, Flink, data lakes) and columnar analytics.

Describe the solution you'd like
Write query results to external files in Parquet format.

Approach (choose one or decide after evaluation):

  • Option A: Direct conversion from QueryResponse to Parquet.
  • Option B: Use Arrow as an intermediate representation: convert QueryResponse to an Arrow Table, then from Arrow to Parquet.

Describe alternatives you've considered

  • Option A has a shorter path and stays close to the existing PB structure.
  • Option B introduces an Arrow layer for ecosystem reuse and future columnar formats.

Query Example:

load parquet;

COPY (MATCH (v:person) RETURN v.ID, v.fName, v.age) 
TO 'person.parquet';

Additional context
Parent issue: Support exporting query results to external files (CSV / JSON / Parquet).

Metadata

Metadata

Assignees

Labels

compilerCompiler infrastructureexecutorExecution engine

Type

No type

Projects

Status

To do

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions