Skip to content

[Flink] Remove unused FlinkAuronCalcOperator and dedupe the FFIReader-leaf rewriter #2328

@weiqingy

Description

@weiqingy

After the source + Calc fusion in #1865, the shadowed StreamExecCalc no longer emits the standalone FFIReader native-Calc path, so FlinkAuronCalcOperator and its unit test are unused.

Its injectFfiReaderLeaf is also a near-duplicate of AuronKafkaSourceFunction.spliceScanIntoLeaf (same recursive Project/Filter/FFIReader walk), so the two can drift apart.

Follow-up to #1865:

  • Remove FlinkAuronCalcOperator and FlinkAuronCalcOperatorTest.
  • Collapse the two tree-rewriters into a single shared walker (or keep only spliceScanIntoLeaf).
  • Replace the discarded full Arrow input schema built for the FFIReader placeholder leaf in StreamExecCalc.tryBuildAuronPlan with a bare marker leaf, since the leaf (schema included) is discarded by the splice.

This lands as a focused PR off master once #1865 merges (the operator is dead only after that).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions