[fix](load) Pass CSV parser properties to multi-table tasks - #67512
Open
0AyanamiRei wants to merge 1 commit into
Open
[fix](load) Pass CSV parser properties to multi-table tasks#675120AyanamiRei wants to merge 1 commit into
0AyanamiRei wants to merge 1 commit into
Conversation
0AyanamiRei
requested review from
Gabriel39,
gavinchou,
liaoxin01,
luwei16 and
morningman
as code owners
September 3, 2026 21:06
Contributor
|
Thank you for your contribution to Apache Doris. Please clearly describe your PR:
|
### What problem does this PR solve? Issue Number: None Related PR: None Problem Summary: Multi-table Routine Load creates per-table stream-load plans on the backend, but the task request did not carry CSV enclose, escape, or empty-field-as-null settings. As a result, dynamic-table CSV rows that depend on those settings were parsed with defaults. Add optional task fields and preserve them through the backend task context into each per-table planning request. ### Release note Multi-table Routine Load now applies enclose, escape, and empty_field_as_null when parsing CSV data. ### Check List (For Author) - Test: Unit Test (added FE task coverage; not run per request) - Behavior changed: Yes. Multi-table CSV Routine Load tasks pass their configured parser properties to per-table plans. - Does this need documentation: No
0AyanamiRei
force-pushed
the
fix/doris-25185-multi-table-csv-parser-options
branch
from
September 3, 2026 21:19
b39f9be to
71b7726
Compare
Contributor
Author
|
run buildall |
Contributor
Cloud UT Coverage ReportIncrement line coverage Increment coverage report
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary: Multi-table Routine Load creates per-table stream-load plans on the backend, but the routine-load task did not carry the CSV enclose, escape, or empty_field_as_null settings. Dynamic-table CSV rows that depend on those settings were therefore parsed with defaults and could fail with column-count mismatches. This change adds optional task fields and preserves the configured values through the backend task context into every per-table planning request. It does not change Routine Load persistence or PAUSE/RESUME behavior.
Release note
Multi-table Routine Load now applies enclose, escape, and empty_field_as_null when parsing CSV data.
Check List (For Author)