Skip to content

Added Deletion Vector Properties to Tables#4666

Open
DavidMikolaKC wants to merge 2 commits into
qatfrom
mod/dev-15149-add-delta-deletion-vectors
Open

Added Deletion Vector Properties to Tables#4666
DavidMikolaKC wants to merge 2 commits into
qatfrom
mod/dev-15149-add-delta-deletion-vectors

Conversation

@DavidMikolaKC
Copy link
Copy Markdown
Contributor

@DavidMikolaKC DavidMikolaKC commented May 21, 2026

Description:

With the upgrade of EMR to 7.12, deletion vectors are now supported in the version of delta that we are using. We need to enable deletion vectors to take advantage of the performance improvements available with this feature.

Technical Details:

The ability for delta tables to use deletion vectors was added by setting the delta.enableDeletionVectors property in the following tables:

  • award search
  • transaction_search
  • account_balances_download
  • award_financial_download
  • object_class_program_activity_download
  • transaction_download

Requirements for PR Merge:

  1. Unit & integration tests updated
  2. API documentation updated (examples listed below)
    1. API Contracts
    2. API UI
    3. Comments
  3. Data validation completed (examples listed below)
    1. Does this work well with the current frontend? Or is the frontend aware of a needed change?
    2. Is performance impacted in the changes (e.g., API, pipeline, downloads, etc.)?
    3. Is the expected data returned with the expected format?
  4. Appropriate Operations ticket(s) created
  5. Jira Ticket(s)
    1. DEV-15149

Explain N/A in above checklist:

@DavidMikolaKC DavidMikolaKC added the in progress [ISSUE | PR] being worked label May 21, 2026
@DavidMikolaKC DavidMikolaKC added the do not merge [PR] shouldn't be merged label May 21, 2026
@DavidMikolaKC DavidMikolaKC marked this pull request as ready for review May 21, 2026 17:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

do not merge [PR] shouldn't be merged in progress [ISSUE | PR] being worked

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant