Skip to content

Add support for fair queue in SQS#2342

Merged
auvipy merged 25 commits intocelery:mainfrom
MartinSiby:martin/support_SQS_fair_queue
Feb 12, 2026
Merged

Add support for fair queue in SQS#2342
auvipy merged 25 commits intocelery:mainfrom
MartinSiby:martin/support_SQS_fair_queue

Conversation

@MartinSiby
Copy link
Contributor

AWS SQS recently introduced native support for fair queues (reference).

To enable this functionality, we need to send the MessageGroupId even for standard (non-FIFO) queues. This change ensures compatibility with the new fair queueing mechanism.

@auvipy auvipy requested review from auvipy and Copilot July 29, 2025 04:21
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR adds support for AWS SQS fair queues by allowing MessageGroupId to be sent for standard (non-FIFO) queues. The change ensures compatibility with AWS's recently introduced native fair queueing mechanism.

  • Modifies the SQS transport logic to check for MessageGroupId independently of FIFO queue detection
  • Restructures conditional logic to handle both fair queues and FIFO queues appropriately
  • Adds test coverage for MessageGroupId functionality in standard queues

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
kombu/transport/SQS.py Updates the _put method to support MessageGroupId for both standard and FIFO queues
t/unit/transport/test_SQS.py Adds test case to verify MessageGroupId is properly passed through for standard queues

@MartinSiby MartinSiby changed the title add support for fair queue in SQS Add support for fair queue in SQS Jul 29, 2025
@auvipy auvipy added this to the 5.7.0 milestone Jul 30, 2025
@rajatmoengage
Copy link

@auvipy , Could you share the plan here? When are we planning to release this feature? I see it has been added to 5.7.0 milestone. Do we have any date in mind? Is it possible to make it part of 5.6.0, if the change is not that big?

@auvipy
Copy link
Member

auvipy commented Aug 28, 2025

it will be slated for v5.70

@rajatmoengage
Copy link

rajatmoengage commented Sep 8, 2025

it will be slated for v5.70

@auvipy Do we know any appropriate time when it would be released?

also, will be update the previous versions with this feature?

Copy link
Member

@auvipy auvipy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can consider this for 5.7 release as well, but need more test coverage

@Nusnus Nusnus requested a review from Copilot October 8, 2025 01:02
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 2 comments.


Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@MartinSiby
Copy link
Contributor Author

@auvipy more test coverage has been added, thanks to @vaibhavcerta

MartinSiby and others added 4 commits November 4, 2025 10:27
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@codecov
Copy link

codecov bot commented Nov 5, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 81.15%. Comparing base (92006e7) to head (c86014d).
⚠️ Report is 1 commits behind head on main.
✅ All tests successful. No failed tests found.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2342      +/-   ##
==========================================
+ Coverage   81.11%   81.15%   +0.04%     
==========================================
  Files          77       77              
  Lines        9738     9739       +1     
  Branches     1098     1099       +1     
==========================================
+ Hits         7899     7904       +5     
+ Misses       1631     1629       -2     
+ Partials      208      206       -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@auvipy auvipy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also please fix the lint issues

@auvipy auvipy requested a review from Copilot December 2, 2025 06:02
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 4 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@DilwoarH
Copy link

@auvipy @MartinSiby - do you know when this will be merged in?

@auvipy
Copy link
Member

auvipy commented Feb 4, 2026

during february

@auvipy auvipy self-requested a review February 9, 2026 05:43
@auvipy auvipy closed this Feb 9, 2026
@auvipy auvipy reopened this Feb 9, 2026
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@joybytes
Copy link

@auvipy could you tell me if these changes be released in a version any time soon please?
and if it would be an upgrade to 5.6 or if it would be part of 5.7 - thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants

Comments