-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Add AwaitMessageTrigger for Redis PubSub #52917
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
jason810496
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice! Thanks for the PR.
Could you help add documentation for this new trigger?
providers/redis/src/airflow/providers/redis/triggers/redis_await_message.py
Outdated
Show resolved
Hide resolved
|
Sure! I've added the documentation for the trigger. |
providers/redis/src/airflow/providers/redis/triggers/redis_await_message.py
Show resolved
Hide resolved
seanghaeli
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good. Let me know when it's merged, I could take a crack at implementing a deferrable Redis pub sub sensor.
Just merged!
Nice to hear that, thanks! |
* add redis_pub_sub trigger * add sync_to_async * add docs for Redis trigger * fix = length * fix - length * add Triggers in toctree in index.rst
Why
Related to #52712.
In order to implement Redis CommonMessageQueueProvider, a trigger for Redis PubSub is a foundational step.
What
Introduces AwaitMessageTrigger for Redis PubSub, enabling async/deferrable sensor support for Redis message channels in Airflow.
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named
{pr_number}.significant.rstor{issue_number}.significant.rst, in airflow-core/newsfragments.