Airflow with TLS-enabled Sentinel as a broker for celery doesn't work #19510
Unanswered
TomYork1986
asked this question in
General
Replies: 1 comment 4 replies
|
Airlfow supports "plain" redis as queue. Sentinel has never been tested (not in CI). So it is likely that some fixes might be necessary. If you would like to make it work also with sentinel, maybe you can make it work and contribute a fix back? |
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hello,
We're trying to enable TLS for celery in our Airflow 2.2.1, but it doesn't work. What we have:
Redis with Sentinel configured with TLS and work fine:
redis.conf:
sentinel.conf
Airflow celery workers and scheduler are fine with Redis as a broker:
But when we try to use Sentinel as a broker:
We have the following in celery.err:
And in sentinel.log:
P.S.
we had to make a trick to avoid "The broker you configured does not support SSL_ACTIVE to be True" error in the airflow/config_templates/default_celery.py file:
Does it mean that the latest version of Airflow doesn't support Sentinel with TLS?
All reactions