-
Notifications
You must be signed in to change notification settings - Fork 26
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement synchronous Azure Service Bus Queue Operators #310
Comments
Created operator for the following
currently working on Integration testing and test case |
Testing the operator with example DAG, got stuck with some dependencies, resolved it and able to run the example DAG setting up the connection withe azure details, and writing test case |
Implement new connection for Azure service bus, with connection details I can create queue, delete queue with operators |
Pushed the code to repo branch azure-servicebus-queue-operators |
|
ETA 24-May for development to complete |
PR link : apache/airflow#24038 |
Addressed PR review comments and updated the PR |
Addressed PR review comments |
Awaiting implementation of review comment, can we close them quickly? |
Implement synchronous Azure service bus queue operators
CreateQueueOperator
UpdateQueueOperator
DeleteQueueOperator
GetQueueRuntimePropertiesOperator
SendQueueMessageOperator(single message, list of message, batch message)
ReceiveQueueMessageOperator
Unit Tests coverage in the PR (80% Code Coverage -- We will need to add CodeCov separately to measure code cov) with all of them passing
Example DAG using the sync Operator that can be used to run Integration tests that are parametrized via Environment variables. Example - https://github.com/apache/airflow/blob/8a03a505e1df0f9de276038c5509135ac569a667/airflow/providers/google/cloud/example_dags/example_bigquery_to_gcs.py#L33-L35
Add proper docstrings for each of the methods and functions including Example DAG on how it should be used (populate
Exception Handling in case of errors
Notion page link: https://www.notion.so/astronomerio/Azure-Service-Bus-130e1721f68f4526b20d081798dd66da
The text was updated successfully, but these errors were encountered: