-
Notifications
You must be signed in to change notification settings - Fork 14.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Status of testing Providers that were prepared on July 13, 2022 #25037
Comments
@wylde780. - please install the RC1 SFTP provider from the link above. |
I have a question regarding Provider http: 4.0.0rc1 and added it in the PR discussion here: #24967 (comment) |
Thanks @pankajkoti - excellent point, I followed up with some extra comment/questions. I am happy to do either way (continue with self.hook removal, or restore it in RC2, and I think we should discuss what's best approach in general for deferred operators. |
Tested the below PR with the respective rc images and they are working fine. Add test_connection method to Databricks hook (#24617): @phanikumv |
Tested the following PR's with the respective rc image and its working fine. Implement Azure service bus subscription (create, delete)Operators (#24625): @bharanidharan14 |
I tested all my changes - mostly they were about common-sql extraction and dependencies. They all looks good! |
Completed testing the below PR and they are working fine. Add test_connection method to Trino hook (#24583): @phanikumv Add on_kill() to kill Trino query if Airflow task is killed (#24559): @phanikumv |
I can confirm that the Amazon Appflow support is working as expected for |
cc: @Fokko - this is not mentioned here but it would be great if you test https://pypi.org/project/apache-airflow-providers-tabular/1.0.0rc1/ |
Indeed. |
Tested new operators introduced in #24099, working correctly. |
#24473 is working as expected. |
#23141 checked. Please see the details below for comparison.
|
Yep #24670 has been removed from changelog as "not important" - we can re-add them later for the docs purpose see changelog with comments included https://raw.githubusercontent.com/apache/airflow/main/airflow/providers/amazon/CHANGELOG.rst) |
Good point. Yes. We need to add a major release for it. I missed the removal. I will remove it from the release and make a new release for SFTP only. |
I have tested #24860, works great! |
Looks okay to me #24726 |
Tested #24306 with |
I'll give the Tabular operator a swing right away. Thanks for running this @potiuk! 👏🏻 |
Sure. I will remove tabular from delivery too and add it to the list of rc2's |
#24617 for Databricks has an issue because selected API is available only on AWS, and will fail on Azure/GCP... More general question - is it possible to subscribe to all Databricks-related RPs? |
Good check. That is not a regression though, test_connection is a new method/functionality added and it partially works, so it's not a reason to cancel it. It can be adressed in the next release.
We discussed it before, unfortunately CODEOWNER (which is a bad name BTW) only allows commiters to be marked as reviewer to part of the repo, which is a bummer (because it's not a codeowner by any means is just assigning people to be reviewers which has nothing to do with either being committer or owner). For now, the best you can do (and it should be pretty accurate) is to subscribe to all notifiction and write a custom filter - if you are using gmail (that's what I'd do at least). It's actually pretty accurate. All PRs/commit messages with databrics contain list of changed files so subscribing to anything with "providers/databricks" should do the job nicely and you can choose how it should be surfaced in your email (and you can archive/store non-matching emails from commts@github elsewhere). In the future (the mixed-governance was a pre-requisite to it) we plan to split providers to separate repos and then it will be much more flexible and you will be able to write more precise filters. |
Not serious at all. It seems the authentication is missing since the original code only. Nothing is breaking , it just needs additional lines to be able to work in my environment. |
Right. Then we can release it now and add fix in the next wave :) |
@Fokko - I actually released 1.0.0 (will be easier) and release 1.0.1 right after - 1.0.0 was the first release, no regression there. |
(both SFTP/Tabular will be rc1 then). |
Closing this one as providers are released. Thanks everyone. you rock! |
Body
I have a kind request for all the contributors to the latest provider packages release.
Could you please help us to test the RC versions of the providers?
Let us know in the comment, whether the issue is addressed.
Those are providers that require testing as there were some substantial changes introduced:
Provider airbyte: 3.1.0rc1
AirbyteHook
add cancel job option (#24593): @sivankumar86Provider alibaba: 2.0.1rc1
cached_property
(#24582): @josh-fellProvider amazon: 4.1.0rc1
SqsSensor
(#24554): @LaPetiteSourisemr_conn_id
should be optional inEmrCreateJobFlowOperator
(#24306): @pankajastrocached_property
(#24582): @josh-fellProvider apache.drill: 2.1.0rc1
Provider apache.druid: 3.1.0rc1
Provider apache.hdfs: 3.0.1rc1
WebHDFSHook
Bugfix/optional port (#24550): @ankurbajaj9Provider apache.hive: 3.1.0rc1
auth_mechanism
inHiveMetastoreHook
andHiveServer2Hook
(#24713): @eladkalProvider apache.pinot: 3.1.0rc1
Provider asana: 2.0.1rc1
cached_property
(#24582): @josh-fellProvider cncf.kubernetes: 4.2.0rc1
airflow_kpo_in_cluster
label to KPO pods (#24658): @jedcunninghamcached_property
(#24582): @josh-fellProvider databricks: 3.1.0rc1
cached_property
(#24582): @josh-fellProvider dbt.cloud: 2.0.1rc1
cached_property
(#24582): @josh-fellProvider docker: 3.1.0rc1
DockerOperator
fix cli.logs giving character array instead of string (#24726): @pasalkarsachin1Provider elasticsearch: 4.1.0rc1
Provider exasol: 3.1.0rc1
Provider facebook: 3.0.1rc1
cached_property
(#24582): @josh-fellProvider ftp: 3.1.0rc1
Provider github: 2.1.0rc1
GithubHook
(#24903): @josh-fellProvider google: 8.2.0rc1
cached_property
(#24582): @josh-fellProvider hashicorp: 3.0.1rc1
cached_property
(#24582): @josh-fellProvider http: 4.0.0rc1
Provider jdbc: 3.1.0rc1
Provider jira: 3.0.1rc1
Provider microsoft.azure: 4.1.0rc1
test_connection
method to AzureCosmosDBHook (#25018): @phanikumvcached_property
(#24582): @josh-fellProvider microsoft.mssql: 3.1.0rc1
Provider mysql: 3.1.0rc1
Provider odbc: 3.1.0rc1
Provider oracle: 3.2.0rc1
Provider postgres: 5.1.0rc1
Provider presto: 3.1.0rc1
Provider qubole: 3.1.0rc1
Provider salesforce: 5.0.0rc1
cached_property
(#24582): @josh-fellProvider sftp: 3.1.0rc1 !!! NOTE this one s removed for breaking changes that need 4.0.0 release.
actual_file_to_check
with renderedpath
(#24451): @remem9527Provider slack: 5.1.0rc1
Provider snowflake: 3.1.0rc1
Provider sqlite: 3.1.0rc1
Provider ssh: 3.1.0rc1
cached_property
(#24582): @josh-fellProvider tableau: 3.0.1rc1
Provider trino: 3.1.0rc1
Provider vertica: 3.1.0rc1
The guidelines on how to test providers can be found in
Verify providers by contributors
Committer
The text was updated successfully, but these errors were encountered: