Async Redshifthook makes sync api calls.

[Mavtti]

Hello I wondered why in the RedshiftDataHook when running the async method get_query_status, the boto3 client is created in async while the api calls made with client.describe_statement are sync.

Why not make api calls async ?
Why not make client creation and api calls sync and only leave asyncio.sleep in async ?

astronomer-providers/astronomer/providers/amazon/aws/hooks/redshift_data.py

Lines 151 to 160 in 102b24f

	client = await sync_to_async(self.get_conn)()
	except ValueError:
	# for apache-airflow-providers-amazon>=4.1.0
	self.resource_type = None
	client = await sync_to_async(self.get_conn)()
	completed_ids: List[str] = []
	for query_id in query_ids:
	while await self.is_still_running(query_id):
	await asyncio.sleep(self.poll_interval)
	res = client.describe_statement(Id=query_id)

[pankajkoti]

@Mavtti can you check if aiobotocore supports async calls for Redshift? In our check, we cannot find a way. And since the major part of the task goes on waiting for the query to finish we focused on awaiting there and the other parts which are quite fast, we did not focus much on making them async. We're open to ideas, discussions, solutions and contribution for the community. Feel free to raise a PR if you believe we can optimise parts of the code.

[pankajkoti]

Closing this discussion as it appears stale.