feat(warehouse): batching of alter add statements

[achettyiitr]

Description

Batching of ALTER ADD statements in order to optimize the Queries that run on the warehouse.

Currently, we are following running single ALTER ADD statement changes for new properties of the Schema. If we batch these, we don't need to run many Queries for these.

Notion Ticket

https://www.notion.so/rudderstacks/Use-batching-to-run-several-of-alter-statements-81ae26d5db6f4b2ca8e0258e3ce0cba6

Security

• The code changed/added as part of this pull request won't create any security issues with how the software is being used.

[codecov]

Codecov Report

Base: 44.09% // Head: 43.20% // Decreases project coverage by -0.88% ⚠️

Coverage data is based on head (916f845) compared to base (b6ce9b9).
Patch coverage: 1.04% of modified lines in pull request are covered.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2484      +/-   ##
==========================================
- Coverage   44.09%   43.20%   -0.89%     
==========================================
  Files         187      186       -1     
  Lines       39255    40041     +786     
==========================================
- Hits        17308    17300       -8     
- Misses      20843    21637     +794     
  Partials     1104     1104              

Impacted Files	Coverage Δ
warehouse/azure-synapse/azure-synapse.go	0.00% <0.00%> (ø)
warehouse/bigquery/bigquery.go	0.00% <0.00%> (ø)
warehouse/clickhouse/clickhouse.go	0.00% <0.00%> (ø)
warehouse/deltalake/deltalake.go	0.00% <0.00%> (ø)
warehouse/mssql/mssql.go	0.00% <0.00%> (ø)
warehouse/postgres/postgres.go	0.00% <0.00%> (ø)
warehouse/redshift/redshift.go	0.00% <0.00%> (ø)
warehouse/snowflake/snowflake.go	0.00% <0.00%> (ø)
warehouse/upload.go	18.39% <0.00%> (-0.16%)	⬇️
warehouse/utils/utils.go	70.18% <ø> (ø)
... and 8 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[lvrach]

The changes look good to me. Note: I don't have a lot of context on how those different warehouse work. I rely on automation tests to verify those changes.

I made a few non-blocking comments/suggestions

[achettyiitr]

The changes look good to me. Note: I don't have a lot of context on how those different warehouse work. I rely on automation tests to verify those changes.

Except for the Azure synapse and S3 Datalake (Glue), all destinations are covered with multiple columns for alter around Integration tests. So we are good here.

[achettyiitr]

The changes look good to me. Note: I don't have a lot of context on how those different warehouse work. I rely on automation tests to verify those changes.

Except for the Azure synapse and S3 Datalake (Glue), all destinations are covered with multiple columns for alter around Integration tests. So we are good here.

For Azure synapse, tested the changes locally.