v24.02.3

Packages

• Maven Release: https://repo1.maven.org/maven2/com/nvidia/rapids-4-spark-tools_2.12/24.02.3/
• PyPI Package: https://pypi.org/project/spark-rapids-user-tools/24.02.3/

Changes

User Tools

• Cache CLI calls for node instance description (#952)
• Improve error handling in prediction code (#950)
• Support dynamic calculation of JVM resources in CLI cmd (#944)
• Syncup estimation model prediction logic updates (#946)
• Cluster inference should not run for unsupported platform (#941)
• Fix invalid values in cluster creation script (#935)
• Fix core tool doc links and user qualification tool default argument values (#931)
• Fix gpu cluster recommendation in user tools (#930)
• Bump idna from 3.4 to 3.7 in /data_validation (#932)
• Add cluster details in qualification summary output (#921)
• Refactor find_matches_for_node return values (#920)
• [FEA] Add and use g5 AWS instances as default for qualification tool output (#898)
• Add jar argument to spark_rapids CLI (#902)
• Support driverlog argument in profiler CLI (#897)

Core

• Followups on handling Photon eventlogs (#953)
• Sync operators support timestamped 24-04-16 (#951)
• Add CheckOverflowInTableInsert support: verify absence from physical plan (#942)
• Fix Notes column in the supported ops CSV files (#933)
• Improve sync plugin supported CSV python script (#919)
• Add cluster details in qualification summary output (#921)
• Add support for unsupported expressions reasons per Exec (#923)
• Adding more metrics and options for qual validation (#926)
• Generate cluster details in JSON output (#912)
• Add Divide and multiple interval expressions as supported (#917)
• Add support for PythonMapInArrowExec and MapInArrowExec (#913)
• Re-enable support for GetJsonObject by default (#916)
• Add support for WindowGroupLimitExec (#906)
• [FEA] Skip Spark Structured Streaming event logs for Qualification tool (#905)
• [FEA] Add and use g5 AWS instances as default for qualification tool output (#898)
• Initial version of qual tool validation script for classification metrics (#903)
• Fix Delta-core dependency for Spark35+ (#904)
• Add support for AtomicCreateTableAsSelectExec (#895)
• Add support for KnownNullable and EphemeralSubstring expressions (#894)
• Add Support for BloomFilterAggregate and BloomFilterMightContain exprs (#891)
• [DOC] Update README for sync plugin supported ops script (#893)
• Add operators to ignore list and update WindowExpr parser (#890)
• Add support to RoundCeil and RoundFloor expressions (#889)