Kyuubi 1.6 compatibility with Hadoop

[nishanth5028]

Hi Everyone,
I am exploring Kyuubi and am trying to setup Kyuubi to help query the delta table stored on S3(on prem). I am trying to setup Kyuubi on the local dev cluster and I am running into the below error which I think is related to hadoop compatibility of Kyuubi, please correct me if my understanding is wrong

I'm using below versions
Kyuubi 1.6.0
Hadoop 3.2.2.4-6
Spark 3.2.2.4-6

I couldn't get from the releases page what version of Kyuubi is compatible with Hadoop 3.2.x . Appreciate the help from the community.

org.apache. kyuubi.jdbc.hive.KyuubiSQLException: org.apache.kyuubi. KyuubiSQLException: org.apache.kyuubi. KyuubiSQLException: Error operating ExecuteStatement: java.lang.NoClassDefFoundError: org/apache/hadoop/fs/statistics/I0Statistics Source
at java.lang.ClassLoader.defineClass1 (Native Method)
at java.lang.ClassLoader.defineClass (ClassLoader.java:756)
at java.security.SecureClassLoader.defineClass(SecureClass Loader.java:142)
at java.net. URLClassLoader.defineClass (URLClassLoader.java:468)
at java.net. URLClassLoader.access$100 (URLClassLoader.java:74)
at java.net. URLClass Loader$1.run(URLClassLoader.java: 369)
at java.net. URLClass Loader$1.run(URLClassLoader.java:363)
at java.security. Access Controller.doPrivileged (Native Method)
at java.net.URLClassLoader.findClass(URLClass Loader.java:362)
at java.lang.ClassLoader.loadClass(ClassLoader.java: 418)
at java.lang.ClassLoader.loadClass(ClassLoader.java:351)
at java.lang.Class. forName (Native Method)
at java.lang.Class. forName (Class.java:348)
at org.apache.hadoop.conf. Configuration.getClass ByName0rNull(Configuration.java: 2573)
at org.apache.hadoop.conf. Configuration.getClass ByName (Configuration.java: 2538)
at org.apache.hadoop.conf. Configuration.getClass(Configuration.java: 2634)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass (FileSystem.java: 3341)
at org.apache.hadoop.fs.FileSystem.createFileSystem (FileSystem.java: 3373)
at org.apache.hadoop.fs.FileSystem.access $200 (FileSystem.java:125)
at org.apache.hadoop.fs.FileSystem $Cache.getInternal (FileSystem.java: 3424)
at org.apache.hadoop.fs.FileSystem$Cache.get (FileSystem. java:3392)
at org.apache.hadoop.fs.FileSystem.get (FileSystem.java: 485)
at org.apache.hadoop.fs. Path.getFileSystem (Path.java:365)
at org.apache.spark.sql.delta.DeltaLog$.apply(DeltaLog.scala:584)
at org.apache.spark.sql.delta. DeltaLog$.forTable (Deltalog.scala:511)
at org.apache.spark.sql.delta.catalog.Delta TableV2.deltaLog$lzycompute(Delta TableV2.scala:85)
at org.apache.spark.sql.delta.catalog. Delta TableV2.delta Log(DeltaTableV2.scala:85)
at org.apache.spark.sql.delta.catalog.Delta TableV2. $anonfun$snapshot $3 (DeltaTableV2.scala: 114)
at scala.Option.get0rElse (Option.scala: 189)
at org.apache.spark.sql.delta.catalog. DeltaTableV2.snapshot$lzycompute(DeltaTableV2.scala:114)
at org.apache.spark.sql.delta.catalog.Delta TableV2.snapshot(DeltaTableV2.scala:102)
at org.apache.spark.sql.delta.catalog.Delta TableV2.tableSchema $lzycompute(Delta TableV2.scala:120)
at org.apache.spark.sql.delta.catalog. DeltaTableV2.tableSchema (DeltaTableV2.scala:118)
at org.apache.spark.sql.delta.catalog. Delta TableV2.schema (Delta TableV2.scala:122)
at org.apache.spark.sql.execution.datasources.v2.DataSourceV2Relation$.create (DataSourceV2Relation.scala:175)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $.$anonfun$lookupRelation $1(Analyzer.scala:1277)
at scala.Option.map (Option.scala:230)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $. loaded $lzycompute$1(Analyzer. scala:1250)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $. loaded $1(Analyzer.scala: 1250)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $.$anonfun$lookupRelation $3 (Analyzer.scala:1287)
at scala.Option.orElse (Option.scala: 447)
at org.apache.spark.sql.catalyst. analysis. Analyzer$ResolveRelations $.org$apache$spark$sql$catalyst$analysis $Analyzer $ResolveRelations $$lookupRelation (Analyzer.scala:1286)
at org.apache.spark.sql.catalyst.analysis. Analyzer$Resolve Relations$$anonfun$apply$15.apply0rElse (Analyzer.scala:1204)
at org.apache.spark.sql.catalyst.analysis. Analyzer$Resolve Relations $$anonfun$apply$15.apply0rElse (Analyzer.scala: 1167)
at org.apache.spark.sql.catalyst.plans.logical. Analysis Helper. $anonfun$resolveOperators UpWithPruning$3(Analysis Helper.scala: 138)
at org.apache.spark.sql.catalyst.trees. CurrentOrigin$.withOrigin (TreeNode.scala:82)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$1(AnalysisHelper.scala: 138)
at org.apache.spark.sql.catalyst.plans.logical. Analysis Helper$.allowInvoking Transforms InAnalyzer (Analysis Helper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning (AnalysisHelper.scala:134)
at org.apache.spark.sql.catalyst.plans.logical. Analysis Helper.resolveOperators UpWithPruning $(Analysis Helper.scala:130)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperators UpWithPruning (LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans. logical.Analysis Helper.$anonfun$resolveOperatorsUpWithPruning $2 (Analysis Helper.scala: 135)
at org.apache.spark.sql.catalyst.trees. UnaryLike.mapChildren (TreeNode.scala:1128)
at org.apache.spark.sql.catalyst.trees. Una ryLike.mapChildren$(TreeNode.scala:1127)
at org.apache.spark.sql.catalyst.plans.logical.OrderPreservingUna ryNode.mapChildren (LogicalPlan.scala:206)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper. $anonfun$resolveOperatorsUpWithPruning $1(Analysis Helper.scala: 135)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper$.allowInvoking Transforms InAnalyzer (AnalysisHelper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning (AnalysisHelper.scala:134)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperators UpWithPruning$(AnalysisHelper.scala:130)
at org.apache.spark.sql.catalyst.plans. logical.LogicalPlan. resolveOperatorsUpWithPruning (LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning $2 (AnalysisHelper.scala:135)
at org.apache.spark.sql.catalyst.trees. UnaryLike.mapChildren (TreeNode.scala:1128)
at org.apache.spark.sql.catalyst.trees. Una ryLike.mapChildren$(TreeNode.scala:1127)
at org.apache.spark.sql.catalyst.plans.logical. Order Preserving Una ryNode.mapChildren (LogicalPlan.scala: 206)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$1(AnalysisHelper.scala:135)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper$.allowInvokingTransforms InAnalyzer (AnalysisHelper.scala:323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning (AnalysisHelper.scala:134)
at org.apache.spark.sql.catalyst.plans.logical. Analysis Helper.resolveOperatorsUpWithPruning $(AnalysisHelper.scala: 130)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan. resolveOperatorsUpWithPruning (LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.analysis. Analyzer $ResolveRelations $.apply(Analyzer.scala:1167)
at org.apache.spark.sql.catalyst.analysis. Analyzer $ResolveRelations $.apply (Analyzer.scala:1133)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$execute$2 (RuleExecutor. scala:211)
at scala.collection. LinearSeqOptimized. fold Left (LinearSeqOptimized.scala:126)
at scala.collection. LinearSeqOptimized. foldLeft$(LinearSeqOptimized.scala:122)
at scala.collection.immutable.List.fold Left (List.scala:91)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$execute$1(RuleExecutor. scala:208)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$execute$1$adapted (RuleExecutor.scala:200)
at scala.collection.immutable.List. foreach(List.scala:431)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:200)
at org.apache.spark.sql.catalyst.analysis. Analyzer.org$apache$spark$sql$catalyst$analysis $Analyzer$$executeSameContext(Analyzer.scala:215)
at org.apache.spark.sql.catalyst.analysis. Analyzer.execute(Analyzer.scala:209)
at org.apache.spark.sql.catalyst. analysis. Analyzer.execute(Analyzer.scala:172)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$executeAndTrack$1(RuleExecutor.scala:179)
at org.apache.spark.sql.catalyst.QueryPlanning Tracker$.withTracker(QueryPlanningTracker.scala:88)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack (RuleExecutor.scala:179)
at org.apache.spark.sql.catalyst.analysis. Analyzer. $anonfun$executeAndCheck$1(Analyzer.scala: 193)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper$.markInAnalyzer (AnalysisHelper.scala:330)
at org.apache.spark.sql.catalyst.analysis. Analyzer.executeAndCheck (Analyzer.scala:192)
at org.apache.spark.sql.execution. QueryExecution. $anonfun$analyzed $1(QueryExecution.scala:88)
at org.apache.spark.sql.catalyst. QueryPlanning Tracker.measurePhase (QueryPlanningTracker.scala:111)
at org.apache.spark.sql.execution. QueryExecution. $anonfun$executePhase$1(QueryExecution.scala: 196)
at org.apache.spark.sql.SparkSession.withActive (SparkSession.scala: 775)
at org.apache.spark.sql.execution. QueryExecution.executePhase (QueryExecution.scala:196)
at org.apache.spark.sql.execution. QueryExecution.analyzed $lzycompute(QueryExecution.scala:88)
at org.apache.spark.sql.execution. QueryExecution.analyzed (QueryExecution.scala:86)
at org.apache.spark.sql.execution. QueryExecution.assertAnalyzed (QueryExecution.scala:78)
at org.apache.spark.sql.Dataset$.$anonfun$ofRows $2 (Dataset.scala:98)
at org.apache.spark.sql.SparkSession.withActive(SparkSession.scala: 775)
at org.apache.spark.sql.Dataset$.ofRows(Dataset.scala:96)
at org.apache.spark.sql.SparkSession.$anonfun$sql$1 (SparkSession.scala: 618)
at org.apache.spark.sql.SparkSession. withActive (SparkSession.scala:775)
at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:613)
at org.apache.kyuubi.engine.spark.operation. ExecuteStatement. $anonfun$executeStatement $1(ExecuteStatement.scala:94)
at scala.runtime.java8.JFunction0$mcV$sp.apply (JFunction $mcV$sp.java:23)
at org.apache.kyuubi.engine.spark.operation. SparkOperation withLocalProperties (SparkOperation.scala:87)
at org.apache.kyuubi.engine.spark. operation. ExecuteStatement.org $apache$kyuubi$engine$spark$operation $ExecuteStatement $$executeStatement (ExecuteStatement.scala:89)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement $$anon$1. run (ExecuteStatement.scala:125)
at java.util.concurrent.Executors $RunnableAdapter.call(Executors.java:511)
at java.util.concurrent. FutureTask.run(FutureTask.java:266)
at java.util.concurrent.Thread PoolExecutor.runWorker (ThreadPoolExecutor.java: 1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run (Thread.java:748)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.statistics.I0StatisticsSource
at java.net. URLClass Loader.findClass (URLClassLoader.java: 382)
at java.lang. ClassLoader.loadClass(Class Loader.java:418)
at java.lang.ClassLoader.loadClass (ClassLoader.java:351)
... 112 more
at org.apache.kyuubi.KyuubiSQLException$.apply(KyuubiSQLException.scala:69)
at org.apache.kyuubi.engine.spark.operation. SparkOperation$$anonfun$onError $1.apply0rElse (SparkOperation.scala:112)
at org.apache.kyuubi.engine.spark.operation. SparkOperation$$anonfun$onError$1.apply0rElse (SparkOperation.scala:96)
at scala.runtime.AbstractPartialFunction.apply(AbstractPartialFunction.scala:38)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement. $anonfun$executeStatement $1(ExecuteStatement.scala:113)
at scala.runtime.java8.JFunction0$mcV$sp.apply (JFunction0$mcV$sp.java:23)
at org.apache.kyuubi.engine.spark.operation. SparkOperation withLocalProperties (SparkOperation.scala:87)
at org.apache.kyuubi.engine.spark.operation.ExecuteStatement.org$apache$kyuubi$engine$spark$operation $ExecuteStatement $$executeStatement (ExecuteStatement.scala:89)
at org.apache.kyuubi.engine.spark.operation. ExecuteStatement $$anon$1. run (ExecuteStatement.scala:125)
at java.util.concurrent. Executors $RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask. run (FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
aused by: java.lang.NoClassDefFoundError: org/apache/hadoop/fs/statistics/I0Statistics Source
at java.lang. ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass (ClassLoader.java:756)
at java.security.SecureClassLoader.defineClass (SecureClassLoader.java: 142)
at java.net. URLClassLoader.defineClass(URLClass Loader.java:468)
at java.net. URL ClassLoader.access$100 (URLClassLoader.java:74)
at java.net. URLClassLoader$ 1. run (URLClassLoader.java: 369)
at java.net. URLClassLoader$1.run(URLClassLoader.java:363)
at java.security. Access Controller.doPrivileged (Native Method)
at java.net. URLClassLoader.findClass(URLClass Loader.java:362)
at java.lang.ClassLoader.loadClass (ClassLoader.java:418)
at
java.lang.ClassLoader.loadClass(ClassLoader.java:351)
at java.lang.Class. forName (Native Method)
at java.lang.Class. forName (Class.java:348)
at org.apache.hadoop.conf. Configuration.getClassByName0rNull(Configuration.java: 2573)
at org.apache.hadoop.conf.Configuration.getClass ByName(Configuration.java:2538)
at org.apache.hadoop.conf. Configuration.getClass (Configuration.java: 2634)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass (FileSystem.java: 3341)
at org.apache.hadoop.fs.FileSystem. createFileSystem (FileSystem.java: 3373)
at org.apache.hadoop.fs.FileSystem.access$200 (FileSystem.java: 125)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3424)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem. java: 3392)
at org.apache.hadoop.fs.FileSystem.get (FileSystem.java:485)
at org.apache.hadoop.fs. Path.getFileSystem (Path.java: 365)
at org.apache.spark.sql.delta.Delta Log$.apply(DeltaLog.scala: 584)
at org.apache.spark.sql.delta. Delta Log $. for Table (Delta Log .scala:511)
at org.apache.spark.sql.delta.catalog. DeltaTableV2.deltaLog$lzycompute(DeltaTableV2.scala:85)
at org.apache.spark.sql.delta.catalog.Delta TableV2.delta Log (Delta TableV2.scala:85)
at org.apache.spark.sql.delta.catalog. DeltaTableV2. $anonfun$snapshot $3 (DeltaTableV2.scala:114)
at scala. Option.getOrElse (Option.scala:189)
at org.apache.spark.sql.delta.catalog. DeltaTableV2.snapshot $lzycompute(DeltaTableV2.scala:114)
at org.apache.spark.sql.delta.catalog.Delta TableV2.snapshot (DeltaTableV2.scala:102)
at org.apache.spark.sql.delta.catalog. DeltaTableV2.tableSchema $lzycompute (DeltaTableV2.scala:120)
at org.apache.spark.sql.delta.catalog.Delta TableV2.tableSchema (DeltaTableV2.scala:118)
at org.apache.spark.sql.delta.catalog.Delta TableV2.schema (Delta TableV2.scala:122)
at org.apache.spark.sql.execution.datasources.v2.DataSourceV2Relation$.create(DataSourceV2Relation.scala: 175)
at org.apache.spark.sql.catalyst.analysis. Analyzer$Resolve Relations $.$anonfun$lookupRelation$1(Analyzer.scala:1277)
at scala.Option.map (Option.scala:230)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations$. loaded $lzycompute$1(Analyzer.scala: 1250)
at org.apache.spark.sql.catalyst.analysis. Analyzer $ ResolveRelations $. loaded $1(Analyzer.scala: 1250)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $.$anonfun$lookupRelation $3 (Analyzer.scala:1287)
at scala. Option.orElse (Option.scala: 447)
at org.apache.spark.sql.catalyst.analysis. Analyzer $ Resolve Relations$.org$apache$spark$sql$catalyst$analysis $Analyzer $ Resolve Relations $$lookupRelation (Analyzer.scala:1286)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations$$anonfun$apply$15.apply0rElse (Analyzer.scala:1204)
at org.apache.spark.sql.catalyst.analysis. Analyzer $ResolveRelations$$anonfun$apply$15.apply0rElse (Analyzer.scala:1167)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning$3 (AnalysisHelper.scala:138)
at org.apache.spark.sql.catalyst.trees. CurrentOrigin$.withOrigin (TreeNode.scala:82)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning $1(AnalysisHelper.scala: 138)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper$.allowInvoking Transforms InAnalyzer (AnalysisHelper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning (AnalysisHelper.scala: 134)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning$(AnalysisHelper.scala:130)
at org.apache.spark.sql.catalyst.plans. logical.LogicalPlan. resolveOperatorsUpWithPruning (LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning $2 (AnalysisHelper.scala:135)
at org.apache.spark.sql.catalyst.trees. UnaryLike.mapChildren(TreeNode.scala:1128)
at org.apache.spark.sql.catalyst.trees. UnaryLike.mapChildren$(TreeNode.scala:1127)
at org.apache.spark.sql.catalyst.plans.logical. OrderPreservingUnaryNode.mapChildren (LogicalPlan.scala:206)
at org.apache.spark.sql.catalyst.plans.logical. Analysis Helper. $anonfun$resolveOperators UpWithPruning$1(Analysis Helper.scala: 135)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper$.allowInvoking Transforms InAnalyzer (AnalysisHelper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning (AnalysisHelper.scala:134)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperators UpWithPruning$(AnalysisHelper.scala:130)
at org.apache.spark.sal.catalyst.plans-logical.LogicalPlan. resolveOperatorsUpWithPruning(LogicalPlan.scala:30)
spark.hadoop.fs.s3a.impl=org.apache.hadoop.fs.s3a. kyuubi_1.6_logs.dat x application_1704430108401_25711
at org.apache.spark.sql.catalyst.analysis. Analyzer $ResolveRelations $. loaded $1(Analyzer.scala:1250)
at org.apache.spark.sql. catalyst.analysis. Analyzer$ResolveRelations $.$anonfun$lookupRelation $3 (Analyzer.scala:1287)
at scala.Option.orElse (Option.scala:447)
at org.apache.spark.sql.catalyst.analysis. Analyzer$Resolve Relations $.org$apache$spark$sql$catalyst$analysis $Analyzer $Resolve Relations $$lookupRelation (Analyzer.scala:1286)
at org.apache.spark.sql.catalyst.analysis. Analyzer $ ResolveRelations$$anonfun$apply$15.apply0rElse (Analyzer.scala:1204)
at org.apache.spark.sql.catalyst.analysis. Analyzer$Resolve Relations$$anonfun$apply$15.apply0rElse (Analyzer.scala:1167)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning $3 (AnalysisHelper.scala: 138)
at org.apache.spark.sql.catalyst.trees. CurrentOrigin$.withOrigin (TreeNode.scala:82)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper. $anonfun$resolveOperatorsUpWithPruning $1(Analysis Helper.scala: 138)
at org.apache.spark.sql.catalyst.plans. logical.AnalysisHelper$.allowInvokingTransforms InAnalyzer (AnalysisHelper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning (AnalysisHelper .scala:134)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning$(AnalysisHelper.scala:130)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan. resolveOperatorsUpWithPruning (LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper. $anonfun$resolveOperatorsUpWithPruning $2 (AnalysisHelper.scala: 135)
at org.apache.spark.sql.catalyst.trees. Una ryLike.mapChildren (TreeNode.scala: 1128)
at org.apache.spark.sql.catalyst.trees. Una ryLike.mapChildren$(TreeNode.scala:1127)
at org.apache.spark.sql.catalyst.plans.logical.OrderPreservingUnaryNode.mapChildren (LogicalPlan.scala: 206)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper. $anonfun$resolveOperatorsUpWithPruning $1(AnalysisHelper.scala:135)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper$.allowInvoking Transforms InAnalyzer (AnalysisHelper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperators UpWithPruning (AnalysisHelper.scala:134)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper.resolveOperators UpWithPruning$(AnalysisHelper.scala:130)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan. resolveOperatorsUpWithPruning (LogicalPlan .scala:30)
at org.apache.spark.sql.catalyst.plans. logical. AnalysisHelper. $anonfun$resolveOperatorsUpWithPruning $2 (AnalysisHelper.scala: 135)
at org.apache.spark.sql.catalyst.trees. Una ryLike.mapChildren (TreeNode.scala:1128)
at org.apache.spark.sql.catalyst.trees. UnaryLike.mapChildren$(TreeNode.scala:1127)
at org.apache.spark.sql.catalyst.plans.logical. OrderPreservingUnaryNode.mapChildren (LogicalPlan.scala:206)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.$anonfun$resolveOperatorsUpWithPruning $1(AnalysisHelper.scala:135)
at org.apache.spark.sql.catalyst.plans.logical.AnalysisHelper$.allowInvokingTransforms InAnalyzer (AnalysisHelper.scala: 323)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperators UpWithPruning (AnalysisHelper.scala: 134)
at org.apache.spark.sql.catalyst.plans.logical. AnalysisHelper.resolveOperatorsUpWithPruning $(AnalysisHelper.scala:130)
at org.apache.spark.sql.catalyst.plans.logical.LogicalPlan.resolveOperators UpWithPruning (LogicalPlan.scala:30)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $.apply(Analyzer. scala:1167)
at org.apache.spark.sql.catalyst.analysis. Analyzer$ResolveRelations $.apply(Analyzer.scala:1133)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$execute$2 (RuleExecutor.scala:211)
at scala.collection. LinearSeqOptimized. foldLeft (LinearSeqOptimized.scala:126)
at scala.collection. LinearSeqOptimized. foldLeft$(LinearSeqOptimized.scala:122)
at scala.collection.immutable. List.fold Left (List.scala:91)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$execute$1(RuleExecutor.scala:208)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$execute$1$adapted (RuleExecutor.scala:200)
at scala.collection.immutable. List.foreach(List.scala:431)
at org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:200)
at org.apache.spark.sql.catalyst.analysis. Analyzer.org $apache$spark$sql$catalyst$analysis $Analyzer$$executeSameContext (Analyzer.scala:215)
at org.apache.spark.sql.catalyst.analysis. Analyzer.execute(Analyzer.scala:209)
at org.apache.spark.sql.catalyst.analysis. Analyzer.execute(Analyzer.scala:172)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. $anonfun$executeAndTrack$1(RuleExecutor.scala:179)
at org.apache.spark.sql.catalyst.QueryPlanning Tracker$.withTracker(QueryPlanningTracker.scala:88)
at org.apache.spark.sql.catalyst.rules.RuleExecutor. executeAndTrack (RuleExecutor.scala:179)
at org.apache.spark.sql.catalyst.analysis. Analyzer. $anonfun$executeAndCheck$1(Analyzer.scala:193)
at org.apache.spark.sql.catalyst.plans. logical.AnalysisHelper$.markInAnalyzer (AnalysisHelper.scala:330)
at org.apache.spark.sql.catalyst.analysis. Analyzer.executeAndCheck(Analyzer.scala:192)
at org.apache.spark.sql.execution. QueryExecution. $anonfun$analyzed $1(QueryExecution.scala:88)
at org.apache.spark.sql.catalyst.QueryPlanning Tracker.measurePhase (Query Planning Tracker.scala:111)
at org.apache.spark.sql.execution. QueryExecution. $anonfun$executePhase$1(QueryExecution.scala:196)
at org.apache.spark.sql.SparkSession.withActive (SparkSession.scala: 775)
at org.apache.spark.sql.execution. QueryExecution.execute Phase (QueryExecution.scala: 196)
at org.apache.spark.sql.execution. QueryExecution.analyzed $lzycompute(QueryExecution.scala:88)
at org.apache.spark.sql.execution. QueryExecution.analyzed (QueryExecution.scala:86)
at org.apache.spark.sql.execution. QueryExecution.assertAnalyzed (QueryExecution.scala:78)
at org.apache.spark.sql.Dataset$.$anonfun$ofRows $2 (Dataset.scala:98)
at org.apache.spark.sql.SparkSession.withActive (SparkSession.scala: 775)
at org.apache.spark.sql.Dataset$.ofRows (Dataset.scala:96)
at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala: 618)
at org.apache.spark.sql.SparkSession.withActive (SparkSession.scala: 775)
at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:613)
at org.apache.kyuubi.engine.spark.operation. ExecuteStatement. $anonfun$executeStatement $1(ExecuteStatement.scala:94)
9 more
Caused by: java.lang.ClassNot FoundException: org.apache.hadoop.fs.statistics.IOStatistics Source
at java.net. URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang. ClassLoader.loadClass (ClassLoader.java: 418)
at java.lang.ClassLoader.loadClass(ClassLoader.java: 351)
112 more
at org.apache. kyuubi. KyuubiSQLException$.apply(KyuubiSQLException.scala:69)
at org.apache.kyuubi.operation.ExecuteStatement.waitStatement Complete (ExecuteStatement.scala:119)
at org.apache.kyuubi.operation.ExecuteStatement. $anonfun$runInternal$1(ExecuteStatement.scala: 154)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent. FutureTask.run (FutureTask.java: 266)
at java.util.concurrent.ThreadPoolExecutor.runWorker (ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:624)
at java.lang.Thread.run (Thread.java: 750)
at org.apache.kyuubi.jdbc.hive.KyuubiStatement.waitForOperationToComplete (KyuubiStatement.java: 350)
at org.apache.kyuubi.jdbc.hive.KyuubiStatement.executeWith ConfOverlay(KyuubiStatement.java: 196)
at org.apache.kyuubi.jdbc.hive.KyuubiStatement.execute (KyuubiStatement.java: 190)
at org.apache.kyuubi.jdbc.hive.KyuubiStatement.executeQuery (KyuubiStatement.java:397)
at org.apache.kyuubi.jdbc.hive.KyuubiPreparedStatement.executeQuery(KyuubiPreparedStatement.java:72)
at org.apache.spark.sql.execution.datasources.jdbc. JDBCRDD$.getQueryOutputSchema (JDBCRDD.scala:67)
at org.apache.spark.sql.execution.datasources.jdbc. JDBCRDD$. resolveTable (JDBCRDD.scala:57)
at org.apache.spark.sql.execution.datasources.jdbc.JDBCRelation$.getSchema (JDBCRelation.scala: 239)
at org.apache.spark.sql.execution.datasources.jdbc.JdbcRelation Provider.createRelation (JdbcRelation Provider.scala:36)
at org.apache.spark.sql.execution.datasources.DataSource. resolveRelation (DataSource.scala: 350)
at org.apache.spark.sql.DataFrameReader.loadV1Source (DataFrameReader.scala:274)
at org.apache.spark.sql.DataFrameReader. $anonfun$load $3 (DataFrameReader.scala:245)
at scala. Option.get0rElse (Option.scala:189)
at org.apache.spark.sql.DataFrameReader.load (DataFrameReader.scala: 245)
at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:174)
... 49 elided

[pan3793]

can you try to run the same query in vanilla spark-shell or spark-sql? I suppose you will meet the same error. basically, the Hadoop compatibility depends on your Spark client, the Kyuubi engine is just a normal Spark application.

[pan3793]

I hope this slides could help you understand the relationship between Kyuubi and Spark.

[nishanth5028]

Yes, Im able to run the query through spark-shell. It’s confusing why this dependency is required when executing through kyuubi .

[pan3793]

Have you configured $KYUUBI_HOME/conf/kyuubi-env.sh properly? e.g. the SPAKR_HOME should point to your customized Spark 3.2.2.4-6, and other env vars like HADOOP_CONF_DIR should be set properly too.

[nishanth5028]

I figured that this issue occured because of version incompatibility of hadoop-aws and aws-java-sdk-bundle jars . I corrected them to use aws-java-sdk-bundle-1.11.271 for compatibility with my hadoop version. Thanks for pointing me to think about configuration.

[pan3793]

np, glad to know u addressed the issue.