You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Describe the bug
Why do I only print Rust logs when I run code on Spark333 and execute SQL commands in Sparkshell? How do I print logs related to Scala?
import org.apache.spark.sql.SparkSession
val spark = SparkSession.builder().appName("Spark SQL Example").getOrCreate()
spark.sql("CREATE DATABASE IF NOT EXISTS test_db")
spark.sql("USE test_db")
spark.sql("DROP TABLE IF EXISTS test_table")
spark.sql("""
CREATE TABLE IF NOT EXISTS test_table (
id INT,
value DOUBLE
)
USING PARQUET
""")
val data = spark.range(100000).map(id => (
id,
Math.random() * 100,
)).toDF("id", "value")
data.write.mode("overwrite").insertInto("test_table")
sql("SELECT AVG(value) FROM test_table").show()
I found only rust log can be printed. So why?!
Screenshots
Desktop (please complete the following information):
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Describe the bug
Why do I only print Rust logs when I run code on Spark333 and execute SQL commands in Sparkshell? How do I print logs related to Scala?
To Reproduce
3.execute some code
Screenshots
Desktop (please complete the following information):
Beta Was this translation helpful? Give feedback.
All reactions