4.1.1 Environment

Back to Master

Runtime Information

NameValue
Java Home/opt/java/openjdk
Java Version21.0.9 (Eclipse Adoptium)
Scala Versionversion 2.13.17

Spark Properties

NameValue
spark.cores.max1
spark.databricks.delta.catalog.enableServerSidePlanningfalse
spark.dynamicAllocation.enabledfalse
spark.executor.cores1
spark.executor.memory768m
spark.hadoop.fs.s3.implorg.apache.hadoop.fs.s3a.S3AFileSystem
spark.hadoop.fs.s3a.access.key*********(redacted)
spark.hadoop.fs.s3a.bucket.warehouse.access.key*********(redacted)
spark.hadoop.fs.s3a.bucket.warehouse.change.detection.modenone
spark.hadoop.fs.s3a.bucket.warehouse.connection.ssl.enabledfalse
spark.hadoop.fs.s3a.bucket.warehouse.endpointhttp://dbhp-datawarehouse-minio:9000
spark.hadoop.fs.s3a.bucket.warehouse.endpoint.regionus-east-1
spark.hadoop.fs.s3a.bucket.warehouse.path.style.accesstrue
spark.hadoop.fs.s3a.bucket.warehouse.secret.key*********(redacted)
spark.hadoop.fs.s3a.change.detection.modenone
spark.hadoop.fs.s3a.connection.ssl.enabledfalse
spark.hadoop.fs.s3a.endpointhttp://dbhp-datawarehouse-minio:9000
spark.hadoop.fs.s3a.endpoint.regionus-east-1
spark.hadoop.fs.s3a.path.style.accesstrue
spark.hadoop.fs.s3a.secret.key*********(redacted)
spark.jars.ivy/opt/spark/.ivy2
spark.scheduler.mode
spark.sql.catalog.spark_catalogorg.apache.spark.sql.delta.catalog.DeltaCatalog
spark.sql.catalog.unityio.unitycatalog.spark.UCSingleCatalog
spark.sql.catalog.unity.token*********(redacted)
spark.sql.catalog.unity.urihttp://dbhp-datawarehouse-unitycatalog-server:8080
spark.sql.defaultCatalogunity
spark.sql.extensionsio.delta.sql.DeltaSparkSessionExtension
spark.sql.warehouse.dirs3a://warehouse/
spark.ui.reverseProxytrue
spark.ui.reverseProxyUrlhttps://spark.dbhp-ms.staging.ufsc.br

Hadoop Properties

System Properties

Metrics Properties

Classpath Entries

Environment Variables