Skip to content

F
ffm-baseline
Commit cdc1d255 authored by 王志伟's avatar 王志伟
Browse files
Options

重新跑数据

parent 7ee9d665
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
eda/feededa/src/main/scala/com/gmei/GmeiConfig.scala
View file @ cdc1d255
...@@ -37,6 +37,8 @@ object GmeiConfig extends Serializable { ...@@ -37,6 +37,8 @@ object GmeiConfig extends Serializable {
sparkConf.set("spark.debug.maxToStringFields", "130") sparkConf.set("spark.debug.maxToStringFields", "130")
sparkConf.set("spark.sql.broadcastTimeout", "6000") sparkConf.set("spark.sql.broadcastTimeout", "6000")
sparkConf.set("spark.tispark.plan.allow_index_read", "false") sparkConf.set("spark.tispark.plan.allow_index_read", "false")
sparkConf.set("spark.hive.mapred.supports.subdirectories","true")
sparkConf.set("spark.hadoop.mapreduce.input.fileinputformat.input.dir.recursive","true")
val spark = SparkSession val spark = SparkSession
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment