Skip to content

F
ffm-baseline
Commit 5612f78a authored by 张彦钊's avatar 张彦钊
Browse files
Options

修改特征工程文件

parent de0eec79
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 3 deletions
eda/esmm/Model_pipline/feature_engineering.py
View file @ 5612f78a
...@@ -371,9 +371,10 @@ if __name__ == '__main__': ...@@ -371,9 +371,10 @@ if __name__ == '__main__':
.set("spark.driver.maxResultSize", "8g").set("spark.sql.avro.compression.codec","snappy") .set("spark.driver.maxResultSize", "8g").set("spark.sql.avro.compression.codec","snappy")
spark = SparkSession.builder.config(conf=sparkConf).enableHiveSupport().getOrCreate() spark = SparkSession.builder.config(conf=sparkConf).enableHiveSupport().getOrCreate()
# ti = pti.TiContext(spark) ti = pti.TiContext(spark)
# ti.tidbMapDatabase("jerry_test") ti.tidbMapDatabase("jerry_test")
# ti.tidbMapDatabase("eagle") ti.tidbMapDatabase("jerry_prod")
ti.tidbMapDatabase("eagle")
spark.sparkContext.setLogLevel("WARN") spark.sparkContext.setLogLevel("WARN")
path = "hdfs:///strategy/esmm/" path = "hdfs:///strategy/esmm/"
local_path = "/home/gmuser/esmm/" local_path = "/home/gmuser/esmm/"
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment