Skip to content

F
ffm-baseline
Commit b13ae91c authored by 高雅喆's avatar 高雅喆
Browse files
Options

test_df

parent e146843c
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
eda/smart_rank/gyz_test.py
View file @ b13ae91c
...@@ -79,7 +79,7 @@ sparkConf = SparkConf().set("spark.hive.mapred.supports.subdirectories", "true") ...@@ -79,7 +79,7 @@ sparkConf = SparkConf().set("spark.hive.mapred.supports.subdirectories", "true")
.set("spark.sql.extensions", "org.apache.spark.sql.TiExtensions") \ .set("spark.sql.extensions", "org.apache.spark.sql.TiExtensions") \
.set("spark.tispark.pd.addresses", "172.16.40.170:2379").set("spark.io.compression.codec", "lzf") \ .set("spark.tispark.pd.addresses", "172.16.40.170:2379").set("spark.io.compression.codec", "lzf") \
.set("spark.driver.maxResultSize", "8g").set("spark.sql.avro.compression.codec", "snappy") .set("spark.driver.maxResultSize", "8g").set("spark.sql.avro.compression.codec", "snappy")
sc = SparkContex() sc = SparkContext()
sqlContext = SparkSession(sc) sqlContext = SparkSession(sc)
spark = SparkSession.builder.config(conf=sparkConf).enableHiveSupport().getOrCreate() spark = SparkSession.builder.config(conf=sparkConf).enableHiveSupport().getOrCreate()
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment