Skip to content

F
ffm-baseline
Commit fff075d7 authored by Your Name's avatar Your Name
Browse files
Options

dist predict test

parent 149aa897
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
eda/esmm/Model_pipline/dist_predict.py
View file @ fff075d7
...@@ -269,7 +269,7 @@ if __name__ == "__main__": ...@@ -269,7 +269,7 @@ if __name__ == "__main__":
rdd_te_files = spark.sparkContext.parallelize(te_files) rdd_te_files = spark.sparkContext.parallelize(te_files)
print("-"*100) print("-"*100)
indices = rdd_te_files.repartition(40).map(lambda x: main(x)) indices = rdd_te_files.repartition(40).map(lambda x: main(x))
# print(indices.take(1)) print(indices.take(1))
print("dist predict nearby") print("dist predict nearby")
te_result_dataframe = spark.createDataFrame(indices.flatMap(lambda x: x.split(";")).map( te_result_dataframe = spark.createDataFrame(indices.flatMap(lambda x: x.split(";")).map(
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment