Skip to content

F
ffm-baseline
Commit 386d1cc0 authored by 高雅喆's avatar 高雅喆
Browse files
Options

update

parent f27fd87b
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
eda/smart_rank/gyz_test.py
View file @ 386d1cc0
...@@ -94,7 +94,7 @@ spark.sparkContext.setLogLevel("WARN") ...@@ -94,7 +94,7 @@ spark.sparkContext.setLogLevel("WARN")
spark.sparkContext.addPyFile("/srv/apps/ffm-baseline_git/eda/smart_rank/tool.py") spark.sparkContext.addPyFile("/srv/apps/ffm-baseline_git/eda/smart_rank/tool.py")
device_ids_lst_rdd = spark.sparkContext.parallelize(device_info) device_ids_lst_rdd = spark.sparkContext.parallelize(device_info)
result = device_ids_lst_rdd.repartition(100).map(lambda x: get_user_service_portrait(x, all_word_tags, all_tag_tag_type, all_3tag_2tag, all_tags_name, size=None, pay_time=pay_time)) result = device_ids_lst_rdd.repartition(100).map(lambda x: get_user_service_portrait(x, all_word_tags, all_tag_tag_type, all_3tag_2tag, all_tags_name, size=None, pay_time=pay_time))
# print(result.take(10)) print(result.take(10))
df = result.toDF() df = result.toDF()
df.show() df.show()
# result.write.format('csv').save("~/test_df.csv") # result.write.format('csv').save("~/test_df.csv")
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment