Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
F
ffm-baseline
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
ML
ffm-baseline
Commits
54bb47f7
Commit
54bb47f7
authored
Aug 16, 2019
by
高雅喆
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update
parent
a2845f38
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
2 deletions
+6
-2
dist_update_user_portrait.py
eda/smart_rank/dist_update_user_portrait.py
+6
-2
No files found.
eda/smart_rank/dist_update_user_portrait.py
View file @
54bb47f7
...
...
@@ -145,8 +145,12 @@ if __name__ == '__main__':
result
=
device_ids_lst_rdd
.
repartition
(
100
)
.
map
(
lambda
x
:
get_user_tag_score
(
x
,
all_log_df
))
a
=
result
.
collect
()
print
(
a
)
print
(
type
(
a
))
# stat_date = datetime.datetime.today().strftime('%Y-%m-%d')
stat_date
=
datetime
.
datetime
.
today
()
.
strftime
(
'
%
Y-
%
m-
%
d'
)
for
i
in
a
:
insert_sql
=
"insert into user_portrait_tags values({stat_date},{cl_id},{tag_list})"
\
.
format
(
stat_date
=
stat_date
,
cl_id
=
i
[
0
],
tag_list
=
json
.
dumps
(
i
[
1
]))
# result_last = result_rename.withColumn("stat_date", lit(stat_date))
# result_last.show()
# df = result_last.select("stat_date", "cl_id", concat_ws(',', 'tag_list').alias("tag_list"))
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment