Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
M
meta_base_code
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
黎涛
meta_base_code
Commits
19b6157d
Commit
19b6157d
authored
Nov 18, 2020
by
litaolemo
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update
parent
21d4e37d
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
5 deletions
+4
-5
daily_search_word_count.py
task/daily_search_word_count.py
+4
-5
No files found.
task/daily_search_word_count.py
View file @
19b6157d
...
...
@@ -194,7 +194,7 @@ for t in range(0, task_days):
nums
=
name
.
all_search_pv
uv
=
name
.
all_search_uv
partition_date
=
str
(
now
+
datetime
.
timedelta
(
days
=-
1
))
tag_names_list_week
.
append
((
word
,
nums
,
uv
,
partition_date
))
tag_names_list_week
.
append
((
word
,
nums
,
uv
,
partition_date
))
db
=
pymysql
.
connect
(
host
=
'172.16.40.158'
,
port
=
4000
,
user
=
'st_user'
,
passwd
=
'aqpuBLYzEV7tML5RPsN1pntUzFy'
,
db
=
'jerry_prod'
)
...
...
@@ -202,15 +202,14 @@ for t in range(0, task_days):
insert_sql
=
"replace into daily_search_word_count(word, nums, uv,pid,partition_day) VALUES(
%
s,
%
s,
%
s,
%
s,
%
s)"
insert_list
=
[]
for
count
,
item
in
enumerate
(
tag_names_list_week
):
word
,
nums
,
uv
,
date_str
=
item
partition_date
=
date_str
word
,
nums
,
uv
,
partition_date
=
item
try
:
pid
=
hashlib
.
md5
((
partition_date
+
word
)
.
encode
(
"utf8"
))
.
hexdigest
()
insert_sql_tuple
=
(
word
,
nums
,
uv
,
pid
,
date_str
)
insert_sql_tuple
=
(
word
,
nums
,
uv
,
pid
,
partition_date
)
insert_list
.
append
(
insert_sql_tuple
)
print
(
insert_sql_tuple
)
except
:
continue
print
(
insert_sql
)
if
count
%
100
==
0
:
cursor
.
execute
(
"set names 'UTF8'"
)
res
=
cursor
.
executemany
(
insert_sql
,
insert_list
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment