Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
M
meta_base_code
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
黎涛
meta_base_code
Commits
ab678363
Commit
ab678363
authored
Sep 23, 2020
by
litaolemo
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update
parent
f208f919
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
7 deletions
+7
-7
func_from_es_get_article.py
utils/func_from_es_get_article.py
+7
-7
No files found.
utils/func_from_es_get_article.py
View file @
ab678363
...
@@ -354,23 +354,23 @@ def get_user_post_from_mysql(sql):
...
@@ -354,23 +354,23 @@ def get_user_post_from_mysql(sql):
tags_v3_tractate_dict
=
{}
tags_v3_tractate_dict
=
{}
sql_res
=
con_sql_doris_prod
(
sql
)
sql_res
=
con_sql_doris_prod
(
sql
)
for
card_id
in
sql_res
:
for
card_id
in
sql_res
:
print
(
type
(
card_id
),
card_id
)
# print(type(card_id[0]
),card_id)
es_res
=
get_diary_from_mysql
(
card_id
,
id_type
=
'diary'
)
es_res
=
get_diary_from_mysql
(
card_id
[
0
]
,
id_type
=
'diary'
)
second_demands_tractate_dict
[
card_id
]
=
es_res
[
"_source"
][
"second_demands"
]
second_demands_tractate_dict
[
card_id
[
0
]
]
=
es_res
[
"_source"
][
"second_demands"
]
tags_v3_tractate_dict
[
card_id
]
=
es_res
[
"_source"
][
"tags_v3"
]
tags_v3_tractate_dict
[
card_id
[
0
]
]
=
es_res
[
"_source"
][
"tags_v3"
]
for
position
in
es_res
[
"_source"
][
"second_demands"
]:
for
position
in
es_res
[
"_source"
][
"second_demands"
]:
if
position
in
second_demands_count_dict
:
if
position
in
second_demands_count_dict
:
second_demands_count_dict
[
position
]
+=
1
second_demands_count_dict
[
position
]
+=
1
else
:
else
:
second_demands_count_dict
[
position
]
=
1
second_demands_count_dict
[
position
]
=
1
second_demands_card_id_list
.
append
(
int
(
card_id
))
second_demands_card_id_list
.
append
(
int
(
card_id
[
0
]
))
for
tag
in
es_res
[
"_source"
][
"tags_v3"
]:
for
tag
in
es_res
[
"_source"
][
"tags_v3"
]:
if
tag
in
tags_v3_count_dict
:
if
tag
in
tags_v3_count_dict
:
tags_v3_count_dict
[
tag
]
+=
1
tags_v3_count_dict
[
tag
]
+=
1
else
:
else
:
tags_v3_count_dict
[
tag
]
=
1
tags_v3_count_dict
[
tag
]
=
1
tags_v3_card_id_list
.
append
(
int
(
card_id
))
tags_v3_card_id_list
.
append
(
int
(
card_id
[
0
]
))
# print(card_id_list)
# print(card_id_list)
return
second_demands_count_dict
,
tags_v3_count_dict
,
second_demands_card_id_list
,
tags_v3_card_id_list
,
second_demands_tractate_dict
,
tags_v3_tractate_dict
return
second_demands_count_dict
,
tags_v3_count_dict
,
second_demands_card_id_list
,
tags_v3_card_id_list
,
second_demands_tractate_dict
,
tags_v3_tractate_dict
...
@@ -386,7 +386,7 @@ def get_diary_from_mysql(sql,id_type='tractate'):
...
@@ -386,7 +386,7 @@ def get_diary_from_mysql(sql,id_type='tractate'):
sql_res
=
con_sql_doris_prod
(
sql
)
sql_res
=
con_sql_doris_prod
(
sql
)
for
card_id
in
sql_res
:
for
card_id
in
sql_res
:
# print(type(card_id[0]),card_id)
# print(type(card_id[0]),card_id)
es_res
=
get_tractate_tags_from_es
(
card_id
[
0
],
id_type
=
'diary'
)
es_res
=
get_tractate_tags_from_es
(
card_id
[
0
],
id_type
=
id_type
)
second_demands_tractate_dict
[
card_id
[
0
]]
=
es_res
[
"_source"
][
"second_demands"
]
second_demands_tractate_dict
[
card_id
[
0
]]
=
es_res
[
"_source"
][
"second_demands"
]
tags_v3_tractate_dict
[
card_id
[
0
]]
=
es_res
[
"_source"
][
"tags_v3"
]
tags_v3_tractate_dict
[
card_id
[
0
]]
=
es_res
[
"_source"
][
"tags_v3"
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment