Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
C
crawler
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
backend
crawler
Commits
fcd87f60
Commit
fcd87f60
authored
4 years ago
by
litaolemo
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
update
parent
04a37775
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
2 deletions
+13
-2
xiaohongshu_to_rpc.py
crawler_sys/scheduler/xiaohongshu_to_rpc.py
+13
-2
No files found.
crawler_sys/scheduler/xiaohongshu_to_rpc.py
View file @
fcd87f60
...
@@ -143,9 +143,19 @@ for pid in pid_list:
...
@@ -143,9 +143,19 @@ for pid in pid_list:
video_dic
[
"content"
]
=
desc_fix
video_dic
[
"content"
]
=
desc_fix
video_dic
[
"user_id"
]
=
random
.
choice
(
user_id_list_copy
)
video_dic
[
"user_id"
]
=
random
.
choice
(
user_id_list_copy
)
rpc_res
=
post_single_data
(
copy
.
deepcopy
(
video_dic
),
"cims/answer/batch_create"
)
rpc_res
=
post_single_data
(
copy
.
deepcopy
(
video_dic
),
"cims/answer/batch_create"
)
try
:
if
res_json
[
"NoteView"
]
.
get
(
"data"
):
if
res_json
[
"NoteView"
]
.
get
(
"data"
):
print
(
res_json
[
"NoteView"
]
.
get
(
"data"
))
print
(
res_json
[
"NoteView"
]
.
get
(
"data"
))
try
:
for
comment
in
res_json
[
"NoteView"
][
"data"
][
"comments"
]:
video_dic
[
"content"
]
=
comment
[
'content'
]
comment_id_list_copy
=
copy
.
deepcopy
(
majiayonghu_list
)
comment_id
=
random
.
choice
(
comment_id_list_copy
)
video_dic
[
"user_id"
]
=
comment_id
comment_id_list_copy
.
remove
(
comment_id
)
video_dic
[
"create_time"
]
=
(
create_time
+
datetime
.
timedelta
(
hours
=
random
.
randint
(
0
,
24
),
minutes
=
random
.
randint
(
0
,
60
)))
.
timestamp
()
rpc_res
=
post_single_data
(
copy
.
deepcopy
(
video_dic
),
"cims/reply/batch_create"
)
elif
res_json
[
"NoteView"
]
.
get
(
"commentInfo"
):
for
comment
in
res_json
[
"NoteView"
][
"commentInfo"
][
"comments"
]:
for
comment
in
res_json
[
"NoteView"
][
"commentInfo"
][
"comments"
]:
video_dic
[
"content"
]
=
comment
[
'content'
]
video_dic
[
"content"
]
=
comment
[
'content'
]
comment_id_list_copy
=
copy
.
deepcopy
(
majiayonghu_list
)
comment_id_list_copy
=
copy
.
deepcopy
(
majiayonghu_list
)
...
@@ -156,5 +166,5 @@ for pid in pid_list:
...
@@ -156,5 +166,5 @@ for pid in pid_list:
rpc_res
=
post_single_data
(
copy
.
deepcopy
(
video_dic
),
"cims/reply/batch_create"
)
rpc_res
=
post_single_data
(
copy
.
deepcopy
(
video_dic
),
"cims/reply/batch_create"
)
except
:
except
:
print
(
"comment error"
)
print
(
"comment error"
)
#
print(res)
print
(
res
)
# break
# break
\ No newline at end of file
This diff is collapsed.
Click to expand it.
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment