Skip to content

C
crawler
Commit 4c7484fa authored by litaolemo's avatar litaolemo
Browse files
Options

update

parent 2cbb528d
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
crawler_sys/scheduler/weibo_to_rpc.py
View file @ 4c7484fa
...@@ -128,6 +128,8 @@ for pid in pid_list: ...@@ -128,6 +128,8 @@ for pid in pid_list:
video_dic = {} video_dic = {}
qiniu_img_list = [] qiniu_img_list = []
# print(res_json) # print(res_json)
if "http://t.cn/" in res_json["title"]:
continue
for img_url in res_json["img_list"]: for img_url in res_json["img_list"]:
try: try:
img_wb = retry_get_url(img_url.replace("large", "sq480")).content img_wb = retry_get_url(img_url.replace("large", "sq480")).content
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment