Skip to content

C
crawler
Commit 8d5b2667 authored by litaolemo's avatar litaolemo
Browse files
Options

update

parent e870b0bd
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
crawler_sys/framework/search_page_single_process.py
View file @ 8d5b2667
...@@ -101,7 +101,7 @@ for platform in PLATFORM_LIST: ...@@ -101,7 +101,7 @@ for platform in PLATFORM_LIST:
initialize_crawler = get_crawler(platform) initialize_crawler = get_crawler(platform)
crawler = initialize_crawler() crawler = initialize_crawler()
KEYWORD_dic = func_search_keywordlist(platform) KEYWORD_dic = func_search_keywordlist(platform)
KEYWORD_dic = random.shuffle(KEYWORD_dic) # KEYWORD_dic = random.shuffle(KEYWORD_dic)
executor = ProcessPoolExecutor(max_workers=3) executor = ProcessPoolExecutor(max_workers=3)
futures = [] futures = []
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment