Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in
Toggle navigation
A
Appium-crawl
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
李康
Appium-crawl
Commits
e9a74aa2
Commit
e9a74aa2
authored
Oct 29, 2019
by
李康
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
add some comment
parent
84dc06c7
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
0 deletions
+1
-0
README.txt
README.txt
+1
-0
No files found.
README.txt
View file @
e9a74aa2
...
@@ -24,6 +24,7 @@ data_clean.py:
...
@@ -24,6 +24,7 @@ data_clean.py:
product.py:
product.py:
用于提取所有产品信息
用于提取所有产品信息
需要预先提供一个done.txt文件,该文件记录了哪些品牌已经被爬取,爬虫会跳过这些品牌防止重复爬取
执行方式为,将app翻到品牌列表页,然后执行python product.py 品牌名,这样会爬取对应品牌下的所有产品信息
执行方式为,将app翻到品牌列表页,然后执行python product.py 品牌名,这样会爬取对应品牌下的所有产品信息
或者将app翻到某品牌的产品列表页,执行python product.py,也会爬取该品牌的所有产品
或者将app翻到某品牌的产品列表页,执行python product.py,也会爬取该品牌的所有产品
在长时间爬取时,以息app可能会crash,爬虫提供了自动检测重启功能,但是该功能不是完全有效,有些时候手机会死机,有些时候重启逻辑会出bug,
在长时间爬取时,以息app可能会crash,爬虫提供了自动检测重启功能,但是该功能不是完全有效,有些时候手机会死机,有些时候重启逻辑会出bug,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment