Skip to content

C
crawler
Commit 420468ac authored by litaolemo's avatar litaolemo
Browse files
Options

update

parent 920f7fe1
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 3 deletions
run.sh
View file @ 420468ac
#!/bin/bash
sudo su - gmuser
source /root/anaconda3/bin/activate
conda activate crawler_env
python /srv/apps/crawler/crawler_sys/framework/write_releasers_to_redis.py -p weibo -d 1 -proxies 5
python /srv/apps/crawler/crawler_sys/framework/write_releasers_to_redis.py -p douban -d 1 -proxies 5
\ No newline at end of file
python /srv/apps/crawler/crawler_sys/framework/write_releasers_to_redis.py -p weibo -d 1 -proxies 5 > /data/log/write_task.log &
python /srv/apps/crawler/crawler_sys/framework/write_releasers_to_redis.py -p douban -d 1 -proxies 5 > /data/log/write_task.log &
\ No newline at end of file
start_crawler.sh
View file @ 420468ac
#!/bin/bash
sudo su - gmuser
source /root/anaconda3/bin/activate
conda activate crawler_env
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment