chore: initialize lawyers crawler project
This commit is contained in:
@@ -0,0 +1,20 @@
|
||||
# lawyers
|
||||
|
||||
`common_sites` 独立采集项目。
|
||||
|
||||
## 目录
|
||||
|
||||
- `common_sites/`:大律师、找法网、法律快车、律图、华律 5 个采集脚本
|
||||
- `request/proxy_config.py`:代理配置加载逻辑
|
||||
- `request/proxy_settings.json`:代理配置文件
|
||||
- `Db.py`:数据库连接与基础操作
|
||||
- `config.py`:数据库与请求头配置
|
||||
|
||||
## 运行
|
||||
|
||||
```bash
|
||||
cd /www/wwwroot/lawyers
|
||||
python3 -m pip install -r requirements.txt
|
||||
cd common_sites
|
||||
./start.sh
|
||||
```
|
||||
Reference in New Issue
Block a user