3 Commits

Author SHA1 Message Date
hello-dd-code f67cb30f0d chore: 暂存本地修改 2026-04-28 17:33:51 +08:00
hello-dd-code 38e7c284e8 feat: enhance project configuration and improve data export functionality
- Updated `.gitignore` to streamline ignored files and added logging for common sites.
- Expanded `config.py` with new configurations for Weixin and Redis, and improved database connection settings.
- Refined `README.md` to clarify project structure and usage instructions.
- Enhanced `requirements.txt` with additional dependencies for MongoDB and Redis support.
- Refactored multiple spider scripts to utilize a session-based approach for HTTP requests, improving error handling and proxy management.
- Updated `export_lawyers_excel.py` to include a default timestamp for data exports.
2026-03-18 10:02:25 +08:00
hello-dd-code 03847a4b8e chore: initialize lawyers crawler project 2026-03-02 00:19:48 +08:00