feat: enhance project configuration and improve data export functionality
- Updated `.gitignore` to streamline ignored files and added logging for common sites. - Expanded `config.py` with new configurations for Weixin and Redis, and improved database connection settings. - Refined `README.md` to clarify project structure and usage instructions. - Enhanced `requirements.txt` with additional dependencies for MongoDB and Redis support. - Refactored multiple spider scripts to utilize a session-based approach for HTTP requests, improving error handling and proxy management. - Updated `export_lawyers_excel.py` to include a default timestamp for data exports.
This commit is contained in:
+1
-19
@@ -1,19 +1 @@
|
||||
from request.requests_client import (
|
||||
RequestClientError,
|
||||
RequestConnectTimeout,
|
||||
RequestConnectionError,
|
||||
RequestSSLError,
|
||||
RequestTimeout,
|
||||
RequestsClient,
|
||||
ResponseData,
|
||||
)
|
||||
|
||||
__all__ = [
|
||||
"RequestsClient",
|
||||
"ResponseData",
|
||||
"RequestClientError",
|
||||
"RequestConnectTimeout",
|
||||
"RequestTimeout",
|
||||
"RequestConnectionError",
|
||||
"RequestSSLError",
|
||||
]
|
||||
# Package marker for request utilities.
|
||||
|
||||
Reference in New Issue
Block a user