migrate to SeleniumBase UC Mode for automatic version management

- Replace undetected-chromedriver with seleniumbase for better Chrome/ChromeDriver compatibility
- Automatic version matching eliminates manual cache clearing and version conflicts
- Enhanced anti-detection with UC Mode and CDP stealth settings
- Simplified requirements.txt (SeleniumBase manages common dependencies)
- Fix sort selection bug (was selecting wrong menu items)
- Improve scrolling patience (max_idle: 3→15, max_attempts: 10→50)
- Add scroll position tracking to detect when stuck
- Add fallback pane selectors for better reliability
- Update documentation (README, ARCHITECTURE, TROUBLESHOOTING)
- Add comprehensive test suite for SeleniumBase integration
- Version bump to 1.0.1

Developed by George Khananaev
This commit is contained in:
George Khananaev
2025-12-07 19:40:13 +07:00
parent 6b60b02eec
commit 262f0c0be7
7 changed files with 3802 additions and 106 deletions

View File

@@ -1,17 +1,8 @@
requests==2.32.3
beautifulsoup4==4.12.3
aiohttp==3.11.11
seleniumbase>=4.34.9
googletrans==4.0.2
selenium==4.15.2
undetected-chromedriver==3.5.4
tqdm==4.66.3
tqdm>=4.66.3
pymongo==4.12.0
pyyaml==6.0.1
certifi==2024.7.4
webdriver-manager==4.0.2
setuptools==79.0.1
boto3==1.35.1
pytest==7.4.3
fastapi==0.104.1
uvicorn==0.24.0
botocore~=1.35.99