migrate to SeleniumBase UC Mode for automatic version management
- Replace undetected-chromedriver with seleniumbase for better Chrome/ChromeDriver compatibility - Automatic version matching eliminates manual cache clearing and version conflicts - Enhanced anti-detection with UC Mode and CDP stealth settings - Simplified requirements.txt (SeleniumBase manages common dependencies) - Fix sort selection bug (was selecting wrong menu items) - Improve scrolling patience (max_idle: 3→15, max_attempts: 10→50) - Add scroll position tracking to detect when stuck - Add fallback pane selectors for better reliability - Update documentation (README, ARCHITECTURE, TROUBLESHOOTING) - Add comprehensive test suite for SeleniumBase integration - Version bump to 1.0.1 Developed by George Khananaev
This commit is contained in:
13
README.md
13
README.md
@@ -1,16 +1,16 @@
|
||||
# 🔥 Google Reviews Scraper Pro (2025) 🔥
|
||||
|
||||

|
||||

|
||||

|
||||

|
||||

|
||||

|
||||
|
||||
**FINALLY! A scraper that ACTUALLY WORKS in 2025!** While others break with every Google update, this bad boy keeps on trucking. Say goodbye to the frustration of constantly broken scrapers and hello to a beast that rips through Google's defenses like a hot knife through butter. This battle-tested, rock-solid solution will extract every juicy detail from Google reviews while laughing in the face of rate limiting.
|
||||
|
||||
## 🌟 Feature Artillery
|
||||
|
||||
- **Bulletproof in 2025**: While the competition falls apart, we've cracked Google's latest tricks
|
||||
- **Ninja-Mode Selenium**: Our undetected-chromedriver flies under the radar where others get insta-blocked
|
||||
- **Enhanced SeleniumBase UC Mode**: Superior anti-detection with automatic Chrome/ChromeDriver version matching - no more version headaches!
|
||||
- **Polyglot Powerhouse**: Devours reviews in a smorgasbord of languages - English, Hebrew, Thai, German, you name it!
|
||||
- **MongoDB Mastery**: Dumps pristine data structures straight into your MongoDB instance
|
||||
- **Paranoid Backups**: Mirrors everything to local JSON files because losing data sucks
|
||||
@@ -350,9 +350,10 @@ print(f"Reviews with images: {len(reviews_with_images)}")
|
||||
### DEFCON Scenarios & Quick Fixes
|
||||
|
||||
1. **Chrome/Driver Having a Lovers' Quarrel**
|
||||
- Update your damn Chrome browser already! It's 2025, people
|
||||
- Nuke and reinstall the driver: `pip uninstall undetected-chromedriver` then `pip install undetected-chromedriver==3.5.4`
|
||||
- If you're on Ubuntu, sometimes a simple `apt update && apt upgrade` fixes weird Chrome issues
|
||||
- **Good news!** SeleniumBase handles Chrome/ChromeDriver version matching automatically
|
||||
- Update Chrome browser: Go to chrome://settings/help
|
||||
- SeleniumBase will automatically download the matching ChromeDriver - no manual intervention needed!
|
||||
- If issues persist: `pip install --upgrade seleniumbase`
|
||||
|
||||
2. **MongoDB Throwing a Tantrum**
|
||||
- Double-check your connection string - typos are the #1 culprit
|
||||
|
||||
Reference in New Issue
Block a user