Alejandro Gutiérrez 4f48fb28cd Optimize wait times for faster scraping ...

- Reduce initial page load wait: 3s -> 1s
- Reduce consent click wait: 2s -> 0.5s
- Reduce post-consent reload wait: 3s -> 1s
- Reduce tab click wait: 2s -> 0.3s
- Use smart polling for tabs (0.25s intervals, up to 2.5s)
- Use faster scroll container polling (0.25s intervals)
- Remove redundant 2s wait after reviews load

Total execution time reduced from ~22s to ~13s

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>

2026-01-21 20:49:12 +00:00

..

__init__.py

Release Google Reviews Scraper Pro v1.0.0 (2025)

2025-04-24 22:12:07 +07:00

api_interceptor.py

Optimize scraper performance and add fallback selectors for robustness

2026-01-18 19:49:24 +00:00

chrome_pool.py

Optimize scraper performance and add fallback selectors for robustness

2026-01-18 19:49:24 +00:00

cli.py

Add API interception for hybrid scraping and update selectors

2026-01-17 21:51:10 +00:00

config.py

fixed the issue with english localization

2025-06-02 13:22:50 +07:00

data_storage.py

fixed the issue with english localization

2025-06-02 13:22:50 +07:00

database.py

Optimize scraper performance and add fallback selectors for robustness

2026-01-18 19:49:24 +00:00

date_converter.py

Release Google Reviews Scraper Pro v1.0.0 (2025)

2025-04-24 22:12:07 +07:00

fast_scraper.py

Add fallback locale retry and pane-scoped selectors for robust review detection

2026-01-18 20:36:42 +00:00

health_checks.py

Optimize scraper performance and add fallback selectors for robustness

2026-01-18 19:49:24 +00:00

image_handler.py

Test

2025-08-20 02:46:01 +07:00

job_manager.py

Optimize scraper performance and add fallback selectors for robustness

2026-01-18 19:49:24 +00:00

models.py

Add API interception for hybrid scraping and update selectors

2026-01-17 21:51:10 +00:00

s3_handler.py

Added pytest + some tests.

2025-06-03 00:12:11 +07:00

scraper_clean.py

Optimize wait times for faster scraping

2026-01-21 20:49:12 +00:00

scraper.py

Implement continuous scrolling with smart gap-based timeout

2026-01-19 01:39:47 +00:00

utils.py

Release Google Reviews Scraper Pro v1.0.0 (2025)

2025-04-24 22:12:07 +07:00

webhooks.py

Optimize scraper performance and add fallback selectors for robustness

2026-01-18 19:49:24 +00:00