39c80fc8be
Phase 5 - Main Dashboard: - Dashboard overview page with system health stats - Jobs by status breakdown, success rates, top clients - Dashboard API (/api/dashboard/overview, by-client, problems, by-version) Phase 6 - Admin/Scraper Management: - Scrapers management page with traffic allocation UI - Admin API for scraper CRUD operations - Traffic percentage updates for A/B testing - Promote/deprecate scraper versions Phase 7 - Authentication: - API key authentication middleware - SHA-256 key hashing (keys never stored in plain text) - Scope-based authorization (jobs:read, jobs:write, admin) - Rate limiting per API key Also: - Updated api_server_production.py to include new routers - Extended core/database.py with dashboard query methods - Added dashboard link to sidebar navigation - Updated CONTEXT-KEEPER.md to mark all phases complete Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Google Reviews Scraper - Testing Interface
A Next.js web interface for testing the containerized Google Reviews Scraper API.
Features
- 🎯 URL Input - Paste any Google Maps business URL
- 📊 Real-time Status - Live job tracking with polling
- ⚡ Performance Metrics - Reviews count, time, speed
- 📱 Review Display - Beautiful UI for scraped reviews
- 💾 Export JSON - Download reviews as JSON
Quick Start
1. Start the Scraper API
First, make sure the containerized scraper is running:
cd ..
docker-compose -f docker-compose.production.yml up -d
The API should be running at http://localhost:8000
2. Start the Web Interface
npm install
npm run dev
Usage
-
Paste a Google Maps URL
https://www.google.com/maps/place/Business+Name/... -
Click "Scrape"
- Job is submitted to the API
- Status updates in real-time
- Reviews appear when complete
-
View Results
- See all scraped reviews
- Export as JSON
- View performance metrics
Environment Variables
Create .env.local if you need to customize:
# API URL (default: http://localhost:8000)
NEXT_PUBLIC_API_URL=http://localhost:8000
API Endpoints Used
This interface connects to:
POST /scrape- Submit scraping jobGET /jobs/{job_id}- Get job statusGET /jobs/{job_id}/reviews- Get reviews
Tech Stack
- Next.js 15 - React framework
- TypeScript - Type safety
- Tailwind CSS - Styling
- API Proxy - Next.js API routes proxy to scraper API
Development
npm run dev # Start dev server
npm run build # Build for production
npm run start # Start production server
npm run lint # Run ESLint
Notes
- The interface polls job status every 2 seconds
- Polling stops when job completes or fails
- Reviews are fetched with a limit of 1000 by default
- Export button downloads reviews as formatted JSON