Event Scraper Agent
Multi-source event aggregation with deduplication and enrichment
Overview
Scrapes events from 15+ sources (Eventbrite, Meetup, venue sites, community calendars), deduplicates, enriches with venue data, and loads into Supabase. Powers 3 newsletter editions and a public events website.
Execution Phases
Source Scraping
Runs 15+ scrapers against event sources
Deduplication
Identifies and merges duplicate events across sources
Enrichment
Adds venue details, age ranges, pricing, and registration links
Quality Check
Validates dates, links, and categorization
Database Load
Upserts events into Supabase with source tracking
Outputs
- Enriched event database
- Source quality metrics
- Failed scraper alerts
Example
Wednesday 5 AM: 15 scrapers run against Eventbrite, Meetup, library calendars, and venue sites. 340 events collected, 47 duplicates merged, 293 unique events enriched with venue data and age ranges. 2 scraper failures flagged for investigation.
Deep Dives
Ready to deploy Event Scraper Agent?
This agent ships with Knowledge OS. Set up your system in 90 minutes.
Built and maintained by Victor Sowers at STEEPWORKS