Vinny Vegas

the ultimate vegas nightlife scraper — development roadmap

v2.3.1 — 13+ venues • incremental scraping • Astro site live at vinny.vegas
Venues
Events Indexed
Milestones
Repos
Core Pipeline — vinny sync
Step 1
Scrape
Crawlee + extractors
incremental sitemaps
→
Step 2
Pricing
UrVenue AJAX API
table tiers + deposits
→
Step 3
Images
VEA CDN download
venue-aware paths
→
Step 4
R2 Upload
HEAD-check dedup
img.vinny.vegas
→
Step 5
D1 Export
Cloudflare D1
REST API push

Completed Milestones 10 shipped in 9 days

v1.0.0
LIV Perfection
Feb 26
Full event data extraction CSV export capability
v1.5.0
Plugin Architecture
Feb 27
Multi-venue plugin system Artist enrichment pipeline Timestamped run folders Field-level diff tracking
v1.6.0
Table Pricing
Feb 27
Direct UrVenue AJAX API All sections, min spend, deposits VEN1121562 venue code bug fix
v1.7.0
D1 Schema + CLI
Mar 1
table_tiers, artists, event_artists SQLite export command Rich console output CLI module split + grouping
v1.8.0
XS + Multi-Venue
Mar 1
XS Nightclub extractor Schema.org JSON-LD parsing Combined --with-pricing flag
v1.9.0
Images + R2
Mar 1
Venue-aware image storage Cloudflare R2 integration HEAD-check dedup
v1.10.0
Pipeline Automation
Mar 1
vinny sync one-command pipeline D1 REST API (bypass wrangler) Spotify + RA + 1001Tracklists
v2.0.0
Astro Site
Mar 2
vinny.vegas goes live SEO, Open Graph, JSON-LD Cloudflare Pages auto-deploy
v2.2.0
TAO Group + EBC
Mar 5
10 TAO Group venues in one extractor Incremental sitemap scraping 1,388 total events indexed
v2.3.0
Cyclopts + Docs
Mar 6
Typer → Cyclopts migration MkDocs auto-generated CLI ref Repo health: README, CLAUDE.md

Venue Coverage 13 venues • 3 hotel groups

Wynn Resorts
XS
xs
Nightclub
Encore Beach Club
ebc
Dayclub
EBC at Night
ebcn
Nightclub
Drai's
planned
Coming Soon
TAO Group
Omnia
omn
Nightclub
Hakkasan
hak
Nightclub
Marquee
marq
Nightclub
Jewel
jwl
Nightclub
Tao Nightclub
tao
Nightclub
Marquee Dayclub
marqd
Dayclub
Tao Beach
taob
Dayclub
Liquid Pool
liq
Dayclub
Wet Republic
wet
No Events Yet
Fontainebleau Las Vegas
LIV
liv
Nightclub
LIV Beach
livb
Dayclub

Roadmap next up

Scraper: Data Quality & Expansion
#122
Firecrawl Integration
Scrape Drai's, EBC After Hours, and off-strip venues without structured sitemaps. 10K credits available.
#114
Pricing Freshness
Scheduled re-scraping with escalating frequency. Week before: 1x. 3 days: daily. Day-of: hourly.
#8
Zouk (Resorts World)
New venue extractor for Resorts World nightclub.
#92
Venue Enrichment
Description, hours, capacity, images, table map screenshots.
#98
Stale Venue ID Fix
Jewel, Tao Nightclub, Palm Tree have wrong venue_id in D1.
#10
Wet Republic
Waiting for events to appear in TAO sitemaps.
Site: UX & Search
#113
Events Pagination
24-36 events per page instead of 1,200+. Server-side with URL params.
#60
Full-Text Search
Search endpoint + SearchBox component for event discovery.
#62
Quick Filters
"Tonight", "This Weekend", "Next 2 Weeks" filter buttons.
#115
Historical Pricing
Original vs current, "Sold Out" badges, price change indicators.
#63
Event Comparison
Side-by-side comparison page for events.
#76
Table/List Toggle
View toggle on events page.
AI Agent: Conversational Discovery
#120
ElevenLabs Voice Agent
ConvAI widget embedded in site footer. Vegas nightlife concierge powered by D1 knowledge base.
#121
Proactive Notifications
Outbound calls via ElevenLabs + Twilio on pricing changes. Voicemail, SMS, WhatsApp fallbacks.
#64
Workers AI Tools
Backend query tools that power the ElevenLabs agent via webhooks.
Infrastructure
#116
Local Dev Workflow
Wrangler local D1/R2 emulation. Full pipeline works offline.
#117
R2 Image Transforms
Auto-resize to thumb (150px), mobile (400px), main (800px), og (1200px).
#118
Static Page Generation
Pre-render event pages from D1. Regenerate on updates. Dynamic pages stay SSR.
#119
Guestlist Worker
Deploy vinny-urvenue as a Cloudflare Worker at guestlist.vinny.vegas.
#68
Dynamic Sitemap
Auto-generated sitemap.xml + robots.txt for SEO.
#69
OG Image Generation
Per-event social cards for sharing.

Tech Journey all in under a month

Week 1 — Apify Actor
Started as a single Apify Actor scraping LIV Las Vegas. Playwright browser automation, cloud-hosted on the Apify platform.
Apify SDK Playwright Python 3.10+ Pydantic v2
Week 1.5 — Vinny CLI
Evolved into a local CLI tool built on Crawlee. Plugin architecture for multi-venue support, timestamped runs, field-level diffs, and a master event database.
Crawlee Cyclopts Rich Console CSV + Markdown export
Week 2 — Cloud Storage
Events and images moved to Cloudflare D1 and R2. Custom domain img.vinny.vegas for artist images. Direct D1 REST API bypasses wrangler OAuth issues.
Cloudflare D1 Cloudflare R2 SQLite export
Week 2.5 — Astro Site Launch
Browsable, SEO-friendly event site at vinny.vegas. Cloudflare Pages auto-deploy from GitLab. TypeScript + D1 query helpers, JSON-LD schema.org markup.
Astro TypeScript Cloudflare Pages React Islands
Week 3 — Enrichment + Scale
Artist pages enriched with Spotify top tracks, Resident Advisor profiles, and 1001Tracklists data. TAO Group extractor covers 10 venues from one sitemap. Incremental scraping means only new/updated events get processed.
Spotify API Resident Advisor 1001Tracklists Incremental Sitemaps
Week 3.5 — UrVenue + Docs
Custom UrVenue API integration for table pricing + guestlist management. MkDocs site with auto-generated CLI reference. Vinny-urvenue spun out as its own CLI.
UrVenue API MkDocs vinny-urvenue CLI
Week 4 — Documentation Site
docs.vinny.vegas launches with interactive diagrams, MkDocs, and an AutoRAG-powered knowledge base. This roadmap diagram lives here alongside architecture and pipeline visualizations.
AutoRAG Interactive Diagrams Cloudflare Workers

Repositories 3 repos

🐙
prime-optimal/vinny
GitHub — Scraper, CLI, pipeline
🐙
prime-optimal/vinny-urvenue
GitHub — UrVenue CLI + Worker
🦊
optimalprime/vinny-vegas-app
GitLab — Astro site at vinny.vegas