| Age | Commit message (Collapse) | Author | Lines |
|---|
|
- Install Playwright + Chromium; add shared browser singleton (playwright.server.ts)
- Rewrite flat-nishiogikubo scraper: Wix calendar via headless browser,
month navigation via date picker, extracts .WPczEB/.ExCBIq selectors
- Rewrite pitbar-nishiogikubo scraper: freecalend.com via headless browser,
parses cal-{member}-{year}-{month}-{day} cell IDs
- scraper-runner: close shared browser after each run with closeBrowser()
- Remove all scrape trigger buttons from web UI (events index, venues page);
remove /api/scrape and /api/scrape-status from routes.ts
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
|
Background scraping:
- POST /api/scrape returns 202 immediately with run_id; scraping runs async
- GET /api/scrape-status?run_id=xxx polls for results per venue
- scrape_logs table: per-venue status (running/ok/error), events_saved, error, timestamps
CLI (npm run scrape):
- npm run scrape — 全会場をスクレイプ、結果を色付きで出力
- npm run scrape liquid-room — 特定会場のみ
- npm run scrape -- --list — 登録済み会場一覧を表示
- エラー時は exit code 1 + エラーメッセージを dim 表示
Venues page:
- 最終スクレイプ日時・成否をインラインで表示
- 会場ごとの「更新」ボタンを追加
Bug fix: upsertEvent に description/optional fields のデフォルト値を設定し
better-sqlite3 の "Missing named parameter" エラーを解消
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
|
Pitbar 西荻窪
meets-otsuka: rinky.info プラットフォーム。div.blog-entry.event-wrap[event-date]
から日付・タイトル・出演者・時間・価格・チケットURLを取得。
warp-kichijoji: WordPress カスタムテーマ。<h3>YYYY<br/><span>MM</span></h3> で
年月を取得、article.schedules-box から各イベントをパース。
flat-nishiogikubo: Wix サイトのため JS レンダリング必須。エラーを返す
プレースホルダー実装（Playwright 等への移行が必要）。
pitbar-nishiogikubo: freecalend.com (mem25771) から取得を試みるが、
ボット遮断のため現状はエラー。URL パターン・代替策をコメントに記載。
SCRAPE_TARGETS.md に状態列（✅/⚠️）を追加。
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
|
Documents all registered venues, their schedule URLs, scraper file paths,
and instructions for running scrapes and adding new venues.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
|
Scraper runner now filters events to today + 35 days before upserting,
so the DB only holds the upcoming month of events.
Event list loader defaults date_from/date_to to the same window when
no query params are set, and passes the values down to FilterBar so the
date inputs are pre-filled on first load.
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
|
Full-stack React Router v7 app that scrapes event listings from major
Tokyo live venues (Liquid Room, WWW/WWW X, Shibuya O-EAST, Shinjuku LOFT,
Club Quattro) and stores them in SQLite for browsing and search.
- Modular scraper architecture: add a new venue by dropping a file in
app/scrapers/ and registering it in index.ts
- Routes: /events (filter by keyword/venue/date), /events/:id, /venues,
GET /api/scrape
- EventCard shows artist, date/time, venue, ticket URL, and fee
- Post-scrape per-venue Markdown files generated to events/ (dev reference)
- /add-livehouse Claude Code skill defined in .claude/commands/
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
|
|
