stock-oracle

Commit Graph

Author	SHA1	Message	Date
I Luk Kim	8c9abe3e31	feat(attention): Attention 서브시스템 추가 — 이벤트 중심 Wikipedia/GDELT 관심도 피처 ## 주요 기능 - Entity resolver: ticker → canonical name → Wikipedia 매칭 - SEC company_tickers.json fallback으로 placeholder name 자동 수정 - all-caps SEC 이름 title-case 변환, "Com" suffix 처리 - Wikipedia 페이지뷰 수집 + spike_10d / zscore_20d 피처 계산 - GDELT V2 DOC API 뉴스 기사 수집 (2017-01-01 이후) ## GDELT rate limit 제약 강제 - /event/{ticker} 온디맨드 GDELT 수집 제거 (IP ban 방지) - 프로세스 전역 asyncio.Lock + 10초 최소 간격 강제 - 429 시 exponential backoff (30→60→120s) - news.gdelt_status 필드로 클라이언트에 수집 상태 명시 ('collected' \| 'not_collected' \| 'not_available') ## API - GET /api/v1/attention/event/{ticker}?event_date=YYYY-MM-DD - GET /api/v1/attention/entity/{ticker} - POST /api/v1/attention/admin/resolve/{ticker} - POST /api/v1/attention/admin/collect/wiki/{ticker} - POST /api/v1/attention/admin/collect/gdelt/{ticker} ← scheduler 전용 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago
I Luk Kim	29fc870b37	Add Phase 5 Attention Overlay API and fix Redis port mismatch - 12 REST endpoints: overlay score, bulk, top-movers, headlines, youtube, wiki, crowding, trends, history, admin (health/trigger/job-log) - 10 services: entity_resolver, yahoo_rss_adapter, wikimedia_adapter, youtube_adapter, google_trends_adapter, finra_overlay_loader, feature_builder, overlay_scorer, overlay_pipeline, scheduler - 10 DB tables across overlay_registry, overlay_raw_event, overlay_feature models - APScheduler: collect @ 23:30 UTC + feature build @ 01:30 UTC weekdays - Fix Redis port mismatch: config default 16379 → 16380 to match docker-compose external port - 64 overlay tests covering cache utils, Redis config, all 12 endpoints, route ordering Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago
I Luk Kim	9e2a8aba47	Codebase improvements: caching decorator, Pydantic v2, DB indexes, connection pooling, Alembic - Add @with_cache() decorator to eliminate ~15-line caching boilerplate per endpoint - Apply decorator to 8 existing endpoints (stocks, alpaca, finra) and add caching to 6 previously uncached endpoints (news, etf, filings) with appropriate TTLs - Migrate all @validator to @field_validator (Pydantic v2), deduplicate validation logic into shared functions in validators.py - Fix datetime.utcnow() → datetime.now(timezone.utc), remove unused uuid import - Convert ErrorLogResponse class Config → model_config = ConfigDict(...) - Add health check exception logging instead of silent pass - Add data_source indexes to PriceData and FinancialData tables - Initialize Alembic with async engine configuration - Add persistent HTTP sessions for SEC client (aiohttp) and FRED proxy (httpx) - Add response_model schemas for Alpaca bars/intraday and news-only/social-only Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>	5 months ago

Author

SHA1

Message

Date

I Luk Kim

8c9abe3e31

feat(attention): Attention 서브시스템 추가 — 이벤트 중심 Wikipedia/GDELT 관심도 피처

## 주요 기능
- Entity resolver: ticker → canonical name → Wikipedia 매칭
  - SEC company_tickers.json fallback으로 placeholder name 자동 수정
  - all-caps SEC 이름 title-case 변환, "Com" suffix 처리
- Wikipedia 페이지뷰 수집 + spike_10d / zscore_20d 피처 계산
- GDELT V2 DOC API 뉴스 기사 수집 (2017-01-01 이후)

## GDELT rate limit 제약 강제
- /event/{ticker} 온디맨드 GDELT 수집 제거 (IP ban 방지)
- 프로세스 전역 asyncio.Lock + 10초 최소 간격 강제
- 429 시 exponential backoff (30→60→120s)
- news.gdelt_status 필드로 클라이언트에 수집 상태 명시
  ('collected' | 'not_collected' | 'not_available')

## API
- GET  /api/v1/attention/event/{ticker}?event_date=YYYY-MM-DD
- GET  /api/v1/attention/entity/{ticker}
- POST /api/v1/attention/admin/resolve/{ticker}
- POST /api/v1/attention/admin/collect/wiki/{ticker}
- POST /api/v1/attention/admin/collect/gdelt/{ticker}  ← scheduler 전용

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

I Luk Kim

29fc870b37

Add Phase 5 Attention Overlay API and fix Redis port mismatch

- 12 REST endpoints: overlay score, bulk, top-movers, headlines, youtube, wiki, crowding, trends, history, admin (health/trigger/job-log)
- 10 services: entity_resolver, yahoo_rss_adapter, wikimedia_adapter, youtube_adapter, google_trends_adapter, finra_overlay_loader, feature_builder, overlay_scorer, overlay_pipeline, scheduler
- 10 DB tables across overlay_registry, overlay_raw_event, overlay_feature models
- APScheduler: collect @ 23:30 UTC + feature build @ 01:30 UTC weekdays
- Fix Redis port mismatch: config default 16379 → 16380 to match docker-compose external port
- 64 overlay tests covering cache utils, Redis config, all 12 endpoints, route ordering

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

I Luk Kim

9e2a8aba47

Codebase improvements: caching decorator, Pydantic v2, DB indexes, connection pooling, Alembic

- Add @with_cache() decorator to eliminate ~15-line caching boilerplate per endpoint
- Apply decorator to 8 existing endpoints (stocks, alpaca, finra) and add caching
  to 6 previously uncached endpoints (news, etf, filings) with appropriate TTLs
- Migrate all @validator to @field_validator (Pydantic v2), deduplicate validation
  logic into shared functions in validators.py
- Fix datetime.utcnow() → datetime.now(timezone.utc), remove unused uuid import
- Convert ErrorLogResponse class Config → model_config = ConfigDict(...)
- Add health check exception logging instead of silent pass
- Add data_source indexes to PriceData and FinancialData tables
- Initialize Alembic with async engine configuration
- Add persistent HTTP sessions for SEC client (aiohttp) and FRED proxy (httpx)
- Add response_model schemas for Alpaca bars/intraday and news-only/social-only

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

3 Commits (8c9abe3e31025cbe9f63c4f9773c0783ec1986b0)