stock-oracle

Commit Graph

Author	SHA1	Message	Date
I Luk Kim	e2c242c7cc	fix(sec): 대형 exhibit 파일로 인한 서버 메모리 고갈 방지 - fetch_text에 max_bytes 파라미터 추가: Content-Length 헤더로 다운로드 전 사전 reject, 헤더 없으면 content.read(max_bytes+1)로 제한적 읽기 - ValueError는 즉시 raise (retry 없음 — 크기는 재시도해도 안 줄어듦) - in-memory 캐시(_text_cache) 1MB 가드: 대형 응답은 디스크 캐시에만 저장 - MAX_EXHIBIT_SIZE 1MB → 5MB, fetch_text(max_bytes=...) 호출로 다운로드 전 체크 - exhibit deadline 30초 → 15초 (서비스 + 엔드포인트 + bulk) - 신규 테스트 5개: Content-Length 사전 거부, body 제한 읽기, 메모리 캐시 가드, 소형 캐시 유지, ValueError no-retry Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago
I Luk Kim	f17644e5e8	fix(sec): N+1 쿼리 제거, 청크 커밋, 세션 분리, rate limiter 추가 - sec_filings_service: 루프 전 accession_number 일괄 pre-fetch로 N+1 제거 - sec_filings_service: 500건 단위 청크 커밋으로 all-or-nothing 트랜잭션 방지 - sec_filings_service: bulk 인덱싱 시 코루틴별 독립 세션 생성으로 동시 세션 충돌 해결 - sec_filings_service: index_filings 데드라인 60s → 120s, bulk timeout 동일 적용 - sec_http_client: _TokenBucket(10 req/sec) 추가로 SEC EDGAR 과부하 방지 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago
I Luk Kim	45d832ba5c	perf: Phase 1-3 Stock Oracle API 성능 개선 Phase 1A - yfinance hang 제거 - _run_with_timeout() 헬퍼 추가 (asyncio.wait_for 래퍼) - run_in_executor 6곳에 timeout 적용: history(30s), .info(20s), bulk download(60s) Phase 1B - SEC Filing deadline 설정 - index_filings: 60s deadline + try/finally - get_filing_documents: 30s deadline (중첩 호출 시 기존 deadline 유지) - get_exhibit_content: 30s deadline + try/finally Phase 1C - _get_ticker_max_range async 전환 - sync → async def + run_in_executor + wait_for(20s) - get_or_create_company_data에서 period=="max" 사전 체크 → await 직접 호출 Phase 1D - Endpoint 레벨 timeout - POST /price/data/bulk: 300s → 504 - POST /financial/data/bulk: 300s → 504 - GET /filings/search/{ticker}: 120s → 504 - GET /filings/documents/{accession}: 30s → 504 - GET /filings/exhibit/{accession}: 30s → 504 Phase 2 - Filing 캐시 추가 - GET /filings/documents: @with_cache(ttl=86400) - GET /filings/exhibit: @with_cache(ttl=86400) Phase 3A - POST /filings/search/bulk 추가 - BulkFilingSearchRequest/Item/Response 스키마 - search_filings_bulk(): 배치 DB 조회 → 미인덱싱 ticker 병렬 인덱싱(Semaphore 4) - @with_cache(ttl=3600), 600s endpoint timeout Phase 3B - POST /filings/exhibit/bulk 추가 - BulkExhibitRequest/Item/Response 스키마 - asyncio.gather + 개별 30s timeout, 최대 50건 Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago
I Luk Kim	76e154eccd	feat(filings): add accepted_at field to filing search response Expose SEC ACCEPTANCE-DATETIME so downstream consumers (filing_poller) can populate Document.accepted_at_utc and Event.filed_at_utc. - SECFiling model: add nullable accepted_at TIMESTAMP column - main.py startup: ALTER TABLE migration for existing SQLite DBs - sec_filings_service: extract acceptanceDateTime from SEC JSON, store on INSERT and force_refresh UPDATE - FilingSummary schema: add Optional[str] accepted_at field - filings endpoint: map accepted_at as ISO 8601 string in response - CHANGELOG: v3.0.1 entry Existing rows have accepted_at=NULL; backfill with force_refresh=true. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago
I Luk Kim	d0f1a9a7d0	Add SEC filings indexing, search, and exhibit extraction (8-K, 6-K, 20-F, 40-F) Extract shared SECHttpClient from ETF fetcher (retry, backoff, cache, throttle) and apply it to both ETF and core SEC services, fixing missing rate limiting. Add SECFiling DB model, Pydantic schemas, SECFilingsService with auto-indexing, and REST endpoints at /filings/search, /filings/documents, /filings/exhibit. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>	5 months ago

5 Commits (e2c242c7ccbd135abaca24791a04c528cdc66872)