2 Commits

Author	SHA1	Message	Date
wasrusgen	e7f6e64e38	playwright_engine: route through proxy_pool — random residential IP per request ... - New use_proxy param (default True) - Per-request random proxy from pool - _parse_proxy_url_for_playwright converts http://user:pass@host:port to playwright.proxy dict	2026-05-11 16:05:36 +03:00
wasrusgen	d5f290bd0a	backend: Playwright + Chromium for JS-rendered sites (Я.Маркет, OZON fallback) ... DOCKERFILE: - + Chromium system deps (libnss3, libxkbcommon0, libgbm1, libgtk-3-0, etc.) - + RUN python -m playwright install chromium (~150MB) - + ENV PLAYWRIGHT_BROWSERS_PATH REQUIREMENTS: - + playwright >= 1.45 PARSERS: - new playwright_engine.py — singleton browser, isolated context per request, blocks images/fonts/CSS to save memory, waits for selector + JS hydration - yamarket.py — rewritten to use Playwright (Я.Маркет is React SPA) - ozon.py — Playwright fallback when composer-api returns challenge (403) - wb.py — exponential backoff on 429, still uses direct HTTP (JSON API, no JS needed) STRATEGY (Hybrid Path C): - Я.Маркет: Playwright (rendering JS) - OZON: composer-api first, Playwright fallback - WB: direct HTTP with backoff (JSON API, fast) - DNS: kept but lower priority (Qrator hard to crack) - No more proxy needed for primary path DEPLOY: removed PROXY_STATIC_LIST from .env, expect ~5min for first build (Chromium download)	2026-05-11 13:25:05 +03:00