Files
vf-cuda-grid/controller
gx 19ddaf2dde controller: browser-rendered overlays — Grafana/chat/любой HTML
MVP Phase 8 feature: headless Chromium snapshot URL → PNG → existing icon
overlay infrastructure. Use case — Grafana dashboard, web chat, любой
HTML widget с transparent background поверх video composite.

Архитектура:
  BrowserRenderer launches один shared Chromium instance, per-dashboard
  page. Loop:
    page.reload (для свежих данных — Grafana auto-refresh не triggers
                 в headless mode без user interaction)
    page.add_style_tag (re-inject transparent CSS — reload teryает styles)
    page.wait_for_selector (если selector задан)
    page.screenshot(omit_background=True) или locator(selector).screenshot
    save PNG к icon_dir
    dispatcher._reload_icon → filter re-reads atlas

Config (dynamic_overlays.dashboards в controller.yaml):
  id, target_instance, cell, url, x, y, w_px, h_px,
  refresh_sec (default 2.0s, min 0.5s — frequent reload bad см. stutter memory),
  inject_css (default — transparent background + zero margins),
  selector (optional CSS selector — экспортить только конкретный element),
  viewport_w/h (override page viewport, default = w_px/h_px;
                полезно при selector чтобы page layout не collapsed),
  wait_until, page_timeout_ms, opacity, z_order.

Dockerfile:
  + pip install playwright
  + playwright install --with-deps chromium (~170MB Chromium + ~150MB system libs)

Если dashboards не нужны — можно убрать оба install'а (playwright
import lazy, BrowserRenderer.start() graceful no-op без playwright).

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
2026-05-21 23:09:50 +01:00
..

cuda-grid-controller

Control-plane sidecar для vf_cuda_grid FFmpeg filter. Transforms MQTT / HTTP REST commands от Home Assistant / Node-RED / custom apps в FFmpeg process_command через ZeroMQ. Publishes state + events наружу для bidirectional integration.

Статус: Phase 3 work-in-progress — basic skeleton + HA Discovery + ZMQ command bridge. Phase 4+ добавит overlays, audio orchestration.

Что умеет (Phase 3)

  • MQTT subscribe cuda_grid/cmd/<instance>/layout/set → ZMQ send → FFmpeg layout switch
  • MQTT publish cuda_grid/state/<instance>/layout (retained) + cuda_grid/event/.../layout_switched
  • HA MQTT Discovery — select.layout + sensor.current_layout + binary_sensor.online per instance
  • HTTP REST API: /health, /layouts, /state, POST /layout/{instance}/set
  • Multi-instance (несколько FFmpeg pipelines с разными ZMQ endpoints)
  • Auto-reconnect MQTT, LWT для availability tracking

Использование

pip install -e .

export MQTT_USERNAME=mqtt
export MQTT_PASSWORD=secret
cuda-grid-controller --config examples/controller.yaml

FFmpeg side — как подключить cuda_grid + zmq filter

ffmpeg -i cam1.mp4 -i cam2.mp4 -i cam3.mp4 -i cam4.mp4 \
  -filter_complex "
    [0:v][1:v][2:v][3:v]cuda_grid=layout=quad,
    zmq=bind_address=tcp\\\\://127.0.0.1\\\\:5555
  " \
  -c:v h264_nvenc out.mp4

(После этого controller с zmq_endpoint: tcp://127.0.0.1:5555 сможет переключать layout командой cuda_grid@... layout six_grid.)

HA dashboard

После startup controller'а — в Home Assistant появятся entities:

  • select.cuda_grid_<instance>_layout — dropdown с layouts
  • sensor.cuda_grid_<instance>_current_layout — текущий выбранный
  • binary_sensor.cuda_grid_controller_online — online/offline

Roadmap

Phase Что
3 (this) Basic skeleton + HA Discovery + ZMQ bridge для layout switching
4 Overlay API (rect/text/icon через side data)
5 Rich overlays (image/dim/graph/chat) + privacy filtering
6 Audio orchestration (state machine, domofon use case)

Полный design: docs/design.md.