-
stefan-sebastian.romas authored
Adds live server monitoring, per-rank timing/resource profiling, and health reporting for RAM/VRAM components. Routing now uses bounded semantic units with batched embeddings and updated scoring, plus bounded HTTP workers and a `--no-monitor` flag. Includes coverage for semantic scoring and profiling behavior.