Skip to content
  • stefan-sebastian.romas's avatar
    Add server monitoring and semantic routing · 065feee1
    stefan-sebastian.romas authored
    Adds live server monitoring, per-rank timing/resource profiling, and health reporting for RAM/VRAM components. Routing now uses bounded semantic units with batched embeddings and updated scoring, plus bounded HTTP workers and a `--no-monitor` flag. Includes coverage for semantic scoring and profiling behavior.
    065feee1