Lab 11: KServe Inference with HAMi DRA GPU Sharing
Deploy a KServe Standard vLLM service and run two Predictor replicas on one NVIDIA GPU through native HAMi DRA claims.
5 docs tagged with "hami"
View all tagsLab 15: Run SGLang on HAMi GPU Shares
Install HAMi on a GPU cluster and schedule SGLang inference services with GPU partitioning.
Lab 16: Dynamic MIG Lifecycle on RTX PRO 6000
Install HAMi v2.10.0 and verify per-Pod MIG placement, mixed profiles, selective reclamation, restart recovery, and multi-GPU spillover.
Lab 19: Hard-Slicing an Ascend 310P3 vNPU with HAMi
Install HAMi 2.10.0 and the Ascend device plugin, then verify template matching, multi-Pod sharing, capacity exhaustion, whole-card exclusion, and monitoring on an Ascend 310P3.
Lab 5: Fake-GPU Scheduling with nvml-mock
Simulate 8 A100 GPUs with HAMi scheduling features, no real GPU needed.
