# Research paper: GPU-Virt-Bench: A Comprehensive Benchmarking Framework for Software-Based GPU Virtualization Systems — retained record

> Retained semantic-scholar record from semantic-scholar.

Canonical: https://highsignal.app/data/records/6163968c8c9a3e8f

[← sources](https://highsignal.app/data)


source: [semantic-scholar](https://highsignal.app/data/semantic-scholar) published 2025-11-26 00:00 ingested 2026-07-25 07:53

[NVIDIA Corporation](https://highsignal.app/entities/NVDA)[original source ↗](https://www.semanticscholar.org/paper/4bcdfb14f3491dd09ea77625ebe0bfc9f1ff8eeb)

## retained text



```
Query: large language model inference gpu datacenter
Authors: VG Jithin, PS Ditto
Citations: 0
The proliferation of GPU-accelerated workloads, particularly in artificial intelligence and large language model (LLM) inference, has created unprecedented demand for efficient GPU resource sharing in cloud and container environments. While NVIDIA's Multi-Instance GPU (MIG) technology provides hardware-level isolation, its availability is limited to high-end datacenter GPUs. Software-based virtualization solutions such as HAMi-core and BUD-FCSP offer alternatives for broader GPU families but lack standardized evaluation methodologies. We present GPU-Virt-Bench, a comprehensive benchmarking framework that evaluates GPU virtualization systems across 56 performance metrics organized into 10 categories. Our framework measures overhead, isolation quality, LLM-specific performance, memory bandwidth, cache behavior, PCIe throughput, multi-GPU communication, scheduling efficiency, memory fragmentation, and error recovery. GPU-Virt-Bench enables systematic comparison between software virtualization approaches and ideal MIG behavior, providing actionable insights for practitioners deploying GPU resources in multi-tenant environments. We demonstrate the framework's utility through evaluation of HAMi-core, BUD-FCSP, and simulated MIG baselines, revealing performance characteristics critical for production deployment decisions.
```



document fetched 2026-08-06 08:19 · canonical https://semanticscholar.org/paper/4bcdfb14f3491dd09ea77625ebe0bfc9f1ff8eeb
