NVIDIA Green Contexts：如何控制 GPU 工作共享
Control How Your GPU Shares Work with Green Contexts
NVIDIA 介绍 Green Contexts，用于控制单个进程内多个独立组件间的 GPU 资源分配。该机制面向延迟敏感算子与后台吞吐内核、数据预处理与模型推理、多阶段工作流等需共享同一 GPU 的场景，解决 GPU 资源共享控制困难的问题。
GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator...
GPU applications increasingly consist of multiple independent components running at the same time within a single process: a latency-sensitive operator alongside a throughput-oriented background kernel; a data preprocessing stage alongside model inference; or multiple stages of a processing workflow sharing a single GPU. Controlling how GPU resources are shared between them remains difficult.
来源：NVIDIA Technical Blog · developer.nvidia.com