用 C++ 和 NVIDIA TensorRT RTX 示例构建本地 AI 应用
Build Local AI Apps with C++ and NVIDIA TensorRT RTX Samples
NVIDIA 发布开源 C++ 示例集 Do Inference Now (DIN) Deploy,结合 ONNX Runtime 与 NVIDIA TensorRT RTX 执行提供程序,帮助开发者将模型检查点部署为本地原生 AI 应用。该示例集面向需要可移植模型格式、可靠运行时和跨目标系统加速的本地 AI 应用场景。
Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference Now...
Adding AI models to local applications requires a portable model format, a reliable runtime, and acceleration that works across target systems. Do Inference Now (DIN) Deploy is an open-source collection of practical C++ samples that bridges that gap. It combines ONNX Runtime with the NVIDIA TensorRT RTX execution provider to help developers move from a model checkpoint to a native…
来源:NVIDIA Technical Blog(开发者技术博客 · RSS) · developer.nvidia.com