Affected Vendor(s)
Affected Product(s)
Summary
Mindgard discovered a vulnerability in NVIDIA TensorRT-LLM (v1.3.0rc5), a distributed large language model inference framework for GPU-accelerated serving. The issue affects TensorRT-LLM’s disaggregated serving architecture and manifests in how serialized communication state is transferred between inference components.
Timeline
Credit
Blog Post
References
Mindgard secures AI models, agents, and applications against exploitable threats. Spun out of more than a decade of pioneering AI security research at Lancaster University, Mindgard combines offensive security expertise, AI red teaming, attacker intelligence, and automated protection to help organizations discover, assess, and mitigate risk across AI models, agents, and applications.
