Search results

[bug] AutoDeploy: Remove Standalone Test Timeout

AutoDeploy/llmc-blocker<NV> Tag for issues that are blocking AutoDeploy standalone repo<NV> Tag for issues that are blocking AutoDeploy standalone repo

Status: Open.

#13535 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Apr 28, 2026

[chore] AutoDeploy: Remove Two Model Speculative Decoding

Speculative Decoding<NV>MTP/Eagle/Medusa/Lookahead/Prompt-Lookup-Decoding/Draft-Target-Model/ReDrafter<NV>MTP/Eagle/Medusa/Lookahead/Prompt-Lookup-Decoding/Draft-Target-Model/ReDrafter

Status: Open.

#13534 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Apr 28, 2026

[Feature]: AutoDeploy: MultiLorA TP > 1

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#13524 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Apr 27, 2026

[Feature]: AutoDeploy: MultiLorA Fusion Pass

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Lora/P-tuningParameter-Efficient Fine-Tuning (PEFT) like LoRA/P-tuning in TRTLLM: adapter use & perf.Parameter-Efficient Fine-Tuning (PEFT) like LoRA/P-tuning in TRTLLM: adapter use & perf.

Status: Open.

#13522 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Apr 27, 2026

[Feature]: AutoDeploy: MultiLorA Support

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#13521 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Apr 27, 2026

[Feature]: cache transfer without extra GPU memory allocation for long ISL requests

Disaggregated serving<NV>Deploying with separated, distributed components (params, kv-cache, compute). Arch & perf.<NV>Deploying with separated, distributed components (params, kv-cache, compute). Arch & perf.

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#13506 In NVIDIA/TensorRT-LLM;

· YimianFang opened on Apr 27, 2026

[None][feat] Add duration-based execution to trtllm-bench

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#13487 In NVIDIA/TensorRT-LLM;

· weikuo0506 opened on Apr 27, 2026

[Feature]: Add NVFP4 support for AD dashboard

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

AutoDeploy/Dashboard<NV> AutoDeploy Backend: Dashboard related<NV> AutoDeploy Backend: Dashboard related

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#13472 In NVIDIA/TensorRT-LLM;

· tcherckez-nvidia opened on Apr 26, 2026

[Feature]: Merge Remaining Models from Sprint

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

new modelRequest to add a new modelRequest to add a new model

Status: Open.

#13446 In NVIDIA/TensorRT-LLM;

· govind-ramnarayan opened on Apr 24, 2026

[Feat] Support DeepSeek-V4 in PyTorch backend

Pytorch<NV>Pytorch backend related issues<NV>Pytorch backend related issues

Status: Open.

#13435 In NVIDIA/TensorRT-LLM;

· weikuo0506 opened on Apr 24, 2026

[New Model]: DeepSeek V4 support https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro

new modelRequest to add a new modelRequest to add a new model

Status: Open.

#13431 In NVIDIA/TensorRT-LLM;

· inference666 opened on Apr 24, 2026

[AutoDeploy][Feature]: Switch nemotron-H, qwen3, qwen3.5-moe, deepseek to sharding IR (step 2)

AutoDeploy<NV> AutoDeploy Backend<NV> AutoDeploy Backend

feature requestNew feature or request. This includes new model, dtype, functionality supportNew feature or request. This includes new model, dtype, functionality support

Status: Open.

#13429 In NVIDIA/TensorRT-LLM;

· greg-kwasniewski1 opened on Apr 24, 2026