Are you in the UK? Ultrafast Internet up to 8Gbps. Switch to YouFibre
Are you in the UK? Ultrafast Internet up to 8Gbps. Switch to YouFibre

Just Released: NVIDIA TensorRT-LLM 0.13.0

GIXnews
Decorative image of an atomic model icon connected to a computer monitor.

Updates include tensor parallel support for Mamba2, sparse mixer normalization for MoE models, and more.

Updates include tensor parallel support for Mamba2, sparse mixer normalization for MoE models, and more.

Source

Source:: NVIDIA