tensorrt-llm

TensorRT-LLM: A TensorRT Toolbox for Large Language Models

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install tensorrt-llm
PyPI page
pypi.org/project/tensorrt-llm
Project JSON
piwheels.org/project/tensorrt-llm/json
Versions
81
Files
0
Downloads (all time)
loading...
Downloads (last 30 days)
loading...

Releases

Version Released Bullseye
Python 3.9		 Bookworm
Python 3.11		 Files
0.19.0.dev2025040100 pre-release 2025-04-01    
0.19.0.dev2025032500 pre-release 2025-03-26    
0.19.0.dev2025031800 pre-release 2025-03-18    
0.18.0 2025-04-02
0.18.0.dev2025031100 pre-release 2025-03-12    
0.18.0.dev2025030400 pre-release 2025-03-05    
0.18.0.dev2025022500 pre-release 2025-02-26    
0.18.0.dev2025021800 pre-release 2025-02-19    
0.18.0.dev2025021101 pre-release 2025-02-13    
0.18.0.dev2025021100 pre-release 2025-02-13    
0.18.0.dev2025020400 pre-release 2025-02-07    
0.17.0.post1 2025-02-02    
0.17.0 yanked 2025-01-30    
0.17.0.dev2024121700 pre-release 2024-12-17    
0.16.0 2024-12-24    
0.16.0.dev2024121000 pre-release 2024-12-12    
0.16.0.dev2024120300 pre-release 2024-12-05    
0.16.0.dev2024112600 pre-release 2024-11-26    
0.16.0.dev2024111900 pre-release 2024-11-20    
0.15.0 2024-12-04    
0.15.0.dev2024111200 pre-release 2024-11-12    
0.15.0.dev2024110500 pre-release 2024-11-05    
0.15.0.dev2024102900 pre-release 2024-10-30    
0.15.0.dev2024102200 pre-release 2024-10-22    
0.15.0.dev2024101500 pre-release 2024-10-15    
0.14.0 2024-11-01    
0.14.0.dev2024100800 pre-release 2024-10-08    
0.14.0.dev2024100100 pre-release 2024-09-30    
0.14.0.dev2024092401 pre-release 2024-09-26    
0.14.0.dev2024092400 pre-release 2024-09-24    
0.14.0.dev2024091700 pre-release 2024-09-18    
0.14.0.dev2024091000 pre-release 2024-09-10    
0.13.0 2024-09-30    
0.13.0.dev2024090300 pre-release 2024-09-04    
0.13.0.dev2024082700 pre-release 2024-08-27    
0.13.0.dev2024082000 pre-release 2024-08-20    
0.13.0.dev2024081300 pre-release 2024-08-14    
0.12.0 2024-08-29    
0.12.0.dev2024080600 pre-release 2024-08-07    
0.12.0.dev2024073000 pre-release 2024-07-30    
0.12.0.dev2024072302 pre-release 2024-07-29    
0.12.0.dev2024072301 pre-release 2024-07-25    
0.12.0.dev2024072300 pre-release 2024-07-24    
0.12.0.dev2024071600 pre-release 2024-07-16    
0.12.0.dev2024070900 pre-release 2024-07-09    
0.12.0.dev2024070200 pre-release 2024-07-04    
0.11.0 2024-07-17    
0.11.0.dev2024062500 pre-release 2024-06-25    
0.11.0.dev2024061800 pre-release 2024-06-18    
0.11.0.dev2024061100 pre-release 2024-06-12    
0.11.0.dev2024060400 pre-release 2024-06-05    
0.11.0.dev2024052800 pre-release 2024-05-28    
0.11.0.dev2024052100 pre-release 2024-05-21    
0.11.0.dev2024051400 pre-release 2024-05-14    
0.10.0 2024-06-05    
0.10.0.dev2024050700 pre-release 2024-05-07    
0.10.0.dev2024043000 pre-release 2024-04-30    
0.10.0.dev2024042300 pre-release 2024-04-24    
0.10.0.dev2024041600 pre-release 2024-04-16    
0.9.0 2024-04-11    
0.9.0.dev2024040900 pre-release 2024-04-09    
0.9.0.dev2024040200 pre-release 2024-04-01    
0.9.0.dev2024032600 pre-release 2024-03-26    
0.9.0.dev2024031900 pre-release 2024-03-19    
0.9.0.dev2024031200 pre-release 2024-03-13    
0.9.0.dev2024030500 pre-release 2024-03-05    
0.9.0.dev2024022700 pre-release 2024-02-27    
0.9.0.dev2024022000 pre-release 2024-02-21    
0.9.0.dev2024020600 pre-release 2024-02-06    
0.8.0 2024-02-29    
0.8.0.dev2024013000 pre-release 2024-02-01    
0.8.0.dev2024012302 pre-release 2024-01-31    
0.8.0.dev2024012301 pre-release 2024-01-24    
0.8.0.dev2024011601 pre-release 2024-01-17    
0.8.0.dev20240123 pre-release 2024-01-24    
0.8.0.dev20240116 pre-release 2024-01-17    
0.7.1 2023-12-28    
0.7.0 2023-12-20    
0.6.1 2023-12-05    
0.5.0.post1 2023-11-01    
0.5.0 2023-10-20    

Issues with this package?

Key

Build succeeded
Build failed
Build skipped
Build pending

Page last updated 2025-04-02 10:23:36 UTC