Invalid TensorRT-LLM Wheel File During Installation ERROR: Wheel 'tensorrt-llm' located at tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl is invalid.

[wxn1229]

Issue: Invalid TensorRT-LLM Wheel File During Installation

Environment

• OS: Windows
• Python Version: 3.10.11
• Installation Path: D:\roop_api\rtx_service\ChatRTX_APIs\dist

Steps to Reproduce

1. Downloaded tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl from the repository
2. Navigated to the directory containing the wheel file
3. Ran the installation command:

pip install tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl --extra-index-url https://pypi.nvidia.com --extra-index-url https://download.pytorch.org/whl/cu121

Error Message

Looking in indexes: https://pypi.org/simple, https://pypi.nvidia.com, https://download.pytorch.org/whl/cu121
Processing d:\roop_api\rtx_service\chatrtx_apis\dist\tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl
ERROR: Wheel 'tensorrt-llm' located at D:\roop_api\rtx_service\ChatRTX_APIs\dist\tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl is invalid.

What I've Tried

• Verified Python version is 3.10.11
• Confirmed the wheel file exists in the specified path
• Using the exact installation command from the README

Questions

1. Is there a known issue with this wheel file?
2. Are there any specific prerequisites I might be missing?
3. Is there an alternative installation method available?

Any help or guidance would be greatly appreciated.

[anujj]

Please try with python 3.10 version

[wxn1229]

I'm currently using Anaconda environment and have tried with different Python 3.10 versions (3.10.0 and 3.10.16), but still getting the same error:

pip install tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl --extra-index-url https://pypi.nvidia.com --extra-index-url https://download.pytorch.org/whl/cu121
Looking in indexes: https://pypi.org/simple, https://pypi.nvidia.com, https://download.pytorch.org/whl/cu121
Processing d:\roop_api\rtx_service\chatrtx_apis\dist\tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl
ERROR: Wheel 'tensorrt-llm' located at D:\roop_api\rtx_service\ChatRTX_APIs\dist\tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl is invalid.

Environment details:

• Using Anaconda virtual environment
• Python versions tested: 3.10.0, 3.10.16
• Windows OS
• Fresh conda environment for testing

Additional information:

1. Created fresh conda environments for each Python version
2. Made sure all paths are correct
3. Downloaded the wheel file directly from the repository

Questions:

1. Could you confirm if the wheel file in the repository is correct and not corrupted?
2. Are there any additional prerequisites that might be needed?
3. Could you share the exact steps that worked for you?
4. Should I try using a regular venv instead of Anaconda? Does it make any difference?

[anujj]

Wheel in the repo is correct.. I am able to use this wheel

[akaanupkumar]

We verify using venv.

we have released 0.5 version. Please go through the pre-requisites mentioned in readme and give this version a try.