xfastertransformer-icx

Boost large language model inference performance on CPU platform.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install xfastertransformer-icx

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
1.8.2 2024-10-10
1.8.1 2024-07-31
1.8.0 2024-07-23
1.7.3 2024-06-27
1.7.2 2024-06-18
1.7.1 2024-06-12
1.7.0 2024-06-05
1.6.0.0 2024-05-16

Issues with this package?

Page last updated 2024-10-10 07:52:18 UTC