ai-suite-rocm-local/bitsandbytes-rocm-build
2024-06-30 22:19:28 +02:00
..
.gitignore First push 2024-06-30 22:06:23 +02:00
build.sh update bitsandbytes build system 2024-06-30 22:19:28 +02:00
Dockerfile update bitsandbytes build system 2024-06-30 22:19:28 +02:00
extract_build.sh update bitsandbytes build system 2024-06-30 22:19:28 +02:00
README.md update bitsandbytes build system 2024-06-30 22:19:28 +02:00

bitsandbytes-rocm-build-pip

This is a simple script to help you build the latest bitsandbytes for rocm. The official build process requires a lot of ROCM-related packages and can mess up your computer easily if you install the wrong packages.

This creates a Docker image that builds the package and extract the built wheel file that you can then easily install using pip.

./build.sh
./extract_build.sh

The wheel file will be in a folder named build_output/

You can also find my latest build in the releases section.