ai-suite-rocm-local/bitsandbytes-rocm-build
2024-08-27 16:01:31 +02:00
..
.gitignore First push 2024-06-30 22:06:23 +02:00
bitsandbytes-0.43.3.dev0-cp310-cp310-linux_x86_64.whl move bnb whl 2024-08-19 18:45:15 +02:00
build.sh update bitsandbytes build system 2024-06-30 22:19:28 +02:00
Dockerfile update bitsandbytes build script 2024-08-19 18:43:30 +02:00
extract_build.sh update bitsandbytes build system 2024-06-30 22:19:28 +02:00
README.md add llamacpp build 2024-08-27 16:01:31 +02:00

bitsandbytes-rocm-build-pip

This is a simple script to help you build the latest bitsandbytes for rocm. The official build process requires a lot of ROCM-related packages and can mess up your computer easily if you install the wrong packages.

This creates a Docker image that builds the package and extract the built wheel file that you can then easily install using pip.

./build.sh
./extract_build.sh

The wheel file will be in a folder named build_output/

You might also find one of my already built wheel in this folder or on the github releases page (may not be up to date)