2024-06-30 22:06:23 +02:00
|
|
|
# ai-suite-rocm-local
|
|
|
|
|
|
2024-08-28 14:02:08 +02:00
|
|
|
This is a simple project to make hosting multiple AI tools easily on Linux with AMD GPUs using ROCM locally (without
|
|
|
|
|
docker).
|
2024-06-30 22:06:23 +02:00
|
|
|
|
2024-08-28 10:38:05 +02:00
|
|
|
> [!WARNING]
|
|
|
|
|
> Currently rewriting this project to be more modular and easier to use. This is a work in progress.
|
|
|
|
|
> Instructions below outdated !
|
|
|
|
|
|
2024-06-30 22:06:23 +02:00
|
|
|
To use you have to clone the repo run the install script for the service you want to use.
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
git clone https://git.broillet.ch/mathieu/ai-suite-rocm-local.git
|
|
|
|
|
cd ai-suite-rocm-local/<service name>/
|
|
|
|
|
./install.sh
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Then you can run whichever service you want using their respectives run.sh scripts.
|
|
|
|
|
|
|
|
|
|
```bash
|
|
|
|
|
./run.sh
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
*This has been tested on Fedora 40 with kernel 6.9.6 with an AMD RX 6800 XT.*
|
|
|
|
|
|
