mathieu/ai-suite-rocm-local
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
An easy to setup, all-in-one AI software suite for AMD GPU on Linux (ROCM)
25 Commits 2 Branches 3 Tags 665 KiB
Python 90.7%
Shell 5.1%
Dockerfile 4.2%
11c9e812ec
Go to file
Mathieu Broillet 11c9e812ec
try to free some space on github runner
2024-08-28 11:28:43 +02:00
.github/workflows try to free some space on github runner 2024-08-28 11:28:43 +02:00
prebuilts split dockerfile with entrypoint and test github workflow 2024-08-28 11:18:19 +02:00
services add all the old services 2024-08-28 10:39:27 +02:00
.gitignore update gitignore 2024-08-28 10:42:19 +02:00
main.py add new system base in python for services 2024-08-28 10:39:16 +02:00
README.md remove all shell scripts from before 2024-08-28 10:38:05 +02:00
utils.py add new system base in python for services 2024-08-28 10:39:16 +02:00

README.md

ai-suite-rocm-local

This is a simple project to make hosting multiple AI tools easily on Linux with AMD GPUs using ROCM locally (without docker).

Warning

Currently rewriting this project to be more modular and easier to use. This is a work in progress. Instructions below outdated !

To use you have to clone the repo run the install script for the service you want to use.

git clone https://git.broillet.ch/mathieu/ai-suite-rocm-local.git
cd ai-suite-rocm-local/<service name>/
./install.sh

Then you can run whichever service you want using their respectives run.sh scripts.

./run.sh

This has been tested on Fedora 40 with kernel 6.9.6 with an AMD RX 6800 XT.