An easy to setup, all-in-one AI software suite for AMD GPU on Linux (ROCM)

Go to file

Mathieu Broillet a6728d3d1c massive refactor, added terminal interface, daemon system (still not working)		2024-08-28 22:20:36 +02:00
.github/workflows	fix artifacts upload ?	2024-08-28 16:30:46 +02:00
core	massive refactor, added terminal interface, daemon system (still not working)	2024-08-28 22:20:36 +02:00
prebuilts	try without -complete	2024-08-28 16:08:40 +02:00
services	massive refactor, added terminal interface, daemon system (still not working)	2024-08-28 22:20:36 +02:00
ui	massive refactor, added terminal interface, daemon system (still not working)	2024-08-28 22:20:36 +02:00
.gitignore	update gitignore	2024-08-28 10:42:19 +02:00
main.py	massive refactor, added terminal interface, daemon system (still not working)	2024-08-28 22:20:36 +02:00
README.md	set chmod +x entrypoint	2024-08-28 14:02:08 +02:00

ai-suite-rocm-local

This is a simple project to make hosting multiple AI tools easily on Linux with AMD GPUs using ROCM locally (without docker).

Warning

Currently rewriting this project to be more modular and easier to use. This is a work in progress. Instructions below outdated !

To use you have to clone the repo run the install script for the service you want to use.

git clone https://git.broillet.ch/mathieu/ai-suite-rocm-local.git
cd ai-suite-rocm-local/<service name>/
./install.sh

Then you can run whichever service you want using their respectives run.sh scripts.

./run.sh

This has been tested on Fedora 40 with kernel 6.9.6 with an AMD RX 6800 XT.