mathieu/ai-suite-rocm-local
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
An easy to setup, all-in-one AI software suite for AMD GPU on Linux (ROCM)
46 Commits 2 Branches 3 Tags 665 KiB
Python 90.7%
Shell 5.1%
Dockerfile 4.2%
06d9e39f9d
Go to file
Mathieu Broillet 06d9e39f9d
qol impro.
2024-08-29 12:10:20 +02:00
.github/workflows fix artifacts upload ? 2024-08-28 16:30:46 +02:00
core qol impro. 2024-08-29 12:10:20 +02:00
prebuilts try to fix dockerfile arch synthax (need testing) 2024-08-29 12:05:53 +02:00
services fixed daemon running system 2024-08-29 12:03:37 +02:00
ui fixed daemon running system 2024-08-29 12:03:37 +02:00
.gitignore update gitignore 2024-08-28 10:42:19 +02:00
main.py massive refactor, added terminal interface, daemon system (still not working) 2024-08-28 22:20:36 +02:00
README.md set chmod +x entrypoint 2024-08-28 14:02:08 +02:00

README.md

ai-suite-rocm-local

This is a simple project to make hosting multiple AI tools easily on Linux with AMD GPUs using ROCM locally (without docker).

Warning

Currently rewriting this project to be more modular and easier to use. This is a work in progress. Instructions below outdated !

To use you have to clone the repo run the install script for the service you want to use.

git clone https://git.broillet.ch/mathieu/ai-suite-rocm-local.git
cd ai-suite-rocm-local/<service name>/
./install.sh

Then you can run whichever service you want using their respectives run.sh scripts.

./run.sh

This has been tested on Fedora 40 with kernel 6.9.6 with an AMD RX 6800 XT.