mathieu/ai-suite-rocm-local
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases 1 Wiki Activity
An easy to setup, all-in-one AI software suite for AMD GPU on Linux (ROCM)
70 Commits 2 Branches 3 Tags 665 KiB
Python 90.7%
Shell 5.1%
Dockerfile 4.2%
v2-python
Go to file
Mathieu Broillet d2afc0fdd2
fixed errors
2024-10-11 20:23:26 +02:00
.github/workflows add xformers to prebuilts 2024-10-05 12:11:19 +02:00
core fixed errors 2024-10-11 20:23:26 +02:00
prebuilts remove xformers to prebuilts 2024-10-05 14:19:15 +02:00
services update services to refactor 2024-10-05 14:23:55 +02:00
ui fix screen alive status 2024-10-05 14:35:58 +02:00
.gitignore update gitignore 2024-08-28 10:42:19 +02:00
build.sh update rocm to 6.2 2024-09-23 18:29:56 +02:00
main.py update services to refactor 2024-10-05 14:23:55 +02:00
README.md set chmod +x entrypoint 2024-08-28 14:02:08 +02:00
requirements.txt add build workflow 2024-08-30 12:20:41 +02:00

README.md

ai-suite-rocm-local

This is a simple project to make hosting multiple AI tools easily on Linux with AMD GPUs using ROCM locally (without docker).

Warning

Currently rewriting this project to be more modular and easier to use. This is a work in progress. Instructions below outdated !

To use you have to clone the repo run the install script for the service you want to use.

git clone https://git.broillet.ch/mathieu/ai-suite-rocm-local.git
cd ai-suite-rocm-local/<service name>/
./install.sh

Then you can run whichever service you want using their respectives run.sh scripts.

./run.sh

This has been tested on Fedora 40 with kernel 6.9.6 with an AMD RX 6800 XT.