Say you want to dedicate a Pi5 to an LLM AI application, now there is a way to wrap it up nicely.
https://hacks.mozilla.org/2023/11/intro ... llamafile/
It says Pi5 will run it too.
I can say it compiled but I don't know what to do with it yet![;)]( "Wink")
https://github.com/Mozilla-Ocho/llamafile
It should make installing LLMs a bit simpler, especially for Embedded Pi's.
https://hacks.mozilla.org/2023/11/intro ... llamafile/
It says Pi5 will run it too.
I can say it compiled but I don't know what to do with it yet
https://github.com/Mozilla-Ocho/llamafile
It should make installing LLMs a bit simpler, especially for Embedded Pi's.
Statistics: Posted by Gavinmc42 — Tue Apr 02, 2024 4:17 am