Faster LLM's by using bitnet?
https://github.com/kyegomez/BitNet
The examples ran, no idea what to do with it yet but faster LLM's on PI5 and Pi4 has to be good.
FYI, Intel can do 1Bit math, AMD/Nvidia cannot?
Something to check before I spend money for $$$$ PC n GPU.
I have used Yolo which is one bit based NN on Pi4.
Deepvision in Processing uses Yolo.
https://github.com/kyegomez/BitNet
The examples ran, no idea what to do with it yet but faster LLM's on PI5 and Pi4 has to be good.
FYI, Intel can do 1Bit math, AMD/Nvidia cannot?
Something to check before I spend money for $$$$ PC n GPU.
I have used Yolo which is one bit based NN on Pi4.
Deepvision in Processing uses Yolo.
Statistics: Posted by Gavinmc42 — Thu Mar 21, 2024 2:57 am