Faster local AI - FreeToken

AI
1

This looks interesting

I haven’t tried it as I only have an old 3060ti GPU.

1 Like
2

The program looks good.
A lot of people asking for it to support multiple GPUs.
(Ollama seems to handle this fine.)

3

4

Install for Windows & Linux