Using Local LLMs with Smart CodeInsight in RAD Studio - Code Partners

You might check out this (aussie) guy’s videos …

There are these cards around that have come out of servers (I presume) that rely on external cooling … but have much lower prices for the memory they carry.

I’ve just added my old 1070 card back in with my 3070 (each one 8GB vram), and have been experimenting with that.