I have an alternative for you if your power bills are cheap: X99 motherboard + CPU combos from China

In general how much VRAM do I need for 14B and 24B models?

I didn’t know that. I thought just one ROCM binary to install, run Ollama and that’s it. Thanks for the explanation

Do you have any recommendations for running the Mistral small model? I’m very interested in it alongside CodeLlama, OogaBooga and others

Wait how does that work? How is 24GB enough for a 38B model?

The 7900XTX was $1000 when it launched, I wouldn’t mind it used either.

I don’t mind multiple GPUs but my motherboard doesn’t have 2+ electrically connected X16 slots. I could build a new homeserver (I’ve been thinking about it) but consumer platforms simply don’t have the PCIE lanes for 2 actual x16 slots. I’d have to go back to Broadwell Xeons for that, which are really power hungry. Oh well, I don’t think it matters considering how power hungry GPUs are now.

I am OK with either Nvidia or AMD especially if Ollama supports it. With that said I have heard that AMD takes some manual effort whilst Nvidia is easier. Depends on how difficult ROCM is

Thank you. Are 14B models the biggest you can run comfortably?

Do you have 2 PCIE X16 slots on your motherboard (speaking in terms of electrical connections)?

Rage-read until the second paragraph lol

I don’t know how PoW works but do you think that TOR and Dread’s PoW can be reused?

Honestly I have no idea how PoW works at all. I’m just happy to see the innovation in this space. With that said, people have raised the idea of using TOR’s PoW mechanism, or in my case, Dread’s PoW. I believe both of them work without JavaScript

Anubis without JavaScript is what I’m waiting for. I know that the Darknet forum Dread has a PoW system that doesn’t use JS (or maybe it does something else entirely and I completely missed it)

I know that LineageOS devs were complaining about OP not giving them the unbrick tool anymore, without which they can’t test their ROM. I don’t know if anything has changed since then

The last 3 generations of OnePlus phones do not have custom ROM support AFAIK. They either refuse to unlock the bootloader or do not provide the tool to unbrick the phone anymore, making testing custom ROMs impossible

No custom ROM support == no buy from me

What ratio are you at with your Linux ISOs *wink.

Ooh XE Iaso’s blog. I watched a couple of her videos on YouTube. What a talented person

I stopped using the LX suite when they stopped working on LXDE and switched to LXQT. I think I need to look towards openbox for a minimal DE experience