Yeah mine is a Broadwell i7, 3.1ghz with boost up to 3.4ghz, model number 5557U. The guy I bought it from maxed out the specs at launch and I bought pretty cheap a few years ago. For a ten year old device it runs like a dream and handles pretty much anything short of gaming and video editing with ease

This is very true to be fair, I’ve noticed it hallucinating multiple times. Critical thinking should be taught in schools, I feel like kids growing up with LLMs are taking way too much of it what they say at face-value. Interrogation and reflection is a must. For me, I use it as a shortcut to gain a base-level of knowledge, I only tinker when I’m sure I have the right information and won’t mess anything up.

I’d likely be running it with the lid closed 95% of the time

Okay thanks. Damn shame manufacturers keep removing useful ports

I should definitely play it relatively safe when it comes to this stuff. But I do think that, in lieu of formal training in networking, LLMs can be useful in the hands of someone who is cautious and responsible. I’m an adult with a full time job and other responsibilities, I don’t have the time or the inclination to take a course on networking. So, I’m strictly a hobbyist when it comes to this stuff, but I’m also not an idiot who thinks ChatGPT can magically solve any problems I throw at it.

That’s definitely a consideration. Are minipcs less power-hungry?

Thanks, yeah my Mac will be a dedicated machine for this setup. Do you think I should keep sonoma on it (obviously that’s an issue as far as my goal of going all-FOSS) or install proxmox/ another Linux distro?

Thank you, I’ll look into VPS, that’s new territory for me.

Re transcoding on Jellyfin. Yes that’s something I have considered. A lot of my media is x265 10-bit 1080p stuff, decent quality but not huge lossless blu-ray rips. I stick to encodes that are about 4-8gb a movie. Clients connecting to the server are a couple of laptops and two smart tvs using the native Jellyfin apps. So far I’ve only run into issue with things like AV1 files or very large 4k rips that won’t play on smart tv, mkvs play fine.

Thanks for the reply. Regarding pi-hole on WiFi, I can connect the laptop via LAN with a usb adapter. So that may mitigate that issue

Thanks for the info. Yeah, I was wondering what kind of hardware you’d need to host LLMs locally with decent performance and your post clarifies that. I doubt many people would have the kind of hardware required.

Hi there, I’m thinking about getting into self-hosting. I already have a Jellyfin server set up at home but nothing beyond that really. If you have a few minutes, how can self-hosting help in the context of OPs post? Do you mean hosting LLMs on Ollama?

Does using rdx benefit Reddit at all? I don’t have a Reddit account anymore but I sometimes check it with rdx but I think im ready to cut ties altogether.