minus-squareboudica@lemmy.worldtoSelfhosted@lemmy.world•Is anyone self-hosting their own AI?linkfedilinkEnglisharrow-up4·2 days agoLlama.cpp running qwen 3.8 on a mini PC with 32GB ddr5 ram and 8GB vram. Not the most speedy but it works. I only really access it while at home but I’m also set up with tailscale. linkfedilink
minus-squareboudica@lemmy.worldtoSelfhosted@lemmy.world•ISP won't set up static IP - Services keep going downlinkfedilinkEnglisharrow-up9·4 days agoDynamic dns is what you need. Only takes a few minutes to set up linkfedilink
Llama.cpp running qwen 3.8 on a mini PC with 32GB ddr5 ram and 8GB vram. Not the most speedy but it works. I only really access it while at home but I’m also set up with tailscale.