SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 2 months agoDo you host your own AI?message-squaremessage-square203linkfedilinkarrow-up1184arrow-down144file-text
arrow-up1140arrow-down1message-squareDo you host your own AI?SuspiciousCarrot78@aussie.zone to Selfhosted@lemmy.worldEnglish · 2 months agomessage-square203linkfedilinkfile-text
minus-squareirmadlad@lemmy.worldlinkfedilinkEnglisharrow-up2arrow-down1·2 months agoI was thinking something along the lines of: AMD Ryzen 9 9950X3D 4.3GHz NVIDIA Tesla M10 Quad 96GB DDR5 4TB 990 EVO M.2 Which, with all the other accoutrements like water cooling, etc, will put me right at the $4k mark. https://codeberg.org/BobbyLLM/picoGURU I’ll check it out.
minus-squareSuspiciousCarrot78@aussie.zoneOPlinkfedilinkEnglisharrow-up3arrow-down2·2 months agoNice bit of kit that. Very nice. Planning on serious AI shenanigans? I’ll check it out. Cool. It’s not ready any time soon but when it is, I’ll announce it and make sure it’s callable via SSH / terminal / OpenAI style chat end point. That way you don’t need anything fancier than a nice terminal to call it.
minus-squareirmadlad@lemmy.worldlinkfedilinkEnglisharrow-up3arrow-down2·2 months ago Planning on serious AI shenanigans Absolutely. Like I said, if I’m going to do it, I want to do it up right. I don’t want to come back in 5+ minutes for a result. LOL
minus-squareNatanox@discuss.tchncs.delinkfedilinkEnglisharrow-up3arrow-down2·2 months agoDamn bro, you’re treating yourself for sure! The RAM alone is what, 2k? 🥴
minus-squareirmadlad@lemmy.worldlinkfedilinkEnglisharrow-up3arrow-down2·2 months agoWell, I haven’t had any new equipment in 15 years. I always buy used or refurb’d. I’m getting old. I figure, I’ve worked hard enough, might as well enjoy the fruits of my labor.
I was thinking something along the lines of:
Which, with all the other accoutrements like water cooling, etc, will put me right at the $4k mark.
I’ll check it out.
Nice bit of kit that. Very nice. Planning on serious AI shenanigans?
Cool. It’s not ready any time soon but when it is, I’ll announce it and make sure it’s callable via SSH / terminal / OpenAI style chat end point.
That way you don’t need anything fancier than a nice terminal to call it.
Absolutely. Like I said, if I’m going to do it, I want to do it up right. I don’t want to come back in 5+ minutes for a result. LOL
Damn bro, you’re treating yourself for sure! The RAM alone is what, 2k? 🥴
Well, I haven’t had any new equipment in 15 years. I always buy used or refurb’d. I’m getting old. I figure, I’ve worked hard enough, might as well enjoy the fruits of my labor.