The developer behind Teach My Little Sister How to Drive, a driving instruction sim where you instruct a generative-AI-powered, dynamic NPC, has been spending $1,000 dollars a day to keep the demo working.

  • Taasz/Woof@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    19
    arrow-down
    2
    ·
    5 days ago

    Given that people playing this have GPUs, why not run the AI model locally? I can’t imagine it needs to be a very large model.

    • aksdb@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      5 days ago

      Actually sounds like the perfect use case for a model like Jev. I think Jevos should be able to handle that locally.

    • Encrypt-Keeper@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      4 days ago

      Because even very small models will take up a large chunk of your cards VRAM, if not all of it. And then you still have to render the game on top of it.

      • Taasz/Woof@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        It looks like a very simple game graphically, so having say 2GB VRAM left over for a small model would probably be viable?

      • humanspiral@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 days ago

        There are 1-2gb vram models that should fit in anything. Game doesn’t appear to be texture heavy, and targetting a 6gb gpu, would cover anything less than 10-12 years old.

        • Encrypt-Keeper@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          4 days ago

          A 1-2 min vram model would probably not be sufficient for what the game is trying to do. Those micro models aren’t really for anything beyond basic object image recognition or RAG searching