• BlameThePeacock@lemmy.ca
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    2
    ·
    3 days ago

    Shrinking demand for LLMs? What planet are you living on?

    If you look at OpenRouter’s history back a year you can see the massive explosion in inference tokens consumed. https://openrouter.ai/rankings?view=month#top-models Obviously that’s not a perfect representation of the entire market given that the major companies also provide their own inference, but it’s the largest public view of usage and is likely extremely representative of what’s going on behind the scenes.

    The only thing holding more organizations back from using even more inference is cost, so any sort of “pop” is just going to immediately be eaten up by increased usage at slightly lower prices.

    Will a bunch of investors lose their shirts? Absolutely, but there is no lack of demand for datacenters right now.

    • Nocklusamigos@lemmy.world
      link
      fedilink
      arrow-up
      1
      ·
      1 day ago

      Lets see how that plays out with increasing prices of electricity, cooling systems, fresh water.

      Next year will be full of surprises:

      1. Insanely hot heat waves
      2. Grid system failures as a result
      3. shortage of fresh water
      4. difficulty of cooling those data centers (there will be more of them)

      AI efficiency has to double at least to be viable at that point

      • BlameThePeacock@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        1 day ago

        AI currently (as of a month ago) only uses about 0.5% of total global energy. It’s not as big of a threat to the environment as you seem to think it is.

        Not to mention that the 2, 3, and 4 are failures by your government. My local government doesn’t have those issues because they properly regulated datacenters already.

        New datacenters here have to bid for specific limited available power blocks yearly when the utility determines how much will be available to their use, they also can’t be built with evaporative cooling anymore, and… 4 doesn’t apply because we don’t use evaporative cooling anymore.

        It’s fucking hilarious that the US is allowing datacenters to be build with evaporative water cooling in the middle of fucking deserts and/or drought regions. Stop being idiots.

        • Nocklusamigos@lemmy.world
          link
          fedilink
          arrow-up
          1
          arrow-down
          1
          ·
          22 hours ago

          I dont know why you have to lie. It is 1.5% officially but my guess is 3% at least. Which is huge. 2,3,4 already a problem in some parts of USA and you I wrote about future problems. Maybe your gov is able to offload 2, 3, 4 to the nature but it is not your gov beinf smart, it is harming my home, my life and for what for useless pet projects and useless media

          • BlameThePeacock@lemmy.ca
            link
            fedilink
            English
            arrow-up
            1
            ·
            18 hours ago

            Nope, it’s not. You’re counting “electricity usage” not energy usage.

            Those are not the same thing.

      • Nocklusamigos@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 day ago

        And keep in mind. Grids need cooling, people need more ac, data centers need more ac, fresh water needs electricity. It is just going to snowball

        • codydodd@lemmy.ca
          link
          fedilink
          arrow-up
          3
          arrow-down
          1
          ·
          2 days ago

          Ceos are turning sour as ability measure ROI has proven elusive. Also, the above implies a slow increase to prices which is already happening.