• 1 Post
  • 597 Comments
Joined 2 years ago
cake
Cake day: March 22nd, 2024

help-circle
  • Not just them. GLM, Qwen, Kimi, Stepfun, Baidu’s models. Z-Image. Small finetuners, Huawei’s prototype. There’s even a Chinese fast food chain that trains a ridiculously good audio/text mixed model (Longcat).

    I actually thought the recent Deepseek preview was a little underwhelming and “deep fried” compared to competition, though maybe it’s just underbaked. And the architecture is interesting.

    Gemma is great, too, if Google would actually unrestrain it and give it Gemini’s architecture.

    Europe is struggling though. Mistral (and everyone else) basically can’t do anything because the EU left regulation ambiguous; however strictly they regulate AI (and it should be pretty strict), anything is better than “we have no idea if we’ll get litigated, the law is clear as mud and might change?” They have at least one communal training project too, but everything I’ve seen is weirdly dated, architecture wise, like they’re living two years in the past.


  • A constriction on GPUs is literally the best thing to ever happen to Chinese ML dev.

    It made them thrifty, it made them focus, it forced them to go open weights, it made them build proper ASICs, research new techniques, pay engineers to implement them, and now their models are supremely efficient, dirt cheap, running Nvidia free on Huawei NPUs, and close to better tools than the US models.

    Meanwhile, US models are all (except maybe Google) enshittifying and getting benchmaxxed. Engineers are wasting man hours hopelessly trying to scale training, which does not scale like people think, and are literally giving GPUs busywork to meet utilization quotas. They’re trying to scale data and parameter count, without improving architecture or data quality or even basic problems like random token sampling, and it’s not working anymore.

    At the same time, the big US AI houses have squashed nearly every bit of “garage innovation” I’ve seen. Cool teams, hero devs with proven work on a budget, they all just disappear into the maw of Microsoft or whomever like it’s a black hole, their work never integrated into anything.

    US AI is GOING to collapse because we gave all the money to tech bros so they can poison the well. The ML research community has been screaming this since like 2022. And apparently before, as Aaron Swartz allegedly identified Altman as a sociopath right before he died by suicide.


    Sorry to rant.

    Not that China doesn’t have significant dev issues, to be clear.

    Europe, too.

    But this is a sensitive point for me. Hobbyist machine learning has been a passion of mine for a decade, and it makes me sick to hear people quote Altman, like throwing GPUs at tech bros going to fix this. That. Is. A. LIE.


    I don’t have a solution either. In the AI space, I do not even see a path back to moonshot-style cooperative innovation like the US has repeatedly pulled off before.



  • Can we agree that Brave:

    • Is scummy.

    • Has a shady ceo, and a shady history.

    • Is possibly a security risk.

    • Is still orders of magnitude better than using Google Chrome.

    And that:

    • This headline is both true and clickbait-ish.

    • You can turn these things off in Brave’s settings, for free.

    • That doesn’t make this feature not scummy.

    Basically no one should be using Brave, but no one should be using Google Chrome either, yet here we are.

    And the revolving door of “best unabandoned Chromium fork to use” (Helium for the moment, or Ungoogled Chromium if you don’t mind some broken features, just to name two), is buried under so much SEO that it’s legitimately difficult to research.

    So… I’m not gonna go out of my way to flame Brave users. If they’re trying to do better than Chrome, good! Not-Google is good. They can pay for this I guess. I’m not installing Brave, though, I’m not recommending it, and this certainly isn’t making me want to.




  • They’re calling this out because Anthropic is afraid of dirt cheap, “good enough” open weights models undercutting them. Probably very afraid now that even Nvidia is on that boat, with huge Nemotron models.

    The real battle isn’t pro AI vs anti AI. It’s closed weights answers-as-a-premium-service vs open weights, hackable tools. It’s Huggingface vs OpenAI. It’s akin to Lemmy vs Reddit.

    Why would anyone use Anthropic once people figure out LLMs are configurable tools, not “AGI,” and efficient ones cost like 2 orders of magnitude less to run?

    So they want to squash open research. Because businesses are asking about costs now, they don’t realize they can just host assistants on-prem or through dirt cheap competing providers, but they’re starting to figure it out.




  • The propaganda is heavy controlled via a few companies. Google and Meta, primarily.

    I’d argue it’s worse, as now it’s intensely personalized, so everyone gets their own little shard of reality instead of one “averaged” version. That, and even with slants, the old networks did follow journalistic standards to some extent, while modern influencers are under no such obligation.











  • brucethemoose@lemmy.worldtoMemes@lemmy.mlThe double standard
    link
    fedilink
    arrow-up
    9
    arrow-down
    37
    ·
    edit-2
    2 days ago

    Every time I see such memes, I remind myself that lemmy.ml is blocked in:

    • China (including Hong Kong)

    • Iran

    • North Korea

    It is currently unblocked in:

    • The United States

    • Israel (and Palestine)

    • Ukraine

    • EU

    • Pretty much the rest of the world

    • Russia

    Though I worry about Russia, as they’ve already blocked Bluesky and at least one part of the fediverse: https://lemmy.world/post/14156170

    (And FYI I checked these regions myself, with a VPN, and then when another external tool, just now).