Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • SuspiciousCarrot78@aussie.zoneOP
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    1 day ago

    Do you mean Sonnet 4.5?

    I don’t have the rig to run it at real speeds but I’ve played with it over API. Seems pretty good.

    • PetteriPano@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      13 hours ago

      No, it needs a lot more babysitting than 4.5 does. 3.5 was on the same level of mistakes, at least on the quants I have to use.