• Deebster@infosec.pub
    link
    fedilink
    English
    arrow-up
    0
    ·
    4 months ago

    So Anthropic have made a change that prevented people from wasting tokens? I’m sure they’ll be very keen to reverse that.

    • [object Object]@lemmy.ca
      link
      fedilink
      English
      arrow-up
      0
      ·
      4 months ago

      Showing the tool call string does not waste tokens.

      That’s just how they display information to the user — tool calls no longer show arguments unless they need use permissions, and they’re often hidden entirely being “4 tools called”.

      • bjorney@lemmy.ca
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        As per the article, knowing when the tool is reading totally unrelated files allows devs to cancel the workflow early before it churns thousands of tokens on output that is based on totally incorrect information

      • Deebster@infosec.pub
        link
        fedilink
        English
        arrow-up
        0
        ·
        4 months ago

        From the article, fourth paragraph:

        There’s also a financial impact. If developers spot that Claude is going down a wrong track, they can interrupt and avoid wasting tokens.

        @[email protected] understood what I was referring to, I don’t really understand what you thought I was saying.