After months of fierce debate, Linus Torvalds and the Linux kernel maintainers have laid down the law on AI-generated code.
  • Feyd@programming.devEnglish
    14·
    2 months ago

    You can, at that will cause the same output on the same input if there is no variation in floating point rounding errors. (True if the same code is running but easy when optimizing to hit a round up/down and if the tokens are very close the output will diverge)

    There are more aspects to the randomness such as race conditions and intentionally nondeterministic tiebreaking when tokens have the same probability, apparently.

    I actually think LLMs are ill suited for the vast majority of things people are currently using them for, and there are obviously the ethical problems with data centers bringing new fossil fuel power sources online, but the technology is interesting in and of itself

      • Feyd@programming.devEnglish
        14·
        2 months ago
        1. Floating point math is deterministic.
        2. Systems don’t have to be programmed with race conditions. That is not a fundamental aspect of an LLM, but a design decision.
        3. Systems don’t have to be programmed to tie break with random methods. That is not a fundamental aspect of an LLM, but a design decision.

        This is not hard stuff to understand, if you understand computing.