cross-posted from: https://programming.dev/post/51407459

Check what can you use and at what rate of token per seconds would it be… It has examples of many models and quantization levels. Huge resource!

  • CallMeAl (like Alan)@piefed.zip
    link
    fedilink
    English
    arrow-up
    0
    ·
    15 days ago

    Because I looked at the source code on the site. Being a data harvester doesn’t mean they don’t give real answers. Just that there is no such thing as a free lunch. You got a suggestion and they got your data.