I’ve assumed the memory shortage is more than just an unfortunate byproduct. To the extent that LLMs have any use, its a threat to the datacenter model if people realize they can be run well enough locally. Hearing stories of datacenters hoarding hardware they can’t use yet make me think they want extra time for people to get used to the norm of subscribing to a service. I’d love for a reporter to ask Sam Altman if he’d be happy to see consumers get access to cheaper ram again.
Sure, just like there will always be a speed advantage for the newest Ferrari or Lamborghini. Are they worth leasing though? Or do Honda Civics go fast enough for the vast majority of people?
I’ve assumed the memory shortage is more than just an unfortunate byproduct. To the extent that LLMs have any use, its a threat to the datacenter model if people realize they can be run well enough locally. Hearing stories of datacenters hoarding hardware they can’t use yet make me think they want extra time for people to get used to the norm of subscribing to a service. I’d love for a reporter to ask Sam Altman if he’d be happy to see consumers get access to cheaper ram again.
There will likely always be an advantage to running the biggest models. And you will not be able to run those on your local PC.
Sure, just like there will always be a speed advantage for the newest Ferrari or Lamborghini. Are they worth leasing though? Or do Honda Civics go fast enough for the vast majority of people?