These unnamed companies have collectively pre-purchased several exabytes of storage capacity
So… What’s the point of this? Even the openai ram purchase was bizarre to me as they’ve been able to train their LLMs without gobbling up all the ram just fine, then the ssds and now hard disks? It’s not even the write cache that sold out, the hard disks themselves are.
I don’t think there’s any untapped source of data for llm training is there? Datasets can’t get larger so I fail to see any reason this would be necessary.
Does anyone know the reason they’re buying up storage? No cynical doomerism please.
Even aside from training datasets, as long as they keep hosting chats for people using these genAIs their storage will keep expanding over time as people upload/generate more pictures and videos.
I really hope all this urgency on getting as much hardware as possible is because the ai companies see the funding drying up soon and are trying to maximize what they get out of it, but it’s probably more likely they’re just focusing more on videos now and want to have all of youtube (+etc) in their training sets
So… What’s the point of this? Even the openai ram purchase was bizarre to me as they’ve been able to train their LLMs without gobbling up all the ram just fine, then the ssds and now hard disks? It’s not even the write cache that sold out, the hard disks themselves are.
I don’t think there’s any untapped source of data for llm training is there? Datasets can’t get larger so I fail to see any reason this would be necessary.
Does anyone know the reason they’re buying up storage? No cynical doomerism please.
Even aside from training datasets, as long as they keep hosting chats for people using these genAIs their storage will keep expanding over time as people upload/generate more pictures and videos.
I really hope all this urgency on getting as much hardware as possible is because the ai companies see the funding drying up soon and are trying to maximize what they get out of it, but it’s probably more likely they’re just focusing more on videos now and want to have all of youtube (+etc) in their training sets