TL;DR: Big Tech steals all of human knowledge, packages it all up into models and sells it back to you, making billions off other people’s work. The heist makes the Napster case look insignificant in comparison. Bernie Sanders thinks AI company should be charged for what they stole.
The video’s title is terrible and it’s complete gibberish to me, but the video is interesting.
Cool, thanks for the info. When I saw the memory bandwidth for the integrated systems like these, I thought perhaps it wouldn’t be worth it over a custom build with a couple of 5090s (2.5x the price before the memory price hike). What models have you thrown at it? What’s your tokens/second? The local-sized models keep getting more capable.
My potato 2060 plus 64GB of system RAM is enough to crawl along with some of the MoE models, but I’ve got projects that need way more compute (would like to content filter my torrent crawler database, finetune of one of the small Qwens to produce my novel programming language, ML experiments that currently take days/weeks to iterate, etc). Maybe an integrated system like yours is worth it after all.