Why do we need centralized data centers? Why can't we just create a decentralized network of open weight models that can spread the load over a vast network of consumer devices and NPU's that already exist?Scam Altman has a point, but for the wrong reasons.
Reported for racism outside of /b/ (antisemitism)
>>110217874napster or kazaa for the AI ageyes please
>Why Its simple go to any discussion about torrenting and just see how many people are proud to be leechers. Then they'll turn around and bitch about network quality. If you were talking on a technical level it would also suck because you'd pay a price for getting all the machines to work together and deal with long distance. In a data center infrastructure guys fix all those problems so everything can run as fast as possible. In a decentralized model that's impossible. Also you'd have too many free loaders. I can use the network with a raspberry pi, but its obvious as a member of the network that I am functionally worthless and just taking resources. If I use AI a lot it just sucks for everyone else on the network. Which means someone would have to be in charge or be able to kick leechers out like in a private tracker.
>>110217874Control.
>>110217874fuck off you are not using my computet. lifelong pirate that has never once seeded
>>110217937it's okay, they can use mine
>>110217874It'd be inferior to data centers, for obvious reasons. Besides that, people already share access with other people since stable diffusion took off 4years ago.There are also projects for that sort of ai torrenting, but it will remain niche compared to cloud for the same reason torrenting is niche compared to streaming/DL
>>110217874I think network latency would make this idea basically useless, at least for powerful models. Maybe it could work on shitty ones with few parameters. The issue is that different GPUs in your cluster need to be able to exchange data with each other, and quickly. That's why in state of the art stuff they'll have GPUs directly connected to each other instead of exchanging data over a network. Even if you manage it so that lets say people in the same city are "paired up" for this decentralized AI cluster, the GPUs are still going to be sitting idle 99% of the time waiting for data because they're just that much faster than internet traffic can deliver the data.
>>110217889
it works for torrenting because lots of people want to share the same mediaAI requests are highly individualized so I don't think you get the same efficiencies of scaleSome requests are just 'gpt how is babby formed' and others are 'prove Riemann hypothesis pls', so it's like you're doing crypto mining for other people's benefit>>110217896this tooidg why people are like that, the only leeching I do is when I get a new machine and am too lazy to port all my data over so I just install a new torrent client, then I seed foreverI just look for obscure movies or shows once or twice a month tho
