Revolut says that in less than a year it’s managed to slash its [code generation] costs by roughly 90 percent by making self-hosted models its default instead of relying primarily on commercial services like Claude.
Self-hosting is illegal in 5 … 4 … 3 …
This is going to be a trend, and why I think the IPO for Anthropic is ridiculous. Competition is massive, there is no moat.
About time this hit enterprise.
Been saying the downfall of OpenAI and Anthropic will be local models that can accomplish the same thing without needing a dstacenter worth of GPUs to run.
Plus you have no total token limit on self hosted models. You can let a slop agent run for weeks without ballooning costs or getting rate limited.
And no model censoring, so you can go build that nuclear bomb you always wanted lol.
Both AI giants are already losing a ton of money because their pricing isn’t viable for the amount of training they’re doing trying to be on top. If they readjust, they’re gonna suffocate against much cheaper solutions.
The data center is still needed, just not the same scale. You don’t run “small” local models to compete with Claude’s size. They don’t publish numbers, but estimates were like 1-2T params for the models like early Opus. You need a lot of hardware to run those efficiently at a scale an enterprise would need.
Or they just spent enough to upgrade developer desktops with RTX Pro’s to run quantized ~100B param models at their desks. Those are very good for coding.
If AI isnʻt going to go away, it needs to be cheap, sustainable, open source, and self hosted/ hostable.
And ethically trained. People should be financially compensated if their data was used to train AI without their consent.
I don’t think it’s really possible to do this.
I mean speaking just logistically, how would you determine who gets how much? If it’s based on quality, how do you determine what is of high quality? Otherwise, does everyone who has every written anything that finds its way into a training dataset get like a tenth of a cent?
Alternative proposal: all AI models must be released as open weights, available to everyone.
AI, through its use of training data, has benefited from the sum total of human knowledge, therefore the results of this training should be given back for the use of all humanity.
That seems fair to me.
You are right if we look at it short term, long term llm will be replaced with the next thing and who knows maybe it can be trained ethically, at least we should require research into it.
I don’t think it’s really possible to do this.
Why not? Both parties have to figure out how much they want to pay or to get payed. Similar like it works for any other license like on Netflix or Spotify. It is not the AI companies job to determine how much they will get payed but how much the data is worth to them and the data creator how much they want.
If i am at a bakery and the bread they offer does not look like its for that much to me then i have not to buy it.
How do you suggest an individual should go about this?
Do I go down to my local courthouse and file a suit against Anthropic so I can ask the judge to subpoena them to determine if my Reddit shitpost from 2012 is in their training set?
Class action lawsuits. How would something like this work for anything else? Like Netflix subscription violations?
And we are talking about meaningful data not your shitpost, like licensed code or a book you wrote and anthropic pirated.
And we are talking about meaningful data not your shitpost, like licensed code or a book you wrote and anthropic pirated.
Ah ha! You see, that’s the problem. My shitpost is meaningful data. This is something people seem to have a really hard time understanding. Scaling laws and the size of the search space in AI training means that the datum is not valuable. It’s only the data (in conglomerate) that is value for training, and my shitpost would be a part of that.
Once you understand this, you should see what I meant when I said it’s not feasible. How do you determine and then fairly distribute the payout to everyone who has ever written or recorded anything in digital format? This is not a simple supply vs demand equation, like your bakery example assumes.
Also I have no idea what Netflix has to do with this discussion.
Ah ha! You see, that’s the problem.
No. Meaningful in the sense of copyright. Data you get copyright
There you got your distinction.
