Look, if you know a way to convert a PDF to text with less than 500GB of VRAM and 2000W of power used for twenty seconds, I’m all ears.
I’m…but…no…wait….
We’re not going to make it.
No, we aren’t.
But it’s so good at programming if you already know how to program! Surely that’s worth burning the planet and crashing the world economy??
Actually still no
https://github.com/JustVugg/colibri
Everyone was desperate to be first because capitalism. But we are getting good models without the insane build out requirement. Which will be hilarious to leave the cunts holding the bag. Not that the planet is better for it in the end.
The engine is a single C file (c/glm.c, ~2,400 lines)
That file is almost 6k lines. The style also makes my eyes bleed. Why do people pretend stuffing 6k lines of code with almost no whitespace and meaningless variable names into a single file is a good thing? I’ve seen this a lot recently
Actually, it’s better at programming if you don’t know how to program.
For example, someone who didn’t know how to program sent me a patch to my code to ‘fix’ a problem they encountered. It was changed to silently swallow the error that really really would have needed to be fixed, but they were so enthusiastic that the problem looked to go away that they wouldn’t let me know actually actionable debug information and just whined that I wouldn’t take Claude’s perfectly good fix for it. It is much better at satisfying folks that don’t know how to look for better.
To satisfy my standards, I would have had to extract more debugging info, probably construct a test case tickling that exact situation making an expected error to ensure it won’t just throw it away, and add it to the suite and then ask it to spin until the test case passed.
But alas, I’m neck deep in merge requests from folks that were formerly intimidated by coding and are now complaining that I’m not accepting more of their changes and more quickly because “all” I have to do is review the code which is obviously so much easier than writing it… It’s like the “I have an app idea, all I need is for you to do it”, but on steriods…
All for software that’ll be out of date and fashion next year!
We are repeating an old pattern in computing: throw more hardware at the problem until efficiency becomes impossible to ignore. Bigger models have delivered remarkable gains, but they’re increasingly expensive. The next breakthroughs may come less from adding parameters and more from smarter architectures, better algorithms and more efficient inference.
That’s literally exactly what Chinese researchers are doing at DeepSeek and they’ve built frontier models with that philosophy
AI is the idea of putting a million monkeys in a room with a typewriter and waiting for Shakespeare.
The smart people already knew the monkeys would just starve to death. The business majors are just now figuring that out.
It was the best of times, it was the blurst of times.
To be or not to be, that is…
Well if you have a better way to generate Jurassic Park “but everyone’s fat” videos I’d love to hear it.
Hiring fat people?
ok tough guy so how do I get fat T-rexes hm?
Hire some already underpaid VFX artists
Jurassic Pork
Yeah no shit Sherlock. AI chat bots are just a way to market and sell a dystopian surveillance apparatus to the masses wrapped in the guise of it will right your bullshit corporate emails and messages for you all the while the government and the corporations are fucking you in the ass.
It was a barely functional technology that provides convenience and laziness well hiding it’s true purpose, Machine learning algorithms for facial recognition license prints tracking making it efficient and relatively economical to spy on and control an entire population.
what makes you think advances in LLMs have anything to do with ML for Computer vision? If you wanted the latter, you would’ve gotten that way cheaper than by training on reddit text.
12 upvotes for this thin conspiracy theory, congrats Lemmy.
If you think those datacenters being built are for LLMs only, I have a bridge to sell you.
ML and LLMs both need massive compute to work with the data sets involved.
It isn’t about content generation at all. It’s about pattern recognition and prediction, which, in the hands of those with the most power to change the world, offers insights into our collective behavior that rulers from every age would have committed genocide to get. AI will tell them how to better build the prison the poor are being impoverished into.
It has the same flaw as every other overreaching evil. We outnumber them. A significant number on our side is willing to kill the other side.
Ima die in the crossfire for sure. But the evildoers always assume they are going to win and they literally never do. They always lose. Expensively.
It’s a dying echo. Nothing more.
Yes but we are effectively disconnected from our mutual self interest. We should already have risen up together and our complacency is a testament to their existing ability to pacify us.
The losing that you’re talking about happens on the scale of centuries, not years. History shows that empires built on malice can last for centuries. Look at the Romans, for example. Even the Soviet Union lasted 70 years.
If this echo dies out in a hundred years, what good is that going to do my son and myself?
Stop spreading criti-hype! Zuck didn’t invent a mind-control ray with targeted advertising, and Sam Altman doesn’t run a terminator factory with GenAI.
Wtf are you talking about? Do you even know the nature of data usage today? You can’t identify reality from science fiction?
AI enables them to better do what they have already been doing with analytics and user data. They are already doing it and have been for decades.
I’ve seen it first hand on smaller software products during analytics reviews and telemetry design discussions during preproduction through product launch and post launch. I know the questions that gets asked, the purpose of a telemetry hook for a user action, heard what they wished they could track and why. I know how they can cohort a user base, how they extrapolate and predict user behavior and user characteristics from that data to target content. There’s laws already written to prevent some data collection because of what is known can be done. That’s a small software product with a few millions users, not Amazon or Google who have billions of users, many of whom give them access to their entire phone telemetry at all times, cross device access and service wide account tracking, across decades of their lives. Location, region, timezone, battery usage, app usage, age, phone numbers, address, gender, mac ids, wifi connections and data usage etc etc etc.
With just my gender and age, you can make predictions, of some accuracy, using existing research data, about my life, who I am, what I think and how I behave. Every single piece of data more allows further clarity and breadth. That knowledge is what gives them more and more accurate predictions about me, you and all of us. Now they want cameras everywhere, microphones everywhere, OS real ID and VPNs to be banned so there is no anonymity. They want as much data as possible because they now have a data pattern recognition system(LLMs) that can effectively make use of that amount of data.
FFS, this isn’t science fiction anymore, it’s here, now. And those companies have never had your, or my, interests or well-being in mind. They will use it for power, as they always have.
It is no more different with the gold rushes to California, Oregon, and Alaska, where the real winners are the merchants selling pickaxes and work overalls.
It’s different in so far as we didn’t invest a trillion dollars in giant strip mines that destroyed these states.
Pre roasted coffee took off at this time.
He’s sadly right… My wife is Chinese, she watches AI Chinese dramas and she has told me that most of China watch AI dramas. And Gen Z watch AI, Everyone younger than 30 relies on AI.
Now before you downvote me, I’m 37 and I’ve worked in IT since I was 19… AI gives me nothing I can’t find for myself. The only time I’ve used AI was when chat GPT was fresh and new and I told it to be more sarcastic and snarky in it’s answers and I argued with it for 2-3 mins before I got bored.
Humans are much better at arguing with me and being sarcastic to me.
I don’t care for AI, Turn off all the air conditioners and AI burns out.
My wife is Chinese, she watches AI Chinese dramas and she has told me that most of China watch AI dramas. And Gen Z watch AI, Everyone younger than 30 relies on AI.
If it’s not that, I’m seeing people almost everywhere hunched on their phones, watching AI-generated summaries of… what? soap opera episodes and whole movies. And those people complaining about the low quality of education when they’re so fucking focused much on getting a piece of paper just to be hired even for a department store attendant.
Are you responding to something specific from this article? I feel like we might have read completely different articles.
“AI gives me nothing I can’t find for myself.” True, but that’s the point.
From a worker standpoint, while you’re researching that thing you can find for yourself, someone of equal skill to you that is leveraging AI has solved 3 of those issues. And someone with more skill has solved 10. And someone with lesser has either crashed the network, or solved that same 1.
From a personal use standpoint: is the value of creation in the journey and the learning? For some it is. For others it being able to remove barriers and obstacles to create a new website you’ve been wanting to, or planning out a garden, or brainstorming an idea.
You’ve used it once 2+ years ago and wrote it off completely. Do you also still do your laundry with a wasboard and clothesline? Is the Internet just a fad also?
It’s has value. It also has large risk. But pandoras box is open. Those that refuse to leverage and learn it will be at a disadvantage.
You’ve used it once 2+ years ago and wrote it off completely. Do you also still do your laundry with a wasboard and clothesline? Is the Internet just a fad also?
I just don’t get why people like you exist. You guys have the stupidest fucking arguments for why not wanting to use the regurgitation machine that murders the environment and causes people to kill themselves is bad.
But, like, do you still use NFTs? That was the future. It was so the future. Same fucking arguments from the same fucking mouth-breathing dipshits.
And using AI does not even make you faster or better at what you do. It can increase output, and it can cause you to do a shit job, and it can falate your ego so you think you are soooo much better and bigger than everyone else, you big strong muscly man, you. You’re basically just saying that workers can never and should never have any fucking downtime, ever. They cannot stop. They must always, always produce, more and more. And, like, fuck all the way off. You don’t need to output more. You do not need to be faster. You don’t need AI, even if it was as good as people pretend it is, which it is not!
Because AI sucks. It isn’t good at anything other than replicating an amalgamation of the data that is fed into it. Anyone that says it is good at any other thing is just shit at that specific thing and doesn’t know any better. LLMs are just huge giant matrices full of coefficients matching language segments. They don’t know jackshit. They have relatively small context windows compared to even the dumbest motherfucker on this planet and people working on making LLMs better are running out of shortcuts to make them better. The money they have been lent needs to start making it back. And they can’t make money because they are subsidizing everyone using AI with that venture capital because it still hasn’t made a fucking dime yet.
Don’t worry, guys. We just need to keep feeding more data into it! It’s so much better, guys, I swear! This one won’t hallucinate all the time, bro, I swear! Just one more model, it’s so close!
I feel like your projecting. My comment didn’t approach anything close to the unmedicated fantasy in which you seemed to have made up and responded to.
Nfts, no downtime, and anti-worker? Really? Not even gemini would hallucinate that out of my comment.
The world is accelerating faster than most of us are comfortable with. The future is bleak and we absorb utter chaos daily in the 24hr news cycle. It’s exhausting
I’m sorry that pandoras box is open. But it’s not going away.
I’m not naive enough to think we’re going back to a world without a machine that statically produces regurgitated characters that happen to match an exceedingly large class of common problems that people are looking for help with, whether it’s an over burdened worker at soulless corporation, an 18yo with an idea but not the background, a 21year assessing if the lease for their first apartment has red flags, or a mom making a video game based on her son’s stuffed animal named slappy.
Unfortunately, even with their small context windows, useless matrices, and lowly statistical representions of language segments, they are better at debugging, brainstorming, “coding”, and answering questions than a lot of people, let alone “the dumbest mother fucker on the planet”.
Unfortunately, even with their small context windows, useless matrices, and lowly statistical representions of language segments, they are better at debugging, brainstorming, “coding”, and answering questions than a lot of people, let alone “the dumbest mother fucker on the planet”.
That’s why those people do not code or do those other things, and, surprisingly, most of those people don’t suddenly think they are now better than a person who has done… Just… The smallest amount of actual training to become good at that thing.
You got that AI psychosis in you, buddy. Ask your AI friend for the nearest person to get you the hell away from it.
If only telling you how brainwashed you are would actually fox things. Let me know when you have enough tokens to reply to me.
There you go projecting again. Pushing a narrative about how I must feel about people that you push as being dumb.
It is hilarious how a comment where I say AI is pandoras box, aka the mechanism that spawned all of the world’s evil, and conceeding it has risks and flaws, all of a sudden makes me the world’s biggest AI sycophant because I say it has value.
As you grow older, or if you watch the movie Inside Out to completion, you will learn people can have multiple complex feelings about things. Only on reddit, and this place it seems, must someone have the most extreme all good or all bad else they’re the worst thing that ever existed. I truely hope you find the help you most surely need.
I agree its pandoras box but I disagree about the quality of life it brings. What it is creating is larger electric bills that is strangling the lower class, killing consumer low end computers which also harms the lower class, creating a dependency which will likely increase in price, lowering childrens critical thinking (according to studies private schools are not being as affected), killing jobs, oh and the fuck ton of effect it has on climate change which also affects the lower class more.
Yeah but you see, everyone who’s gun-ho on AI doesn’t seem to be bother to give two fucks. It’s bat-shit people are chasing this like their lives depend on it. They don’t give a fuck about the lower class, they never have, it’s a new shiny toy, and until something catastrophic happens, nothing is going to change.
Eat the rich.
Yes. I agree those are all terrible. And I agree with your assessment of almost all of them. But I’m not naive enough to think that we can put the evils back in and switch back to a non-ai world. We live, we grow, we adapt. This is the future, no matter how bleak it is.
I didn’t say it improves quality of life. I said it can lower barriers of entry to some things, and it can improve a workers productivity when you compare two workers of equal skill.
For some it is. For others it being able to remove barriers and obstacles to create a new website you’ve been wanting to.
You’ve used it once 2+ years ago and wrote it off completely. Do you also still do your laundry with a wasboard and clothesline?
Okay but one of those is an artform and the other is physical labor.
Programming doesn’t really equate to physical labor like that.
No, but it helps design. How big of a box. What vegetables thrive together. What ones should be kept apart. What spacing. How much root depth. Can ground hogs get at it. Here look at this picture. Looks like a tomator disease, what do you think?
Programming equates to architecture. It equates to system design. You can have good (non-sycophantic) conversations about what, why, push back when it’s wrong, agree when it’s right.
And if it’s for a personal project, then for some people the labor and the learning is the value. For others maybe it’s showing the end product to their 6year old that dreamt of a game where a dolphin was flying in space with ninjas trying to attack it.
If only the mainstream media would have said this since 2023. We maybe even have dodged the bullet called the Trump second term, but now we’re heading towards a global financial collapse.
paywall removed: https://archive.ph/J3VLi
Here here! well said!
Many dystopian science fiction books have already become reality. Look at “Enemy of the State” for example.
Heck, back in like what 1971? Enders game predicted the whole internet Influencer concept.
The author seems to be confusing user scalability with performance scaling:
The problem with generative AI, in the industry’s own jargon, is that it does not scale. The cost of growing from, say, a thousand users to a million is a key factor that venture capitalists examine when they evaluate start-ups.
This is a question of whether openai can handle 1 million users asking chatgpt to write a basic html website. That can be scaled horizontally and is just a matter of building more data centers.
The author then goes on to conflate this user scaling with performance scaling:
Yet the returns are diminishing. The bigger an AI model is, the less it improves with each added parameter, and so it must be made bigger at a faster rate just to sustain steady progress. I asked a few AI researchers whether they could name any other real-world software that scales so poorly. None of them could think of any. Even outside the world of software, it’s hard to find a comparable example, given that economy of scale is the principle that has made light bulbs, cars, and clothing so affordable. By economic and engineering measures, generative AI might be the worst technology ever deployed.
This is a question of whether chatgpt can generate a full complex web app. For this there may be a limit to this bigger model approach but this is common to most technologies, performance sometimes has hard limits. You aren’t going to get a car to go 300 mph by making the engine bigger and adding more cylinders, there’s diminishing returns, that doesn’t make cars the worst technology ever deployed… maybe they are but for other reasons.
Economies of scale also isn’t about performance scaling, it’s about capacity scaling. Capacity scaling for AI does reflect economies of scale, that’s why you have these large AI companies building large data centers.
That can be scaled horizontally and is just a matter of building more data centers.
That was a spectacular way of outlining the fact that you don’t at all understand the problems and limits with “AI” without having any awareness or understanding that you don’t at all understand the problems and limits with “AI.”
Ok, explain to me why you can’t scale out existing small and mid tier models horizontally? yes there are current resource limits on chips and energy but we know how to build those out and those types of limits are common to nearly every other industry, it’s just that no other industry has generated such rapid demand/investment for infrastructure.
There’s no O(n^2) problem on number of requests that would make handling large scale rollout impossible like the article is suggesting.
If “AI” data centers are the only goal, sure, we could definitely bottleneck all technological progress into forcing a fractional level of slightly higher functionality to things that have already hit their potential at the cost of hobbling every other technology. Just fuck the environment, every level of consumer technology, limit the marketplace of ideas and materials to tech oligarchs, and cripple progress in literally any other field of technology, and it all just makes sense, right? Easy peasy.
if only AI companies optimized their AI to run on less compute (in the data centers)
