‘Overhyped’ generative AI will get a ‘cold shower’ in 2024, analysts predict::Analyst firm CCS Insight predicts generative AI will get a “cold shower” in 2024 as concerns over growing costs replace the “hype” surrounding the technology.
Honest title: lazy analyst pretends to be smart recycling an overused Gartner graph
an overhyped thing won’t be as hyped in the near future?
who would’ve thunk
We’re getting customers that want to use LLMs to query databases and such. And I fully expect that to work well 95% of the time, but not always, while looking like it always works correctly. And then you can tell customers a hundred times that it’s not 100% reliable, they’ll forget.
So, at some point, that LLM will randomly run a complete non-sense query, returning data that’s so wildly wrong that the customers notice. And precisely that is the moment when they’ll realize, holy crap, this thing isn’t always reliable?! It’s been telling us inaccurate information 5% of the usages?! Why did no one inform us?!?!?!
And then we’ll tell them that we did inform them and no, it cannot be fixed. Then the project will get cancelled and everyone lived happily ever after.
Or something. Can’t wait to see it.
Would you trust a fresh out of college intern to do it? That’s been my metric for relying on LLM’s
It might actually help the intern if they use it:
I’ve been speculating that people raving about these things are just bad at their jobs for a bit, I’ve never been able to get anything useful out of an llm.
If you have a job that involves diagnosing, or a wide array of different problems that change day to day it’s extremely useful. If you do the same thing over and over again it may not be as much.
You’re right but it’s worse than that. I have been in the game for decades. One bum formula and the whole platform loses credibility. There isn’t a customer on the planet who’ll look at us as 5%.
2024 headline: “Analyst replaced by generative AI”
In the mean time, I’m using chat gpt at work every day now and I’m able to work much faster because of it.
To me it’s next generation search engine. For tech queries it’s correct a lot.
Once it stops giving non-existent powershell commands, I’ll give it another go, but for now it has wasted enough of my time.
or non-existent switches for linux cli commands
The worst part is how eager it is to give you a non-existent switch or cli option. Like if it gives you some multi-line solution, all you have to do is say something like “are you sure there’s not an option where I can do this in one line?” And it’ll be like, “oh yeah you’re totally right, you can just use this non-existent thing that totally won’t work! Sorry about the confusion!”
Unfortunately that hasn’t been my experience, but I’m only using it to find answers for things a couple ddg queries won’t solve because traditional search engines are so much faster
Yeah I think it depends so much on context. For my tech queries it’s usually spot on.
I’m finding it useful for detecting / correcting really simple mistakes, syntax errors and stuff like that.
But I’m finding it mostly useless for anything more complicated.
Pretty much every tech question I ask it it just refers the answer to the “Your IT Administrator” which isn’t helpful.
I’m an analyst too, and I analyse that you’re gonna go fuck yourself.
Preacher: Can you read, my son?
Bubbles: Well that depends; can you go fuck yourself?
