this post was submitted on 17 Mar 2025
438 points (96.2% liked)

Technology

66783 readers
4636 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
top 50 comments
sorted by: hot top controversial new old
[–] Zink@programming.dev 1 points 10 minutes ago

If I think of what causes the average person to consider another to be “smart,” like quickly answering a question about almost any subject, giving lots of detail, and most importantly saying it with confidence and authority, LLMs are great at that shit!

They might be bad reasons to consider a person or thing “smart,” but I can’t say I’m surprised by the results. People can be tricked by a computer for the same reasons they can be tricked by a human.

[–] gravitas_deficiency@sh.itjust.works 27 points 3 hours ago (1 children)

And you know what? The people who believe that are right.

Note that that’s not a commentary on the capabilities of LLMs.

[–] skozzii@lemmy.ca 16 points 3 hours ago* (last edited 3 hours ago)

It's sad, but the old saying from George Carlin something along the lines of, "just think of how stupid the average person is, and then realize that 50% are even worse..."

[–] CalipherJones@lemmy.world 3 points 1 hour ago (1 children)

AI is essentially the human superid. No one man could ever be more knowledgeable. Being intelligent is a different matter.

[–] Waraugh@lemmy.dbzer0.com 3 points 1 hour ago (3 children)

Is stringing words together really considered knowledge?

[–] CalipherJones@lemmy.world 1 points 1 hour ago

If they're strung together correctly then yeah.

[–] ILikeBoobies@lemmy.ca 1 points 1 hour ago

As much as a search engine is

[–] Donkter@lemmy.world 0 points 1 hour ago (1 children)

It's semantics. The difference between an llm and "asking" wikipedia a knowledge question is that the llm will "answer" you with predictive text. Both things contain more knowledge than you do, as in they have answers to more trivia and test questions than you ever will.

[–] Waraugh@lemmy.dbzer0.com 1 points 52 minutes ago

I guess I can see that, maybe my understanding of words or their implication is incorrect. While I would agree they contain more knowledge I guess that reads different to me than being more knowledgeable. I think that maybe it comes across as anthropomorphizing a dataset of information to me. I could easily be wrong.

[–] communism@lemmy.ml 6 points 2 hours ago

Given the US adults I see on the internet, I would hazard a guess that they're right.

[–] futatorius@lemm.ee 23 points 4 hours ago (2 children)

Half of all voters voted for Trump. So an LLM might be smarter than them. Even a bag of pea gravel might be.

[–] Psythik@lemm.ee 7 points 3 hours ago (1 children)

Less than a third of all voters voted for Trump. Most voters stayed home.

[–] kent_eh@lemmy.ca 1 points 1 hour ago

Of you didn't vote then you're not a voter.

Most eligable voters stayed home

[–] Viskio_Neta_Kafo@lemm.ee 1 points 3 hours ago

A bag of frozen peas's is smarter than some of these Trump followers. Even half a frozen pea is.

[–] conditional_soup@lemm.ee 3 points 2 hours ago (1 children)

This is sad. This does not spark joy. We're months from someone using "but look, ChatGPT says..." To try to win an argument. I can't wait to spend the rest of my life explaining to people that LLMs are really fancy bullshit generator toys.

[–] jj4211@lemmy.world 2 points 1 hour ago

Already happened in my work. People swearing an API call exists because an LLM hallucinated it. Even as the people who wrote the backend tells them it does not exist

[–] curiousaur@reddthat.com 2 points 2 hours ago* (last edited 28 minutes ago) (1 children)

This is hard to quantify. I use them constantly throughout my work day now.

Are they smarter than me? I'm not sure. Haven't thought too much about it.

What they certainly are, and by a long shot, is faster. Given a set of data, I could analyze it and pull out insights and conclusions. It might take me a week or a month depending on the size and breadth of the data set. An LLM can pull out insights and conclusions in seconds.

I can read error stacks coming from my code, but before I've even read the first few lines the LLM has ingested all of them, checked the code, and reached a conclusion about the necessary fix. Is it right, optimal, and avoid creating other bugs? Like 75% at this point. I can coax it, interate on the solution my self, or do it entirely myself with the understanding of the bug that it granted me. This same bug might have taken hours to figure out myself.

My point is, I'm not sure how to compare smarter vs orders of magnitude faster.

[–] fyzzlefry@retrolemmy.com 2 points 1 hour ago

Are you smarter than a calculator?

[–] ZephyrXero@lemmy.world 3 points 2 hours ago

What a very unfortunate name for a university.

[–] KingThrillgore@lemmy.ml 21 points 5 hours ago

The average literacy level is around that of a sixth grader.

This tracks

[–] Feathercrown@lemmy.world 15 points 5 hours ago

I believe LLMs are smarter than half of US adults

[–] tvbusy@lemmy.dbzer0.com 11 points 5 hours ago

LLM is proof that even if you're extremely stupid, having access to information can still make you sound smart.

[–] interested_party@lemmy.org 1 points 2 hours ago

It's probably true too.

[–] Retropunk64@lemmy.world 0 points 1 hour ago (1 children)
[–] the_q@lemm.ee 2 points 1 hour ago

Large language model. It's what all these AI really are.

[–] MrAlternateTape@lemm.ee 19 points 7 hours ago (1 children)

That is the problem with US adults. Half of them probably is dumber than AI.....

[–] Flocklesscrow@lemm.ee 14 points 6 hours ago

The grammatical error here is chef's kiss.

[–] cmhe@lemmy.world 1 points 3 hours ago

I suppose some of that comes down to the personal understanding of what "smart" is.

I guess you could call some person, that doesn't understand a topic, but still manages to sound reasonable when talking about it, and might even convince people that they actually have a deep understanding of that topic, "smart", in a kind of "smart imposter".

[–] DarrinBrunner@lemmy.world 3 points 5 hours ago (1 children)

Intelligence and knowledge are two different things. Or, rather, the difference between smart and stupid people is how they interpret the knowledge they acquire. Both can acquire knowledge, but stupid people come to wrong conclusions by misinterpreting the knowledge. Like LLMs, 40% of the time, apparently.

[–] ZephyrXero@lemmy.world 2 points 3 hours ago

My new mental model for LLMs is that they're like genius 4 year olds. They have huge amounts of information, and yet have little to no wisdom as to what to do with it or how to interpret it.

[–] rottingleaf@lemmy.world 14 points 8 hours ago

That's called a self-proving statement.

[–] tad_lispy@lemm.ee 16 points 8 hours ago

If we are talking about American adults, I guess they might be right.

[–] Naevermix@lemmy.world 13 points 8 hours ago

Hallucination comes off as confidence. Very human like behavior tbh.

[–] Grizzlyboy@lemm.ee 36 points 11 hours ago (1 children)

It’s like asking if you think a calculator is smarter than you.

[–] Dayroom7485@lemmy.world 18 points 11 hours ago (2 children)

„It‘s totally a lot smarter than I am, no way could I deliver (234 * 534)^21 as confidently!“

load more comments (2 replies)
[–] JackFrostNCola@lemmy.world 32 points 11 hours ago

"Half of LLM users " beleive this. Which is not to say that people who understand how flawed LLMs are, or what their actual function is, do not use LLMs and therefore arent i cluded in this statistic?
This is kinda like saying '60% of people who pay for their daily horoscope beleive it is an accurate prediction'.

[–] jh29a@lemmy.blahaj.zone 7 points 9 hours ago

Do the other half believe it is dumber than it actually is?

load more comments
view more: next ›