this post was submitted on 01 Jun 2025
77 points (100.0% liked)

TechTakes

1901 readers
153 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS
dgerard@awful.systems
77
ChatGPT o3 found a Linux Kernel vulnerability. "The future" has an 8% success rate, and a 28% chance of false positives. (sean.heelan.io)
submitted 4 days ago* (last edited 4 days ago) by wizardbeard@lemmy.dbzer0.com to c/techtakes@awful.systems
10 comments fedilink hide all child comments
 

This blog post has been reported on and distorted by a lot of tech news sites using it to wax delusional about AI's future role in vulnerability detection.

But they all gloss over the critical bit: in fairly ideal circumstances where the AI was being directed to the vuln, it had only an 8% success rate, and a whopping 28% false positive rate!

you are viewing a single comment's thread
view the rest of the comments
[–] sailor_sega_saturn@awful.systems 24 points 4 days ago* (last edited 3 days ago)

LLMs: now as effective as enumerating use-after-frees as grep "free" source.cc.