Architeuthis

joined 2 years ago
[–] Architeuthis@awful.systems 12 points 3 months ago* (last edited 3 months ago)

AI is the product, not the science.

Having said that:

  • Alignment research: pseudoscience
  • AGI timelines: pseudoscience
  • Prompt engineering: pseudoscience
  • Problem solving benchmarks: almost certainly pseudoscience
  • Hyperscaling: borderline, one could be generous and call it a failed experiment
  • Neural network training and design fundamentals: that's applied maths meets trial and error, no pseudo about it
  • I'm probably forgetting stuff
[–] Architeuthis@awful.systems 4 points 3 months ago* (last edited 3 months ago)

you know that there’s almost no chance you’re the real you and not a torture copy

I basilisk's wager was framed like that, that you can't know if you are already living in the torture sim with the basilisk silently judging you, it would be way more compelling that the actual "you are ontologically identical with any software that simulates you at a high enough level even way after the fact because [preposterous transhumanist motivated reasoning]".

[–] Architeuthis@awful.systems 8 points 3 months ago* (last edited 3 months ago)

I'd say if there's a weak part in your admittedly tongue-in-cheek theory it's requiring Roko to have had a broader scope plan instead of a really catchy brainfart, not the part about making the basilisk thing out to be smarter/nobler than it is.

Reframing the infohazard aspect as an empathy filter definitely has legs in terms of building a narrative.

[–] Architeuthis@awful.systems 12 points 3 months ago* (last edited 3 months ago) (2 children)

Not wanting the Basilisk eternal torture dungeon to happen isn't an empathy thing, they just think that a sufficiently high fidelity simulation of you would be literally you, because otherwise brain uploads aren't life extension. It's basically transhumanist cope.

Yud expands on it in some place or other, along the lines that the gap in consciousness between the biological and digital instance isn't that different from the gap created by anesthesia or a night's sleep, it's just on the space axis instead of the time axis, or something like that.

And since he also likes the many world interpretations it turns out you also share a soul with yourselves in parallel dimensions; this is why the zizians are so eager to throw down, since getting killed in one dimension just lets supradimensional entities know you mean business.

Early 21st century anthropology is going to be such a ridiculous field of study.

[–] Architeuthis@awful.systems 5 points 3 months ago (1 children)

Here's the exact text in the prompt that I had in mind (found here), it's in the function specification for the js repl:

[...] The analysis tool (also known as the REPL) can be used to execute code in a JavaScript environment in the browser.

What is the analysis tool?

The analysis tool is a JavaScript REPL. You can use it just like you would use a REPL. But from here on out, we will call it the analysis tool.

When to use the analysis tool

Use the analysis tool for:

  • Complex math problems that require a high level of accuracy and cannot easily be done with “mental math”
  • To give you the idea, 4-digit multiplication is within your capabilities, 5-digit multiplication is borderline, and 6-digit multiplication would necessitate using the tool.
  • [...]

What if this is not a being terminally AI pilled thing? What if this is the absolute pinnacle of what billions and billions of dollars in research will buy you for requiring your lake-drying sea-boiling LLM-as-a-service not look dumb compared to a pocket calculator?

[–] Architeuthis@awful.systems 6 points 3 months ago

Except not really, because even if stuff that has to be reasoned about in multiple iterations was a distinct category of problems, reasoning models by all accounts hallucinate a whole bunch more.

[–] Architeuthis@awful.systems 11 points 3 months ago

Anecdotally, it took like one and a half week from the c-suite okaying using copilot to people beginning to consider googling beneath them and to start elevating to me the literal dumbest shit just because copilot was having a hard time with it.

[–] Architeuthis@awful.systems 21 points 3 months ago (4 children)

Claude's system prompt had leaked at one point, it was a whopping 15K words and there was a directive that if it were asked a math question that you can't do in your brain or some very similar language it should forward it to the calculator module.

Just tried it, Sonnet 4 got even less digits right 425,808 × 547,958 = 233,325,693,264 (correct is 233.324.900.064)

I'd love to see benchmarks on exactly how bad at numbers LLMs are, since I'm assuming there's very little useful syntactic information you can encode in a word embedding that corresponds to a number. I know RAG was notoriously bad at matching facts with their proper year for instance, and using an LLM as a shopping assistant (ChatGTP what's the best 2k monitor for less than $500 made after 2020) is an incredibly obvious use case that the CEOs that love to claim so and so profession will be done as a human endeavor by next Tuesday after lunch won't even allude to.

[–] Architeuthis@awful.systems 2 points 3 months ago (5 children)

Nothing in the article suggests he is a programmer, or that being a programmer is inherently fascist.

[–] Architeuthis@awful.systems 8 points 3 months ago* (last edited 3 months ago) (1 children)

I think mostly by websites colluding to track your browser's fingerprint so facebook/meta can maintain your behavioral profile and sell it back to them.

[–] Architeuthis@awful.systems 10 points 3 months ago* (last edited 3 months ago)

Hey now, there's plenty of generalization going on with LLM networks, it's just that we've taken to calling it hallucinations these days.

[–] Architeuthis@awful.systems 17 points 3 months ago

EA Star Wars pitch

image transcriptionZach Weinersmith skeeted: Movie idea:

Effective Altruism Star Wars, in which it's OK to be a Sith as long as the majority of your earnings go through vetted charities.

‪Plod‬ skeeted: And when the Death Star explodes it's due to fraudulant accounting

‪tiedoton‬ skeeted: Building endless swaths of droids that do nothing but continuously experience bliss to offset any suffering caused by the Empire.

Not sure if that would be done by the Empire or the Rebellion

view more: ‹ prev next ›