T
traeai
登录
返回首页
Astral Codex Ten

Open Thread 434 - by Scott Alexander - Astral Codex Ten

6.5Score
Open Thread 434 - by Scott Alexander - Astral Codex Ten

TL;DR · AI 摘要

Astral Codex Ten 的 Open Thread 434 包含 AI 伦理讨论、社区互动平台和科技文化幽默。

核心要点

  • AI 伦理讨论:虾福利与有效 altruism 的还原论论证,假设正确识别最终原因可判断有效 altruism 的效率原因。
  • 社区互动平台:ACX 有多个平台用于讨论和内容分享。
  • 科技文化幽默:文章以幽默方式描述了旧金山科技圈和 AI 讨论。

结构提纲

按章节快速跳转。

  1. 文章介绍了 ACX 社区的开放讨论和 AI 相关话题。

  2. 讨论了关于虾福利和有效 altruism 的还原论论证。

  3. ACX 有多个平台用于讨论和内容分享。

  4. 文章以幽默方式描述了旧金山科技圈和 AI 讨论。

思维导图

用一张图看清主题之间的关系。

查看大纲文本(无障碍 / 无 JS 友好)
  • Open Thread 434
    • AI伦理讨论
      • 还原论论证
    • 社区互动平台
      • ACX平台
    • 科技文化幽默
      • 旧金山科技圈

金句 / Highlights

值得收藏与分享的关键句。

  • AI 伦理讨论:虾福利与有效 altruism 的还原论论证,假设正确识别最终原因可判断有效 altruism 的效率原因。

    第 2 段

    ⬇︎ 下载 PNG𝕏 分享到 X
  • ACX 有多个平台用于讨论和内容分享,包括 Reddit、Discord 和 bulletin board。

    第 3 段

    ⬇︎ 下载 PNG𝕏 分享到 X
  • 文章以幽默方式描述了旧金山科技圈和 AI 讨论,包含 Dasani 水和 AI 技术的有趣比喻。

    第 2 段

    ⬇︎ 下载 PNG𝕏 分享到 X
#AI Ethics#Community Engagement#Tech Culture#Substack#Open Thread
打开原文

Open Thread 434 - by Scott Alexander - Astral Codex Ten

Image 1: Astral Codex Ten

Open Thread 434

...

May 18, 2026

This is the weekly visible open thread. Post about anything you want, ask random questions, whatever. ACX has an unofficial subreddit, Discord, and bulletin board, and in-person meetups around the world. Most content is free, some is subscriber only; you can subscribe [here](https://astralcodexten.substack.com/subscribe?). Also:

  • * *

1:Primary elections are coming up in many US locales. If your ACX meetup group wants to create a voter guide (samples from last election here), I’m happy to signal boost it here if your city is big enough and has enough likely ACX readers. Email me if interested.

2: New subscribers-only post, Every Magazine Piece On The SF AI Scene:

On a chilly San Francisco day, I found myself in a “group house”, a house where multiple people live in the same house. My host, a bespectacled man named Theodore Wong, grabbed a Dasani water bottle and half-eaten burrito from the refrigerator (a device used to keep food cold - according to Wong’s health-conscious bio-hacker roommate, it “prevents spoiling”). Then he started to speak.

“There is a serious risk that artificial intelligence is going to kill everyone in the world. You really need to explain this to your readers. We are desperate to get this information out. I’m begging you, please don’t make this a human interest story like all the others. We need for people to know the exact arguments,” he intoned nerdily, and proceeded to give me a twenty minute lecture including lots of words like “compute”, “exponential”, and “slaughterbot”.

This was my introduction to the wacky world of the San Francisco tech scene, where people drink Dasani water and say things about AI - a technology which, they tell me, “no really your readers need to know this, stop looking at my water bottle and listen to what I’m saying, I beg you.”

3:An Inkhaven-like writing/blogging residency in Barcelona, late Aug - early Sep.

  • * *

#### Subscribe to Astral Codex Ten

By Scott Alexander

P(A|B) = [P(A)*P(B|A)]/P(B), all the rest is commentary.

By subscribing, you agree Substack's Terms of Use, and acknowledge its Information Collection Notice and Privacy Policy.

19 Likes

[](https://substack.com/note/p-198257206/restacks?utm_source=substack&utm_content=facepile-restacks)

Previous

#### 60 Comments

Image 7: User's avatar

Zanzibar Buck-buck McFate

[3m](https://www.astralcodexten.com/p/open-thread-434/comment/261101605 "May 18, 2026, 4:46 PM")

I had an interesting discussion about reductios. I feel in general, without good quality domain level knowledge, a reductio is probably false, on average. There's nothing wrong with looking at the gestalt of someone else's worldview, smelling a rat and communicating that unease to that person and to others. However, it is unlikely you will correctly identify the feature of the system that is causing the unease. Any moral system is somewhat complex and "the tail may come to wag the dog".

Example: I think shrimp welfare is weird, I'm inclined to smell a rat, but if I were to make a reductio - "if you were effective altruists you would care about people, not shrimp", that assumes I have correctly identified the final cause of effective altruism - human welfare - and can therefore judge the efficient cause - shrimp charities - as contradicting the final cause. If I know my stuff about EA, I stand a chance of doing this in a way that might convince some fence sitters, but in lieu of this I'm essentially firing random shots. My opponent felt I was being too humble and that cliques are prone to over-fitting and "circle jerking" Any thoughts welcome.

ReplyShare

tilman

[16m](https://www.astralcodexten.com/p/open-thread-434/comment/261094233 "May 18, 2026, 4:33 PM")

If you are excited about biosecurity or biodefense you should consider applying to the Frontier Biodefense Fellowship. The program is one of the very few opportunities to get started working in biodefense research, policy, entrepreneurship, especially if you haven't had tons of relevant experience yourself!

Mentors are from virtually all orgs that care about scope sensitive biodefense: SecureBio, Blueprint Biosecurity, CLTR, Coefficient Giving, and many more!

Deadline is June 2nd, apply at fellowship.bio!

ReplyShare

WoolyAI

[27m](https://www.astralcodexten.com/p/open-thread-434/comment/261088056 "May 18, 2026, 4:22 PM")

Does anyone have a good explanation of the US stock market's performance during the Iran War? I'm torn between two different observations.

#1 John Mearsheimer (1) and others predicted massive oil shocks as a result of the Iran War which would lead to recession. This seems largely to have occurred. Oil prices have risen significantly all over the US and everyone I talk to is feeling it at the pump. Seems like it should be a massive oil shock.

#2 Stonks go up. The S&P was $6,858 at the start of the year, ~$6,878 at the start of the Iran war, bottomed out on 3/30 at $6,343, and is currently at $7,383.

I notice that I'm confused. There's a massive risk to global oil markets, that risk materializes, over the next month, the market declines, and then at the end of March the market bounces back $1,000 over 6-7 weeks despite the oil crisis getting worse. On the one hand I'm seeing pretty credible evidence of an oil/energy shock and yet stonks go up. I do not understand this.

(1) As an example of an excellent IR resource, not some rando streamer.

Reply (3)Share

Louis Dormegnie

[11m](https://www.astralcodexten.com/p/open-thread-434/comment/261097001 "May 18, 2026, 4:38 PM")

Oil shocks don't have a major impact on the earnings power of companies whose good fortunes have been the engine of the S&P 500 since 2023.

ReplyShare

Calliope

[21m](https://www.astralcodexten.com/p/open-thread-434/comment/261091399 "May 18, 2026, 4:28 PM")

... are you perchance under the delusion that there isn't active governmental interference trying to keep the global financial markets running? Wheels are close to falling off, so it's pretty stressful down in the trenches.

America is making out against China, in the energy "war", so of course our stocks go up (stopping the gulf oil really kicks China in the bullocks)

The real crisis is being deliberately kept under wraps, so it's no surprise that you're looking at oil instead of water.

Reply (2)Share

Tyrone Slothrop

[17m](https://www.astralcodexten.com/p/open-thread-434/comment/261094125 "May 18, 2026, 4:33 PM")

Yeah, new email addresses are free.

ReplyShare

Alban

[17m](https://www.astralcodexten.com/p/open-thread-434/comment/261093824 "May 18, 2026, 4:32 PM")Edited

Grimmoar/gawdflea/3 other banned nicks, could you just stay away? The conspiracy theories and hints at hidden information are really annoying enough, but combined with the flood-style of posting and derailing it's dragging the comments down. Please, there is a reason for the previous bans.

Reply (1)Share

Tyrone Slothrop

[15m](https://www.astralcodexten.com/p/open-thread-434/comment/261094843 "May 18, 2026, 4:34 PM")

Wimbli—>Aristocat—>Zanni—>Gawdflea—>GrimMoar

Let’s play Where’s Wimbli.

ReplyShare

Bob Bobberson

[22m](https://www.astralcodexten.com/p/open-thread-434/comment/261090968 "May 18, 2026, 4:27 PM")

I don't know much about the stock market but it could be that the oil shock is being cancelled out by something else. Investors seem pretty optimistic about AI lately, so maybe that's it.

ReplyShare

overripebanana

[27m](https://www.astralcodexten.com/p/open-thread-434/comment/261087949 "May 18, 2026, 4:22 PM")

Any good advice or sources on nutrition for fertility and/or pregnancy? I've been asked by my partner to read up on it, and I like to read, so here I am. Like most things regarding nutrition, it seems very hard to find out who/what to trust.

I am unsure if I think this is a good idea, or will just give us more things to worry about. By most standards, I would say we are very healthy and our diet is good, so Im thinking things will work out anyway. Any experiences?

Reply (1)Share

C_B

[22m](https://www.astralcodexten.com/p/open-thread-434/comment/261091042 "May 18, 2026, 4:28 PM")Edited

Scott had a post about this a few years back: https://www.astralcodexten.com/p/obscure-pregnancy-interventions-much

I don't know what might have changed since then.

That post itself contains a recommendation for Emily Oster's "Expecting Better," as a good evidence-based guide to which parts of general pregnancy wisdom are real and which are BS; it looks like there's a 2025 update to that: https://www.amazon.com/Expecting-Better-Conventional-Pregnancy-Wrong/dp/0143125702

ReplyShare

Adrian

[31m](https://www.astralcodexten.com/p/open-thread-434/comment/261086164 "May 18, 2026, 4:19 PM")

I'm not a biologist, nor a zoologist, but I watch pop science videos about extinct critters. And there's one thing that bugs me immensely about phylogeny.

Everyone seems deathly afraid of actually labeling any group of species X as the ancestor of another group of species Y. Don't believe me? Search for "phylogenetic tree of life", and you'll mostly find depictions like this one: https://www.researchgate.net/publication/252743392/figure/fig5/AS:365282104233990@1464101448858/The-phylogenetic-tree-of-life.png

Apparently, if you lived more than 1 million years ago and among your countless descendants are representatives of two different species, then you don't belong to any class, order, or family. Your genus shall not be named, and your place on the tree of life shall forever remain an unmarked fork on the evolutionary path. Fish aren't shown to be descended from archaea, amphibians from fish, mammals from amphibians. The tree always branches off juuuuust before.

Except for birds and dinosaurs. Because birds totally are dinosaurs! Oh, sorry, I meant to say "avian dinosaurs". Yeah, that's how totally birds are dinosaurs. And therefore a sparrow and a triceratops are both dinosaurs, despite branching off from each other some 230 million years ago. Fuck this!

Reply (2)Share

Bugmaster

[9m](https://www.astralcodexten.com/p/open-thread-434/comment/261098352 "May 18, 2026, 4:41 PM")

The whole point about evolution is that there's a smooth transition from one lifeform to another. You can dice up the gradient of life into "phyla" and "species", but your categories are going to be fairly arbitrary no matter what you do. Outside of massive divisions such as "this thing can absorb sunlight for energy, and this other one can't", the fine-grained details will always come down to historical precedent, a.k.a. vibes.

ReplyShare

Xirdus

[23m](https://www.astralcodexten.com/p/open-thread-434/comment/261090614 "May 18, 2026, 4:27 PM")Edited

IIRC the classic taxonomic system of orders and families has been deprecated for about a decade. It's less that they don't bother naming new families anymore and more that there shouldn't have been any families named in the first place. But I'm no biologist, don't quote me.

The birds are dinosaurs thing is less about saying how cool birds are, and more about highlighting the fact that actual dinosaurs of old were in fact feathered. I also think it predates the deprecation of taxonomic ranks by like 6 months.

ReplyShare

George H.

[38m](https://www.astralcodexten.com/p/open-thread-434/comment/261081993 "May 18, 2026, 4:11 PM")

I've stop watching war coverage. But I check the oil price, and that gives me a hint. It's getting worse in the 'oil prices' opinion.

ReplyShare

WaitForMe

[41m](https://www.astralcodexten.com/p/open-thread-434/comment/261080696 "May 18, 2026, 4:09 PM")

I'm still thinking about taste and the way artists stories matter in a way I feel wasn't adequately addressed. The mind set of an artist is not always fundamental to the arts value but sometimes it is incredibly important to the piece. A novel like My Manservant and Me only hits if you know the author is dying of AIDS. Carrie and Lowell is a great album but listening is enhanced by knowing Sufjan Steven's family history. Henry Dargers art is amazing not for it's content necessarily but for the single minded vision a human can have and keep secret in their heart for decades, and seeing it knowing his life transforms the art.

In the same way, the experience of a Monet is enhanced by knowing the history of artistic movements and the forms the Impressionists were rebelling against. It's not surprising to look at a Monet against another painting and to appreciate them equally or even find the other superior, and then appreciate it more after you know the artist and their history.

Maybe most people appreciating Monets over other paintings don't know the history, in which case it's more of a status game in some sense, but for those who do it's very relevant to the appreciation.

Reply (2)Share

Bob Bobberson

[14m](https://www.astralcodexten.com/p/open-thread-434/comment/261095322 "May 18, 2026, 4:35 PM")

I agree, but I think there's a difference between a life story truly necessary to produce the work, and a life story that merely makes the work seem more interesting once you know it. If we put too much weight on the latter, then art becomes basically a genre of celebrity trivia and memorabilia. "This is the actual katana that Mishima stabbed himself with after he tried to overthrow the government! Oh and this is the actual novel that Mishima wrote before he stabbed himself with said katana! And this is a tissue he once sneezed on!" At a certain point you have to let the novels stand on their own. In Mishima's case, I think they do for the most part.

ReplyShare

Calliope

[35m](https://www.astralcodexten.com/p/open-thread-434/comment/261083844 "May 18, 2026, 4:15 PM")

I don't think those are the same at all. An artist's lived history MAY influence the piece (Snow Crash is very influenced by the Author's rebellious nature, but you have to read Diamond Age to understand that).

... or are we not allowed to talk fictional authors? (aka fanfiction?)

Art is done in relationship to other art, and this is best seen in parody, which cannot be understood without reference. Not all art stands alone (in fact, little art does stand precisely alone -- Snow Crash could be seen as poking fun at Neuromancer and Gibson). That's different though, than the artist's own history (beware: you may not read someone's real history, depending on the author, in which case, do you find the novel still as good?).

I would like to say that if you can only understand a novel because of "where the person is standing" as they're writing it, that's probably a pretty bad novel (I hold some level of universal standard, like how I expect Big Bottom or other parody songs to Actually Have Good Music).

Reply (1)Share

WaitForMe

[27m](https://www.astralcodexten.com/p/open-thread-434/comment/261088167 "May 18, 2026, 4:23 PM")

I agree they are different in the ways you describe, but I'm trying to get at the fact that knowledge outside the piece of art itself can change the way it's viewed. This could be knowledge of personal history or art history. Good art should be digestible without knowing the personal history, but it can change the experience.

I feel like the piece on taste was dismissing this. That if you look at two pieces of art in a vacuum and like one better, it seemed to be making the argument that knowledge about the history or creation of the art shouldn't influence your opinion. You should just keep liking the same one, because your "taste" implied it to be the better painting/book/poem/etc. E.g. the part about Chestertons poems.

But the history does matter. It changes my emotional state when absorbing the piece, which is the basis of my taste.

Reply (1)Share

OhNoAnyway

[18m](https://www.astralcodexten.com/p/open-thread-434/comment/261093270 "May 18, 2026, 4:31 PM")

I still feel that you do not distinguish "history of the author" and "history in general" (or, perhaps better put, simply "context") enough.

ReplyShare

Mark Neyer

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261078249 "May 18, 2026, 4:05 PM")

Believing there's a God who loves you solves a concurrency problem.

Just wrote this, would love thoughts or feedback. This is especially relevant to people interested in predictive processing models.

https://apxhard.substack.com/p/monotheism-solves-a-concurrency-problem

ReplyShare

Alexander Turok

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261073462 "May 18, 2026, 3:56 PM")

Left-wing influencer Will Stancil claims “let me be clear: put me in charge and I will absolutely, unequivocally, without any hesitation firebomb the ballroom.”

https://bsky.app/profile/whstancil.bsky.social/post/3mlhdwy3vas2q

Who exactly is supposed to put him in charge is left unsaid. The problem with left-wing terrorism is nobody wants to make a move without getting approval from the firebombing committee and completing a 500-page environmental impact statement.

Reply (4)Share

Deiseach

[17m](https://www.astralcodexten.com/p/open-thread-434/comment/261093649 "May 18, 2026, 4:32 PM")

Ah, poor Will. He's getting it very tough on Bluesky recently so he needs desperately to do something to claw back his leftist street cred. This is just a desperate cry for attention, he's not firebombing anything (except perhaps his reputation).

ReplyShare

Bob Bobberson

[36m](https://www.astralcodexten.com/p/open-thread-434/comment/261083273 "May 18, 2026, 4:14 PM")

So he wants to break the rules, but he wants permission first. There's this strange desire among these people to be both one of the good kids and one of the bad kids at the same time. The fact that he's 40 makes it stranger.

If I were in charge I probably would demolish the ballroom, but it would be relatively low priority, and I'd go through all the proper approvals and permits and such.

Reply (1)Share

Calliope

[34m](https://www.astralcodexten.com/p/open-thread-434/comment/261084287 "May 18, 2026, 4:16 PM")

This is the guy who got kicked out of antifa.

And, no, you wouldn't demolish the ballroom, if you were in charge. If you were in charge, you'd know why it got built.

Reply (1)Share

TGGP

[32m](https://www.astralcodexten.com/p/open-thread-434/comment/261085363 "May 18, 2026, 4:18 PM")

I don't think he was ever really part of antifa. He's a Twitter-turned-Bluesky progressive.

ReplyShare

TGGP

[42m](https://www.astralcodexten.com/p/open-thread-434/comment/261079975 "May 18, 2026, 4:08 PM")

I know you're joking, but terrorists tend to come from the anarchistic direct-action "propaganda of the deed" strain of leftism rather than the bureaucratic vetocracy strain which takes hold in established governments.

ReplyShare

Calliope

[42m](https://www.astralcodexten.com/p/open-thread-434/comment/261079775 "May 18, 2026, 4:07 PM")Edited

This is not how terrorist cells operate.

ReplyShare

Legionaire

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261064512 "May 18, 2026, 3:40 PM")

I thought of a strange conciousness/pzombie thought experiment involving two previous ones. The first is blockhead, a computer that seems to be concious because it has one GIANT lookup table for IO pairs of human conversation. Note that Blockhead inputs could technically even include vision, audio, etc. while outputs could include motor responses, etc, and be arbitrarily quantized regarding time (1 second of IO, or 1 millisecond, etc) It is often used as a modus tolens against behavioralism, because obviously a lookup table isnt concious! Chalmers Dancing Qualia is another thought experiment where you go through the whole brain, taking neurons and converting them to a silicone equivalent, preserving functionality. As you go, the subject should report if qualia disappeared, but if they did, that would be a loss in functionality! Many accept this as a good argument against substrate dependence.

Well lets take a human brain and a single neuron in it: replace it with a lookup table for inputs and outputs. Now replace an adjacent neuron with another table. Now combine those two tables into one larger table. Keep doing this in any order you see fit, until you have one giant lookup table. We have danced our way from a human brain to Blockhead. Remember, any change in concious experience during the process should have been reportable. Any change in reported qualia would violate the functional requirement. Where on the subdivision dimension did it start/stop becoming conscious? Some people try to get around the Blockhead question by claiming that only the thing that recorded it's IO pairs must have been concious. This dancing process closes that loophole somewhat. My conclusion is that a true Blockhead (a lookup table far, FAR larger than our universe btw) would be as concious as I am, OR there is problem, other than size, preventing a lookup table from ever functionally cloning my brain, like how a non turing complete language would be unable to emulate a turing complete one.

My first thought is that this table probably needs more entries than the largest numbers people have yet conceived. But what if you knew in advance all the input I would receive, and only stored those? Now concievable to store it, right? It might even be small. Or would I lose qualia by not storing possible IO pairs that will never happen before I die?

My second thought is something non-woo re quantum mechanics entangling the brain with its surroundings, which I didn't think a lookup table could correctly replicate (a QM system is not just the sum of its parts) but I'm out of my depth here.

Reply (4)Share

Taleuntum

[8m](https://www.astralcodexten.com/p/open-thread-434/comment/261098933 "May 18, 2026, 4:42 PM")

Or would I lose qualia [...]?

Qualia are defined as the phenomenal properties of experience, but unfortunately, there is no such thing. Introspectable properties of experience are merely quasi-phenomenal ones, i.e. purely physical properties that introspection misrepresents as phenomenal.

Please read at least the first two parts of the first section:

https://keithfrankish.github.io/articles/Frankish_Illusionism%20as%20a%20theory%20of%20consciousness_eprint.pdf

ReplyShare

Bugmaster

[13m](https://www.astralcodexten.com/p/open-thread-434/comment/261096056 "May 18, 2026, 4:36 PM")Edited

The problem with all those Chinese Room Blockhead p-Zombie thought experiments is that they're totally unfalsifiable. If you ask the Chinese Room/etc. if it's conscious, it will say "yes", because that's what its loopkup table indicates; and in all other respects it acts as though it were conscious, so there's no way for you to tell that it isn't really truly conscious unless you take it apart -- and maybe not even then. This leads to the following possible conclusions:

1). Only biological systems can be conscious, because I have a priori decided this to be axiomatically true.

2). Consciousness is mysterious and ineffable and nonphysical and it's all a grand spiritual mystery.

3). The philosophical concept of "consciousness"/"qualia"/etc. is hopelessly confused, on par with "elan vital" but more so.

Personally, I'm going with option (3), but that's just me.

ReplyShare

Peter Defeel

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261072870 "May 18, 2026, 3:55 PM")

Many accept this as a good argument against substrate dependence.

I don’t know why people don’t think about the mind being analogous to software here. Something running on a system (or substrate) that depends on the lower system to run but isn’t itself the lower system. In the case of a future AI living in a data centre we could replace all the data centre machines, and keep the AI. If it felt qualia to begin with it it would feel it to end with.

ReplyShare

Timothy M.

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261069515 "May 18, 2026, 3:49 PM")

a lookup table isnt concious

This is basically the Chinese Room thing again, and I find it kind of annoying (no offense to you in particular). You take some data structure and simultaneously say it "obviously" is or isn't [a thing we can barely define] but then you also extend it to a level of complexity we can't really understand (arbitrary size, all kinds of inputs, the passage of time) so it doesn't even really resemble what we would normally think of as "a lookup table".

With these constraints you could implement a deep learning model as "a lookup table" and therefore approximate any continuous function.

Reply (2)Share

OhNoAnyway

[14m](https://www.astralcodexten.com/p/open-thread-434/comment/261095839 "May 18, 2026, 4:36 PM")

BTW is a lookup table the same as sin(x)?

(Not sure about the answer, just asking your opinion.)

Reply (1)Share

Timothy M.

[5m](https://www.astralcodexten.com/p/open-thread-434/comment/261100530 "May 18, 2026, 4:45 PM")

You could implement it that way. I'm pretty sure I had at least one textbook when I was younger with a few pages of sin(x) in the back.

You'd have some limitations - for the paper version, only accept inputs to some finite number of digits and bound it to some 2pi range.

If you rule out those limitations, you'll need a really big table, but it's unclear what the limit would be in the thought experiment given.

ReplyShare

dubious

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261076985 "May 18, 2026, 4:02 PM")

The thing is you can't. The so-called thought experiment is to prevent you from thinking. It's a con. The person using this con will avoid all discussion of _the conversation_ with "the room," because supposedly it is irrelevant.

But it is not irrelevant. If we accept the room cannot be distinguished from a "real person" speaking Chinese, then we can ask it all sorts of things. How do you feel? What did you have for lunch yesterday? Can we meet tomorrow? What is the first question I asked you? Who else have you spoken to and did they tell you a message to relay to me? Let X represent the first question and Y represent the second question and Z represent the third question; what words are common to X and Z but not Y? You’re in a desert walking along in the sand when all of the sudden you look down, and you see a tortoise...

If we accept the room is _perfectly indistinguishable_ from a person, then we could teach the room. It could retain a lifetime of context. And so on. If it can't. then it's not indistinguishable. If it can... then this matters, because a simple lookup table isn't going to work. The person proposing this is on the line for explaining considerably more about how it must work. About how these things are supported. Cards and filing cabinets will not suffice.

ReplyShare

Scott Santens

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261060063 "May 18, 2026, 3:32 PM")

Have you seen this yet, and will you add your name to it? Your article about why UBI is superior to a jobs guarantee remains evergreen and great to this day. https://actionnetwork.org/petitions/the-ai-pledge-for-humanity

ReplyShare

Juan Pablo

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261056119 "May 18, 2026, 3:25 PM")

In the current debate with the buttons: https://knowyourmeme.com/memes/red-button-or-blue-button-question

At what percentage of inherent disadvantage to your default answer do you switch sides?

I'd press red in the original setting, but if a blue outcome was allowed with just 5% of blue votes, I'd easily choose blue. I can't know for certain but I think my boundary is around 30%

Reply (1)Share

Griffin Hilly

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261059821 "May 18, 2026, 3:32 PM")

The problem is so reflexive that even just the manner in which it would be presented has a strong influence on what everyone might think about everyone else's thought process, and thus how one 'ought' to answer. The attempts to transform the question by imagining jumping into a woodchipper which disables if 50%+ of people jump in because the question is not merely whether you, the reader, are willing to jump in or push red, but what you think the likelihood is that others will do so. In the abstract I'm a red-pusher with the original framing but if the presentation of the threat to red-pushers were sufficiently menacing it would shape my decision.

Reply (1)Share

Juan Pablo

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261069235 "May 18, 2026, 3:49 PM")

Oh, yeah, I've been having this issue and it's pretty infuriating. I also hate the stupid tribalism it's spawned, and this question comes from a need to mend that tribalism. For the moment let's say it's the exact same framing with just the percentage required for a blue win adjusted.

In the lower percentages (say, blue wins with 5%), i'd guess the threat to pushing red is social stigma or shame, in proportion with how low the threshold was.

Reply (1)Share

Mark Neyer

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261077677 "May 18, 2026, 4:04 PM")

The button isn't real. But the hate, anger and contempt that people feel for each other, over a thought experiment, is real.

That right there seems to be a way that evil can grow in the world in ways that most of us miss.

Reply (1)Share

Calliope

[32m](https://www.astralcodexten.com/p/open-thread-434/comment/261085445 "May 18, 2026, 4:18 PM")

Self-righteousness is a hell of a drug. It's also why I dislike "implicit bias" training -- it trains people to feel superior to the people who haven't had the training.

ReplyShare

Maxim Nazarenko

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261052176 "May 18, 2026, 3:18 PM")

What's up with Dasani water?

Reply (1)Share

Alcibiades

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261068958 "May 18, 2026, 3:48 PM")

Journalists tend to take completely normal human behaviour and turn it into a focal point of the article to convince readers how weird the SF AI scene is. For example: group houses with brand identities, prediction markets on each other, hanging out with prosties, pharmacology for career advancement, polyamorous workplaces. These are all totally normal things like drinking Dasani, but the journalists turn them into "weird" things.

Reply (2)Share

Bob Bobberson

[32m](https://www.astralcodexten.com/p/open-thread-434/comment/261085641 "May 18, 2026, 4:18 PM")

Honestly some of those are traditionally considered pretty normal as long as you're discreet about it.

ReplyShare

TGGP

[43m](https://www.astralcodexten.com/p/open-thread-434/comment/261079046 "May 18, 2026, 4:06 PM")

I don't think they are nearly as normal as drinking Dasani.

ReplyShare

Amanda Luce

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261051826 "May 18, 2026, 3:17 PM")

What time/time zone on May 20th are the Book Review submissions due? Asking for a friend 😅

ReplyShare

anon

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261051176 "May 18, 2026, 3:16 PM")

Anyone with connections to Hackensack Meridian Health?

ReplyShare

Mark McNeilly

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261049825 "May 18, 2026, 3:14 PM")

The Four Kinds of People in the AI Era:

In the Age of AI, four quadrants emerge that tell four very different stories about where people are headed. There's the Augmented Thinker, the Cognitive Outsourcer, The Traditional Thinker, and the Passive Drifter. Which one will you be?

https://markmcneilly.substack.com/p/the-four-kinds-of-people-in-the-ai

Reply (4)Share

Deiseach

[9m](https://www.astralcodexten.com/p/open-thread-434/comment/261098554 "May 18, 2026, 4:41 PM")Edited

Okay, I'm probably Quadrant 3 but ignore that, I want to fight with you over this:

"Pericles, the great Athenian statesman, said, “You may not be interested in politics, but politics is interested in you.”

I went "I never read a word by Pericles but I'm damn sure he never said that" and going back to the original source, insofar as I'm directed to an original source, no, indeed he did not:

https://home.uncg.edu/~danford/pericles.html

"It is wrong to say that the people love Athens because she is great. It is the other way around --- Athens is great because the people love her and take part in politics. Here each individual is interested not only in his own affairs but in the affairs of the State as well: even those who are mostly occupied with their own business are extremely well-informed on general politics; this is a peculiarity of ours; we do not say that a man who takes no interest in politics is a man who minds his own business; we say that he has no business here at all.

Pericles

Speech to the Athenians in 450 B.C."

So "Politics is interested in you" is a stupid, modern, goldfish attention span, Internet quotes (worst of) boiled-down version of what he did say. It's not "You may not be interested in politics but politics is interested in you", it's "Athenians believe it to be their civic duty to take an interest in the affairs of the State, and this is what makes Athens great".

You have just demonstrated why I'm never going to use AI to think for me or help me think if I can possibly help it; we already have bad Internet Quotes where historical figures are represented as saying shit they never said (pardon the strong language, I feel deeply about this) and AI-mangled précis of data scraped off the Internet is only going to make it worse.

Go back to the original sources or nothing!

ReplyShare

Peter Defeel

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261073910 "May 18, 2026, 3:57 PM")

I’ll be in the local pub on a Thursday doing the pub quiz. Graham Norton turned up once.

ReplyShare

TGGP

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261050853 "May 18, 2026, 3:16 PM")

What reason is there to think those labels are carving nature at the joints rather than being MBTI type fabrications?

Reply (1)Share

Deiseach

[5m](https://www.astralcodexten.com/p/open-thread-434/comment/261100873 "May 18, 2026, 4:45 PM")

It's a guy saying "MY job is safe, I'm an Augmented Thinker!" while using AI to help him write the piece, seeming not to recognise that AI might produce such in future without the need of a human middleman to generate prompts.

The irony may turn out that the job of the fella sweeping the floors in the university is safer in the AI future than that of "Mark McNeilly is a Professor of the Practice at UNC Kenan-Flagler Business School and chairs the UNC Provost’s AI Committee. He writes on AI, leadership, and strategy at Mimir’s Well on Substack.

This article was written by me and improved with additional input from AI."

ReplyShare

None of the Above

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261050439 "May 18, 2026, 3:15 PM")

I was planning on #5: The Paperclip

Reply (1)Share

Maxim Nazarenko

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261051780 "May 18, 2026, 3:17 PM")

Satisfy values through friendship and ponies!

ReplyShare

tempo

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261049090 "May 18, 2026, 3:13 PM")

Did anyone find the voter guides usefu? (as in they weren't 99% what you would have guessed without seeing the guide?)

Reply (1)Share

Anaxagoras

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261051876 "May 18, 2026, 3:18 PM")

It's often helpful when they ask candidates questions about some topic, or organize candidates' public stances on those topics.

ReplyShare

Notmy Realname

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261048169 "May 18, 2026, 3:11 PM")

Is the excerpt from the subscriber article a quote from a real article that is being critiqued, or a parody? I honestly can't tell

Reply (2)Share

Peter Defeel

[1h](https://www.astralcodexten.com/p/open-thread-434/comment/261074391 "May 18, 2026, 3:58 PM")

It’s a parody written by Scott.

ReplyShare

Maxim Nazarenko

[2h](https://www.astralcodexten.com/p/open-thread-434/comment/261052621 "May 18, 2026, 3:19 PM")

Poe's law is brutal...

ReplyShare

Top Latest Discussions

The Dilbert Afterlife

Sixty-eight years of highly defective people

Jan 16

2,063

Image 68

Still Alive

You just keep on trying till you run out of cake

Jan 21, 2021

1,589

Image 69

Ivermectin: Much More Than You Wanted To Know

...

Nov 17, 2021

2,113

Image 70

See all

Ready for more?

AI 可能会生成不准确的信息,请核实重要内容