Back Original

Open Thread 451

This is the weekly visible open thread. Post about anything you want, ask random questions, whatever. ACX has an unofficial subreddit, Discord, and bulletin board, and in-person meetups around the world. Most content is free, some is subscriber only; you can subscribe here. Also:

1: ACX survey closes tomorrow, take it now or lose your chance!

2: EA college meetup updates: late addition meetups at Universidad de Sevilla, Universidade Federal De Santa Catarina, Carnegie Mellon. Time changes at Northwestern, UC San Diego, and University of Illinois Urbana-Champaign. Check the post for details.

3: Sorry for no book review last Friday; I was having technical problems with the site. The book review posts will resume this week.

4: You’ve probably seen that Sam Altman, Dario Amodei, Demis Hassabis, and Elon Musk agreed to “pace the frontier” of AI, with Dario’s essay here as the starting point for a concrete plan. I’m very happy with this development, but it’s one step on a long road, and we can’t rest on our laurels. Lots of things are moving now, there’s a lot of interest in the field, and the opportunities to get involved have never been better. Here are some new ones:

5: Coefficient Giving (a giant effective altruist funder, formerly known as Open Philanthropy) is launching Project Tailwind, a “call for founders to launch ambitious new AI safety initiatives”. If you want to fund a charity/startup working on technical AI safety or the surrounding infrastructure (see a list of specific ideas here), they’re offering “pre-seed funding of up to $2m to develop an idea, seed funding of up to $20m to build an org at scale, and more for exceptional opportunities where teams have a strong track record”.

6: Fields Medalist Jacob Tsimerman is founding the Mathematical AI Safety Institute, an effort to get mathematicians involved in AI safety research. They are “aiming to hire 10-30 mathematicians to join us in the Bay Area by January, and scale up to 30-100 for September 2027”. If you’re a mathematician who’s depressed about Navier-Stokes and wondering what’s left for human mathematicians in a world where AI capabilities are growing exponentially, this is your answer - it’s novel, important, and un-automatable. Apply here.

7: Some frontier AI company employees have expressed an interest in holding their CEOs to the commitments they’ve just made. Pamela Mishkin has organized unded the Coalition Of Concerned AI Staff to unite employees across major companies. And Cassie Pritchard, who I disagreed with about happiness research here but who’s been impressively on-point about AI, is trying to organize a safety-focused labor union; you can reach out to her here. This is why you need to keep a couple of socialists around sometimes!

8: What if you’re not a startup founder, mathematician, or AI company employee? I’m still working on figuring out a good answer to this, but here is a boring boilerplate list of things: