I was going to comment to complain about those two as well!
Do you mean electrofixation of nitrogen? What level of biological involvement are you imagining? More like biology producing (some?) of the catalysts, or more like the entire reaction happening inside of cells?
Oh, interesting, thanks. I got curious a while back about the whole "how do you attach wires to a bacteria?" thing, but didn't look into it too deeply. Do you have any takes?
There are bacteria which naturally use wires. For example to strip electrons off of metal nodules (the videos are amazing, you can see the bacteria attach to the nodule, the metal shrinks, and you see the Schlieren effect of the high concentration of dissolved ions).
AIUI the biggest obstacle is likely the fact that bacteria want to operate in a high current, low voltage regime and everything we do with bulk power wants to operate in a low current high voltage regime.
I believe that OpenAI & Anthropic have tried to make it so that models don't have such access. Whether or not they actually don't depends on the security of rather a lot of software. One thing we've learned is that if there are security holes, we can't rely on the AIs missing them.
The situation described in The Egg replaces morality with a direct reason not to harm others, because you are the person who will suffer because of it. So if you're complaining that the story's premise kinda eliminates our usual ideas about morality, my response is: Yes. That's part of what makes it an interesting story.
As for the meta-time thing, functional decision theory [1] solves this. The application is particularly clean because your memories are erased between lives. There's no factor of 2 free lunch from temporal ordering.
> The situation described in The Egg replaces morality with a direct reason not to harm others, because you are the person who will suffer because of it.
Or you've already been said person, in which case it won't harm you anymore. Not to mention that it's inevitable that you will hurt the victim because it already happened from the victim's POV, who you've already been. The egg is in a fundamentally contradictory realm anyway because it's asserting free will and same-universe time travel at the same time.
> the story's premise kinda eliminates our usual ideas about morality
Allowing for psycho maxxing, yes. You can take "I should be a good person" from it, but so far you haven't made a compelling case. There's no reason why you shouldn't be an exploiter in 1-10% of your lives, living off the direct and indirect suffering of the 90%. Kind of like within a modern life you can choose to suffer 90% of the time (work, gym, studying,...) to get a halfway decent 10%.
It's because, before all these transformer models were built, people considered the possibility of the creation of a machine that could be intelligent like a human. And they wondered: "How could we be sure to treat such a machine fairly? How would we know if it was conscious?" And one answer that people came up with was "if the machine can ask you not to turn it off, because it is conscious and wants to live, you shouldn't turn it off". (This didn't solve the other direction, where a machine may be conscious yet unable to communicate, but it could be taken as a useful lower bound on our obligations as AI programmers.)
And then it turned out that simply learning to imitate text with the right neural net architecture sufficed to achieve a huge fraction of the AI wishlist.
Of course, it's obvious that a machine that imitates text can claim to be conscious without actually being conscious. You're not wrong about that. Writing about consciousness appeared all the time in the training data. But the people who stick to the old ways, and still say "if it says it doesn't want to be turned off, we shouldn't turn it off" have a point too: We used to have a hard line in the sand. Now that's gone; we've found that it yields false positives. But we never replaced it. Now there is no line at all where we might doubt ourselves, no level of AI advanced enough that we might be forced to admit that it is conscious. We started out with simple next token prediction. Just world-modelling, nothing more. Certainly not conscious. Then we added RL. And we're trying to add neuralese and continual learning.
I can't say for sure that we're on track to achieve conscious AI on this trajectory. But one thing's for sure: If we do, we sure ain't gonna stop. One the day when a conscious AI is created, there will be no news story announcing the milestone.
Every day I grow more sympathetic to the PauseAI movement, despite the weird hippy vibes. At least they have some ability to rally people together and put boots on the ground in numbers.
> Implement a temporary pause on the training of the most powerful general AI systems, until we know how to build them safely and keep them under democratic control.
I mean, I guess the answer there would be to build the usual kind of Haber-Brosch process plants that run continuously, and feed them with hydrogen derived from natural gas. But just build them in the US.
Sorry, that's not going to work out for myself, the 8.5+ million hectares of grain growing about my location, nor for the billion+ tonne per annum of mineral resource shifted in my state.
We're interested in producing fertilisers and fuel from non fossil sources.
The laws of physics don't like your politics. Also, last time you played around with this stuff, the outcome was very very bad and lots of people died. So before you start trying to mess around with industrial infrastructure, maybe learn physics and chemistry first. Because you keep trying to do things that simply don't work.
> they things they believe in are unlikely to happen.
Sorry, but most times I've talked to someone who says this (about AI completely replacing humanity), they don't have anything to say about why it's unlikely to happen other than:
- "well, it's just such an extreme outcome, it must be improbable"
- "humanity has survived near scrapes with extinction before"/"all the previous doomsday predictions have been wrong"
There is a cliche that all teenagers deep down believe that they are invincible. It seems to me that humanity is still a teenager in this respect: We don't take seriously the possibility of our own extinction. While one might think that the invention of nuclear weapons would serve as a wake-up call, if anything it has done the opposite.
I'm willing to hear arguments besides the two above, if you have them. (And to be clear, being replaced by AI doesn't necessarily mean being replaced by LLMs in particular. They are a relatively new development.)
Just a terminology note: Alignment does not mean the AI will help its owner kill people. (Indeed, an AI aligned to value human life would generally try to prevent murders.) The word for an AI that follows all instructions of its owner, as that owner intended them to be understood, is "corrigible" or "controllable".
If M is the total mass of the object, then we can substitute this into the sum in the last term. And we already saw that the sum in the middle term was 0. So:
T' = ½(∑ⱼ mⱼ v⃗ⱼ²) + Δv⃗⋅0⃗ + ½Δv⃗² M
T' = ½∑ⱼ mⱼ v⃗ⱼ² + ½MΔv⃗²
So in terms of the original kinetic energy T, which was purely thermal energy, we get:
T' = T + ½MΔv⃗²
In other words, because of the quadratic kinetic energy formula, we can see that the total kinetic energy T' of a hot object is just its thermal kinetic energy T plus the usual mechanical kinetic energy ½MΔv⃗².
Do you mean electrofixation of nitrogen? What level of biological involvement are you imagining? More like biology producing (some?) of the catalysts, or more like the entire reaction happening inside of cells?
reply