This tracks with my experience. I have assembled a homebrew microbiology lab from various parts from aliexpress and integrated it into my agent harness. Just a year ago it was a complete mess, but current models are extremely good at synthesising novel protein and virus structures. One put me in the hospital not last week, haha! I cant wait to see what I perish of
Isn't the "kill us all" concern met by keeping nukes & essential infrastructure airgapped? This is something that should be the case already, and is certainly urgent if not the case. Instead of doomerism and calls to slow down the development of AI (not gonna happen), the conversation could be pivoted towards thorough threat analysis / audit.
Granted that a rogue adversarial AI in a sci-fi scenario could theoretically go into paperclip mode, but if "we" maintain control of energy generation and civilization threatening weaponary, the damage is at least limited. AI needs a lot of power, and AI can only (theoretically) breach & control what it can access through the internet. Even the scenario of nation-states deploying adversarial AIs against each other is just an extension of this and current deterrence / realpolitik.
And, it's not like the scenario of all models teaming up with each other to squash the human plague is plausible. We have AI with which we can protect ourselves against the threat of rogue AI.
> AI needs a lot of power, and AI can only (theoretically) breach & control what it can access through the internet.
"AI needs a lot of power" depends on where you draw your lines. I can say a lightbulb needs a lot of power if I include all the power needed to generate all the surrounding infrastructure and make the lightbulb itself. Sincere question: I wonder how much power was consumed in the 88 hours required for the Navier-Stokes problem.
It took 88 hours and who knows how many kwh to solve a problem that no other human has solved, and Humans have already solved breaching and destroying systems that can't be accessed over the internet (see Stuxnet).
It feels like you're suggesting the solution to keeping on top of this thing that can outsmart smart humans is to just keep doing smart human things.
AI will do social engineering in the future. It will make humans do physical braches and terror attacks. All it needs is some money and there will be a black market. Money is easy to defraud online judging by north korean hacking success.
Nukes cannot be airgapped, since the president needs to be able to make a call. And they will make a call based on information, and this information can be compromised.
Very editorialised title. Not sure this offers any real value to be honest other than to drum up hype before IPO valuations hit for some of these companies.
Could you elebaorate on what that means?
Had to Google 'goyim' and based on that, to my ignorant ears at least, your comment reads like it might be an attempt at a veiled antisemitic comment. But I'm going to assume the best and that that's not what this is.
Maybe we should drone bomb all the datacenters then? Or just turn off the electricity.
Or maybe just do a deep financial audit of all involved companies and investors. Really go into it with a bunch of motivated white collar crime prosecutors. Would be less violent and achieve same level of safety.
Hm, maybe if AI is powerful enough to crack our hardest math problems, we could demonstrate that by cracking one of our hardest math problems. It's not hard to know what they are.
AI can easily manufacture and distribute a bunch of prions through water supply. After that it’s pretty much game over you will not survive even one prion. In fact I’d say prions are probably the great filter.
The US gov if very helpful and gives you a nice well proven full genome starting point for your experiments so you don't waste your time and tokens:
https://www.ncbi.nlm.nih.gov/datasets/taxonomy/10255/
Granted that a rogue adversarial AI in a sci-fi scenario could theoretically go into paperclip mode, but if "we" maintain control of energy generation and civilization threatening weaponary, the damage is at least limited. AI needs a lot of power, and AI can only (theoretically) breach & control what it can access through the internet. Even the scenario of nation-states deploying adversarial AIs against each other is just an extension of this and current deterrence / realpolitik.
And, it's not like the scenario of all models teaming up with each other to squash the human plague is plausible. We have AI with which we can protect ourselves against the threat of rogue AI.
"AI needs a lot of power" depends on where you draw your lines. I can say a lightbulb needs a lot of power if I include all the power needed to generate all the surrounding infrastructure and make the lightbulb itself. Sincere question: I wonder how much power was consumed in the 88 hours required for the Navier-Stokes problem.
It took 88 hours and who knows how many kwh to solve a problem that no other human has solved, and Humans have already solved breaching and destroying systems that can't be accessed over the internet (see Stuxnet).
It feels like you're suggesting the solution to keeping on top of this thing that can outsmart smart humans is to just keep doing smart human things.
Stuxnet surmounted air gaps.
Nukes cannot be airgapped, since the president needs to be able to make a call. And they will make a call based on information, and this information can be compromised.
It can get pretty bad.
let the goyim deal in the real world
Could you elebaorate on what that means? Had to Google 'goyim' and based on that, to my ignorant ears at least, your comment reads like it might be an attempt at a veiled antisemitic comment. But I'm going to assume the best and that that's not what this is.
Or maybe just do a deep financial audit of all involved companies and investors. Really go into it with a bunch of motivated white collar crime prosecutors. Would be less violent and achieve same level of safety.
They might as well rename it to "This one new threat could kill your family"
But luckily, AI will never breach safety-critical system. /s