TED Talk Can we build AI without losing control over it?   Speaker: Sam Harris 第四课

Now, one of the most frightening things, in my view, at this moment, are the kinds of things that AI researchers say when they want to be reassuring.【排序】

And the most common reason we're told not to worry is time. 【排序】

This is all a longway off, don't you know. This is probably 50 or 100 years away. 【排序】

One researcher has said, "Worrying about AI safety is like worrying about overpopulationon Mars."

This is the Silicon Valley version of "don't worry yourpretty little head about it."

No one seems to notice that referencing the time horizon is a total nonsequitur. 

If intelligence is just a matter of information processing, and wecontinue to improve our machines, we will produce some form of superintelligence. 

And we have no idea how long it will take us to create the conditions to do that safely. 

Let me say that again. We have no idea how long it will take us to create the conditions to do that safely.

And if you haven't noticed, 50 years is not what it used to be.

This is 50 years in months. 

This is how long we've had the iPhone.

This is how long"The Simpsons" has been on television. 

Fifty years is not that much time to meet one of the greatest challenges our species will ever face. 【填空】

Onceagain, we seem to be failing to have an appropriate emotional response to what we have every reason to believe is coming.

The computer scientist Stuart Russell has a nice analogy here. 

He said, imagine that we received a message from an alien civilization, which read:"People of Earth, we will arrive on your planet in 50 years. Getready." 

And now we're just counting down the months until the mothership lands?

We would feel a little more urgency than we do.

Another reason we're told not to worry is that these machines can't help but share our values because they will be literally extensions of ourselves.

They'll be grafted onto our brains, and we'll essentially become their limbic systems. 

Now take a moment to consider that the safest and only prudent pathforward, recommended, is to implant this technology directly into ourbrains.

Now, this may in fact be the safest and only prudent path forward, 

but usually one's safety concerns about a technology have to be pretty much worked out before you stick it inside your head.

The deeper problem is that building superintelligent AI on its own seems likely to be easier than building superintelligent AI and having the completed neuroscience that allows us to seamlessly integrate our minds with it.    

【词义】seamlessly intergrated into another=there are no apparent gaps or spaces between one part and the next.

And given that the companies and governments doing this work are likely to perceive themselves as being in a race against all others, 

given that to win this raceis to win the world, provided you don't destroy it in the next moment,

then it seems likely that whatever is easier to do will get done first.

【选择】-Why doesn't Harris think it matters how long it will take to ceate an AI?     -As long as progress continues, AI will ultimately be created.

【选择】-What does Harris say about cooperations and governments trying to create AI?   -They're in a race to control the world.

Now, unfortunately, I don't have a solution to this problem, apart from recommending that more of us think about it. 

I think we need something like a Manhattan Project on the topic of artificial intelligence. 

Not to build it, because I think we'll inevitably do that.

But to understand how to avoid anarms race and to build it in a way that is aligned with our interests.  【排序】

【词义】To align one thing with another means...    to organize them so that they match or fit well together.

When you're talking about superintelligent AI that can make changes to itself, 

it seems that we only have one chance to get the initial conditions right, 

and even then we will need to absorb the economic and political consequences of getting them right.

But the moment we admit that information processing is the source of intelligence, that some appropriate computational system is what the basis of intelligence is, 

and we admit that we will improve these systems continuously, 

and we admit that the horizon of cognition very likely far exceeds what wecurrently know, 

then we have to admit that we are in the process of buildingsome sort of god. 

Now would be a good time to make sure it's a god we can live with.

Thank you very much.

【选择】-What is Harris's call to action?   -Humans need to make sure this AI is a god that they can live with.

【跟读】There is no reason for me to make the talk depressing than it needs to be.

【选择】If Harris's assumptions are true, we must admit that we are creating a type of god.

【跟读】He believes humanity will either be wiped out or continue progressing.

【跟读】Worrying about AI safety is like worrying about overpopulation on Mars.   担心人工智能的安全就像担心火星上的人口过剩一样。

【跟读】No one seems to notice that referencing of time horizon is a total non sequitur.   似乎没有人注意到时间范围的引用是完全不符合逻辑的。