TED Talk Can we build AI without losing control over it?   Speaker: Sam Harris 第三课

And it's important to recognize that this is true by virtue of speed alone. 

Right? So imagine if we just built a super intelligent AI that was no smarter than your average team of researchers at Stanford or MIT. 

Well, electronic circuits function about a million times faster than biochemical ones, so this machine should think about a million times faster than the minds that built it. 

So you set it running for a week, and it will perform 20,000 years of human-level intellectual work, week after week after week.

 How could we even understand, much less constrain, a mind making this sort of progress?

The other thing that's worrying, frankly, is that, imagine the best case scenario. 

So imagine we hit upon a design of super intelligent AI that has no safety concerns. 

We have the perfect design the first time around. 

It's as though we've been handed an oracle that behaves exactly as intended. 

Well, this machine would be the perfect labor-saving device. 

It can design the machine that can build the machine that can do any physical work, powered by sunlight, more or less for the cost of raw materials. 

So we're talking about the end of human drudgery. We're also talking about the end of most intellectual work.

So what would apes like ourselves do in this circumstance? 

Well, we'd be free to play Frisbee and give each other massages. 

Add some LSD and some questionable wardrobe choices, and the whole world could be like Burning Man.

Now, that might sound pretty good, but ask yourself what would happen under our current economic and political order? 

It seems likely that we would witness a level of wealth inequality and unemployment that we have never seen before. 

Absent a willingness to immediately put this new wealth to the service of all humanity, 

a few trillionaires could grace the covers of our business magazines while the rest of the world would be free to starve.

And what would the Russians or the Chinese do if they heard that some company in Silicon Valley was about to deploy a super intelligent AI? 

This machine would be capable of waging war, whether terrestrial or cyber, with unprecedented power. 

This is a winner-take-all scenario. 

To be six months ahead of the competition here is to be 500,000 years ahead, at a minimum. 

So it seems that even mere rumors of this kind of breakthrough could cause our species to go berserk.   【词汇】To go berserk means...  to become very angry or out of control. 狂怒的，控制不住的。

【选择】-How could the development of AI create problems for humanity?    -Massive wealth inequaility could arise.   -人工智能的发展如何给人类带来问题?-可能出现大规模的贫富不均。

【选择】-Why does Harris say to be six months ahead is to be 500,000 years ahead?    -A super intelligent AI would develop so fast that other AI couldn't be able to catch up.   -为什么哈里斯说提前6个月就是提前50万年?-超级智能人工智能发展如此之快，以至于其他人工智能无法赶上。

【跟读】AI will operate at a rate that humans could never match.   人工智能将以人类永远无法匹敌的速度运行。

【跟读】Massive inequaility with wealth could cause humans to turn against each other.    巨大的财富不均可能导致人类相互对立。