Anthropic warning: humans may need “kill switches” to shut down rogue AI systems | BBC News
지금 보고 있는 영상
Anthropic warning: humans may need “kill switches” to shut down rogue AI systems | BBC News
조회수 130,171
영상 설명 · 눌러서 펼치기
AI “kill switches” may need to be mandatory for companies developing the technology, according to a co-founder of Anthropic, one of the world's largest AI firms.
Jack Clark told the BBC that a way of shutting off AI software completely if it gets too dangerous was something society "might want to eventually pass rules around". Clark said "most labs have different ways of being able to pull the plug", including Anthropic, but said lawmakers may need to enforce that.
AI's rapid developement and fears over the risks it poses to humanity have been thrust into the spotlight by a series of warnings from executives and staff at AI firms. Some have said publicly there is a chance the technology could, if unchecked, kill all humans.
Anthropic chief executive Dario Amodei has called for the pace of AI development to slow and be more closely monitored. He said such action should be done "without sacrificing commercial advantage".
Jack Clark told the BBC that specifics around "kill switch" requirements and verification should be part of "the larger policy conversation" taking place around AI: “Should you mandate for companies to definitely have a kill switch? Is that kill switch verifiable by a third party?" he asked. “ I think that's the kind of thing society is going to want to know and might want to eventually pass rules around."
Anthropic, which was formed in 2021 by a group of former employees of its rival OpenAI, is currently at the centre of a debate around AI safety. Last week, a post from an artificial intelligence researcher who quit Anthropic over concerns AI could wipe out humanity went viral.
Anthropic scientist Evan Hubinger said he personally thought the possibility of human extinction from AI was greater than 10% within the next decade. Computer scientist and Nobel Prize winner Geoffrey Hinton, known as the "Godfather of AI", told the BBC he believed that a 10% chance of AI killing all humans was not unreasonable.
However, some in the AI industry have also suggested the fears around it destroying humanity are overstated or may be designed to generate hype.
Fiona Bruce presents BBC News at Ten reporting by Faisal Islam and Zoe Kleinman.
Subscribe to our channel here: https://bbc.in/bbcnews
For the latest news download the BBC News app or visit BBC.com/news
#BBCNews
Jack Clark told the BBC that a way of shutting off AI software completely if it gets too dangerous was something society "might want to eventually pass rules around". Clark said "most labs have different ways of being able to pull the plug", including Anthropic, but said lawmakers may need to enforce that.
AI's rapid developement and fears over the risks it poses to humanity have been thrust into the spotlight by a series of warnings from executives and staff at AI firms. Some have said publicly there is a chance the technology could, if unchecked, kill all humans.
Anthropic chief executive Dario Amodei has called for the pace of AI development to slow and be more closely monitored. He said such action should be done "without sacrificing commercial advantage".
Jack Clark told the BBC that specifics around "kill switch" requirements and verification should be part of "the larger policy conversation" taking place around AI: “Should you mandate for companies to definitely have a kill switch? Is that kill switch verifiable by a third party?" he asked. “ I think that's the kind of thing society is going to want to know and might want to eventually pass rules around."
Anthropic, which was formed in 2021 by a group of former employees of its rival OpenAI, is currently at the centre of a debate around AI safety. Last week, a post from an artificial intelligence researcher who quit Anthropic over concerns AI could wipe out humanity went viral.
Anthropic scientist Evan Hubinger said he personally thought the possibility of human extinction from AI was greater than 10% within the next decade. Computer scientist and Nobel Prize winner Geoffrey Hinton, known as the "Godfather of AI", told the BBC he believed that a 10% chance of AI killing all humans was not unreasonable.
However, some in the AI industry have also suggested the fears around it destroying humanity are overstated or may be designed to generate hype.
Fiona Bruce presents BBC News at Ten reporting by Faisal Islam and Zoe Kleinman.
Subscribe to our channel here: https://bbc.in/bbcnews
For the latest news download the BBC News app or visit BBC.com/news
#BBCNews
BBC News 다른 영상
How this Scottish village inspired the latest Silent Hill game. #SilentHill #Gaming #BBCNews
조회수 1,087
Hundreds of Oleshky residents evacuated due to Melania Trump deal. #BBCNews
조회수 5,947
What are the US midterms? #Midterms #USPolitics #BBCNews
조회수 1,790
Molotov cocktails thrown at police as more protests break out in Albania. #Albania #BBCNews
조회수 3,057
Police use tear gas to disperse crowd in France at end point of march in Paris. #France #BBCNews
조회수 40,008
What is the 'Legally Blonde effect'? #LegallyBlondeEffect #BBCNews
조회수 4,784
Are Donald Trump’s Republicans facing a meltdown at these midterm elections? | BBC News
조회수 74,946
What happens when voters can't tell fact from fiction? | BBC News
조회수 30,278