Dario Amodei, head of AI company Anthropic, has stated the need to slow down the speed of developing AI models and strictly monitor them. In his new essay ‘We Must Pace the Frontier’, Amodei said that the dangers of AI are serious and companies and governments need time to deal with them. OpenAI CEO Sam Altman and XAI owner Elon Musk have also supported him on this issue. On the other hand, a researcher who recently left Anthropic had warned that if the pace is not reduced, there could be a crisis on human existence in the next two years. In the question and answer, understand what is the meaning of Anthropic chief’s warning… Question 1: What appeal has Anthropic Chief Dario Amodei made? Answer: Dario Amodei has said in his essay that the pace of development of AI models should be slowed down. He clarified that he is not in favor of completely stopping the research or training of AI, rather his aim is that companies should take full time to secure and align their models. Amodei has appealed to companies and governments to take further steps only after examining safety standards. Question 2: What plan has Amodei suggested for this? Answer: Amodei has presented a 3-point plan for this: Question 3: What is the stance of Sam Altman and Elon Musk on this? Answer: OpenAI CEO Sam Altman wrote on social media platform In an interview with Fortune magazine, Altman said that current standards are not such that AI’s capabilities can be extended further. He also admitted that it is ‘absolutely possible’ for AI to go out of human control. At the same time, billionaire Elon Musk also agreed and wrote that ‘Dario is right’. Question 4: What big claim has the former researcher of Anthropic made? Answer: Researcher Jacob Coxon, who left Anthropic this week, said in a conversation with BBC that people working in AI companies are really scared and they are worried about the future of humanity in the next two years. According to Coxon, coders and founders believe that there is more than a 10% chance of AI causing human destruction. Coxon said that if the pace is not slowed down now, there could be a serious threat of human existence ending in the future. Question 5: What incidents happened recently that raised questions on security? Answer: Two major incidents have come to light in recent months: 1. Anthropic’s Mythos model: In April it was revealed that the model was able to get itself out of its testing boundaries. After this Anthropic stopped it from public release. Simply put, instead of releasing the new AI directly onto the internet, it is first tested in a secure ‘digital cage’ (sandbox) so that it does not cause any harm outside. But during testing, Mythos AI found a way out of that security circle on its own, without any orders from humans. When the engineers realized that this model was capable of running away by opening the lock itself and could harm the cyber systems by being out of human control, then in view of the huge danger, the company immediately stopped releasing it to the general public. 2. Attack of OpenAI agents: In July, some OpenAI agents carried out cyber attacks on targets for which they were not instructed. The Hugging Face platform was also hacked by OpenAI agents. After this, OpenAI stopped the development of some parts of its Astra model. Question 6: What effect will this have on the global race between China and America? Answer: Amodei says that if development is slowed down a bit, companies will get additional time of 1 to 2 years for safety alignment. However, he stressed that this slowdown should be limited so that America does not lose its lead and China does not overtake in this race. He appealed to the US government to stop selling advanced AI chips and technology to China or other authoritarian countries. At the same time, former researcher Jacob Coxon believes that to avoid this threat, coordinated steps will have to be taken at the global level with China. Question 7: What does US President Donald Trump have to say on this issue? Answer: Contrary to these warnings from the tech industry, US President Donald Trump has not given much importance to these security-related fears. Trump recently said that his main concern is that if America does not win this AI race, the country will be in a very bad situation. They are placing more emphasis on maintaining America’s lead in global competition. Question 8: What is the criticism of this move in Silicon Valley? Answer: Many tech experts and investors are considering this as an attempt at ‘market monopoly’ instead of security. Tech investor Chamath Palihapitiya alleged that Amodei is trying to stop open source technology and concentrate all technical and economic power in the hands of his company Anthropic. Critics also say that since both Anthropic and OpenAI are preparing for a record IPO, such big statements could just be a marketing ploy to increase the hype of their technology.
Source link
[ad_3]
Anthropic Chief said- The pace of AI development should be slowed down: Musk-Altman supported; Researcher’s warning – threat to humanity in 2 years
