OpenAI co-founder and CEO Sam Altman has stressed that humans must remain in control of the future as artificial intelligence increasingly shapes the world and people’s lives.
Speaking at The New York Times DealBook Summit on Wednesday, Altman addressed discussions in Silicon Valley about a possible gradual transfer of authority to AI, where the technology could eventually take over decision-making roles across major industries and institutions.
“One thing we’ve been talking a lot about recently is there’s been this thing in Silicon Valley that seems almost ridiculous to have to fight against, but we both believe very deeply that people need to stay in control of the future, and there’s increasing talk about, well, there is either going to be or there should be this sort of gradual handover to AI. And I — we both — agree that that’s a terrible idea,” said Altman.
The handover theory is based on the belief that as AI models become more powerful, they will eventually learn to improve themselves, a process known as “recursive self-improvement.”
According to this theory, successive generations of AI systems will become increasingly sophisticated, potentially developing into a superintelligence beyond human control.
Altman explained that his disagreement with Brockman centres on how best to ensure humans retain control of AI and the challenges they may encounter along the way.
He, however, described their differences as a debate between two people who share broadly similar views on the bigger picture.
“The question of how to actually prevent [handover] from happening — how to actually ensure that we will, given all of the various pressures and given what other companies may try to do — that we are going to actually ensure that people stay in control of the future in a very deep way, and we don’t have this either accidental or intentional handover — I think we can both agree on that,” Altman said.