Stories

Self-improving AI systems could accelerate beyond human oversight, prompting renewed calls for stronger safeguards.

Brian Green, director of technology ethics, explains the acceleration as, "Rather than humans programming AI, AI becomes powerful enough to program itself."

"It is very important to get recursive self-improvement right, otherwise it could spiral out of control and create new versions of itself that are not friendly," Green said.

But regarding the June 12 intervention by the Trump administration to suspend foreign access to Anthropic's Fable 5 and Mythos 5 models, Green admitted that "in some ways, the restrictions might be too stringent in that even Anthropic's own non-U.S. citizen employees -- many of whom are from friendly nations like Canada, the U.K. and Germany -- are no longer allowed access."

That move signals "direct government interference with business activity, and should cause American businesses some concern about government overreach," said Green.

Brian Green, director, technology ethics, quoted by Union of Catholic Asian News.