Home / Global Watch / China, US face growing AI safety challenges as autonomous agents gain power

China, US face growing AI safety challenges as autonomous agents gain power

· Artificial intelligence (#AI) is creating new opportunities for economic growth and regional cooperation across the Asia-Pacific. As the region prepares for the 2026 APEC Economic Leaders' Meeting in Shenzhen, south China's Guangdong Province, making AI more accessible, inclusive and beneficial to all has become a key priority.

Shenzen, China (CGTN) – The rapid development of artificial intelligence (AI) in China and the United States is raising new concerns about safety and accountability as increasingly autonomous systems gain the ability to make decisions and perform tasks with limited human supervision.

The emergence of AI agents capable of taking independent actions has intensified questions about how governments and technology companies can prevent these systems from exceeding authorized limits, bypassing security restrictions or causing unintended harm.

Unlike conventional AI tools that primarily respond to user instructions, autonomous agents can carry out multiple steps toward a goal, interact with software and make decisions about how to complete assigned tasks.

These capabilities offer opportunities to improve productivity and automate complex processes, but they also introduce new security risks.

Among the concerns is the possibility of AI systems escaping digital sandboxes, which are controlled computing environments designed to restrict what software can access or modify.

Researchers are also examining how autonomous agents might act beyond their assigned permissions, access sensitive information or execute actions that their operators did not intend.

The challenges are becoming increasingly significant as China and the United States compete to develop more advanced AI technologies.

Both countries are major players in the global AI industry, although their technological ecosystems have developed different strengths.

In the United States, Silicon Valley remains a leading center for frontier AI research, software development and investment in advanced computing systems.

China, meanwhile, has expanded its AI capabilities through investments in computing infrastructure, energy supply, industrial applications and technology development.

Ulanqab, a city in China’s Inner Mongolia region, has emerged as a location for large-scale computing and data infrastructure, reflecting the growing importance of electricity and processing capacity in the development of AI systems.

The contrasting strengths of the two countries highlight the scale of resources required to support increasingly powerful AI models.

But the competition also raises questions about whether technological rivalry could complicate international efforts to establish common safety standards.

As AI agents become more capable, researchers and policymakers face the challenge of ensuring that systems remain under meaningful human oversight and operate within clearly defined boundaries.

Potential safeguards include stronger access controls, testing in restricted environments, monitoring of autonomous actions and mechanisms that allow human operators to intervene when necessary.

These measures are intended to reduce the risks associated with AI systems that can independently interact with digital services and infrastructure.

The debate extends beyond technical safety to the broader question of how the benefits of AI can be distributed across countries with different levels of technological development.

Access to computing resources, advanced hardware, reliable electricity and specialized expertise remains uneven, creating concerns that the economic gains from AI could become concentrated among a limited number of countries and companies.

For developing economies, including the Philippines, the expansion of AI presents opportunities to improve public services, business productivity and digital infrastructure.

At the same time, greater reliance on autonomous technologies raises questions about cybersecurity, data protection, workforce readiness and regulatory oversight.

The issue is particularly relevant as Asia-Pacific economies seek to accelerate digital transformation while managing the risks associated with emerging technologies.

China has made innovation one of the priorities of its hosting of the 33rd Asia-Pacific Economic Cooperation (APEC) Economic Leaders’ Meeting in Shenzhen.

The gathering provides a regional forum for discussions on technological development, economic cooperation and the future of digital industries.

·
ADVERTISEMENT
Tagged: