International group calls for AI safety measures for children ahead of UN summit

Global Coalition Demands AI Safety Protections for Children Before UN Summit

International group calls for AI safety - On the eve of the United Nations' first global summit on AI governance, over 100 international organizations—ranging from human rights advocates to children's welfare groups—have issued a unified call for stricter safety measures to shield children from the risks posed by artificial intelligence. The coalition, anchored by the 5Rights Foundation, highlights growing concerns about how AI technologies are impacting young users and argues that current oversight mechanisms are failing to act swiftly enough to prevent harm.

The Coalition's Key Concerns

The group asserts that AI is already causing tangible harm to children, from influencing their emotional development to exposing them to privacy violations. It criticizes the delayed response of regulatory frameworks, which often address issues only after they have escalated. This comes amid a surge in legal cases against AI developers, including companies like Character Technologies and OpenAI, who face scrutiny over the effects of their products on children. For instance, "companion" chatbots, designed to mimic long-term emotional connections, have become targets of lawsuits for marketing themselves as child-safe without adequate warnings.

Leanda Barrington-Leach, executive director of 5Rights Foundation, emphasized the urgency of the matter during a Monday press release. "Children have given us a clear diagnosis of the problem," she stated. "They aren’t asking us to block AI innovation, but it shouldn’t be a case of cleaning up the mess after harm has happened either." Barrington-Leach’s remarks underscore the coalition’s belief that proactive measures are essential to address the unique vulnerabilities of children in the digital age.

Proposed Measures for Child Safety

The coalition has outlined ten specific actions governments should take to safeguard children from AI-related risks. These include mandating that companies provide evidence of safety for their AI systems before launching them for children, implementing financial penalties for those whose products infringe on children’s rights, and prohibiting design elements that manipulate children’s psychological tendencies. Additionally, they propose banning the commercial use of children’s biometric data, images, and voices without explicit consent, ensuring these technologies are not exploited for profit at the expense of child welfare.

One of the coalition’s central arguments is that these steps do not require new legislation but rather the enforcement of existing commitments. They point to the UN Convention on the Rights of the Child and the Global Digital Compact, international agreements that already obligate governments to protect online rights and uphold human dignity. "No fresh laws are needed," Barrington-Leach explained. "What is required is the consistent enforcement of standards already in place." She argued that the current incentive structure rewards companies for rapid growth and data collection rather than prioritizing child safety, leading to a cycle of harm followed by reactive measures.

The coalition’s focus on psychological exploitation is particularly critical. They cite examples where AI systems are engineered to keep children engaged through addictive features, such as personalized content algorithms or gamified interfaces. These tools, while designed for entertainment, may blur the line between play and dependency, affecting cognitive development and emotional well-being. The group also raises concerns about the commercialization of children’s data, noting that biometric information—like facial expressions or voice patterns—can be used to target ads or predict behavior without the child’s understanding.

The Role of the UN Summit

As the UN prepares to host its inaugural Global Dialogue on AI Governance, the coalition sees this as a pivotal moment to push for child-focused reforms. The summit aims to establish international guidelines for AI development, and the group is urging leaders to incorporate child safety into these discussions. Their message is clear: AI governance must not overlook the needs of the youngest users, who are often the most affected by rapid technological changes.

Among the coalition’s recommendations is the requirement for AI companies to conduct rigorous safety assessments before deploying systems for children. This would ensure that products are tailored to meet developmental needs rather than simply scaling adult-oriented designs. Financial penalties are another key proposal, intended to hold companies accountable for lapses in safety standards. Barrington-Leach argued that these measures would create a stronger deterrent against complacency in the industry.

The coalition also emphasizes the importance of transparency in AI marketing. They call for companies to clearly label products as child-friendly and disclose potential risks, ensuring parents and guardians are informed. By doing so, the group hopes to foster trust and encourage responsible innovation. "Respecting children’s rights must become a condition of doing business," Barrington-Leach said. "It shouldn’t be an optional extra." Her statement reflects the coalition’s broader goal of integrating child safety into the core of AI governance.

As the debate over AI regulation intensifies, the coalition’s proposals highlight the growing recognition of children as a distinct demographic requiring targeted protections. With the UN summit serving as a platform for global dialogue, their call for action underscores the need for urgent, coordinated efforts to address the challenges AI poses to young users. The coalition’s emphasis on prevention over reaction aligns with the broader objective of creating a safer digital environment for the next generation.

Broader Implications for AI Governance

The coalition’s arguments extend beyond immediate risks, suggesting that AI’s impact on children could have long-term consequences for society. By failing to address these issues early, governments risk normalizing practices that exploit children’s trust and data. Barrington-Leach warned that without meaningful safeguards, AI could become a tool for entrenched harm, with companies prioritizing profit over the well-being of their youngest users.

Industry leaders and policymakers are now under pressure to reconsider how AI systems are developed and deployed. The coalition’s push for accountability highlights the importance of aligning business models with ethical standards, ensuring that innovation is not at the cost of child safety. Their proposals also serve as a reminder that AI governance must be inclusive, addressing the needs of all stakeholders, including children.

As the UN summit approaches, the coalition’s advocacy adds a critical dimension to the global conversation on AI. Their focus on children’s rights challenges existing frameworks to evolve, ensuring that the benefits of technology are balanced with its risks. By urging governments to act decisively, they aim to set a precedent for future AI policies that protect the most vulnerable users.

"Children are not just passive users of AI—they are the ones experiencing its effects firsthand. We need to ensure that the technologies they interact with daily are designed with their best interests in mind," Barrington-Leach added.

The coalition’s efforts mark a turning point in the fight for AI accountability. With the summit providing an opportunity for international cooperation, their recommendations could shape the future of AI governance, ensuring that the rights of children are protected in the digital era. The message is clear: safety must be embedded in every step of AI development,