AI Inquiry Atlas

An unofficial, independent guide to the public records of the Joint Select Committee on Artificial Intelligence. Not connected with the Parliament of Australia or the committee. Its makers also made a submission (no. 481; see About). Summaries and scores are written by AI and can be wrong: check the original before relying on them.

Submission 204

ARC Centre of Excellence for the Digital Child

Submitter group: Research institutes.

An AI model identified the submitter group and wrote the summary, key points and recommendation summaries. Counts do not measure importance or merit.

Open in the interactive guide

Summary

Read the original submission for the full text.

Addresses risks and harms to children from generative AI, covering AI companionship and social development, children misplacing trust in AI agents, disclosure of personal information, and risks from data centres near children. Makes four recommendations on adult supervision, digital literacy, reporting features and data centre siting distances.

Key points

Quotes are the submitter’s own words. Text taken from documents, including scanned pages read by text-recognition software, can differ from the PDF. Check the original. Listed in the same order as on the submission’s page in the interactive guide.

  1. Says research found that 78% of children aged 10–17 have used an AI assistant and 16% use one daily.

    Uptake of AI has occurred rapidly among young people in Australia. As of 2026, 78% of children aged 10-17 have used an AI assistant such as ChatGPT, Gemini, or Co-Pilot; 16% of children aged 10-17 use an AI assistant on a daily basis.

  2. Says young children are especially prone to believing AI agents are alive.

    Because conversational AI tools are programmed to mimic human-like interaction, people of all ages tend to attribute human-like characteristics to them. Young children are especially prone to believing AI agents are “alive”, promoting a profound sense of attachment, trust, and connection.

  3. Says research found that 45% of AI news summaries had at least one significant issue.

    But AI agents have been shown to misrepresent news content, with 45% of news summaries having at least one significant issue, and 1 in 5 results containing major accuracy issues.

  4. Says that anything a child asks, tells or shares with an AI tool could be embedded in future AI models, as most tools' terms permit use of conversations as training data.

    The Terms and Condition of most GenAl tools (and most other platforms, devices and products that use these tools) typically give AI developers permission to harvest user conversations and interactions as training data. This means anything that a child asks, tells, or shares with an AI tool could be embedded into future AI models.

  5. Says data centre cooling requires large amounts of water and can produce fumes, excess heat and noise.

    The process of cooling data centres requires vast amounts of water, and can produce vast amounts of exhaust fumes, produce considerable excess heat, and can be extremely loud day and night, contributing to noise pollution in the immediate vicinity.

  6. Says children reported rare or unclear reporting options: 11% said all tools used had one, 16% said none did and 52% were unsure.

    Reporting options are either rare or not obvious to children. Only 11% of children said all the AI assistants or companions they had used had a reporting option, 16% said none of them had this, and 52% were unsure.

Recommendations

Recommendations are shown beside the submission’s own words. Listed in the same order as on its page in the interactive guide.

  1. Until sufficient safeguards are demonstrably and verifiably built into all generative AI instances young children encounter, use these tools only with appropriate adult supervision.

    Until sufficient safeguards can be demonstrably and verifiably built into all GenAl instances young children encounter, GenAl tools should only be used with appropriate adult supervision.

  2. Provide sufficient digital literacy opportunities for all Australians, particularly young people, explaining that synthetic companions and chatbots are neither intelligent nor alive and do not have users’ best interests programmed into them.

    All Australians, and young people in particular, need to be provided sufficient digital literacy opportunities to be aware that synthetic companions or chatbots are neither intelligent or alive and do not have the best interests of users “programmed” into them.

  3. Provide intuitive, clearly understandable and prominent reporting features across AI tools, with AI providers responsible for handling reports of harmful interactions or materials appropriately to ensure children's safety.

    we echo the eSafety Commissioner’s call for “reporting features that are intuitive, clearly understandable and prominent across AI tools”, and urge that AI providers bear responsibility for ensuring that “reports of harmful interactions or materials need to be [are] handled appropriately to ensure children’s safety.”

  4. Consider children’s privacy rights, including identity self-determination, freedom from undue influence and manipulation, and the right to be forgotten.

    This demands consideration of children’s rights to privacy, including the right to self-determination and “freedom from unreasonable constraints on the construction of one’s own identity”,*° freedom from undue influence and manipulation, and “the right to be forgotten.”

  5. Mitigate data centre risks to local areas through (a) extensive, meaningful community consultation before projects are approved and (b) ideally locating data centres away from urban and suburban populations.

    These risks to local areas must be mitigated by (a) extensive, meaningful community consultation before data centre projects are approved, (b) ideally locating data centres away from urban and suburban populations,

  6. Ensure data centres have no negative impact on local communities from waste, including fumes or audio pollution.

    ensuring no negative impact on local communities in terms of waste produced by data centres, including fumes or audio pollution.

  7. Specify a minimum distance between data centres and schools, early learning centres and other child-focused spaces.

    Given that data centres have known and unknown risks, we recommend a minimum space distance be specified so that data centres are not located anywhere near schools, early learning centres and other spaces primarily used by large numbers of children and young people.

Read the original

Open in the interactive guide