AI Inquiry Atlas

An unofficial, independent guide to the public records of the Joint Select Committee on Artificial Intelligence. Not connected with the Parliament of Australia or the committee. Its makers also made a submission (no. 481; see About). Summaries and scores are written by AI and can be wrong: check the original before relying on them.

Submission 529

Health Services Union (HSU)

Submitter group: Unions.

An AI model identified the submitter group and wrote the summary, key points and recommendation summaries. Counts do not measure importance or merit.

Open in the interactive guide

Summary

Read the original submission for the full text.

The Health Services Union describes AI use in Australian healthcare and says members raise concerns about job security, patient safety, accountability, data security and consultation. It argues for worker-led implementation and shared productivity gains, recommending consultation, job protection, oversight and data standards.

Key points

Quotes are the submitter’s own words. Text taken from documents, including scanned pages read by text-recognition software, can differ from the PDF. Check the original. Listed in the same order as on the submission’s page in the interactive guide.

  1. Says members describe over-reliance on AI leading to workforce deskilling, unclear accountability when errors occur, and patient confidentiality and data security concerns.

    HSU members are increasingly being expected to navigate broader AI vulnerabilities alone. These include over-reliance on AI leading to workforce deskilling, unclear accountability when errors occur, and ongoing concerns regarding patient confidentiality and data security, particularly where AI software is not locally owned or controlled.

  2. Argues that AI should augment existing roles rather than replace clinical expertise or workforce capacity, reflecting members' views.

    AI is not a substitute for clinical expertise or workforce capacity, but a tool to support and augment existing roles. This distinction is critical and is consistently reflected in the views of HSU members, yet it appears to be lost at the level of policymakers

  3. Says members have seen AI tools produce inaccurate or clinically inappropriate outputs that often fail to account for context, complexity and patient-specific nuance.

    Members have reported AI tools producing inaccurate or clinically inappropriate outputs, often failing to account for context, complexity and patient-specific nuance.

  4. Says member experience highlights concern with premature implementation, with current deployment advancing ahead of governance, clinical integration and workforce readiness.

    HSU member experience highlights concern with premature implementation, identifying emerging risk in real time as current deployment is advancing ahead of governance, clinical integration and workforce readiness.

  5. Says members say consultation on AI often occurs only after procurement decisions have been made, leaving workers to adapt systems that do not reflect clinical realities.

    In practice, HSU members report that consultation on AI often occurs only after procurement decision have already been made. Workers are left to make the technology work, adapting systems that do not reflect clinical realities, creating additional work to make them fit for purpose.

Recommendations

Recommendations are shown beside the submission’s own words. Listed in the same order as on its page in the interactive guide.

  1. Set Commonwealth health funding and workforce agreements to establish clear expectations that AI productivity improvements support better access, quality and working conditions, with workers sharing the benefits.

    Commonwealth health funding and workforce agreements must establish clear expectations that AI-driven productivity improvements support better access, quality and working conditions, with workers sharing the benefits of adopting AI technology.

  2. Strengthen national safeguards for healthcare data, including human oversight, secure Australian storage and processing of sensitive health data, and protection against commercial use of public health data processed by AI.

    Strengthen current national safeguards to protect healthcare data. Include requirements for human oversight, secure Australian storage and processing of sensitive health data, and protection against the commercial use of public health data processed by AI.

  3. Require AI training and support for health workers, with protections from AI surveillance and workload intensification, and develop specific frameworks for AI in health addressing human oversight and nominated accountability.

    Require AI training and support for health workers. Build in protection mechanisms for workers from AI surveillance and workload intensification and develop specific frameworks for implementation of AI in health which address the need for human oversight and nominated accountability for AI systems.

  4. Embed in Commonwealth funding agreements, procurement standards and health frameworks a requirement for genuine workforce and union consultation before AI systems are procured, implemented or materially changed in publicly funded health services.

    Commonwealth funding agreements, procurement standards and health frameworks must embed the requirement of genuine workforce and union consultation before AI systems are procured, implemented or materially changed in publicly funded health services.

  5. Give workers a meaningful opportunity to influence the selection, design, priority areas, implementation and evaluation of AI systems.

    Workers must have meaningful opportunity to influence the selection, design, priority areas, implementation and evaluation of AI systems based on their industry knowledge and expertise.

  6. Establish a national framework for managing AI-driven workforce change in healthcare, aimed at strengthening the health workforce through retaining, redeploying and workforce planning to protect jobs and retain skills.

    Establish a national framework for managing AI-driven workforce change in healthcare. The objective must be to use AI to strengthen the health workforce, including retaining, redeploying and workforce planning to protect jobs and retain skills.

  7. Mandate meaningful human-led clinical oversight and input into AI system decisions, particularly those affecting vulnerable groups, funding allocations and access to care.

    Mandate meaningful human-led clinical oversight and input of AI system decisions particularly, where they affect vulnerable groups, funding allocations and access to care.

Read the original

Open in the interactive guide