Connect
MJA
MJA

Artificial intelligence in health care: nothing about me without me

Clair Sullivan and Keren Pointon
Med J Aust 2024; 220 (8): 407-408. || doi: 10.5694/mja2.52282
Published online: 6 May 2024

The adoption of digital health has accelerated markedly in response to global health care challenges. One transformative technology is artificial intelligence (AI), particularly generative AI, such as ChatGPT. This step change suggests that we are experiencing a new industrial revolution, the data revolution.1 Unlike the coal‐powered industrial revolution, the resources for this revolution are the health‐related data generated by patients and clinicians.1 This disruption is understandably causing some anxiety. Our experiences of earlier major disruptive change will hopefully facilitate a more mature and thoughtful approach to this data‐driven revolution, including amplifying the voice of people who receive health care, who have both the most to gain and the most to lose in this revolution.

In this issue of the MJA, Carter and colleagues2 have taken a novel approach to this disruption, asking a citizens’ jury to provide some guidance on the use of AI in health care. A citizens’ jury attempts to improve the two most frequent approaches to policy change: top down, with little community consultation, and bottom up, with community special interest group consultation.3 The jury is assumed to represent the general population, but an acknowledged limitation is that its composition will be biased toward those willing to devote time to the activity, and it will exclude people who do not feel comfortable participating.

Another acknowledged challenge is the significant time, expense, and planning involved in convening a large, nationally representative citizens’ jury. However, this effort could be considered an investment that achieves robust engagement and informed recommendations. A citizens’ jury is much more empowering than traditional brief consultations, and even brief (single day) citizens’ juries can deliver quality outcomes for policy and practice if the research question is appropriately defined.4,5

Carter and colleagues2 report that gathering the opinions of thirty Australians on this important topic resulted in a consensus statement including fifteen recommendations in ten categories. Perhaps surprisingly, they found that this diverse group welcomed the advent of AI in health care as a tool for overcoming the health system problems we are all experiencing. But this support comes with some important conditions. The jury recommended an independent national charter for AI in health. Other recommendations emphasised rigorous evaluation, fairness, and patient rights, clinical governance and training, technical and data requirements, and community education and involvement.2

The findings by Carter and colleagues2 indicate that the public understand that doing nothing with regard to AI in health care is not an option and that we should proceed to accept it with important caveats regarding governance and privacy. Enabling appropriate use of health care‐derived data is important for improving outcomes, but so is maintaining privacy and ensuring that people retain control of their personal data. The essential components of doing so are:

  • informed consent and transparency: clear and concise information about data use is provided each time data are accessed, and explicit and informed consent is obtained before collecting or sharing data;6
  • granular consent and data sharing controls: allow people to specify the level of detail in their consent and enable them to control with whom their data can be shared (dynamic consent);7
  • access and portability: ensure that people have easy access to their health data, and facilitate data portability between their health care providers;8
  • data de‐identification and anonymisation: robust de‐identification techniques that protect privacy,9 including using synthetic data in appropriate cases;10
  • education and empowerment: educate people about the importance of controlling their health care data, and empower them to make informed decisions about data sharing;11
  • regulatory compliance: ensure compliance with existing regulations, and advocate stronger privacy protection laws and regulations that allow safe sharing.12

In an ideal world, we would undertake these steps immediately, but it is not yet technically possible to do so beyond dedicated cohort studies. But we cannot wait. Balancing the risks and benefits of data‐driven improvement in health care has been difficult without a clear understanding of public perceptions.

The findings of the citizens’ jury reported by Carter and colleagues2 are consistent with opinions expressed by the Australian Medical Association13 and NSW Health;14 in the United States, a presidential executive order has addressed the responsible use of AI in health care.15 The advent of AI in health care is here, and we need to proceed with both enthusiasm and caution.

Although the citizens’ jury in the study by Carter and colleagues2 was helpful, real value to the health system and the Australian public will require the timely and systematic implementation of its recommendations, which in turn will require ongoing, systematised input by the public. The technology is artificial intelligence, but the engagement of human beings must be genuine. As people and their data are the basis on which the AI revolution is built, it is critical that they help lead the change, and that we are guided by the principle: nothing about me without me.



Provenance: Commissioned; not externally peer reviewed.

  • Clair Sullivan1
  • Keren Pointon1,2

  • 1 Queensland Digital Health Centre, University of Queensland, Brisbane, QLD
  • 2 Health Consumers Queensland, Brisbane, QLD



Competing interests:

No relevant disclosures.

  • 1. Pentland A. The data‐driven society. Sci Am 2013; 309(4): 78‐83.
  • 2. Carter SM, Aquino YSJ, Carolan L, et al. How should artificial intelligence be used in Australian health care? Recommendations by a citizens’ jury. Med J Aust 2024; 220: 409‐416.
  • 3. Gooberman‐Hill R, Horwood J, Calnan M. Citizens’ juries in planning research priorities: process, engagement and outcome. Health Expect 2008; 11: 272‐281.
  • 4. Wiles LK, Kay D, Luker JA, et al. Consumer engagement in health care policy, research and services: a systematic review and meta‐analysis of methods and effects. PLoS One 2022; 17: e0261808.
  • 5. Street J, Duszynski K, Krawczyk S, Braunack‐Mayer A. The use of citizens’ juries in health policy decision‐making: a systematic review. Soc Sci Med 2014; 109: 1‐9.
  • 6. Grande D, Mitra N, Shah A, et al. Public preferences about secondary uses of electronic health information. JAMA Intern Med 2013; 173: 1798‐1806.
  • 7. Malin BA. An evaluation of the current state of genomic data privacy protection technology and a roadmap for the future. J Am Med Inform Assoc 2005; 12: 28‐34.
  • 8. Mandl KD, Kohane IS. Time for a patient‐driven health information economy? N Engl J Med. 2016; 374: 205‐208.
  • 9. El Emam K, Jonker E, Arbuckle L, Malin B. A systematic review of re‐identification attacks on health data. PLoS One 2011; 6: e28071.
  • 10. Tsao SF, Sharma K, Noor H, et al. Health synthetic data to enable health learning system and innovation: a scoping review. Stud Health Technol Inform 2023; 302: 53‐57.
  • 11. O'Neill O. Autonomy and trust in bioethics. Cambridge: Cambridge University Press, 2002.
  • 12. Halamka JD. Early experiences with big data at an academic medical center. Health Aff (Millwood) 2014; 33: 1132‐1138.
  • 13. Australian Medical Association. Healthcare sector approach to AI required [media release]. 27 July 2023. https://www.ama.com.au/media/healthcare‐sector‐approach‐ai‐required (viewed Mar 2024).
  • 14. NSW Health. Artificial intelligence. 7 Feb 2024. https://www.health.nsw.gov.au/ai (viewed Mar 2024).
  • 15. The White House. Executive order on the safe, secure, and trustworthy development and use of artificial intelligence. 30 Oct 2023. https://www.whitehouse.gov/briefing‐room/presidential‐actions/2023/10/30/executive‐order‐on‐the‐safe‐secure‐and‐trustworthy‐development‐and‐use‐of‐artificial‐intelligence (viewed Mar 2024).

Author

remove_circle_outline Delete Author
add_circle_outline Add Author

Comment
Do you have any competing interests to declare? *

I/we agree to assign copyright to the Medical Journal of Australia and agree to the Conditions of publication *
I/we agree to the Terms of use of the Medical Journal of Australia *
Email me when people comment on this article

Online responses are no longer available. Please refer to our instructions for authors page for more information.