To the Editor: We congratulate Hill and colleagues1 for their timely research on the performance of symptom assessment smartphone applications (apps) in Australia. The apps in the study were selected using structured criteria2 to identify those featuring most prominently in internet search engines and app stores. However, we note that this strategy is biased against an important class of symptom checkers. Because the app store search included “medical diagnosis” and “health symptom diagnosis”, the authors’ approach was less likely to identify many symptom checkers regulated in Europe under the CE (Conformité Européene) Marking system. Specifically, these apps must not describe themselves as “diagnostic tools”, as diagnosis is a function carried out by a doctor. We believe this to be the reason why the CE‐marked Ada health assessment app was not identified or selected by the authors.1 This represents a missed opportunity for analysis, as Ada has been freely available in Australia since 2016,3 and was downloaded at least 200 times more frequently in Australia between November 2018 and January 2019 than either Symptomate or Symcat, which were included in the study (App Annie [www.appannie.com] download data; viewed June 2020). Other studies have found that the Ada app performs well when compared with the other apps assessed, as recently published.4
The full article is accessible to AMA members and paid subscribers. Login to read more or purchase a subscription now.
Please note: institutional and Research4Life access to the MJA is now provided through Wiley Online Library.
- 1. Hill MG, Sim M, Mills B. The quality of diagnosis and triage advice provided by free online symptom checkers and apps in Australia. Med J Aust 2020; 212: 514–519. https://www.mja.com.au/journal/2020/212/11/quality-diagnosis-and-triage-advice-provided-free-online-symptom-checkers-and
- 2. Boudreaux ED, Waring ME, Hayes RB, et al. Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations. Transl Behav Med 2014; 4: 363–371.
- 3. Elder J. The robot doctor will see you now. The Sydney Morning Herald 2018; 12 Aug. https://www.smh.com.au/lifestyle/health-and-wellness/the-robot-doctor-will-see-you-now-20180810-p4zwpy.html (viewed June 2020).
- 4. Gilbert S, Mehl A, Baluch A, et al. How accurate are digital symptom assessment apps for suggesting conditions and urgency advice? A clinical vignettes comparison to GPs. BMJ Open 2020; 10: e040269.
Stephen Gilbert is an employee of Ada Health and Claire Novorol is a company director and holds stock in Ada Health. Paul Wicks has a consultancy contract with Ada Health and has received speaker fees from Bayer and honoraria from Roche, ARISLA, AMIA, IMI, PSI, and The BMJ. The Ada Health research team has received research grant funding from Fondation Botnar and the Bill and Melinda Gates Foundation. This study was funded by Ada Health.