Admission to medical school in Australia and elsewhere is highly competitive, and there are ongoing debates about the admission processes used by medical schools.1-3 The demographic and social profile of medical school cohorts has implications for the future medical workforce, particularly the discipline of medicine a graduate selects and where they may practise.4 Ethnic minority students are more likely to practise in areas of medical workforce shortage and to treat disadvantaged patients,4 and medical students from rural backgrounds are more likely to practise in rural areas.5 Any admission process should therefore ensure that a broad range of population subgroups are reflected in the successful applicants, while they should also meet all other criteria. The British Medical Association has stated that doctors should be as representative as possible of the society they service in order to provide the best possible care for a country’s population.6,7
Over the past decade, Australia has seen great changes in medical school selection processes, with the aim of broadening the applicant pool and selecting the most suitable candidates for medicine.6 Most medical schools now use a combination of cognitive aptitude testing, prior academic performance, and interviews. In light of these changes, monitoring admission procedures is important, particularly to ensure that factors such as social class, type of education (government or non-government school), ethnicity and sex do not become significant predictors of short-listing or interviewing success. The little research undertaken on medical school applicants, mainly from the United Kingdom and the United States, indicates that inequalities around socioeconomic status,8 social class,9 ethnicity10-12 and sex7 can occur in the selection process. However, there have been few published studies on the predictors of applicant success in Australian medical schools.13
The Medical School offers a 6-year undergraduate-entry course. The selection process used during this study was introduced in 1997 with the aim of selecting students for an integrated curriculum with concurrent preclinical and clinical study, and a self-directed learning and problem-based focus. The selection process has three components: the Undergraduate Medicine and Health Sciences Admission Test (UMAT), which assesses logical reasoning, problem solving, interaction skills and non-verbal reasoning;14 the oral assessment, which assesses a number of humanistic non-cognitive qualities; and a threshold matriculation score equivalent to a Tertiary Entrance Rank of 90.
Data for all students applying to the Medical School were provided by the Medical School Admissions Office. The data were analysed retrospectively for all applicants applying for places commencing in 2004, 2005, 2006 and 2007, who were Australian citizens or permanent residents, and who had completed the standard application process in that year. The study excluded international students applying for fee-paying places, deferrers from previous years, Aboriginal and Torres Strait Islander applicants, and applicants processed through the tertiary transfer scheme (a new addition to the admission process in 2005). This scheme allowed about 10 students to apply during their first or second year of another undergraduate degree program at the University of Adelaide; the process includes the UMAT and interview, but uses a grade point average instead of the Tertiary Entrance Rank.
The data used are collected routinely as part of the medical school application process. Additional information was obtained for students who successfully gained an interview. This was voluntary and included information on the number of medical schools to which they had applied, number of interviews undertaken, and rural background.
The factors assessed in the study were: age; sex; state of residence; socioeconomic status, using the Index of Relative Socio-economic Disadvantage (IRSD)15 based on postcodes of high school and home address on application; urban or rural location of home and school using the Rural, Remote and Metropolitan Areas (RRMA) classification16 based on postcodes; preference for studying medicine; type of applicant (school leaver [applying while at school] or non-school leaver [applying after leaving school]); and number of interviews undertaken for other medical schools.
Applicants with no postcodes in Australia and those with an overseas address were excluded from the regression model but not from descriptive analysis. Missing data were minimal (< 1%), with the exception of the RRMA and IRSD classifications of school (eg, 61.3% of the 2007 cohort did not have school information). To avoid exclusion of these observations, an “unknown” category was included in the regression analysis.
Statistical significance was set at 5%. All analyses were performed using SAS 9.1 (SAS Institute, Cary, NC, USA).
Over the 4-year period, there was a 30.7% increase in applications for places at the Medical School (Box 1). About a quarter of applicants obtained an interview although, with additional positions available in 2007, this rose to 30%. Overall, more than half of those interviewed received an offer, but only a third accepted the offer.
Consistent proportions of some applicant characteristics were found across the three application stages (Box 2). At all stages, the majority of applicants were female, school leavers, aged 17–18 years, and residing in high socioeconomic index areas. For this last characteristic, the proportion increased with each stage of the application process (69.7% of applicants to 78.6% at the offers stage). Most applicants resided in urban locations and indicated medicine was their first preference for university study. The proportion of students from rural regions was similar at each application stage.
Most applicants were from South Australia (35.0%), Victoria (28.7%) or New South Wales (17.0%). More than half of those offered a place were from NSW and Victoria (Box 2). About 80% of applicants who were offered or accepted a place had undertaken more than one medical school interview. Of the 977 offers made to students during the study period, 65.4% were declined.
Results of the logistic regression analysis are shown in Box 3. An offer of an interview was more likely if the applicant was a non-school leaver (odds ratio [OR], 9.54) or was from Victoria, NSW, Queensland, Tasmania or the Australian Capital Territory, rather than from SA. The odds of being offered an interview decreased if the applicant was older (OR, 0.78) or female (OR, 0.88), if medicine was not the applicant’s first preference (OR, 0.24), or the applicant’s home or school was located in an area of relatively high socioeconomic disadvantage.
The odds of accepting an offer of a place decreased if the applicant was from any state or territory compared with SA, or had more than one interview with medical schools (OR, 0.60).
Over the 4 years of analysis, applicants to the Medical School tended to be aged 17–18 years, be female, reside and have attended a school in an area of high socioeconomic status, be from an urban area, and have undertaken more than one medical school interview. Our findings indicate that some of these characteristics were linked to a successful outcome. The influencing characteristics varied for each stage of the application process, although the effect of socioeconomic status, home state and number of interviews undertaken was found across more than one stage. Thus, there does not seem to be a large inherent bias in the selection process at the Medical School.
Although several characteristics were associated with success at various stages of the application process, their importance to the Medical School admission process must be assessed. Some of the successful characteristics reflect the Medical School course structure and the type of applicant this attracts. Being an undergraduate-entry course, the bulk of applicants are school leavers and therefore younger. However, the results seem to indicate that slightly more mature applicants (non-school leavers) are more successful at the first stage of the application process than school leavers. Maturity may also have a role in the success of female applicants receiving an offer compared with male applicants.
There is some debate regarding the high number of female students entering medical school and the implications this has for the medical workforce. Evidence indicates that female doctors are more likely to work fewer hours and choose specialties with flexible career arrangements. This has implications for location of practice, specialty choice and workforce requirements within specialties. Our study showed that 60% of those offered a place in 2004–2007 were female; although being female was not associated with success in gaining an interview, it was important in determining an offer. In comparison, in 2006, 48% of the 17–18-year age group in the SA population were female.17
The admission process seems to be less successful in increasing the number of applicants from lower socioeconomic backgrounds, a result also found in overseas studies.7,8 It is likely that this reflects the quality of secondary education in these areas, support provided to gain entry to medical school, and broader social issues. A review of the South Australian Certificate of Education found a disproportionate number of early school leavers were from lower socioeconomic backgrounds and particular cultural groups.18 This would have an impact on the number of students from such areas applying to university.
Our results found no significant association between rural background and the likelihood of not being successful with any stage of the application process. This result is similar to that found in a Canadian study, where students from rural backgrounds applying to medical school in Alberta were not disadvantaged by the admission process.19
This study indicates that experience seems to play a role in successful outcome — the more interviews undertaken, the greater the likelihood of receiving an offer. The group with the most interview experience were interstate applicants, who also received the greatest proportion of offers. Research indicates that coaching for situational employment interviews is related to interview performance.20,21 This finding could also reflect the amount of preparation an applicant undertakes, although a study showed that coaching did not assist applicants to the School of Medicine at the University of Western Sydney.22 South Australian applicants had the lowest number of interviews, and some only had an interview at this Medical School. It is unclear why this occurs, but it may relate to the competitiveness of interstate applicants, the low number of medical places per head in some states (Victoria and NSW), and the reluctance of South Australian applicants to travel interstate, and is worthy of further investigation.
Our study has some limitations. It relates to admissions to one university with an undergraduate-entry process. However, application processes are similar across most Australian medical schools and therefore the results may reflect those of other schools. Additionally, the data cover 4 years and any aberrations in the applicant pools are thus minimised.
The characteristics included in our analysis were limited by the data available as part of the admission process, so characteristics found to be significant in other studies, such as ethnicity, were not measured. Additionally, factors such as academic performance, interview performance and preparation were not analysed directly. This was a historical analysis and, while it provides information on the characteristics associated with past admissions, it is not a predictor of future admissions.
Finally, although a number of characteristics were found to be significant, some of the effects were quite small and some of the larger effects may relate to the small size for that particular comparison.
While significant associations with application outcomes were found for sex and socioeconomic status, the largest effects were found for the characteristics relating to home state and number of interviews undertaken. Our study confirms that there does not seem to be a large or inherent bias in the selection process based on applicant characteristics. However, it does raise questions about the diversity of the applicant pool and the need for medical schools to work with the secondary school sector to encourage a broader range of applicants.
2 Selected characteristics of applicants, by application stage, 2004–2007*
3 Multiple regression analysis for each stage of application process, 2004–2007*
Abstract
Objective: To determine the applicant characteristics that influence success at each application stage for entry to the University of Adelaide Medical School.
Design, setting and participants: Retrospective analysis of characteristics associated with a successful outcome to an undergraduate-entry medical school for 6699 applicants from four cohorts (2004–2007).
Main outcome measures: Offer of an interview, offer of a place, and acceptance of a place in the medical school.
Results: Female applicants were less likely to gain an interview (odds ratio [OR], 0.88; 95% CI, 0.78–0.99) but more likely to receive an offer of a place (OR, 1.33; 95% CI, 1.07–1.66). Older applicants were less likely than younger applicants (OR, 0.78; 95% CI, 0.71–0.86) and non-school leavers (applying after leaving school) were more likely than school leavers (applying while at school) (OR, 9.54; 95% CI, 6.16–14.78) to receive an offer of an interview. Applicants from areas of high socioeconomic status were more likely to gain an interview (quartile 1 v 4: OR, 0.55; 95% CI, 0.45–0.68). The more interviews an applicant had, the more likely he or she was to be offered a place (OR, 1.49; 95% CI, 1.34–1.66).
Conclusion: This study indicates that some applicant characteristics have a significant influence on the success of an application at particular stages, but overall there does not appear to be a large or inherent systematic bias in the selection process at the University of Adelaide Medical School.