|Received: 13 June 2016    Accepted: 20 September 2016 DOI: 10.1002/jgf2.57 LETTER TO THE EDITOR Educational environment and the improvement in the General Medicine In-t­ raining Examination score Dear Editor: We investigated the association between the educational environment and performance in the General Medicine In-­training Examination (GM-­ITE) among postgraduate year (PGY)-­1 and -­2 resident physicians in Japanese teaching hospitals since 2012. GM-­ITE includes 100 questions designed by a committee comprised of experts organized by the Japan Organization of Advancing Medical Education Program.1 According to our previous report1, hospitals with a general medicine (GM) department or those located in a provincial community had significantly higher GM-­ITE score compared with the other hospitals. Data from the 2013 GM-­ITE showed that appropriate emergency department (ED) workload, inpatient caseload, and online learning resource were associated with greater clinical knowledge.2 In addition, in 2014, we found that factors affecting hospital volume, including the number of hospitalizations, had a positive impact on GM-­ITE scores.3 While our team have been extensively studied factors related to the performance of the GM-­ITE, because previous studies were analyzing cross-­sectional data, we could not evaluate the improvement in GM-­ITE score over time. In this context, we investigate how educational environment of hospitals is related to the improvement in GM-­ITE score using the longitudinal data obtained during two consecutive years. We analyzed GM-­ITE scores of 241 resident physicians affiliated to 46 Japanese teaching hospitals (42 community and four university hospitals, age 26.8±3.0 years, 176 males and 65 females) underwent GM-­ITE in 2013 and 2014. university hospitalswere collected using a self-­reporting questionnaire sheet, the Residency Electronic Information System website, and the Foundation for the Promotion of Medical Training website. We examined the association between the educational environment and changes in the GM-­ITE score (PGY-­2 score minus PGY-­1 score) using hierarchical linear regression models. The covariates with P<.10 on the univariable analysis were included in our multivariable model (Table 1). Our results showed that age, the number of ED duty (3-­5 or ≥6 per month), and the number of inpatients the resident was responsible for (monthly average 5-­9) were associated with the improvement in GM-­ITE scores (Table 1). A previous study showed that a heavy call rotation (every fourth or fifth night) was related to postcall performance impairment.4 Overnight calls were associated with higher burnout and fatigue scores.5 Recently, there has been a trend for limiting workloads for residents because there might have been relationship between an excessive workload and higher risk at burnout. T A B L E   1   Association between educational environment and change in GM-­ITE scores (PGY-­2 minus PGY-­1) Univariable analysis Multivariable analysisa Variable Hospital-­level variables Community hospital (vs. university hospital) Number of hospital beds (per 100 increase) Number of physicians (per 100 increase) Located in urban area (vs provincial) GIM/GM (vs no GIM/GM) Salary (Japanese 10 000 yen) Area of library (100 mm2) Number of books in library (per 10 000 increase) Doctor-­level variables Age (year) Male ED duty per monthb 0 1-­2 3-­5 Estimate (the improvement in GM-­ITE score) 95% CI Lower limit Upper limit 0.15 −0.47 −0.18 1.24 1.00 −0.16 0.01 0.01 0.47 −0.25 1 1.65 2.45 −3.97 −1.35 −1.08 −1.70 −2.16 −0.35 −0.16 −0.18 4.28 0.42 0.73 4.18 4.15 0.03 0.19 0.20 0.13 −2.45 0.81 1.96 Reference −2.31 5.62 0.41 4.50 P-value .94 .30 .70 .41 .53 .11 .91 .92 .01** .83 .41 .02** Estimate (the improvement in GM-­ITE score) 95% CI Lower Upper limit limit P-value 0.46 0.05 0.88 .03** 4.17 3.42 −0.37 1.46 8.71 5.37 .07* <.01** (Continues) This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made. © 2017 The Authors. Journal of General and Family Medicine published by John Wiley & Sons Australia, Ltd on behalf of Japan Primary Care Association. 312  |  wileyonlinelibrary.com/journal/jgf2  J Gen Fam Med. 2017;18:312–314. LETTER TO THE EDITOR |      313 T A B L E   1   (Continued) Univariable analysis Multivariable analysisa Variable 6 or greater Unknown Number of inpatients in chargeb 0-­4 5-­9 10-­14 15 or greater Unknown Study time (min)b 0-­30 31-­60 61-­90 91 or greater Unknown Estimate (the improvement in GM-­ITE score) 2.15 8.34 95% CI Lower limit −0.77 3.69 Upper limit 5.07 13.00 1 2.62 2.02 −0.58 1.89 Reference 0.24 5.00 −1.42 5.46 −4.42 3.26 −7.27 11.06 1 −0.99 0.65 −1.71 −0.59 Reference −4.34 2.35 −2.69 3.98 −4.83 1.41 −11.80 10.63 P-value .15 <.01** .03** .25 .76 .68 .56 .70 .28 .92 Estimate (the improvement in GM-­ITE score) 3.69 7.57 95% CI Lower limit 1.11 1.46 Upper limit 6.27 13.68 P-value .01** .02** 3.17 2.15 −1.77 3.03 0.51 −1.65 −6.77 −2.11 5.82 5.95 3.22 8.17 .02** .27 .48 .25 CI, confidence interval; NS, not significant; GIM, general internal medicine; GM, general medicine; ED, emergency department. aEstimate of hospital random-­effects variance =6.42 (P=0.09). bF-­test with 4 degrees of freedom for univariable analysis: P<.01 for ED duty per month, P=0.07 for the number of inpatients the resident was in charge of, and P=0.27 for study time. *P<.1. **P<.05. Here hospitals with a GM department were not significantly related to the improvement in GM-­ITE scores. Therefore, we presume that the resident physicians did not receive sufficient periods of GM residency. The main limitation of the present study was a small sample size. Although the total number of participants was 1049 and 2015 in 2013 and 2014, respectively, only 241 participants undertook GM-­ ITE during the studied years. Another problem is the possibility of ceiling effect in participants achieving a high score in PGY-­1. The difference in scores (PGY-­2 minus PGY-­1) tended to be smaller when participants achieved a high score in PGY-­1. Finally, the information on ED duty, obtained from the self-­reporting questionnaire sheet, was simply the number of overnight calls per month, and it could not be used to assess the difference in the system of emergency department of each hospital. Also, the number of inpatients in charge obtained from the self-­reporting questionnaire sheet was simply the average number of inpatients in charge, and it could not be used to assess the difference in the system of the specialties the residents rotated on. CONFLICT OF INTEREST The authors have stated explicitly that there are no conflicts of interest in connection with this article. Yuji Nishizaki MD, MPH, PhD1 Atsushi Mizuno MD2 Tomohiro Shinozaki MPH3 Tomoya Okubo PhD4 Yusuke Tsugawa MD, PhD5 Taro Shimizu MD, MPH, MBA6 Ryota Konishi MD, MPH7 Yu Yamamoto MD8 Naotake Yanagisawa PhD9 Toshiaki Shiojiri MD10 Yasuharu Tokuda MD, MPH11 1Department of Cardiovascular Medicine, Juntendo University Graduate School of Medicine, Tokyo, Japan 2Department of Cardiology, St. Luke’s International Hospital, Tokyo, Japan 3Department of Biostatistics, School of Public Health, The University of Tokyo, Tokyo, Japan 4Research Division, The National Center for University Entrance Examinations, Tokyo, Japan 5Department of Health Policy and Management, Harvard T. H. Chan School of Public Health, Boston, MA, USA 6Department of Diagnostic and Generalist Medicine, Dokkyo Medical University Hospital, Tochigi, Japan 7Department of General Internal Medicine, Kanto Rosai Hospital, Kawasaki City, Japan 8Division of General Medicine, Center for Community Medicine, Jichi Medical University School of Medicine, Tochigi, Japan 9Clinical Research Section, R&D Management Department, R&D Division, Morinaga Milk Industry Co., Ltd., Kanagawa, Japan 10Department of General Internal Medicine, Asahi General Hospital, Chiba, Japan 11Japan Community Healthcare Organization, Tokyo, Japan |314       LETTER TO THE EDITOR REFERENCES 1. Shimizu T, Tsugawa Y, Tanoue Y, et  al. The hospital educational environment and performance of residents in the General Medicine In-­ Training Examination: a multicenter study in Japan. Int J Gen Med. 2013;6:637–40. 2. Kinoshita K, Tsugawa Y, Shimizu T, et al. Impact of inpatient caseload, emergency department duties, and online learning resource on General Medicine In-­Training Examination scores in Japan. Int J Gen Med. 2015;8:355–60. 3. Mizuno A, Tsugawa Y, Shimizu T, et al. The Impact of the hospital volume on the performance of residents on the general medicine in-­training examination: a multicenter study in Japan. Intern Med. 2016;55:1553–8. 4. Arnedt JT, Owens J, Crouch M, Stahl J, Carskadon MA. Neurobehavioral performance of residents after heavy night call vs after alcohol ingestion. JAMA. 2005;294:1025–33. 5. Block L, Wu AW, Feldman L, Yeh HC, Desai SV. Residency schedule, burnout and patient care among first-­year residents. Postgrad Med J. 2013;89:495–500.