Objective. This study aimed to enrich the Academy's understanding of pharmacy students' readiness for advanced pharmacy practice experiences (APPEs) by exploring the perspectives of three primary stakeholders: APPE students, APPE preceptors, and APPE faculty site directors.Methods. A descriptive qualitative study of APPE readiness was conducted using workplace learning as a guiding conceptual framework. Data were collected between March and September 2019 through semi-structured focus groups and interviews with students (five groups), preceptors (four groups), and faculty site directors (one group, two individual interviews). The data were analyzed using directed content analysis.Results. Participants described APPE readiness as a multifaceted construct comprised of four themes: learner characteristics, participation in workplace activities, relationship-building, and workplace practices to orient and support students. While all participants addressed each category, faculty site directors and preceptors tended to focus on learner characteristics, while students emphasized their participation in the workplace and relationship building.Conclusion. Knowledge is widely recognized as a requirement for APPE readiness. This study identified learner characteristics, workplace participation, and relational skills as additional requirements. Some of these criteria are challenging to assess prior to APPEs, which makes orienting students both prior to and at the start of APPEs particularly important to support readiness. Thus, a comprehensive review of APPE readiness might also include assessing the readiness of workplaces, administrators, and preceptors for APPE students.

Introduction

Many medical schools engage students in health system improvement (HSI) efforts. Evaluation of these efforts often focuses on students' learning outcomes and rarely considers the impact on health systems, despite the significant commitment health systems make to these efforts. Our study identified and evaluated system-level outcomes of pre-clerkship medical students' engagement in HSI efforts.

Methods

We used an instrumental case study approach to examine the effects of pre-clerkship medical students' engagement in HSI projects as part of a 15-month experiential curriculum. We extracted data from 53 project summaries and posters completed during the 2017-18 academic year and follow-up survey data collected in May 2019 from physician coaches and health system professionals who mentored students, contributed to these projects, and worked in the clinical microsystems where the projects occurred.

Results

We identified three categories and ten indicators of health system outcomes relevant to medical student engagement in HSI. Using these indicators, our evaluation found multiple benefits to the microsystems in which projects occurred. These included achievement of project aims, perceived immediate and sustained project impact on the health system, and development and implementation of projects with aims that aligned with national and health system priorities.

Conclusion

Evaluation of HSI curricula needs to include effects on health systems so that program design can optimize the experience for all involved. Our study offers a framework others can use to evaluate system-level effects of project-based HSI curricula and shows several ways in which students' engagement can add value to health systems.

Background

Pediatric emergency medicine (PEM) physicians receive training in critical procedures, but these procedures are rare in practice. The literature on maintenance of procedural skills focuses on ways to practice (e.g., via simulation) and pays little attention to motivation's role. Understanding what motivates PEM physicians to maintain procedural skills can inform the design of supportive policies and interventions. Our study explores how PEM physicians conceptualize maintenance of procedural skills, what motivates them to maintain procedural skills, and barriers to procedural skill maintenance.

Methods

This was a qualitative study of 12 PEM faculty guided by the self-determination theory (SDT) of motivation. SDT describes a typology that distinguishes extrinsic and intrinsic motivation, with intrinsic motivation based on autonomy, competence, and relatedness. Interviews were transcribed and coded using constant-comparative technique, and interviews continued until thematic sufficiency was achieved.

Results

Participants had difficulty defining procedural skill maintenance by specific criteria and expressed ambivalence about external standards for competence, noting the need to account for individual and local practice factors. Three themes characterizing participants' motivation for procedural skills maintenance included: (1) desire to provide optimal patient care and fear of unsuccessful performance (competence), (2) procedural competence as part of the identity of a PEM physician who teaches and performs procedures (competence and relatedness), and (3) desire for accessibility and choice of options in maintaining procedural skills (autonomy). Participants identified lack of opportunities, time, and support as barriers to motivation and skills maintenance.

Conclusion

SDT concepts were integral to understanding faculty motivation, and this highlights the need for prioritizing faculty autonomy, competence, and relatedness in designing supports for procedural skill maintenance. Our findings regarding the difficulty in defining maintenance of skills emphasize the need for further discussion and study of this topic.

Background

Internal Medicine (IM) subspecialty professional societies can provide valuable community, recognition, resources, and leadership opportunities that promote career success. Historically, this support focused on clinical and research dimensions of academic careers, but educational dimensions have gained more attention recently. This study explores how IM subspecialty professional societies support their clinician-educator members.

Methods

Using a qualitative study with two phases, the authors collected information from each IM subspecialty society's website about support for medical education. Using information from the first phase, we developed an interview guide for subspecialty society leaders. We used inductive thematic analysis to analyze interview transcripts.

Results

Website analysis identified various mechanisms used by several IM subspecialty societies to promote medical education. These included websites focused on medical education, dedicated medical education poster/abstract sessions at annual meetings, and strategies to promote networking among clinician-educators. Interviews with eight subspecialty society leaders about the professional societies' roles with respect to medical education yielded four main themes: [1] varying conceptions of "medical education" in relation to the society [2] strategies to advance medical education at the society level [3] barriers to recognizing medical education [4] benefits of clinician-educators to the societies. Integrating these themes, we describe recommended strategies for professional societies to better serve clinician-educators.

Conclusions

We explore how IM subspecialty societies attend to a growing constituency of clinician-educators, with increasing recognition and support of the career path but persistent barriers to its formalization. These conversations shed light on opportunities for professional subspecialty societies to better serve the needs of their clinician-educator members while also enabling these members to make positive contributions in return.

Objective

Workplace-based assessments (WBAs) are used in multiple surgical specialties to facilitate feedback to residents as a form of formative assessment. The validity evidence to support this purpose is limited and has yet to include investigations of how users interpret the assessment and make rating decisions (response processes). This study aimed to explore the validity evidence based on response processes for a WBA in surgery.

Design

Semi-structured interviews explored the reasonings and strategies used when answering questions in a surgical WBA, the System for Improving and Measuring Procedural Learning (SIMPL). Interview questions probed the interpretation of the three assessment questions and their respective answer categories (level of autonomy, operative performance, case complexity). Researchers analyzed transcripts using directed qualitative content analysis to generate themes.

Setting

Single tertiary academic medical center.

Participants

Eight residents and 13 faculty within the Department of Otolaryngology-Head and Neck Surgery participating in a 6-month pilot of SIMPL.

Results

We identified four overarching themes that that characterized faculty and resident response processes while completing SIMPL: (1) Faculty and resident users had similar content-level interpretations of the questions and corresponding answer choices; (2) Users employed a variety of cognitive, behavioral, and emotional processes to make rating decisions; (3) Contextual factors influenced ratings; and (4) Tensions during interpretation contributed to rating uncertainty.

Conclusions

Response processes are a key source of evidence to support the validity for the formative use of WBAs. Evaluating response process evidence should go beyond basic content-level analysis as contextual factors and tensions that arise during interpretation also play a large role in rating decisions. Additional work and a continued critical lens are needed to ensure that WBAs can truly meet the needs for formative assessment.

Habits of inquiry are considered an essential component of the modern physician's profile. These habits drive physicians to recognize and address the continuous challenges inherent to the practice of medicine; consequently, they meet the aims of better patient-centered care, better health of communities, and improved functioning of the health system. Many medical schools have endeavored to integrate inquiry into their curricula as a means of supporting development of adaptive expertise, a construct that encompasses habits of inquiry. However, the diversity of conceptualizations of inquiry has resulted in correspondingly diverse instructional implementations. Much of the emphasis has been on inquiry methods (e.g., engagement in research projects, courses in research methods and statistics), but the learners' inquiry disposition and its essential attitude component have received little attention in instruction and assessment. The authors propose that both inquiry methods and attitude need to be developed explicitly and simultaneously to prepare physicians to successfully be willing and able to address the challenges of today's health care environment. Because attitudes are established predictors of behavior, a positive inquiry attitude may be the ultimate determinant of physicians' engagement in behaviors of adaptive expertise (i.e., recognizing when learned procedures do not apply, and learning or inventing effective solutions). Addressing the attitude toward inquiry as early as possible in medical school is critical because strong attitudes are difficult to modify. Thus, a curriculum that supports positive inquiry attitude formation and strengthening will carry well beyond medical school and residency training.

Context

Transitions of patient care responsibility occur frequently between physicians. Resultant discontinuities make it difficult for physicians to observe clinical outcomes. Little is known about what physicians do to overcome the practical challenges to learning these discontinuities create. This study explored physicians' activities in practice as they sought follow-up information about patients.

Methods

Using a constructivist grounded theory approach, semi-structured interviews with 18 internal medicine hospitalist and resident physicians at a single tertiary care academic medical center explored participants' strategies when deliberately conducting follow-up after they transitioned responsibility for patients to other physicians. Following open coding, the authors used activity theory (AT) to explore interactions among the social, cultural and material influences related to follow-up.

Results

The authors identified three themes related to follow-up: (i) keeping lists to track patients, (ii) learning to create tracking systems and (iii) conducting follow-up. Analysis of participants' follow-up processes as an activity system highlighted key tensions in the system and participants' work adaptations. Tension within functionality of electronic health records for keeping lists (tools) to find information about patients' outcomes (object) resulted in using paper lists as workarounds. Tension between paper lists (tools) and protecting patients' health information (rules) led to rule-breaking or abandoning activities of locating information. Finding time to conduct desired follow-up produced tension between this and other activity systems.

Conclusion

In clinical environments characterised by discontinuity, lists of patients served as tools for guiding patient care follow-up. The authors offer four recommendations to address the tensions identified through AT: (i) optimise electronic health record tracking systems to eliminate the need for paper lists; (ii) support physicians' skill development in developing and maintaining tracking systems for follow-up; (iii) dedicate time in physicians' work schedules for conducting follow-up; and (iv) engage physicians and patients in determining guidelines for longitudinal tracking that optimise physicians' learning and respect patients' privacy.

Background

Medical students often struggle to apply their nascent clinical skills in clerkships. While transitional clerkships can orient students to new roles and logistics, students may benefit from developing clinical skills in inpatient environments earlier in their curriculum to improve readiness for clerkships.

Intervention

Our four- to six-session elective provides pre-clerkship students with individualized learning in the inpatient setting with the aim of improving clerkship preparedness. Students work one-on-one with faculty who facilitate individualized learning through mentoring, deliberate practice, and directed feedback. Second-year medical students are placed on an attending-only, traditionally 'non-teaching' service in the hospital medicine division of a Veterans Affairs (VA) hospital for half-day sessions. Most students self-select into the elective following a class-wide advertisement. The elective also accepts students who are referred for remediation of their clinical skills.

Outcome

In the elective's first two years, 25 students participated and 47 students were waitlisted. We compared participant and waitlisted (non-participant) students' self-efficacy in several clinical and professional domains during their first clerkship. Elective participants reported significantly higher clerkship preparedness compared to non-participants in the areas of physical exam, oral presentation, and formulation of assessments and plans.

Conclusions

Students found the one-on-one feedback and personalized attention from attending physicians to be a particularly useful aspect of the course. This frequently cited benefit points to students' perceived needs and the value they place on individualized feedback. Our innovation harnesses an untapped resource - the hospital medicine 'non-teaching' service - and serves as an attainable option for schools interested in enhancing early clinical skill-building for all students, including those recommended for remediation.

Abbreviations

A&P: Assessment and plan; H&P: History and physical; ILP: Individual learning plan.

Background

Providing a robust continuity clinic experience is difficult due to uneven distribution of resident time. Immersion experiences early in training may improve residents' learning experiences.

Objective

We designed and implemented a continuity immersion experience to improve internal medicine interns' satisfaction and confidence with their outpatient skills, and we evaluated the timing of the experience and its benefits for learners.

Methods

Two cohorts of interns at 1 academic institution participated in a 3-week immersion block (during the first or second quarter of the intern year). Interns were surveyed twice about satisfaction and confidence. Analysis included independent and paired sample t tests to compare interns' responses pre- and postimmersion, and to evaluate effects over time.

Results

A total of 124 interns completed the immersion, with a survey response rate of 61%. Interns' self-rated confidence on a 5-point Likert scale improved significantly compared with preimmersion in the areas of medical knowledge and confidence with their electronic health record and communication skills (P ≤ .010 for all assessments). Interns reported high satisfaction with continuity clinic following immersion (cohort 1: 4.5 ± 0.54; cohort 2: 4.3 ± 0.68; on a 5-point scale with 5 = very satisfied). Improvements in knowledge, skills, and satisfaction in cohort 1 were sustained over 3 months.

Conclusions

A 3-week immersion experience in the first 6 months of residency improved interns' confidence in ambulatory content areas and satisfaction with clinic.