Self-assessment | Surveys | On-site visit | Interviews
The MPAP assessment process involves four main components:
- On-site visit
Upon completion of the four components, a final report is produced.
In this first component, candidates are required to complete three main self-assessment reports that are submitted with the initial application package including :
- Self-assessment Report
- Self-assessment Report: Reflective Practice
- Self-assessment Report: Clinical Practice Skills (for specialists only)
Information gathered through the self-assessment report will assist the Manitoba Practice Assessment Program (MPAP) Program Team in selecting a lead assessor, and will be used by the assessment team in preparing for the onsite visit.
The second component involves a process called a 360 degree assessment that is used to gather information from physician colleagues, interprofessional colleagues, and patients about the candidate’s practice. Physician and interprofessional colleague complete surveys online and are provided with a secure username and password to access the online survey. Patient surveys are sent out directly from the Manitoba Practice Assessment Program (MPAP) office and returned directly to the MPAP office. The MPAP Program and Team Assessment will review completed surveys prior to the onsite visit. Documents to be completed include:
- Physician Colleague Questionnaire
- Interprofessional Colleague Questionnaire
- Patient Survey of Doctor’s Practice
During the onsite visit the assessment team will conduct a chart audit of approximately 15 – 20 charts with a variety of diagnoses. The chart audit will be followed by a chart stimulated recall session in which the assessment team will interview the candidate and probe for further details regarding information documented in the charts. Assessment reports to be completed by assessors include:
- Practice Assessment Report: Chart Audit
- Practice Assessment Report: Quality of Practice Based on Chart Stimulated Recall
The onsite visit also involves direct observation of the physicians clinical practice. It will entail the assessment team observing the candidate in the candidate’s primary practice area. Observations may be done at more than one site, as appropriate to the particular practice. Generally, it is anticipated that one full day of direct observation will provide an adequate sample for assessment; however, this will vary depending on the type of practice. Some practices that are more complex will require observation over longer periods due to the types of patients seen (e.g., psychiatry), or the different areas of practice to be observed (e.g., Emergency Department, personal care home, operating room).
The assessment will include observing the candidate’s performance while in direct clinical practice with patients. In addition, the candidate’s interactions with colleagues and support staff will be evaluated. Assessment tools that will be used by assessors to evaluate the candidate’s clinical practice include:
- Practice Assessment Report: Observation of Roles in Clinical Practice
- Practice Assessment Report: Observation of Clinical Practice – Flow Sheet
- Practice Assessment Report: Treatments and Procedures – Flow Sheet
- Practice Assessment Report: Diagnostic Imaging Data Interpretation – Flow Sheet
The assessment team will be present strictly as observers, and any questions regarding management will be discussed with the candidate after the patient encounter has ended. The candidate will be required to obtain consent from patients for having an observer present, and shall pre-arrange consent to maximize time efficiency for the assessment team. The candidate also needs to ensure that the patients seen during the observation period represent their typical practice as much as possible. Verification of the candidate’s practice pattern will be possible by reviewing data collected from the Self-Assessment Report.
The final assessment component includes the assessment team interviewing Chiefs of Staff, Program Directors/Administrators, and Medical Residents as appropriate to the particular practice of the candidate. Depending on the nature of the practice of the candidate (i.e., independent practitioner in private practice), interviews may not be required. Standardized interview questions will be used by the assessment team to conduct the interviews:
- Practice Assessment Interview Guide: Medical Colleagues
- Practice Assessment Interview Guide: Medical Students/Residents