University of Colorado Anschutz Medical Campus
Department: Undergraduate Medical Education
Job Title: Evaluator
Position #: 00849104 – Requisition #:40072
The Evaluation Team within the School of Medicine’s Office of Assessment, Evaluation, and Outcomes (AEO) is responsible for the design, implementation, analysis, and reporting of all course, faculty, and program evaluation for Undergraduate Medical Education (UME). The Evaluator applies both project management and data-focused processes to evaluation activities, including longitudinal reporting and continuous quality improvement. This position assists with the design and distribution of survey instruments, data collection and analysis, and results reporting to support curricular improvement, LCME accreditation, faculty promotion, and faculty research, all while maintaining the confidentiality of sensitive data. This position serves and communicates with a diverse group of faculty, staff, and students, with different agendas and objectives, to ensure the successful evaluation of all UME courses, faculty, and programs.
Key Responsibilities:
Data Collection – 35%
Communicates with faculty, staff, and IT professionals to answer questions about the evaluation process and resolve issues that arise during data collection.
Designs and implements surveys to adhere to best practices for data collection including random sampling to reduce survey burden.
Distributes evaluations to students and tracks progress of submissions to ensure sample sufficiency and representativeness.
Implements timelines for releasing, collecting, and managing course and faculty evaluations.
Reviews all open-ended survey feedback and determines whether any comments indicate potential issues to escalate to the AEO Manager.
Quantitative Data Analysis and Reporting – 25%
Analyzes, summarizes, and reports evaluation data to match the data type and stakeholder needs, ensuring accurate results and the confidentiality of survey respondents.
Designs, builds, and maintains Tableau Dashboards to report evaluation results for course and program leadership, both longitudinally within and across courses.
Create and distribute summary reports for program and course directors, distribute individual reports to faculty, residents, and other educators, and create individual reports for upload to PRiSM accounts of faculty educators.
Qualitative Data Analysis and Reporting – 35%
Collects, interprets, and synthesizes course and curricular content area feedback from various sources (e.g., students, staff, faculty, and historical documents) to create thematic analyses used to prompt and facilitate conversation during continuous quality improvement meetings for LCME accreditation.
Conducts thematic analyses of open-ended feedback from course evaluations.
Facilitates and summarizes results from focus groups.
Ad-hoc Data Requests – 5%
Responds to requests for ad-hoc reports, assessing the feasibility from both logistical and student confidentiality standpoints, and providing alternate reporting possibilities when necessary.
Uses Microsoft SQL to generate reports based on stakeholder needs.
Work Location:
Hybrid – this role is eligible for a hybrid schedule of 3 days per week on campus and as needed for in-person meetings.
Why Join Us:
Why work for the University?
We have AMAZING benefits and offerexceptional amounts of holiday, vacation and sick leave! The University of Colorado offers an excellent benefits package including:
Medical: Multiple plan options
Dental: Multiple plan options
Additional Insurance: Disability, Life, Vision
Retirement 401(a) Plan: Employer contributes 10% of your gross pay
Paid Time Off: Accruals over the year
Vacation Days: 22/year (maximum accrual 352 hours)
Sick Days: 15/year (unlimited maximum accrual)
Holiday Days: 15/year
Tuition Benefit: Employees have access to this benefit on all CU campuses
ECO Pass: Reduced rate RTD Bus and light rail service
There are many additional perks & programs with the CU Advantage
Qualifications:
Minimum Qualifications:
Bachelor’s degree in education, psychology, business, public administration, health care, educational technology, social science, liberal arts, communications, accounting, finance, library science, or a directly related field from an accredited institution and 2 years of professional experience serving as a project/change manager, evaluator, analyst, or in a directly related role.
Applicants must meet minimum qualifications at the time of hire.
Preferred Qualifications:
Master’s degree in education or related field,
Experience working with UME curriculum, faculty, and structure.
Experience working with data management programs/applications.
Experience working in an academic medical school environment.
Knowledge, Skills and Abilities:
Ability to communicate effectively, both in writing and orally.
Ability to establish and maintain effective working relationships with employees at all levels throughout the institution.
Outstanding customer service skills.
Outstanding oral and written communication skills
Outstanding organizational skills
Ability to prioritize tasks and work on multiple projects concurrently
Attention to detail and the ability to ensure accuracy in work
Ability to work with minimal supervision and show initiative
Ability to multi-task and work cooperatively with others
Conditions of Employment:
Applicants must be legally authorized to work in the United States without requiring sponsorship. We are unable to provide work visa sponsorship or employment authorization for this position now or in the future.
How to Apply:
For full consideration, please submit the following document(s):
A letter of interest describing relevant job experiences as they relate to listed job qualifications and interest in the position
Curriculum vitae / Resume
Three to five professional references, including name, address, phone number (mobile number if appropriate), and email address
Questions should be directed to: Lucinda Allen, lucinda.allen@cuanschutz.edu
Screening of Applications Begins:
Immediately and continues until position is filled. For best consideration, apply by 6/5/26
Anticipated Pay Range:
The starting salary range (or hiring range) for this position has been established as $59,417 - $75,579
The above salary range (or hiring range) represents the University’s good faith and reasonable estimate of the range of possible compensation at the time of posting. This position may be eligible for overtime compensation, depending on the level.
Your total compensation goes beyond the number on your paycheck. The University of Colorado provides generous leave, health plans and retirement contributions that add to your bottom line.
Equal Employment Opportunity Statement:
CU is an Equal Opportunity Employer and complies with all applicable federal, state, and local laws governing nondiscrimination in employment. We are committed to creating a workplace where all individuals are treated with respect and dignity, and we encourage individuals from all backgrounds to apply, including protected veterans and individuals with disabilities.
ADA Statement:
The University will provide reasonable accommodations to applicants with disabilities throughout the employment application process. To request an accommodation pursuant to the Americans with Disabilities Act, please contact the Human Resources ADA Coordinator at hr.adacoordinator@cuanschutz.edu.
Background Check Statement:
The University of Colorado Anschutz Medical Campus is dedicated to ensuring a safe and secure environment for our faculty, staff, students and visitors. To assist in achieving that goal, we conduct background investigations for all prospective employees.
Vaccination Statement:
CU Anschutz strongly encourages vaccination against the COVID-19 virus and other vaccine preventable diseases If you work, visit, or volunteer in healthcare facilities or clinics operated by our affiliated hospital or clinical partners or by CU Anschutz, you will be required to comply with the vaccination and medical surveillance policies of the facilities or clinics where you work, visit, or volunteer, respectively. In addition, if you work in certain research areas or perform certain safety sensitive job duties, you must enroll in the occupational health medical surveillance program
