AI Evaluation SME Quality Expert
Senior Eval Program Expert
Do you excel at building and managing relationships with subject matter experts? Are you passionate about creating efficient quality assurance processes and operational excellence at scale?
About our Team
Elsevier's Evaluation Operations group supports Health Markets and Research product teams by recruiting, onboarding, and managing large networks of SMEs. We partner with product managers, clinical leaders, data scientists, UX researchers, legal, and procurement to deliver reliable, compliant, and scalable evaluation capacity. Our focus is measurable quality, transparent processes, and a great SME experience.
About the Role
We are seeking a Senior Eval Program Expert to own SME lifecycle operations from requirements gathering through quality oversight and continuous improvement. You will collaborate with evaluation domain leads to define project specifications, implement consistent quality procedures, and ensure audit-ready documentation. You will set SME performance standards, run calibration and inter-rater reliability activities, and drive process improvements. Your work ensures experts are engaged with clear expectations, efficient workflows, and consistent results.
Responsibilities
SME Requirements Gathering and Planning
Collaborate with evaluation domain leads to collect and document SME requirements by activity type and timeline.
Translate evaluation needs into clear SME profiles, sourcing plans, and staffed project specifications.
Maintain proactive communication with stakeholders to forecast capacity and mitigate risks.
SME Quality Oversight and Evaluation Activity Management
Implement quality assurance procedures for SME work, including calibration sessions and inter-rater reliability measurement.
Monitor performance, provide structured feedback, and implement corrective actions where needed.
Track SME activity completion, invoicing, and payments in partnership with Finance and Procurement.
Develop quality dashboards and regular reports for stakeholder visibility.
Process Documentation and Continuous Improvement
Maintain SOPs, templates, checklists, and playbooks for project readiness and quality management.
Drive improvements that increase throughput, reduce cycle time, and improve SME experience.
Maintain audit-ready, version-controlled documentation and ensure compliance with privacy and procurement policies.
SME Relationship Management
Build and nurture ongoing relationships with SME communities across specialties and domains.
Coordinate cross-functional collaboration with HR, Tech, Legal, and Evaluation leads.
Ensure SMEs receive ongoing support, training updates, and clear communication on SOPs, tools, and rater guidance.
Requirements
Bachelor's degree in Business Administration, Operations Management, Human Resources, Information Science, Public Health, or related field.
3 to 5 years in operations, program management, or quality assurance, ideally in healthcare or research settings.
Experience with project management platforms and workflow tools.
Proven ability to produce clear SOPs, training materials, and documentation for technical and non-technical audiences.
Strong organization and program management across multiple concurrent projects and deadlines.
Quality management expertise, including calibration facilitation and inter-rater reliability fundamentals.
Excellent written and verbal communication with strong stakeholder management skills.
Experience in process improvement and scaling operations; proficiency in Excel or Google Sheets.
Working knowledge of privacy and compliance in healthcare and research such as HIPAA and GDPR fundamentals.
Comfortable coordinating with evaluation domain leads and technical teams to drive operational excellence.
Preferred Qualifications
Experience working with SMEs or external contractor networks at scale.
Background in quality assurance or quality management systems.
Familiarity with evaluation or assessment operations.
Experience with vendor management, invoice reconciliation, and basic budgeting.
Project management training or certification (PMP, Lean Six Sigma, or similar).
Work in a way that works for you
We promote a healthy work/life balance across the organization. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals.
Working for you
We know that your well-being and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:
· Comprehensive Pension Plan
· Home, office, or commuting allowance.
· Generous vacation entitlement and option for sabbatical leave
· Maternity, Paternity, Adoption and Family Care leave
· Flexible working hours
· Personal Choice budget
· Internal communities and networks
· Various employee discounts
· Recruitment introduction reward
· Employee Assistance Program (global)
About the business
As a global leader in information and analytics, we help researchers and healthcare professionals advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and vast data sets with analytics to support visionary science and research, health education, and interactive learning, as well as exceptional healthcare and clinical practice. At Elsevier, your work contributes to the world’s grand challenges and a more sustainable future. We harness innovative technologies to support science and healthcare to partner for a better world.
We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.
We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120.
Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here.
Please read our Candidate Privacy Policy.
We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law.
USA Job Seekers: