We are seeking an expert practitioner and thought leader to join our team as a Senior AI Platform Lead. This is a senior, hands-on technical leadership role for a seasoned expert who will be instrumental in shaping and scaling our Artificial Intelligence practices across the enterprise. You will be responsible for defining best practices, building core frameworks, and establishing the standards for how we build, evaluate, and deploy next-generation AI solutions.
The ideal candidate is not just a strategist but a deep, hands-on practitioner with a passion for solving complex problems. You have extensive, practical experience with the latest AI tools and techniques. You are an expert in the science of AI evaluation and have built systems to measure and validate AI performance at an industrial scale. This role is for a practical problem-solver who can lead by example and guide our engineering community toward building robust, reliable, and scalable AI applications.
Key Responsibilities:
- AI Practice Leadership: Act as a senior technical authority to help define and scale our AI engineering practices. Create reference architectures, development blueprints, and best-practice guidelines for building advanced AI solutions.
- Hands-On Prototyping & Framework Development: Lead the design and development of core AI frameworks and libraries. Build production-quality proof-of-concepts and reference implementations for complex patterns like advanced RAG pipelines and multi-agent systems.
- AI Evaluation at Scale: Architect and implement a comprehensive, enterprise-grade AI evaluation framework. This includes defining key metrics, developing automated testing pipelines, and establishing processes to continuously evaluate the performance, accuracy, safety, and cost of our AI models and systems.
- Technical Mentorship & Evangelism: Serve as a senior mentor to AI engineers across the organization. Evangelize best practices in AI engineering, MLOps, and system evaluation through workshops, documentation, and direct consultation.
- Expert Consultation: Act as the go-to expert for application teams on advanced AI topics. Provide deep technical guidance on architecture, tool selection, and implementation challenges related to RAG, agentic systems, and large-scale deployment.
- Practical Problem Solving: Partner with business and technology teams to tackle the most challenging problems. Apply your deep expertise to architect and deliver practical, efficient, and scalable AI solutions that create tangible business value.
Qualifications:
- Experience: 12+ years of experience in software engineering, with at least 5-7 years in a senior, hands-on AI/ML engineering role.
- Core Technical Expertise:
- Deep, hands-on experience building and deploying sophisticated, large-scale AI systems.
- Proven, practical expertise in modern AI techniques, specifically designing, building, and optimizing Retrieval-Augmented Generation (RAG) pipelines.
- Demonstrable experience in architecting and developing agentic AI ecosystems (e.g., using frameworks like LangChain, LlamaIndex, Autogen, or custom-built agentic frameworks).
- Expert-level knowledge of AI evaluation methodologies and frameworks. Must have practical experience designing and implementing automated evaluation pipelines at scale to test for quality, toxicity, hallucination, and accuracy.
- Foundational Skills:
- Expert-level programming skills, particularly in Python, and deep familiarity with major AI/ML libraries (e.g., PyTorch, Hugging Face, LangChain, LlamaIndex, Scikit-learn).
- Strong experience with LLM Operations (LLMOps/MLOps), including model deployment, monitoring, fine-tuning, and lifecycle management.
- Solid experience with cloud platforms (AWS, Azure, GCP) and their associated AI/ML services.
- Mindset & Leadership:
- A true practitioner with a passion for staying hands-on and writing code.
- A pragmatic and practical problem-solver who can navigate complex technical challenges and deliver effective, real-world solutions.
- Proven ability to mentor senior engineers and provide technical leadership across a large organization.
- Excellent communication skills with the ability to articulate highly complex technical concepts to both technical and non-technical audiences.
Education:
- Bachelor’s degree in Computer Science, Engineering, or a related quantitative field.
- Master’s or PhD in Computer Science, AI, or a related field is strongly preferred.
------------------------------------------------------
Job Family Group:
Technology
------------------------------------------------------
Job Family:
Applications Development
------------------------------------------------------
Time Type:
Full time
------------------------------------------------------
Most Relevant Skills
Please see the requirements listed above.
------------------------------------------------------
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.