The Applications Development Senior Supervisor is an intermediate management level position responsible for providing full leadership and direction to a team of employees in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.
Responsibilities:
Build REST endpoints
Refine prompts and write Agentic code
Adjusting LLM Inference parameters
Writing and refining prompts
Selecting context for given LLM window size and setup
Debugging Agent Self-Reflection loops
Calling external search libraries and writing formatting code to connect prompt templates
Writing code in compliance with risk restrictions
Documenting code to ensure compliance and reusability of work
Write SQL queries and optimize queries for LLM context retrieval
Writing unit and integration tests for LLMs
Qualifications:
AI ML Engineer
6+ years of total experience
3+ Years experience as a data scientist, or machine learning engineer (data-adjacent profession)
Proficient in every aspect of the data pipeline, including:
Data cleaning and preprocessing
Model Selection
Feature engineering
Model training and retraining
Model evaluation
Moving models into productions
Building APIs
Python expertise
Familiar with FastAPI, Flask
Some python library or libraries for calling LLMs (LangChain or similar)
Data manipulation libraries (Pandas, Numpy, Scipy)
NLPText processing and parsing library experience (SpaCy, NLTK, TextBlob
Deep LearningFamiliarity with model binaries and inferencing, experience with HuggingFace, PyTorch, or Tensorflow a plus
LLMs Able to write promptsUnderstanding of the fundamentals of Language Modeling
SQL
Education:
Bachelor’s degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
------------------------------------------------------
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.