Software Engineer

So, what’s the role all about?

We are looking for a Software Engineer to join our AI Engineering team, focusing on building and operationalizing AI/ML and Generative AI solutions. In this role, you will design and implement robust software systems that enable MLOps and GenAI Ops workflows, ensuring scalable, secure, and efficient deployment of AI models and applications. You will work closely with data scientists, prompt engineers, and cloud specialists to deliver production-grade AI services using Azure AI and AI Foundry.

 How will you make an impact?

• Design and implement GenAI Ops pipelines for LLM deployment, fine-tuning, and inference optimization.
• Automate prompt lifecycle management, versioning, and evaluation.
• Integrate Azure AI services and AI Foundry for scalable GenAI solutions.
• Build CI/CD workflows for LLM-based applications, including containerization and orchestration.
• Implement observability and monitoring for LLM performance, latency, and hallucination detection.
• Collaborate with Data Scientists and Prompt Engineers to streamline GenAI workflows.
• Ensure compliance with Responsible AI, data privacy, and model governance.

Have you got what it takes?

• Cloud Platforms: Strong experience with Azure AI, Azure ML, and Azure DevOps.
• GenAI Tools: Hands-on with AI Foundry, OpenAI/Azure OpenAI APIs, or similar platforms.
• Programming: Proficiency in .Net or Python; experience with prompt engineering frameworks.
• CI/CD: Familiarity with Azure DevOps pipelines, Docker, Kubernetes.
• Monitoring: Knowledge of LLM observability tools and metrics for GenAI (e.g., prompt success rate, token usage).
• Understanding of MLOps principles and GenAI Ops best practices.

Qualifications:

• Bachelor’s or master’s degree in computer science or a related field.
• Experience with fine-tuning LLMs and embedding models.
• Knowledge of vector databases (e.g., PostgressPGE Vector, Azure Cognitive Search).
• Familiarity with RAG (Retrieval-Augmented Generation) architectures.

 What’s in it for you?

Join an ever-growing, market disrupting, global company where the teams – comprised of the best of the best – work in a fast-paced, collaborative, and creative environment! As the market leader, every day at NiCE is a chance to learn and grow, and there are endless internal career opportunities across multiple roles, disciplines, domains, and locations. If you are passionate, innovative, and excited to constantly raise the bar, you may just be our next NiCEr!

Enjoy NiCE-FLEX!

At NiCE, we work according to the NiCE-FLEX hybrid model, which enables maximum flexibility: 2 days working from the office and 3 days of remote work, each week. Naturally, office days focus on face-to-face meetings, where teamwork and collaborative thinking generate innovation, new ideas, and a vibrant, interactive atmosphere.

Requisition ID: 9158
Reporting into: Tech Manager
Role Type: Software Engineer