Software Engineer

Who you are

You have a strong background in machine learning and software engineering, with hands-on experience in building and operationalizing AI solutions. Your expertise includes working with cloud platforms, particularly Azure AI and Azure ML, and you are familiar with MLOps practices. You thrive in collaborative environments, working closely with data scientists and prompt engineers to deliver production-grade AI services. You understand the importance of compliance with Responsible AI and data privacy, ensuring that your solutions are not only effective but also ethical.

You are skilled in designing and implementing GenAI Ops pipelines for large language model (LLM) deployment, fine-tuning, and inference optimization. Your experience includes automating prompt lifecycle management, versioning, and evaluation, which are crucial for maintaining high-quality AI outputs. You are also adept at integrating various Azure AI services and AI Foundry to create scalable generative AI solutions.

Your technical toolkit includes proficiency in CI/CD workflows, containerization, and orchestration, which you leverage to ensure efficient deployment of AI models and applications. You have a keen eye for observability and monitoring, focusing on LLM performance, latency, and hallucination detection to enhance the reliability of AI systems.

Desirable

Experience with additional cloud platforms or AI tools would be a plus, as would familiarity with best practices in model governance and data privacy. You are always eager to learn and adapt to new technologies in the rapidly evolving field of AI.

What you'll do

In this role, you will design and implement robust software systems that enable MLOps and GenAI Ops workflows. You will collaborate with a diverse team of data scientists, prompt engineers, and cloud specialists to deliver scalable and secure AI solutions. Your responsibilities will include building GenAI Ops pipelines for LLM deployment, ensuring that models are fine-tuned and optimized for performance.

You will automate the prompt lifecycle management process, which includes versioning and evaluation, to streamline workflows and enhance productivity. Integrating Azure AI services and AI Foundry will be a key part of your role, allowing you to leverage the full capabilities of these platforms for generative AI solutions.

You will also be responsible for implementing CI/CD workflows for LLM-based applications, focusing on containerization and orchestration to facilitate smooth deployments. Monitoring and observability will be critical aspects of your work, as you will track LLM performance, latency, and detect any hallucinations to ensure the reliability of the AI services you develop.

Collaboration will be at the heart of your role, as you will work closely with data scientists and prompt engineers to streamline GenAI workflows and ensure that the solutions you create meet the highest standards of quality and compliance.

What we offer

At NICE, we pride ourselves on fostering a culture of innovation and excellence. You will have the opportunity to work on cutting-edge AI technologies and contribute to projects that challenge the status quo. We offer a supportive environment where you can grow your skills and advance your career in the exciting field of AI and machine learning. Join us and be part of a team that is dedicated to making a significant impact in the industry.