Software Quality Engineer (AI/ML Applications)

Vizient, Inc is a company that values its talented employees and provides an inclusive environment for personal and professional development. In this role, you will validate AI and ML-powered healthcare solutions to ensure data quality and model performance while applying Agile and QA methodologies throughout the software development lifecycle. Responsibilities: Develop and execute test strategies for ML and generative AI-powered applications; Create and execute test cases, plans, and scripts based on story-defined acceptance criteria, and review Qualifications: 2 or more years of relevant experience required; Experience in Quality Assurance with a focus on data testing, analytics validation, and BI/ETL systems required; Experience validating ML or generative AI-based applications, including model evaluation and data quality assessment; Experience with QA automation frameworks (Selenium or similar) and Python for scripting, data validation, and automation; Experience evaluating Large Language Model systems, including prompt regression testing and automated or human-in-the-loop judging methodologies; Familiarity with RAG evaluation concepts, including retrieval quality, context relevance, faithfulness, and safety testing; Experience designing AI evaluation metrics and monitoring model performance in production environments; Understanding of Agile methodologies and CI/CD practices; Strong analytical, documentation, and communication skills; self-starter who thrives in fast-paced, iterative environments and drives quality initiatives amid ambiguity and shifting priorities Required Skills: Quality Assurance, ML application validation, QA automation frameworks, Python scripting, Agile methodologies, CI/CD practices, Analytical skills