AIML - QA 

Position Overview: 

We are seeking an experienced AI/ML Testing Engineer to join our team. The ideal candidate will have a strong background in testing AI and machine learning applications, ensuring that models function as intended, are reliable, and meet quality standards. You will work closely with data scientists, AI/ML engineers, and software developers to design, develop, and implement testing frameworks and strategies specifically for AI/ML-based systems.

Key Responsibilities:

• Develop and execute test plans and strategies for AI/ML models, focusing on accuracy, bias, performance, and fairness.
• Collaborate with AI/ML engineers to ensure model outputs are thoroughly validated, including edge-case testing.
• Perform functional, non-functional, integration, and system testing on AI/ML algorithms and models.
• Conduct data validation and quality testing to ensure inputs to models are correct and produce reliable outcomes.
• Design and implement automated testing frameworks for AI/ML workflows to improve efficiency and coverage.
• Validate model updates, retraining, and versioning for accuracy and performance.
• Test AI models for interpretability, explainability, and consistency in decision-making.
• Identify and test for potential bias or ethical concerns in AI model outputs.
• Work with DevOps teams to automate testing processes within CI/CD pipelines.
• Troubleshoot and resolve defects, collaborating with developers to find effective solutions.
• Document test cases, test results, and issues, providing detailed feedback for continuous improvement.

Skills and Qualifications:

• Educational Background: Bachelor’s or Master’s degree in Computer Science, Data Science, AI/ML, or a related field.
• Experience: 7+ years of experience in software testing with at least 2-3 years in testing AI/ML systems.
• Technical Skills:
• Hands-on experience with AI/ML frameworks (e.g., TensorFlow, PyTorch, Scikit-learn).
• Proficiency in Python, Java, or other programming languages commonly used in AI testing.
• Experience in designing and implementing automated testing frameworks for AI/ML models.
• Familiarity with data science concepts and model evaluation metrics (e.g., precision, recall, AUC, F1 score).
• Experience in testing ML models on cloud platforms (AWS, Azure, GCP).
• Knowledge of CI/CD pipelines and DevOps tools (e.g., Jenkins, Docker, Kubernetes).
• Strong understanding of ethical AI principles and bias testing.
• Soft Skills:
• Strong problem-solving skills and attention to detail.
• Ability to work in a fast-paced, dynamic environment and manage multiple tasks.
• Excellent communication skills for cross-functional team collaboration.

Preferred Qualifications:

• Experience with NLP, Computer Vision, or other specialized AI fields.
• Knowledge of regulatory requirements related to AI/ML (e.g., GDPR, CCPA).
• Familiarity with MLOps tools and frameworks.
• Certification in AI/ML or Testing tools (e.g., ISTQB, TensorFlow certification).