The Data Scientist/AI-ML Engineer Lead Analyst (Open) plays a critical role in advancing and integrating Machine Learning (ML) and Artificial Intelligence (AI) capabilities within Internal Audit processes. This position requires a deep understanding and hands-on experience with AI/ML concepts, generative AI, agile methodologies, cloud computing, and AI agents. The role emphasizes utilizing AI and Large Language Model (LLM) techniques such as Retrieval-Augmented Generation (RAG) to build robust models and applications. A significant focus is placed on designing and refining prompts to ensure high-quality, contextually relevant outputs from generative AI models for various technical applications.

The Lead Analyst will collaborate extensively with Digital Solutions and Implementation (DSI) teams, audit teams, technology teams, and external stakeholders to prioritize, develop, and implement AI/ML use cases while adhering to model risk management practices. Success in this role demands strong technical expertise, excellent communication skills, and a forward-looking mindset to deliver innovative solutions that enhance the efficiency and effectiveness of audit processes.

Key Responsibilities:

• Lead the design, testing, deployment, and maintenance of Machine Learning models leveraging IBM Watson SaaS environment and other technologies
• Lead the enhancement of existing AI/ML capabilities through ideation, testing, and implementation in cloud environments
• Build and refine LLM-based applications by designing, testing, and optimizing prompts for generative AI models to ensure accuracy and contextual relevance
• Prepare and maintain Model Risk Management (MRM) documentation, ensuring optimal model performance and accuracy through regular reviews
• Collaborate with internal and external stakeholders on use case ideation, planning, development, and deployment
• Regularly communicate project progress, objectives, and milestones to diverse audiences, including senior leadership
• Identify opportunities to enhance audit efficiencies by leveraging ML/AI capabilities.
• Drive the adoption of emerging technologies and techniques to meet stakeholder needs and deliver innovative tools
• Apply strong project management skills to develop detailed project plans, track progress, and deliver results on time

Key Qualifications and Competences:

• 6–10 years of experience in Python coding, AI/ML model development, and deployment
• Proficiency in developing Machine Learning use cases within IBM SaaS/Watson environments (preferred)
• Deep understanding of supervised, unsupervised, semi-supervised, and reinforcement learning models, particularly in NLP/NLU
• Demonstrated expertise in working with generative AI models, including prompt engineering and performance optimization
• Experience testing and integrating APIs
• Strong statistical foundation with expertise in Machine Learning algorithms and techniques
• Proficiency in analytics and data visualization tools such as Tableau and Cognos (preferred)
• Ability to apply a strong understanding of business processes, risks, and controls to identify and implement audit innovations
• Forward-looking and imaginative approach to problem-solving and process improvement
• Comfortable operating in a fast-paced, results-driven environment with a change-oriented mindset
• Excellent communication and interpersonal skills to foster strong working relationships and collaboration
• Strong presentation skills, with the ability to confidently articulate ideas and respond to challenges in public forums
• Expertise in agile and waterfall project management methodologies, with experience using tools like JIRA (preferred)
• Positive attitude, self-starter mentality, and accountability for project delivery
• Ability to consider the broader implications of decisions across functions and units
• Familiarity with financial services and/or auditing processes is a plus

Education:

• Bachelor’s degree in Data Science, Computer Science, MIS, or related discipline
• PMP, Agile/Scrum, Cloud Computing, or related certifications are a plus
• Master’s degree or PhD is a plus

------------------------------------------------------

Job Family Group:

Decision Management

------------------------------------------------------

Job Family:

Specialized Analytics (Data Science/Computational Statistics)

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Primary Location:

New York New York United States

------------------------------------------------------

Primary Location Full Time Salary Range:

$157,040.00 - $235,560.00

In addition to salary, Citi’s offerings may also include, for eligible employees, discretionary and formulaic incentive and retention awards. Citi offers competitive employee benefits, including: medical, dental & vision coverage; 401(k); life, accident, and disability insurance; and wellness programs. Citi also offers paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays. For additional information regarding Citi employee benefits, please visit citibenefits.com. Available offerings may vary by jurisdiction, job level, and date of hire.

------------------------------------------------------

Anticipated Posting Close Date:

Jan 20, 2025

------------------------------------------------------

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting