Senior AI Test Engineer - Embedded LLM

Posted:
10/29/2024, 5:53:44 AM

Location(s):
Quebec, Canada ⋅ Montreal, Quebec, Canada

Experience Level(s):
Senior

Field(s):
AI & Machine Learning ⋅ Software Engineering

A Moving Experience.

We are seeking a skilled and detail-oriented AI Test Engineer with LLM experience to join our dynamic team at Cerence. As an AI Test Engineer you will be responsible for testing, evaluating, and optimizing LLM models and AI systems tailored for automotive environments. You will ensure the quality, safety, and performance through the design and execution of comprehensive testing strategies, ensuring the AI systems meet both functional and non-functional requirements.

But that's not all! As a Cerence team member, you'll also:   

  • Collaborate with cross-functional teams to understand product requirements, LLM development processes, and integrate testing within Cerence's automotive software solutions. 
  • Design and develop test suites, and conduct unit tests, integration tests, and accuracy tests on hardware prototypes or actual vehicles.
  • Analyze the performance of LLM-based systems in terms of processing speed, scalability, and efficiency.
  • Develop and maintain automated testing tools to streamline testing of AI models and data pipelines. Ensure data integrity through continuous monitoring and verification.
  • Provide clear documentation of test results, defects, and performance issues. Report findings to stakeholders with actionable insights and recommendations for improvement.
  • Stay updated with the latest advancements in AI testing techniques and technologies, implementing best practices to continuously improve our testing processes.

Who you are: 

  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, Artificial Intelligence or related field. 
  • Proven experience in software testing, with a focus on AI/ML models and systems. Familiarity with testing tools, automation frameworks, CI/CD pipelines.
  • Solid understanding of machine learning algorithms and concepts, and data validation techniques.
  • Strong embedded programming skills (C/C++) and proficiency in software development using embedded machine learning hardware accelerators (NPU, GPU).
  • Excellent problem-solving skills, attention to detail, and ability to work effectively in a collaborative team environment. 
  • Strong communication skills and ability to effectively communicate technical concepts to non-technical stakeholders. 
  • Familiarity with automotive software development processes, standards, and protocols is a plus. 

Cerence Inc. (Nasdaq: CRNC and www.cerence.com) is the global industry leader in creating unique, moving experiences for the automotive world. Spun out from Nuance in October 2019, Cerence is a new, independent company that has quickly gained traction as a leader in the automotive voice assistant space, working with all of the world’s leading automakers – from Ford and Fiat Chrysler to Daimler, Audi and BMW to Geely and SAIC – to transform how a car feels, responds and learns. Its track record is built on more than 20 years of industry experience and leadership and more than 500 million cars on the road today across more than 70 languages.  

 

As Cerence looks to the future and continues an ambitious growth agenda, we need someone to join the team and help build the future of voice and AI in cars. This is an exciting opportunity to join Cerence’s passionate, dedicated, global team and be a part of meaningful innovation in a rapidly growing industry. 

EQUAL OPPORTUNITY EMPLOYER

Cerence is firmly committed to Equal Employment Opportunity (EEO) and to compliance with all federal, state and local laws that prohibit employment discrimination on the basis of age, race, color, gender, gender identity, gender expression, sex, sex stereotyping, pregnancy, national origin, ancestry, religion, physical or mental disability, medical condition, marital status, citizenship status, sexual orientation, protected military or veteran status, genetic information and other protected classifications. Cerence Equal Employment Opportunity Policy Statement.

All prospective and current Employees need to remain vigilant when it comes to executing security policies in the workplace. This includes:


- Following workplace security protocols and training programs to familiarize with the ways to maintain a safe workplace.
- Following security procedures to report any suspicious activity.
- Having respect for corporate security procedures to allow those procedures to be effective.
- Adhering to company's compliance and regulations.
- Encouraging to follow a zero tolerance for workplace violence.

- Basic knowledge of information security and data privacy requirements (e.g., how to protect data & how to be handling this data).

- Demonstrative knowledge of information security through internal training programs.