Senior Starburst Engineer

Posted:
8/29/2024, 5:11:36 AM

Location(s):
Ontario, Canada ⋅ Mississauga, Ontario, Canada

Experience Level(s):
Senior

Field(s):
DevOps & Infrastructure ⋅ Software Engineering

About the team

ISG Technology strives to provide measurable competitive advantage to our business by delivering high quality, innovative and cost-effective data technology and operational solutions to meet the needs of the business, our clients, our regulators and stakeholders.

Olympus is a next generation Data Fabric to streamline data sources across ICG and enable industry-leading analytics, client, regulatory, surveillance, supervisory, risk & finance reporting and data science solutions that are Accurate, Reliable, Relevant, Consistent, Complete, Scalable, Timely, Secure, Nimble. Olympus is built on a Big Data platform and technologies under Cloudera distribution, like HDFS, Hive, Impala, Spark, YARN, Sentry, Oozie, Kafka. Our team interfaces with a vast client base and works in close partnership with Operations, Development and other technology counterparts running the application production platform, providing quick resolutions and timely communications to their issues, and driving improvements to stability and efficiency practices to help us and the business succeed.

About the Role

In the Senior Starburst Engineer role, you are required to have hands-on Starburst/Trino administration experience on Starburst Enterprise Platform (SEP) and have a good grasp of configuring the cluster parameters for the best user experience. Strong data warehousing skills, focus on databases and multi-petabyte database experience is expected. As an administrator, ability to analyze database plans, implement performance improvements, disaster recovery plans and guidance on best practices is essential. You will be working with the global team responsible for modernizing and optimizing technology platforms, infrastructure, and technology controls, as well as develop engineering solutions to increase system reliability, availability, and performance. You are expected to be a self-starter, working with minimal supervision in a fast-paced and challenging environment.

Key responsibilities include:

  • Mastery of Data Logic: Expertise in crafting complex stored procedures, enhance existing database code, and fine-tune queries, ensuring top-notch performance and reliability, even with intricate data structures.

  • End-to-End Ownership: Take charge of the entire administration process, from setting standards, implementing security controls, debugging, query improvements and monitoring system performance.

  • DevOps Mindset: Focus on standardizing, improving the DevOps Process. enhance lower environment and application ecosystem stability, reduce operation support cost, and Improve overall Developer experience.

  • Autonomy and Mentorship: Operate with a high level of autonomy, providing valuable insights as a subject matter expert to senior stakeholders and mentorship to junior analysts.

  • Problem Solving: Address complex data-related challenges with creative and effective solutions, enabling the organization to overcome obstacles and achieve its objectives.

  • Documentation and Knowledge Sharing: Maintain thorough documentation of data models, processes, and best practices while actively sharing knowledge within the team and the broader organization.

Requirements/Qualifications:

  • Years of Experience: at least 12 years of relevant experience in Database Administration and Engineering.

  • Educational Qualification: Degree in computer science, computer engineering or a related field.

  • Starburst Proficiency:

    • Cluster tuning, monitoring and analysis and optimization of Starburst query plans

    • Knowledge of Installation and upgrade of Starburst Enterprise platform (SEP) or Trino

    • Update cluster configuration files, catalog properties for data source configuration and permissions

    • Service management of the cluster (start/stop/restart/status)

    • Collection, debugging and analysis of logs and Java thread dumps from Splunk

    • Defining UDFs using custom binary files/code

    • Build and support materialized views

    • Good to have : knowledge of Apache Ranger and Starburst connectors such as Hive, Tableau, Elasticsearch, Kafka, Oracle and Iceberg

  • Data Prowess: Proven hands-on experience in database architecture, and administration, along with a knack for emerging BigData technologies.

  • Motivated; Proactive, meticulous, and tenacious self-starter.

  • Performance Optimization: A track record of excelling in query performance tuning and database optimization, particularly with complex datasets.

  • Scripting Skills: Proficiency in scripting languages such as Python and Linux shell, with exposure to other database technologies like Oracle, Impala, Spark.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Technology Quality

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Citi is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Citigroup Inc. and its subsidiaries ("Citi”) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View the "EEO is the Law" poster. View the EEO is the Law Supplement.

View the EEO Policy Statement.

View the Pay Transparency Posting