Lead Data Engineer

Job description

Job Description

We are seeking an experienced Lead Data Engineer to join our team.

This role will lead our data engineering efforts, manage a team of data engineers, and work closely with stakeholders to deliver robust data solutions using Cloud technologies.

Responsibilities

• Lead and mentor a team of data engineers, fostering professional growth and technical excellence
• Architect, design, and implement scalable data pipelines and processing systems using AWS services
• Establish data engineering best practices, standards, and governance frameworks
• Collaborate with business stakeholders to understand requirements and translate them into technical solutions
• Drive technical vision and roadmap for data infrastructure and platforms
• Optimize existing data workflows for performance, reliability, and cost-effectiveness
• Provide technical leadership in designing data models and ETL/ELT processes
• Conduct code reviews and ensure high-quality implementations from team members
• Support stakeholders with data-related inquiries and problem-solving
• Present technical solutions to both technical and non-technical audiences

Requirements

Data Lake & Data Warehouse Expertise

• Proven experience designing and implementing enterprise data lake solutions
• Deep knowledge of data lake architecture patterns and best practices
• Experience with AWS Lake Formation and data cataloging solutions
• Strong understanding of data warehouse concepts, including star/snowflake schemas
• Hands-on experience optimizing query performance in data warehouse environments
• Knowledge of data partitioning, compression, and storage optimization techniques
• Experience implementing data governance and security controls across data platforms
• Understanding of medallion architecture (bronze/silver/gold) or similar data quality frameworks

Leadership & Soft Skills

• 2+ years of team leadership or management experience
• Proven ability to mentor junior engineers and develop team capabilities
• Excellent communication skills for collaborating with cross-functional teams
• Strong problem-solving abilities and analytical thinking
• Experience in translating business requirements into technical solutions
• Ability to manage multiple priorities in a fast-paced environment
• Customer-focused mindset with experience in stakeholder management

Data Engineering Core Principles

• Demonstrated expertise in implementing data pipeline patterns and architectures
• Strong understanding of data integration patterns and practices
• Experience with data validation and testing methodologies
• Knowledge of data security and compliance requirements

Good to Have Experience

• Experience with Databricks and Delta Lake architecture
• Knowledge of business intelligence tools, particularly PowerBI, Tableau and Qlik Sense
• Experience connecting data visualization tools to various data sources
• Familiarity with developing and maintaining data models for self-service analytics
• Experience with orchestrating end-to-end data pipelines from source systems through to visualization layers
• Understanding of semantic layer concepts and implementation approaches
• Cloud certifications (AWS Certified Data Analytics, Solutions Architect)

• 8+ years of experience in data engineering roles
• 4+ years of experience with AWS data services (including Glue, Redshift, S3, EMR, Lambda, Athena)
• Strong proficiency in SQL and at least one programming language (Python, Scala, or Java)
• Experience with big data technologies implementation on AWS (PySpark etc)
• Hands-on experience with data pipeline orchestration tools (Airflow, Step Functions)
• Knowledge of data modeling, database design, and optimization techniques
• Experience implementing data quality controls and monitoring frameworks
• Understanding of data warehousing concepts and dimensional modeling
• Experience with real-time data processing frameworks

BENEFITS & PERKS FOR WORKING AT OLLION

Our employees multiply their potential because they have opportunities to: Create a lasting Impact, Learn and Grow professionally & personally, Experience great Culture, and Be your Whole Self!

Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:

• Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
• We are a virtual-by-default, small but Global organization; ‘learn wherever, whenever’ frees our people from a rigid view of learning and growth
• Retirement planning (i.e. CPF, EPF, company-matched 401(k))
• Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens.
  
   Employees have access to a fully comprehensive benefits package to choose the medical, dental, and vision insurance plan that best fits their lives.
  
  In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.
• Generous time off and leave allowances
• And more!

Ollion is an equal opportunity employer.

We celebrate diversity and we are committed to creating an inclusive environment for all employees.

Ollion does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or other non-merit factor.

Required Skill Profession

Computer Occupations