Lead Data Engineer

Job description

Let’s be honest: there are lots of people out there doing what we do.

We’re just not convinced they’re doing it right.

Businesses are hungry for innovation and opportunity, but not at the cost of their independence.

At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust.

WORKING AT OLLION

Innovation is risky.

It demands bold steps and big questions, but that’s the price of making change.

We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference.

And we’re building a global team to do just that— a team capable of making game-changing breakthroughs without ever losing sight of the people it will impact.

This is more than consulting.

This is the change you can be.

THE OLLION DIFFERENCE

At Ollion, we’re all in on your independence.

Our teams are seasoned.

Our solutions are straightforward—sometimes even groundbreaking.

And our engagements?

Exactly as long as you want them to be.

We deliver fresh thinking and hard-earned insight in a way that works for you and your customers, arming your organization with everything you need to make your transformation truly mean something.

Progress matters more than process.

Our global team of cloud-native pros is all about creating new and better ways to work—not just by solving your tech challenges, but by using technology to solve your business challenges.

We keep the formulas, frameworks, and ten-point plans to a minimum, tackling your most pressing problems with a proprietary mix of good-old-fashioned ingenuity and refreshing humanity.

DIVERSITY AT OLLION

One of our cultural keystones, ‘Find the angle’ recognizes that every individual has different aspirations, needs and brings a unique perspective.

We value diversity, inclusion, and equity (DE&I) as core to our success.

We believe that a diverse workforce brings together unique perspectives, experiences, and ideas, leading to innovation, creativity, and better outcomes for our clients and our organization.

We are on a journey and are committed to building a workplace that celebrates and respects individuals from all backgrounds, including but not limited to race, ethnicity, gender, sexual orientation, age, disability, and cultural heritage.

As our commitment to diversity and inclusion is reflected in our:

• Awareness and sensitisation programs: to create awareness and sensitisation.
  
  We encourage open dialogue, active listening, and mutual respect, creating a safe and supportive environment for everyone to contribute their unique perspectives and ideas.
  
  
• Dedicated efforts to building diverse teams: that leverage the strength of our differences to tackle complex challenges and drive innovation.
  
  By embracing diversity, we broaden our collective knowledge, enhance problem-solving capabilities, and unlock limitless potential for our employees.
  
  

Job Description

We are seeking an experienced Lead Data Engineer to join our team.

This role will lead our data engineering efforts, manage a team of data engineers, and work closely with stakeholders to deliver robust data solutions using Cloud technologies.

Responsibilities

• Lead and mentor a team of data engineers, fostering professional growth and technical excellence
• Architect, design, and implement scalable data pipelines and processing systems using AWS services
• Establish data engineering best practices, standards, and governance frameworks
• Collaborate with business stakeholders to understand requirements and translate them into technical solutions
• Drive technical vision and roadmap for data infrastructure and platforms
• Optimize existing data workflows for performance, reliability, and cost-effectiveness
• Provide technical leadership in designing data models and ETL/ELT processes
• Conduct code reviews and ensure high-quality implementations from team members
• Support stakeholders with data-related inquiries and problem-solving
• Present technical solutions to both technical and non-technical audiences

Requirements

Data Lake & Data Warehouse Expertise

• Proven experience designing and implementing enterprise data lake solutions
• Deep knowledge of data lake architecture patterns and best practices
• Experience with AWS Lake Formation and data cataloging solutions
• Strong understanding of data warehouse concepts, including star/snowflake schemas
• Hands-on experience optimizing query performance in data warehouse environments
• Knowledge of data partitioning, compression, and storage optimization techniques
• Experience implementing data governance and security controls across data platforms
• Understanding of medallion architecture (bronze/silver/gold) or similar data quality frameworks

Leadership & Soft Skills

• 3+ years of team leadership or management experience
• Proven ability to mentor junior engineers and develop team capabilities
• Excellent communication skills for collaborating with cross-functional teams
• Strong problem-solving abilities and analytical thinking
• Experience in translating business requirements into technical solutions
• Ability to manage multiple priorities in a fast-paced environment
• Customer-focused mindset with experience in stakeholder management

Data Engineering Core Principles

• Demonstrated expertise in implementing data pipeline patterns and architectures
• Strong understanding of data integration patterns and practices
• Experience with data validation and testing methodologies
• Knowledge of data security and compliance requirements
• Commitment to automation, CI/CD, and infrastructure as code principles
• Experience with implementing logging, monitoring, and observability solutions

Good to Have Experience

• Experience with Databricks and Delta Lake architecture
• Knowledge of business intelligence tools, particularly PowerBI, Tableau and Qlik Sense
• Experience connecting data visualization tools to various data sources
• Familiarity with developing and maintaining data models for self-service analytics
• Experience with orchestrating end-to-end data pipelines from source systems through to visualization layers
• Understanding of semantic layer concepts and implementation approaches

Qualifications

• 8+ years of experience in data engineering roles
• 4+ years of experience with AWS data services (including Glue, Redshift, S3, EMR, Lambda, Athena)
• Strong proficiency in SQL and at least one programming language (Python, Scala, or Java)
• Experience with big data technologies (Spark, Hadoop ecosystem)
• Hands-on experience with data pipeline orchestration tools (Airflow, Step Functions)
• Knowledge of data modeling, database design, and optimization techniques
• Experience implementing data quality controls and monitoring frameworks
• Understanding of data warehousing concepts and dimensional modeling
• Experience with real-time data processing frameworks
• Knowledge of machine learning operations and data science workflows
• Familiarity with data mesh or data fabric architectures
• Cloud certifications (AWS Certified Data Analytics, Solutions Architect)

Additional Information

BENEFITS & PERKS FOR WORKING AT OLLION

Our employees multiply their potential because they have opportunities to: Create a lasting Impact , Learn and Grow professionally & personally, Experience great Culture , and Be your Whole Self !

Beyond an amazing, collaborative work environment, great people, and inspiring, innovative work, we have some great benefits and perks:

• Benchmarked, competitive, in-market total rewards package including (but not limited to): base salary & short-term incentive for all employees
• We are a virtual-by-default, small but Global organization; ‘learn wherever, whenever’ frees our people from a rigid view of learning and growth
• Globally, we build benefit plans that offer choices for whatever stage in life our employees are in and allow for flexibility as life happens.
  
  Employees have access to a fully comprehensive benefits package to choose the medical, dental, and vision insurance plan that best fits their lives.
  
  In addition to great healthcare coverage, we also offer all employees mental health resources and additional wellness programs.
  
  
• Generous time off and leave allowances
• And more!

Ollion is an equal opportunity employer.

We celebrate diversity and we are committed to creating an inclusive environment for all employees.

Ollion does not discriminate in employment on the basis of race, color, religion, sex (including pregnancy and gender identity), national origin, political affiliation, sexual orientation, marital status, disability, genetic information, age, membership in an employee organization, parental status, military service, or other non-merit factor.

Required Skill Profession

Database, Analytics & Bi