Description
We are looking for a Big Data Engineer to join our team! The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environments e.g., Cloudera Data Platform.
The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as per business requirements.
The candidate will also be integrating data sets to provide seamless data access to users.
Responsibilities
Analyze and document the Authority's data requirements Optimize data collection by migrating to efficient channels Design and implement data engineering jobs and reporting solutions to meet analytical needs Develop and execute test plans and scripts for system and user acceptance testing Collaborate with technical teams to ensure smooth deployment and adoption Maintain IT solution operations and service levels Resolve production issues and ensure systems deliver high availability, performance, and security
Requirements
Minimum 4 years of experience managing data engineering projects in a big data environment, such as Cloudera Data Platform Strong understanding of analytics, data warehousing, and data modeling Proven ability to troubleshoot complex technical issues Expert-level SQL skills and proficiency in data analysis Hands-on experience with big data technologies including Python, PySpark, Linux, and ETL tools like Informatica Demonstrated success implementing systems using Hive, Impala, and Cloudera Data Platform Preferred experience with DevOps deployment, data virtualization (Denodo), and reporting/visualization tools (SAP BO, Tableau) Strong project management skills in both waterfall and Agile methodologies
We offer
By choosing EPAM, you're getting a job at Employee ideas are the main driver of our business.
We have a very supportive environment where your voice matters You will be challenged while working side-by-side with the best talent globally.
We work with top-notch technologies, constantly seeking new industry trends and best practices We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world.
You will learn, contribute, and grow with us How We Hire
Apply and tell us about yourself!
Go through some standard interviews:
- General interview with a recruiter - Technical interview with our technology experts - Manager interview or Offer interview with a hiring manager Get ready to join the team!
Life at EPAM
EPAM is a leading global provider of digital platform engineering and development services.
EPAM has been expanding in Singapore since and delivering the best solutions to our customers.
As a recognized leader, EPAM Singapore achieved Great Place to Work Certification in and is committed to providing our team with inspiring careers.
You will have the opportunity to work with fellow talented technologists and accelerate your career by participating in our numerous upskilling, training, and certification programs.
That is why EPAM Singapore was awarded Gold for Best In-House Certification Programmes in the Employee Experience Awards and Silver in the SkillsFuture Employers Awards for our efforts in championing employees' skills development and building a lifelong learning culture at the workplace.
You can also look forward to developing holistically with the multiracial festivals and various wellness and cultural activities organized by our passionate colleagues here.