Overview
Data Engineer - Intelligence & Data at Shopee.
About The Team
The Marketplace Intelligence and Data team's mission is to build sustainable and efficient data and intelligence products to facilitate Shopee's business development.
The team is responsible for Shopee e-commerce data warehouse construction, merchant and operation data product construction, all-link traffic data, product algorithms (including product release, control, information optimization, SPU library and its comparison business), marketing algorithms (including Merchandising, Product Selection, Recommendation Algorithm, Evaluation Algorithms, User Profiling), and basic AI capabilities such as Machine Translation, Speech Algorithm, Image Algorithm, and Real-person Authentication.
The data team aims to build high-quality offline and real-time data warehouses for Shopee's e-commerce business, integrate diverse raw data, build consistent data models, and provide efficient data marts for different data application scenarios.
We are a data solution provider delivering stable, reliable and efficient data services for each data user in the company.
Job Description
Participate in the development work related to the Marketplace data warehouse, including data collection in offline and real-time data stores, data public layer construction, data application layer construction, and data governance.
Support data applications for various business modules; communicate requirements with different teams and design data architecture to provide data users with efficient solutions, including BI analysis, data products, and algorithm applications.
Explore and advance Marketplace key data technologies; optimize and improve existing data architecture, enhance data quality and productivity, including mass data processing, real-time processing, and application of new technologies.
Qualifications
Bachelor degree or above in computer-related field and 3+ years of working experience.
Familiarity with one or more big data processing technologies such as Spark, Flink, Hadoop, HBase, Kafka, Druid, Clickhouse, etc.
Proficiency in one or more programming languages, such as Java, Scala, Python, SQL, etc.
Familiar with data warehouse architecture and principles, with relevant experience in big data architecture design, model design and performance tuning.
Good thinking logic and communication skills, as well as strong project management and coordination abilities, and ability to communicate in English.
Seniority level
Not Applicable
Employment type
Full-time
Job function
Information Technology
Industries
Software Development
Internet Marketplace Platforms
Technology, Information and Internet
#J-18808-Ljbffr