Client Description
Major digital and media solutions provider in Hong Kong
Job Description
Candidates with less experience will be considered as Data Engineer.
Responsibilities
Build up best in class data infrastructure, data engineering solutions.
Work with cross-functional teams within the organization of different countries, and working with PB size of data, by using modern data technologies (AWS, Databricks, Confluent Kafka, dbt, etc.).
Leverage industry best practices to build highly flexible, scalable and cost-effective data pipelines and platforms.
Manage data lakehouse architecture and self-service tools. Ensure that data is highly available and reusable for enabling data science initiatives, analytics and end users to drive business growth.
Develop efficient clean code, improve existing code for better performance, code review, execute code builds to test and production environments.
Manage and lead several data projects.
Job Requirements
To be successful in your new position, it is essential to have the following skills:
Degree in Computer Science, Information System, Actuarial or related discipline.
At least 5 years of working experience in data warehouse, ETL, BI, Big data areas and broad exposure to all its sub-disciplines.
Strong in SQL, Python/Scala.
Experience working with large, complex and multiple data sets from various sources.
Expert in data architecture, data modelling and design, data pipeline and data integration.
Hands-on experience in using big data components such as Hive, Spark, Presto, Python and Airflow.
Experience in AWS (EC2, S3, Kinesis/Kafka, Athena, Redshift), Google Cloud or other Public cloud environments is a must.
Experience leading a small team of data engineers is a plus.
Working experience in the digital, e-commerce industry, mobile app and web environment is highly desirable.