Regional Data Engineer

About the Job:

We are looking for a proactive enthusiast who drives our data infrastructure and shares our overall vision of creating a better everyday life for the many people. As a Data Engineer, you take on regional responsibilities, striving to deliver high quality data products focusing on the following key responsibilities.

Job Description:

• Act as technical lead, driving the development of new/innovative capabilities and cutting-edge solutions, while enhancing, building and maintaining robust data infrastructure for optimal extraction, transformation, loading (ETL) and serving of data from wide range of (expanded) data sources. Prepare for the adoption and integration of AI technologies, leveraging data for advanced analytics, machine learning, and automation to unlock valuable insights.
• Identify, implement and lead internal process improvements by redesigning infrastructure to enhance greater scalability, optimizing data delivery, improving cost efficiency, and automating manual processes.
• Monitor, support and continuously enhance production pipelines to ensure data availability and data accuracy targets are consistently met.
• Define, design and optimise data modelling strategy within data lake, while establishing design standards, best practices and development methodologies to ensure our data models aligns with user needs and business goals.
• Collaborate with the Data Infrastructure Manager to identify, implement and drive ongoing enhancements, ensuring that the data architecture and infrastructure remain scalable, adhere to industry standards, and continually improve load time and cost efficiency.
• Work closely with stakeholders, including data/analytics, digital product and executive, to support, develop competence, share knowledge and address any data infrastructure needs or technical challenges.
• Lead documentation for data infrastructure, orchestration principles, coding standards and CI/CD pipeline(s), ensuring clear and accessible records for team members.
• Drive the development and maintenance of CI/CD pipeline(s), as well as manage the data solution code repository and code migration processes to ensure seamless deployment and version control.
• Collaborate and coordinate within our data and digital teams, business stakeholders, partners, and external vendors developing excellent data solutions and building long-term beneficial relationships.
• Be a part of a dynamic data team. Together we are putting data into co-workers hands and establish a data informed decision mindset.

Requirements:

• 8-10 years experience in designing, building, managing, and maintaining large-scale data solutions across diverse industries.
• Expert-level proficiency in SQL, data modelling concepts, analytics and implementation methods, with a proven ability to apply these skills in complex data environments.
• In-depth knowledge of cloud computing platforms, particularly Azure, and key data components including Azure Data Factory, Databricks and PySpark, Azure Synapse, and dbt.
• Exceptional skills in documenting data pipelines, data models and processes in a clear, structured and comprehensible manner, ensuring transparency and ease of understanding for cross-functional teams.
• You are curious, meticulous, flexible with a positive attitude and equipped with strong problem solving and communication skills.
• Excellent analytical and planning skills, with a drive for results and optimization.
• A passion to share knowledge and expertise, levelling up fellow junior team members.
• High proficiency in English, both written and verbal.

Working location

Mutiara Damansara, Selangor

Remuneration

up to MYR 13, months salary

Consultant in charge

Angel Chok | |