Lead Data Engineer

A leading organisation is seeking a highly skilled Lead Data Engineer to spearhead the development and optimisation of Snowflake-based solutions that underpin advanced AI and data initiatives. This role offers you the opportunity to shape scalable infrastructure, drive legacy data warehouse migration, and build robust ETL/ELT pipelines, all while collaborating closely with business stakeholders and technical teams.

What you'll do:

As Lead Data Engineer - Snowflake, Cloud and AI, you will be entrusted with architecting sophisticated data solutions that drive the organisation's most critical AI initiatives. Your day-to-day responsibilities will involve analysing diverse sources of raw data to create actionable datasets for business intelligence and advanced analytics. You'll design scalable pipelines that transform this information into valuable assets within the company's centralised warehouse. By developing intuitive data marts, you'll empower stakeholders across departments to make informed decisions. Your expertise will be essential in proposing enhancements to existing models while overseeing the migration of legacy systems onto modern Snowflake infrastructure. You'll champion governance best practices-ensuring robust security protocols are always maintained-and provide vital support for AI projects through expert-level integration techniques. Working alongside talented colleagues from various disciplines, you'll help deliver innovative solutions that set new benchmarks for excellence in cloud-based analytics.

• Analyse internally and externally sourced raw data to generate business intelligence and advanced analytics datasets tailored to stakeholder requirements.
• Design scalable data pipelines that curate sourced data into the in-house data warehouse, ensuring reliability and efficiency.
• Develop data marts that facilitate seamless dataset consumption by both business users and IT professionals.
• Propose changes to data models that align with established in-house data warehouse standards for optimal performance.
• Define and execute comprehensive migration activities from legacy databases to the Snowflake-based data warehouse environment.
• Implement and manage Snowflake governance protocols including access control, data security measures, and usage monitoring systems.
• Support AI use cases through meticulous data preparation and integration processes that enable advanced machine learning applications.
• Collaborate with cross-functional teams-including data scientists, ML engineers, and business stakeholders-to deliver impactful data-driven solutions.
• Design and implement ETL/ELT processes specifically tailored for AI and machine learning model development.
• Select and manage cloud-based data storage solutions to ensure scalability, security, and cost-effectiveness.

What you bring:

In the Lead Data Engineer - Snowflake, Cloud and AI role, your proven experience will be instrumental in driving transformative change across the organisation's digital landscape. Your academic background in computer science or related fields provides a solid foundation for tackling complex challenges. With several years spent implementing Snowflake Data Cloud solutions at scale, you bring deep technical insight into optimising performance while maintaining rigorous governance standards. Your proficiency with ETL/ELT frameworks ensures seamless integration of disparate datasets into unified warehouses. Experience with MLOps tools enables you to support advanced machine learning deployments efficiently. You have successfully migrated legacy systems onto modern cloud platforms-demonstrating adaptability and forward-thinking problem-solving skills. Your strong grasp of SQL programming allows you to design intuitive models that power business intelligence efforts. Collaborative by nature, you excel at engaging stakeholders from both technical and non-technical backgrounds-translating requirements into actionable outcomes. Certification as a SnowPro Data Engineer further highlights your dedication to continuous learning. Familiarity with cutting-edge technologies such as LLMs or generative AI positions you at the forefront of industry trends. Above all else, your interpersonal skills foster an environment where teamwork thrives-ensuring every project benefits from shared knowledge and mutual support.

• Bachelor's or Master's degree in Computer Science, Information Technology, Engineering or a related quantitative discipline is required for this position.
• At least 4-5 years of hands-on experience implementing Snowflake Data Cloud in production environments is essential for success.
• Demonstrated expertise in ETL/ELT tools such as AWS Glue, dbt, Talend or Informatica is highly valued.
• Experience with MLOps tools including MLflow, Docker or LangChain will be beneficial for supporting AI workflows.
• Proven track record in migrating legacy databases to cloud-based architectures is necessary for this role.
• Solid understanding of data modelling principles, SQL programming skills and BI/Analytics concepts is expected.
• Ability to work collaboratively with business teams to deliver strategic data solutions aligned with organisational goals is crucial.
• Familiarity with Snowflake governance best practices including access control and usage monitoring is important.
• Certification as a SnowPro Data Engineer demonstrates your commitment to professional excellence.
• Deep knowledge of Snowflake performance optimisation techniques as well as governance and security protocols is required.
• Experience with cloud technologies such as AWS RDS, AWS Fargate, AWS S3 or Azure adds significant value.
• Familiarity with relational databases like PostgreSQL or MS SQL enhances your ability to integrate diverse systems.
• Strong programming skills in Python or Java are necessary for building robust pipelines.
• Understanding of LLMs (Large Language Models), RAG pipelines (Retrieval-Augmented Generation) and generative AI deployment is advantageous.
• Excellent communication skills combined with proven stakeholder engagement abilities are key for collaborative success.
• Ability to manage multiple priorities independently while maintaining a proactive approach towards continuous improvement.

What sets this company apart:

This organisation stands out for its unwavering commitment to employee wellbeing, professional growth, and inclusivity within the workplace. Located in Petaling Jaya-a vibrant hub for technology talent-you'll find yourself surrounded by knowledgeable colleagues who value collaboration above all else. Flexible working opportunities allow you to balance personal commitments without compromising on career progression. Generous pension contributions reflect the company's dedication to long-term financial security for its staff members. Comprehensive training programmes ensure you remain at the cutting edge of technological advancements while nurturing your own skillset through ongoing development initiatives. Supportive leadership fosters an open environment where ideas are welcomed from every corner of the team-creating a culture built on trust, respect, and shared achievement. Whether you're looking to expand your expertise or contribute meaningfully to transformative projects, this organisation provides the resources needed for both personal fulfilment and professional success.

Do note that we will only be in touch if your application is shortlisted.

Agensi Pekerjaan Robert Walters Sdn Bhd

Business Registration Number : T

Licence Number : JTKSM 423C