Senior Data Engineer

4 hours ago

Petaling Jaya, Selangor, Malaysia Talentbook Solutions Full time $60,000 - $180,000 per year

Urgent opening for Senior Data Engineers (3 positions open) ... must be able to work EMEA hours 4pm to 1am Malaysian time (hybrid) and you must be in Malaysia currently

  1. 5+ years experience for Senior level

  2. Perm employment with top notch US Delivery Center in MY

As part of the Data Science and Analytics Team, the Senior Data engineer will partner with Data

Scientists and work hands-on with Big Data technologies and build a scalable infrastructure to

support development of machine learning based Audience Propensity Models and solutions for our

domestic and global businesses. The Senior Data engineer's responsibilities include collaborating

with internal and external stakeholders to identify data ingestion, processing, ETL, data

warehousing requirements and developing appropriate solutions using modern data engineering

tools in cloud. We want this person to help us build a scalable data lake and EDW using modern

tech stack from the ground up. Success in this role comes from combining a strong data engineering

background with product and business acumen to deliver scalable data pipeline and database

solutions that can enable & support a high-performance, large-scale modeling infrastructure. The

Senior Data Engineer will be a champion of the latest Cloud database technologies & data engineering tools.

Requirements


• Background in data pipelining, warehousing, ETL development solutions for data science

and other Big Data applications


• 5 years of Snowflake Expertise – Strong experience developing data engineering/ETL/Dataware housing solutions


• 5 years of experience with distributed, columnar and/or analytic oriented databases or distributed data processing frameworks.


• Minimum of 5 years of experience with Cloud databases –Snowflake, Azure SQL database,

AWS Redshift, Google Cloud SQL or similar. Experience with NoSQL databases such as

mongoDB, Cassandra or similar


• Minimum of 5 years of experience in developing data ingestion, data processing and

analytical pipelines for big data, relational databases, data lake and data warehouse

solutions


• Minimum of 5 years of hands-on experience in Big Data technologies such as Hadoop, Spark,

PySpark, Spark/SparkSQL, Hive, Pig, Oozie and streaming technologies such as Kafka, Spark

Streaming Ingestion API, Unix shell/Perl scripting etc.


• Strong programming skills using Java, Python, PySpark, Scala or similar


• 5 years of experience with public cloud architecture, pros/cons, and migration

considerations.


• 5 years of Experience with container-based application deployment frameworks

(Kubernetes, Docker, ECS/EKS or similar)


• Experience with Data Visualization tools such as Tableau, Looker or similar


• Outstanding troubleshooting, attention to detail, and communication skills (verbal/written)

in a fast-paced setting.


• Bachelor's degree in Computer Science or relevant discipline or 7+ years of relevant work

experience.

Preferred Qualifications:


• Snowflake and databricks certification will be a plus


• Ability to work in white space and be able to develop solutions independently.


• Prior experience with Cloud based ETL tools such as AWS Glue, AWS Data pipeline or

similar


• Experience with building real-time and streaming data pipelines a plus


• Experience with MLOps tools such as Apache MLFlow/KubeFlow is a plus


• Exposure to E2E ML platform such as AWS Sagemaker, Azure ML studio, Google AI/ML,

Datarobot, Databricks or similar a plus


• Experience with ingestion, processing and management of 3rd party data

  • Senior Data Engineer

    2 hours ago

    Petaling Jaya, Selangor, Malaysia STRATEQ GROUP (Strateq Sdn Bhd) Full time 120,000 - 180,000 per year

    About the role We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at STRATEQ GROUP. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining robust data infrastructure and pipelines to support the company's data-driven initiatives. This is a full-time position based in Petaling...

  • Senior Hybrid Data Center Engineer

    2 weeks ago

    Petaling Jaya, Selangor, Malaysia NTT DATA, Inc. Full time 120,000 - 240,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Key Responsibilities:Technical...

  • Senior Hybrid Data Center Support Engineer

    2 weeks ago

    Petaling Jaya, Selangor, Malaysia NTT DATA Asia Pacific Full time 90,000 - 120,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Key Responsibilities:Technical...

  • TS Implementation Engineer

    2 days ago

    Petaling Jaya, Selangor, Malaysia NTT DATA Full time 40,000 - 80,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe associate...

  • Data Engineer

    2 hours ago

    Petaling Jaya, Selangor, Malaysia Avinity Analytics Full time 48,000 - 60,000 per year

    DATA ENGINEER at a Data Consultancy & Data Solutions ProviderSalary: RM4000 - RM6000Position: Senior Data EngineerJOB OVERVIEWJoin Avinity Analytics where we focus on providing you with the best training and education in data engineering, as well as relevant data projects that will help you gain the necessary experience to advance your career.There are...

  • Product and Pricing Senior Executive

    2 days ago

    Petaling Jaya, Selangor, Malaysia NTT DATA Full time 120,000 - 180,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe role of a...

  • Network Engineer

    4 hours ago

    Petaling Jaya, Selangor, Malaysia NTT DATA Full time

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Network...

  • Data Engineer Intern

    2 days ago

    Petaling Jaya, Selangor, Malaysia Hilti (Malaysia) Sdn Bhd Full time 30,000 - 60,000 per year

    What's the role? In the role of Data Engineer intern, you will be developing, deploying, and maintaining data pipelines to support analytics and data science on a Hilti group level. Embedded in the global enterprise data lake team you will work closely with leading experts in the field of data engineering. You will interact with key stakeholders from...

  • Network Engineer

    4 hours ago

    Petaling Jaya, Selangor, Malaysia NTT DATA Full time

    Continue to make an impact with a company that is pushing the boundaries of what is possible. At NTT DATA, we are renowned for our technical excellence, leading innovations, and making a difference for our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can continue to grow, belong, and thrive.Your career here...

  • Internship - Data Engineer

    2 days ago

    Petaling Jaya, Selangor, Malaysia Hilti (Malaysia) Sdn Bhd Full time 80,000 - 120,000 per year

    What's the role? In the role of Data Engineer intern, you will be developing, deploying, and maintaining data pipelines to support analytics and data science on a Hilti group level. Embedded in the global enterprise data lake team you will work closely with leading experts in the field of data engineering. You will interact with key stakeholders from...