Senior Data Engineer

2 weeks ago


Kuala Lumpur, Kuala Lumpur, Malaysia Wipro Full time

Direct message the job poster from Wipro

Candidates residing only in South East Asia region DM me | #Hiring @ Wipro

Get to know the Role

As the Data Engineer in the Fulfillment Data Engineering team, you will work closely with data modelers, product analytics, product managers, software engineers, and business stakeholders across the SEA in understanding the business and data requirements. You will be responsible for building and managing the data asset, including acquisition, storage, processing, and consumption channels, and using some of the most scalable and resilient open-source big data technologies like Flink, Airflow, Spark, Kafka, and more on cloud infrastructure. You are encouraged to think out of the box and have fun exploring the latest patterns and designs.

The Day-to-Day Activities

  1. Developing scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of data sources.
  2. Developing a deep understanding of real-time data production availability to inform on the real-time metric definitions.
  3. Maintaining and optimizing the performance of our data analytics infrastructure to ensure accurate, reliable, and timely delivery of key insights for decision making.
  4. Design and deliver the next-gen data lifecycle management suite of tools/frameworks, including ingestion and consumption on the top of the data lake to support real-time, API-based and serverless use-cases, along with batch as relevant.

The Must-Haves

  1. At least 5+ years of relevant experience in developing scalable, secured, distributed, fault-tolerant, resilient & mission-critical Big Data platforms.
  2. Proficiency in at least one of the programming languages Python, Scala, or Java.
  3. Strong understanding of big data and related technologies like Flink, Spark, Airflow, Kafka, etc.
  4. Experience with different databases – NoSQL, Columnar, Relational.
  5. You have a hunger for consuming data, new data technologies, and discovering new and innovative solutions to the company's data needs.
  6. You are organized, insightful, and can communicate your observations well, both written and verbally to your stakeholders to share updates and coordinate the development of data pipelines.

The Nice-to-Haves

  1. You have a degree or higher in Computer Science, Electronics or Electrical Engineering, Software Engineering, Information Technology, or other related technical disciplines.
  2. You have a good understanding of Data Structures, Algorithms, or Machine Learning models.
Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

IT Services and IT Consulting

#J-18808-Ljbffr
  • Senior Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Robert Walters Full time

    Our client is seeking a Senior Data Engineer for a 12+ month contract (extendable) to play a pivotal role in developing data-driven solutions within their healthcare business. This is an exciting opportunity to work with a leading healthcare group, where you will be instrumental in introducing innovation for the healthcare industry and creating a...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Finexus Group Full time

    Senior Software Engineer, Data EngineeringAs a Senior Data Engineer, you will be responsible for designing, developing, and optimizing data infrastructure and pipelines, ensuring data integrity, and enabling analytics and machine learning initiatives. You will work closely with data scientists, analysts, and software engineers to architect and implement data...

  • Senior Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Borong Full time

    Borong Federal Territory of Kuala Lumpur, MalaysiaSeasoned Talent Acquisition Expert | Extensive experience sourcing top talent | Strategic and data-driven approach | Committed to building exceptional…Job SummaryBorong Sdn Bhd is looking for an experienced Senior Data Engineer to lead the design and maintenance of our data infrastructure. You will be...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Luxoft Full time

    Luxoft is looking for a Senior Big Data Engineer to join their team. As a Senior Big Data Engineer, you will play a key role in designing and implementing big data solutions using Hadoop ecosystem tools.The company has a global network of more than 500 branches and offices in 19 countries and territories, with a history of over 80 years in the banking...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Avensys Consulting Full time

    About Avensys ConsultingAvensys is a reputable global IT professional services company headquartered in Singapore.We provide enterprise solution consulting, business intelligence, business process automation and managed services to clients across various industries.This opportunity is ideal for a mid-senior level data engineer looking to expand their skill...

  • Senior Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia HFG Insurance Recruitment Full time

    Get AI-powered advice on this job and more exclusive features.Consultant | Specialized in recruiting talents within the Insurance spaceKey Responsibilities:Design, develop, document, and implement data pipelines and integration processes, including ETL/ELT jobs and workflows.Perform data analysis, profiling, cleansing, lineage, mapping, and transformation to...


  • Kuala Lumpur, Kuala Lumpur, Malaysia The Chemical Engineer Full time

    About usAt ExxonMobil, our vision is to lead in energy innovations that advance modern living and a net-zero future. As one of the world's largest publicly traded energy and chemical companies, we are powered by a unique and diverse workforce fueled by the pride in what we do and what we stand for.The success of our Upstream, Product Solutions and Low Carbon...

  • Data Engineer

    3 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Hyppies Full time

    Data Engineer (Senior to Principal Levels)Hyppies Kuala Lumpur, Federal Territory of Kuala Lumpur, MalaysiaJoin to apply for the Data Engineer (Senior to Principal Levels) role at Hyppies2 days ago Be among the first 25 applicantsResponsibilities:Build and maintain efficient data pipelines and ETL processes using Python, focusing on native coding over...

  • Senior Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia Capco Full time

    MalaysiaJoining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to #BeYourselfAtWork. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent as we can and we...


  • Kuala Lumpur, Kuala Lumpur, Malaysia AirAsia Full time

    Hiring CompanyTBD BIGLIFE Sdn. Bhd.Job DescriptionWhy AirAsia MoveAre you ready to take off and be part of AirAsia Move? AirAsia Move is the latest offering from AirAsia Group, focused on leveraging cutting-edge technologies to build and scale data-driven products and services across the travel, e-commerce, and logistics ecosystems. We are transforming the...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Arvato Systems Malaysia Full time

    This job is for a Senior Data Engineer who designs and maintains the backbone of data systems. You might like this job because you'll work with the latest tools to optimize data flow, collaborating with scientists to enhance analytics and machine learning projects.Responsibilities:Selects the right tools and technologies for data ingestion, transformation,...


  • Kuala Lumpur, Kuala Lumpur, Malaysia The Chemical Engineer Full time

    Job OverviewThis is an exciting opportunity to join our team of experts in Process Safety Engineering.As a key member of our Kuala Lumpur Process Safety team, you will work closely with various business lines, collaborating with our community of Process Safety discipline experts and senior technical professionals around the world to deliver engineering...

  • Senior Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia GREAT EASTERN Full time

    As a LIFE company, our customers are at the heart of all that we do. Being one of Asia's leading insurers for over a century, we have built a long-lasting legacy of trust with our customers over many generations. At the foundation of this trust is Integrity, Initiative, and Involvement – from the way we treat every customer relationship with honesty and...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Hyppies Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our team at Hyppies. As a key member of our engineering department, you will be responsible for building and maintaining efficient data pipelines using Python.You will work closely with stakeholders to understand data needs and develop technical solutions that drive business...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Alibaba Cloud Full time

    Job SummaryWe are looking for an experienced Senior Data Center Facilities Engineer to join our team at Alibaba Cloud.The successful candidate will be responsible for leading the design and implementation of data center facilities, including electrical systems, mechanical systems, and fire suppression systems. They will work closely with internal and...

  • Senior EHS Advisor

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia SP Data Centers Full time

    Direct message the job poster from SP Data CentresHead of Client Services | Data Centres | Australia | APACHSEQ Senior Advisor for a leading Engineering firmAre you passionate about sustainable development and making a meaningful impact? SP Data Centres are delighted to be partnering with a global engineering team to help shape a better world. For over 75...

  • senior data analyst

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia CTOS Data Systems Full time

    We are Malaysia's leading Credit Reporting Agency (CRA) and we are aggressively expanding our business, looking for dynamic, driven, and motivated individuals to join our team. Our Direct-To-Consumer segment (D2C) is one of our fastest-growing product areas in the market, with an abundance of expansion plans and innovative ideas on hand.Job Summary:CTOS Data...


  • Kuala Lumpur, Kuala Lumpur, Malaysia 婵物捨 Full time

    The Opportunity:Zurich Edge is looking for a motivated and versatile professional to join our team as Senior Data Engineer. This position focuses on two key areas: supporting activities related to database administration and data engineering to create a robust and efficient data ecosystem.Key Responsibilities:Database AdministrationResponsible for managing...

  • Big Data Engineer

    2 weeks ago


    Kuala Lumpur, Kuala Lumpur, Malaysia HTC Global Services Full time

    Mid-Senior Level Data Engineer PositionWe are seeking a Mid-Senior Level Data Engineer to join our team. The successful candidate will have experience in designing and developing data pipelines, working with cross-functional teams, and analyzing complex data issues.Key Responsibilities:Design and develop data pipelines using AWS services.Collaborate with...


  • Kuala Lumpur, Kuala Lumpur, Malaysia Bybit Full time

    Bybit Federal Territory of Kuala Lumpur, Malaysia1 month ago Be among the first 25 applicantsResponsible for the architecture design and development of the company's Big data platform, providing solutions for platform architecture and Performance optimization, and leading the rapid iteration of the Big data platformResponsible for the construction of data...