Senior Hadoop Developer

5 days ago

Greater Kuala Lumpur, Malaysia Softenger Malaysia Full time 48,000 - 96,000 per year

Job Location: Kuala Lumpur

Job Type: Contractual

Salary: RM10000 Per month (Max)

Responsibilities
:

Big Data Development and Engineering:

  • Design, implement, and validate Hadoop-based solutions.
  • Analyze data requirements across multiple entities to develop and maintain data ingestion pipelines.
  • Troubleshoot MapReduce and Spark jobs, including performance tuning in production environments.
  • Develop reusable automated scripts for analytics and reporting activities.
  • Automate data validation steps and report generation.
  • Manage end-to-end data extraction, integration, and ensure accuracy, timeliness, and automation of data processes.

Scheduling & Production Support:

  • Design job schedules using scheduling tools and create configuration files for job schedulers.
  • Perform L2 batch production support to ensure smooth data pipeline operations.

Continuous Learning & Task Execution:

  • Independently develop and maintain technical knowledge, certifications, and relevant skills.
  • Handle day-to-day assignments effectively with moderate guidance and supervision.

Requirements:

Core Skills:

  • Analytical Skills:
    Ability to collect, organize, and analyze large datasets.
  • Attention to Detail:
    Strong capability to detect discrepancies, data trends, and ensure data accuracy.
  • Communication Skills:
    Ability to communicate clearly in writing and speech with business users.
  • Experience in
    Financial Reporting
    or
    Insurance
    domain is an added advantage.

Qualifications
:

  • BS/MS in Computer Science, Engineering, or a related field.
  • 5+ years of experience as a
    Hadoop Developer
    .
  • Proficient in
    Java
    and
    Scala
    .
  • Strong hands-on experience with
    Spark
    ,
    Hadoop MapReduce
    ,
    Hive
    , and distributed data processing frameworks.
  • Proficient with ETL tools such as
    Talend
    and
    Datastage
    .
  • Experienced with RDBMS databases:
    Oracle
    ,
    MySQL
    ,
    MS SQL Server
    .
  • Good to have experience with cloud platforms such as
    AWS
    ,
    Azure
    , or
    Google Cloud Platform (GCP)
    .
  • Hands-on experience in
    Linux system administration
    .
  • Strong communication and collaboration skills for working with distributed teams.
  • Analytical thinker with strong problem-solving abilities.

  • Senior Hadoop Developer

    7 days ago

    Greater Kuala Lumpur, Malaysia Chemcastle Sdn Bhd Full time 1,000,000 - 1,200,000 per year

    POSITION OVERVIEW : Software Development AnalystPOSITION GENERAL DUTIES AND TASKS :KEY DUTIES AND RESPONSIBLITIES : –· Design, implement and validate Hadoop solutions.· Troubleshoot MapReduce/Spark Jobs and do performance tuning in production environments.· Independently develop and sustain technical knowledge, certifications, and skills.· Effectively...

  • Developer - Informatica/Teradata/Hadoop

    5 days ago

    Greater Kuala Lumpur, Malaysia Luxoft Full time 900,000 - 1,200,000 per year

    Responsibilities:• Design, develop, and implement ETL solutions using Informatica PowerCenter and Teradata/Hadoop.• Perform data mapping, modeling, profiling, and build data marts aligned with business requirements.• Work on data integration, cleansing, transformation, and validation across heterogeneous data sources.• Develop and optimize SQL...

  • Bigdata and Hadoop Developer

    2 weeks ago

    Kuala Lumpur, Malaysia Purple Drive Technologies Full time

    **Must Have skills.** - Working experience of Hadoop, Hive SQL’s, Spark, Bigdata Eco System Tools. - Should be able to tweak queries and work on performance enhancement. - Preferable to have good technical knowledge on Cloud computing, AWS, or Azure Cloud Services. - Strong conceptual and creative problem-solving skills, ability to work with considerable...

  • Hadoop Bigdata Developer

    7 days ago

    Kuala Lumpur, Malaysia Net2source LLP Full time

    Working experience of Hadoop, Hive SQL's, Spark, Bigdata Eco System Tools. - Should be able to tweak queries and work on performance enhancement. - Preferable to have good technical knowledge on Cloud computing, AWS, or Azure Cloud Services. - Strong conceptual and creative problem-solving skills, ability to work with considerable ambiguity, ability to learn...

  • Bigdata Hadoop Developer

    5 days ago

    Kuala Lumpur, Malaysia Tata Consultancy Services Full time

    JD:- Need to work as a developer in Cloudera Hadoop. - Work on Hadoop, PySpark, Spark SQL, Hive, Bigdata Eco System Tools. - Experience in working with teams in a complex organization involving multiple reporting lines. - Create PySpark jobs for data transformation and aggregation. - Experience with stream-processing systems like...

  • Hadoop Developer

    1 week ago

    Kuala Lumpur, Malaysia Optimum Infosolutions (M) Sdn Bhd Full time

    Must have (maximum of 5 bullet points) 1. Good development, analytical and technical expertise in Tableau and MSTR HDFS, HIVE, SQL/HQL and other Hadoop ecosystems. 2. Production support knowledge/experience. Problem solving skills to manage the incident. 3. Minimum 2-4 years of development experience with 6-7 of working experience. Possess a hunger for...

  • Big Data Hadoop Developer

    5 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Unison Group Full time 80,000 - 140,000 per year

    Job Summary: We are looking for a Big Data Hadoop Developer to design, develop, and maintain large-scale data processing solutions. The ideal candidate should have strong hands-on experience with the Hadoop ecosystem and integration with relational databases such as MariaDB or Oracle DB for analytics and reporting.Key Responsibilities: Design, develop, and...

  • BigData Hadoop Developer

    7 days ago

    Kuala Lumpur, Kuala Lumpur, Malaysia Tata Consultancy Services (TCS) Full time 80,000 - 120,000 per year

    JD:Need to work as a developer in Cloudera Hadoop.Work on Hadoop, PySpark, Spark SQL, Hive, Bigdata Eco System Tools.Experience in working with teams in a complex organization involving multiple reporting lines.The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking...

  • Developer - Informatica/Teradata/Hadoop

    5 days ago

    Kuala Lumpur Centre, Kuala Lumpur, Malaysia LUXOFT MALAYSIA SDN. BHD. Full time 60,000 - 120,000 per year

    Project description Our Client a leading bank in Asia with a global network of more than 500 branches and offices in 19 countries and territories in Asia Pacific, Europe and North America are looking for Consultants to be part of the projectThe Technology and Operations function is comprised of five teams of specialists with distinct capabilities: business...

  • Junior Developer

    7 days ago

    Kuala Lumpur, Malaysia Tentacle Infotech Full time

    **Job Title**: Junior Developer - Global Data Warehouse (GDW) **Job Summary**: **Key Responsibilities**: **1. Data Engineering & ETL Development** - Develop and optimize ETL/data pipelines using **Informatica** or **SAS**. - Integrate data solutions with **Teradata (FSLDM, IFX, MDM, View Point, TASM)** and **Hadoop (HDFS, Hive, HUE, Scala)**. - Support...