Etl Developer

5 months ago


Cyberjaya, Malaysia Esync Software Services Sdn Bhd Full time

We are seeking an experienced ETL (Extract, Transform, Load) Developer to join our

and maintaining robust ETL processes to ingest data from Mambu Stream into AWS

Kinesis and subsequently load it into AWS Redshift. This role requires strong expertise

in data integration, AWS services, and a solid understanding of financial data from

Mambu Stream.

**Responsibilities**:

- **System Analysis and Design**:_
- Analyze and understand data structures and formats in Mambu Stream.
- Design and architect ETL processes for efficient data extraction transformation, and loading into AWS Kinesis and AWS Redshift.

*
- _**ETL Development**:_
- Develop scalable and maintainable ETL workflows using industry-standard tools and frameworks.
- Implement data transformations and cleansing procedures to ensure data quality and integrity.

*
- _**Integration with Mambu Stream**:_
- Work closely with Mambu Stream APIs to extract financial data.
- Establish secure and reliable connections between Mambu Stream and AWS Kinesis.

*
- _**AWS Kinesis Implementation**:_
- Set up and configure AWS Kinesis streams to handle real-time data ingestion.
- Optimize the performance and scalability of Kinesis streams for efficient data processing.

*
- _**AWS Redshift Integration**:_
- Implement data loading processes from AWS Kinesis into AWS Redshift.
- Optimize Redshift tables and queries for optimal performance.

*
- _**Monitoring and Optimization**:_
- Implement monitoring solutions for ETL processes to ensure data accuracy and integrity.
- Proactively identify and address performance bottlenecks, ensuring optimal ETL performance.

*
- _**Documentation**:_
- Maintain comprehensive documentation for ETL processes, data mappings, and configurations.
- Create operational guides for troubleshooting and maintenance.

**Qualifications**:

- Bachelor’s degree in Computer Science, Information Technology, or related field.
- Proven experience in ETL development with a focus on financial data.
- Strong proficiency in AWS services, especially Kinesis and Redshift.
- Experience working with Mambu Stream APIs or any other Data Stream APIs.
- Proficient in programming languages like Python, SQL, and familiarity with relevant ETL tools.
- Knowledge of data warehousing concepts and best practices.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills for effective collaboration with cross-functional teams.

**Preferred Qualifications**:

- AWS Certification in relevant areas.
- Experience with real-time data processing and streaming analytics.
- Familiarity with data modeling and schema design in AWS Redshift.

**Job Types**: Full-time, Permanent

**Salary**: Up to RM6,000.00 per month

**Benefits**:

- Health insurance
- Maternity leave
- Opportunities for promotion
- Parental leave
- Professional development

Schedule:

- Day shift
- Monday to Friday

Supplemental pay types:

- 13th month salary
- Attendance bonus
- Performance bonus

**Education**:

- Bachelor's (required)

**Experience**:

- ETL: 3 years (required)

Ability to Commute:

- Cyberjaya (required)

Ability to Relocate:

- Cyberjaya: Relocate before starting work (preferred)


  • Data Migration Lead

    5 months ago


    Cyberjaya, Malaysia VHS Consulting Sdn Bhd Full time

    _**JOB DESCRIPTION**:_ - **Role: Migration and Sync Lead**_ Job Requirements and Responsibilities: - Prepare data migration plans including migration risk, milestones, quality and business sign-off details. - Manage assigned risks and monitor potential impacts as part of the data migration plan. - Develop best practice, processes, and standards for...