Senior Data Engineer

Job descriptionOur team

We are the Business Intelligence team. We lead the organisation in cultivating a data-driven culture as our company moves toward the future. We collect meaningful data and analytics for us to deeply understand our consumers and build more valuable products and services. What we do is incredibly important in driving smart marketing decisions, optimising our business, and increasing profitability.

Your role

At Deriv, we are looking for a detail-oriented Senior Data Engineer with the capability to define the data pipeline of our future data models. You will leverage technologies such as Google Cloud Platform, Airflow, Python, Docker, and PostgreSQL to help provide the company with dependable business intelligence solutions. As part of this role, you will develop, test, and maintain architectures for data processing and build Extract, Transform, and Load (ETL) pipelines. You will be a key contributor to making our data warehouse trustworthy by ensuring data accuracy.

Your challenges

Ensure data integrity while extracting data from in-house and third-party complex sources and manage its systematic storage. Responsible for data security, accuracy, and accessibilityProvide tangible business solutions and decisions using your expertise in the data engineering domainDesign and build high-performance, secure, and scalable company data warehouse and pipeline to support data science projects following best practicesDebug and resolve complex issues, and recommend improvements to ensure a well-functioning ETL pipelined architectureTransform raw data into easy-to-use tables for the Data AnalystsKeep up-to-date on company products and new releases to efficiently plan changes in our data warehouse or pipelines
What you have

A minimum of 5 years of experience in the data engineering fieldExpertise in data modelling techniques

such as Kimball star schema, Anchor modelling, and Data vaultCompetence in object-oriented or object function scripting languages such as PythonProficiency in relational SQL and NoSQL databases, preferably with PostgreSQL, PITR, Pg_basebackup, WAL archival, and ReplicationFamiliarity with column-oriented storage or data warehouses such as parquet, Redshift, and BigqueryIn-depth skills in developing and maintaining ETL/ELT data pipelines and workflow management tools such as AirflowHands-on experience with Google Cloud Platform (GCP) services such as BigQuery, scheduled queries, Cloud Storage and Cloud FunctionsFamiliar with alerting and self-recovery methods concerning data accuracyAnalytical skills with the ability to transform data into optimal business decisionsExpertise in peer reviewing pipeline codes and suggesting improvements when requiredExperience in helping teams make informed business decisions with dataStrong communication and presentation skillsFluency in spoken and written English

What's good to have

A good background in cybersecurity and data protectionProficiency in using data pipeline and workflow management tools such as LuigiExposure to maintaining and monitoring database health and resolving errorsExperience in managing stakeholders expectations and technical requirement gatheringFamiliarity with container technologies such as DockerA fintech background

What well give you

The best workplace you can possibly imagine, a gorgeous 5-storey building including a rooftop garden, a gym, squash court, yoga room, barbecue pit, jam studio, and a lot moreA chance to work with top talent from across the globe (55+ nationalities)Ample team-building and bonding activitiesGreat overseas travel opportunitiesCompetitive salary, annual performance bonus, and retirement planA range of health benefitsCasual dress code

JOB TYPE

Work Day:Full Time

Employment type:Permanent Job

Salary:Negotiable

JOB REQUIREMENTS

Minimal experience:Unspecified