DATA ENGINEER

CMS (Pvt) Ltd
4 months ago
tie
1 Applied
Expired on: Jul 23 2024
tie

Ref.No 00005618

Description

Are you ready to join a team of growing global innovators shaping the future of Al-driven precision management of sustainable resource usage?

Responsibilities

  • Build data pipelines to ingest large volumes of new customer data into existing database structures.
  • Work on the vision of building a self-service data import portal for the application.
  • Ensure data quality, integrity, and reliability of ingested data from various sources.
  • Perform data cleansing, wrangling, and transformation to prepare data.
  • Collaborate with ETL developers and the Head of Data Operations.
  • Manage ETL processes that integrate data from various IoT devices into our systems using Apache NiFi.
  • Ensure the efficiency and scalability of data ingestion and integration pipelines.


Qualifications

  • Minimum of 4 years’ experience in data engineering.
  • Expertise in ETL development, optimization and management (Apache Nifi is preferred).
  • Highly skilled in SQL and NoSQL database development and design practices.
  • Experience working with various data sources including CSV, JSON, Backup files, APIs,
  • Data-warehouses and Data Lakes.
  • Understanding of data governance principles and best practices.
  • Experience working with MySQL or similar RDBMS.
  • Proficiency in Python for data manipulation and automation tasks is a plus.
  • Basic database administration skills are advantageous.
  • Proactive, independent learner and self-driven individual with the ability to work in a fast-paced environment.
  • Excellent problem-solving abilities and attention to detail.
  • Excellent spoken & written English skills to work together with the onsite team in the EU.
Skills
ETL Development
SQL/NOSQL
JSON
Apache Nifi
CSV
Industry Sector