Description
Are you ready to join a team of growing global innovators shaping the future of Al-driven precision management of sustainable resource usage?
Responsibilities
- Build data pipelines to ingest large volumes of new customer data into existing database structures.
- Work on the vision of building a self-service data import portal for the application.
- Ensure data quality, integrity, and reliability of ingested data from various sources.
- Perform data cleansing, wrangling, and transformation to prepare data.
- Collaborate with ETL developers and the Head of Data Operations.
- Manage ETL processes that integrate data from various IoT devices into our systems using Apache NiFi.
- Ensure the efficiency and scalability of data ingestion and integration pipelines.
Qualifications
- Minimum of 4 years’ experience in data engineering.
- Expertise in ETL development, optimization and management (Apache Nifi is preferred).
- Highly skilled in SQL and NoSQL database development and design practices.
- Experience working with various data sources including CSV, JSON, Backup files, APIs,
- Data-warehouses and Data Lakes.
- Understanding of data governance principles and best practices.
- Experience working with MySQL or similar RDBMS.
- Proficiency in Python for data manipulation and automation tasks is a plus.
- Basic database administration skills are advantageous.
- Proactive, independent learner and self-driven individual with the ability to work in a fast-paced environment.
- Excellent problem-solving abilities and attention to detail.
- Excellent spoken & written English skills to work together with the onsite team in the EU.
Skills
ETL Development
SQL/NOSQL
JSON
Apache Nifi
CSV
Industry Sector