Lead Cloud Data Engineer

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 8+ years of relevant experience in Cloud Data Management, preferably in a lead capacity.
• Expertise in Big Data Technologies: Demonstrated proficiency in Kafka, ElasticSearch, Logstash, and Kibana, ensuring optimal utilization within the data ecosystem.
• Data Engineering and ETL/EDW Design: Extensive experience in Data Engineering methodologies, ETL/EDW design processes, and best practices.
• Data Modeling: Proficiency in data modeling techniques to create efficient and scalable data structures.
• Change Data Capture (CDC) Process: Experience in CDC processes, preferably with knowledge in tools like Debezium or other CDC tools.
• On-Prem to Cloud Migration: Specialized knowledge in facilitating seamless migration of data from on-premises to cloud environments.
• Hortonworks Data Platform/Cloudera Stacks: Experience with Hortonworks Data Platform or Cloudera Distribution stacks for effective data management.
• AWS Development: Proficiency in AWS services such as RDS with Postgres SQL, DynamoDB, Data Pipeline, Database Migration, and AWS Kafka.
• Code Management and CI/CD: Experience in configuring Git/Bitbucket/SVN for code management and a solid understanding of Continuous Integration/Continuous Deployment (CI/CD) practices.
• Source-to-Target Mapping and Data Modeling: Hands-on experience in source-to-target mapping and adherence to data modeling best practices.
• REST API Processes: Knowledge and practical experience in REST API processes, including PUT/GET methods.
• Agile Methodology: Experience working in Agile environments, utilizing SCRUM or Kanban methodologies.
• Domain Experience: Exposure to the Insurance domain is advantageous.
• Client Handling: Experience in managing client interactions is beneficial.
• Additional Skills (Advantageous): Experience in Python and Spark will be considered a plus.
• SQL Proficiency: Hands-on experience in SQL coding, optimization, and fine-tuning for database operations.

.