Data Engineer - Level III

CONSULTFIZ LATAM, a fully owned subsidiary of Confiz LLC is looking for a Data Engineer to join our innovative team. You will play a critical role in developing and maintaining this robust platform, ensuring that users can efficiently extract actionable insights without being burdened by the complexities of big data technologies. Your work will enable the team to scale its operations while keeping technical demands on non-engineering staff to a minimum.

Responsibilities:

• Platform Support: Perform on-going production support and on-call support duties. Work with both Onsite and offshore resources daily to resolve any incidents and issues.  
• Platform Development: Evolve, design, and maintain our orchestration platforms which aim to abstract complexities of big data technologies and simplify ETL/ELT operations for users.
• Integration: Develop seamless connectivity to diverse data sources and destinations, ensuring high performance and reliability.
• Scalability: Design solutions that are scalable and resilient, capable of handling large data volumes, high velocity, and diverse data formats.
• Innovation: Stay up-to-date with emerging big data and ETL technologies, incorporating them into the framework as needed to enhance functionality and user experience.
• Documentation: Create and maintain comprehensive documentation, ensuring users can easily understand and utilize the framework.

Requirements:

• Atleast 5+ years of experience in required skill set
• Proficiency in SQL and experience optimizing SQL queries for large-scale data processing.
• Solid understanding of ETL/ELT processes and data pipeline architecture.
• Experience working with big data technologies such as Kafka, S3, BigQuery or similar platforms.
• Experience with cloud environments such as AWS, GCP.
• Experience in developing near real-time distributed data processing solutions using Kafka, Flink, Spark, Kubernetes, Airflow.
• Strong programming skills in languages such as Python, Java, and Scala is a plus.
• Excellent problem-solving and communication skills, with the ability to work effectively in a collaborative environment.
• Education: Bachelor’s degree in Computer Science, Engineering, Data Science, or a related field.
• Languages: English, be able to Read, Write and Speak.

We have a global team of amazing individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves. 

To know more about Confiz Limited, visit https://www.linkedin.com/company/confiz/