Big Data Architect

We’re looking for a Big Data Architect to provide technical leadership in architecting and designing end to end solutions for our Data initiatives as we venture into offering more services for consumers across multiple digital channels. Ensuring the current implementation of our big data solutions are in-line with industry best practices and standards. Drive improvements in the current design, processes & implementation to improve operational management, scalability, and extensibility.

Responsibilities:

• Articulate business and data requirements from business analysts across the various functional and business areas and then design/manage enterprise big data architecture, data governance, and automated data reconciliation.
• Hands-on technical big data architect with extensive experience in designing big data solutions using open source and cloud native technologies.
• Technical line management of remote big data engineering teams. Responsible for engineering excellence, resource management, hiring, coaching engineers, and timely delivery of committed work.
• Create and maintain big data architectural & design artefacts to ensure the up to date documentation for the relevant program and projects is readily available; ensuring knowledge is disseminated.
• Contribute to the evolution and planning of the enterprise architecture from data perspective by ensuring solutions are developed in line with the roadmap.
• Collaborate with a wide range of stakeholders to identify and define customer needs.
• Involve in partner selection and partner resource selection to ensure that the right partner/resource are selected who would be assisting the company in development & engineering.
• Be the voice of the customer in the context and value of the business requirements.
• Manage the Technical Product Backlog of epics and features and drive prioritization.
• Support data lake design, development, release schedule and maintain a development road map.
• Ability to clearly articulate pros and cons of various technologies and platforms and architectural options to be able to document use cases, solutions, and recommendations.
• Advocate and champion the DataOps within the business, will be responsible that the existing datalake solution running smoothly.
• Maintain your own personal skills and knowledge in the field of enterprise architecture and your functional domain specialization.
• Actively contribute to the definition of the overall standards for design, development/configuration (including tools) and related documentation.

Requirements:

• Demonstrable experience owning and developing big data and ETL/ELT solutions on cloud and/or on-prem using Kafka, HDFS/S3/ADLS, Spark/EMR/Azure Databricks/Dataproc, Snowflake/BigQuery, ADF/Airflow/Prefect etc. for 5+ years.
• 10+ years of Information Technology experience.
• Experience in designing data solution following Agile practices; designing for testability, deployability and releasability; rapid prototyping, data modeling, and decentralized innovation.
• DataOps mindset: allowing the architecture of a system to evolve continuously over time, while simultaneously supporting the needs of current users.
• Create and maintain Architectural Runway, and Non-Functional Requirements.
• Design for Continuous Delivery Pipeline (CI/CD data pipeline) and enables Built-in Quality & Security from the start.
• The ability to apply data, research, and professional judgment and experience to ensure our products are making the biggest difference to consumers.
• Demonstrated ability to work collaboratively.
• Excellent written, verbal and social skills - You will be interacting with all types of people (user experience designers, developers, managers, marketers, etc.)
• Ability to work in a fast paced, multiple project environment on an independent basis and with minimal supervision.
• Technologies AWS, Azure; Azure Synapse, Nifi, RDS, Apache Kafka, Azure Data bricks, Azure datalake storage, Power BI, Reporting Analytics, QlickView, SQL on-prem Datawarehouse; BSS, OSS & Enterprise Support Systems.

We have an amazing team of 550+ individuals working on highly innovative enterprise projects & products. Our customer base includes fortune 5 retail and CPG companies, leading store chains, fast growth fintech and multiple Silicon Valley startups. 

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 certified. We have a vibrant culture of learning via collaboration and making workplace fun. 

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves. This is obviously above and beyond the usual stuff (excellent pay, medical benefits, provident fund, stock options, frequent appraisals and bonuses). 

To know more about Confiz Limited, visit: https://web.facebook.com/lifeatconfiz