Sr. Staff Forward Deployed Engineer - Data & ML
- Scottsdale, Arizona, United States
- Full-time
- Delivery
Confiz is seeking a Sr. Staff Forward Deployed Engineer - Data & ML who brings a fully hands-on delivery mindset, deep technical expertise, and customer-first ownership.
We are looking for individuals who embed directly within a client's engineering and business teams, own systems end to end, and are measured on what runs in production. At the Sr. Staff level, you will also set the technical direction for the data platform on the account, working closely with business and product teams to understand the business domain and use cases, identify relevant data, and partner with engineering and data engineers to drive delivery.
Work Location: Scottsdale, AZ – Hybrid
Employment Type: Full-time
Responsibilities:
- Embed directly within the client's engineering and business teams to drive hands-on, end-to-end delivery of production-scale data and ML systems.
- Set the technical direction for the customer's data platform, defining data strategies and building the foundational data layer for organization-wide data orchestration across diverse consumers.
- Partner closely with business and product teams to understand the business domain, define use cases, and identify relevant data sources.
- Collaborate with engineering and data engineering teams to drive execution and take accountability for system uptime in production.
- Design, build, and manage lakehouse architectures using Databricks (Spark, Delta, Unity Catalog), Databricks Genie, and hands-on ownership of bronze, silver, and gold data layers.
- Architect and maintain scalable ingestion and streaming pipelines (Kafka, ETL/ELT at scale, blob storage) with self-healing and automated alerting capabilities.
- Build and optimize operational data stores, including production PostgreSQL, pgVector, embeddings, vector databases, and Redis caching strategies.
- Design and tune search and retrieval solutions using Azure AI Search, covering index and schema design, indexers, hybrid retrieval, semantic reranking, and freshness/relevance tuning.
- Develop semantic models and BI solutions leveraging Microsoft Fabric and Power BI.
- Deliver machine learning models in production, owning the lifecycle from classifier training through serving, evaluation, drift detection, and retraining.
- Build document intelligence and multi-modal RAG pipelines capable of extracting and grounding information across unstructured, scanned, text, table, and image sources.
- Establish MLOps and reliability practices, including CI/CD for data and models, observability, monitoring, alerting, and on-call ownership.
- Lead live platform migrations, moving data architectures from one platform to another with zero disruption to active consumers.
- Manage Azure cloud infrastructure at depth, driving active cloud and data platform cost optimization.
- Build query interfaces for AI agents, including Model Context Protocol (MCP) servers and text-to-SQL tooling over governed data.
Requirements
- 12+ years of hands-on engineering experience building and maintaining production-scale systems with direct accountability for uptime.
- Proven ability to define data strategies and build foundational data layers from the ground up for organization-wide orchestration.
- Concrete, hands-on experience across most of the following technical areas:
- Lakehouse & Processing: Databricks (Spark, Delta, Unity Catalog), Databricks Genie, and ownership of bronze, silver, and gold layers.
- Ingestion & Streaming: Kafka, ETL/ELT at scale, blob storage, and self-healing, automated ingestion pipelines with alerting.
- Operational Data Stores: Production PostgreSQL, pgVector, embeddings, vector databases, and Redis caching strategies.
- Search & Retrieval: Azure AI Search (index and schema design, indexers, hybrid retrieval, semantic reranking, freshness and relevance tuning).
- Semantics & BI: Microsoft Fabric, semantic modeling, and Power BI.
- ML in Production: End-to-end classifiers from training through serving, evaluation, drift detection, and retraining.
- Document Intelligence & Multi-Modal RAG: Extraction from unstructured and scanned sources, grounded over mixed text, table, and image content.
- MLOps & Reliability: CI/CD for data and models, observability, monitoring, alerting, and on-call ownership.
- Platform Migration: Hands-on experience migrating data architectures between platforms with live consumers.
- Cloud & Cost Management: Deep Azure expertise paired with active cloud and data platform cost management.
- Query Interfaces for Agents: Building MCP servers and text-to-SQL tooling over governed data.
- Willingness and ability to work in a hybrid model in Scottsdale, AZ.
Qualifications:
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, Data Science, or a related field.
- 12+ years of hands-on software, data, or machine learning engineering experience in production environments.
Good to Have:
- Agentic AI & Orchestration: Familiarity with agentic AI patterns and orchestration engines such as LangGraph or equivalent frameworks, understanding how downstream agents consume data and ML platforms.
- Advanced RAG Architecture: Deep understanding of retrieval strategies, grounding, context assembly, and failure modes beyond basic implementations.
- Workflow Architecture: Ability to determine where deterministic workflows vs. non-deterministic agentic workflows are appropriate and maintain clean boundaries between them.
- AI System Evaluation: Experience with offline and online evaluations, golden datasets, regression suites, and evaluating output quality where there is no single right answer.
- Domain Experience: Previous experience working within the retail or grocery domain.
We have a global team of amazing individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast growth fintech, and multiple Silicon Valley startups.
What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.
People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.
To know more about Confiz visit https://www.linkedin.com/company/confiz/
