Skip to main content
Wise Step Recruiting · Full Remote · Remote · Contract · Lead ·B2B

Data Architect – Greenfield Insurance Data Platform

Databricks Delta Lake Unity Catalog Data Modeling Medallion Architecture Insurance SQL

About the Role

You’ll lead the architectural design of a greenfield data platform for a new insurance business unit. With no legacy data estate in place, your mission is to define the foundation — entities, grains, keys, conventions, and serving patterns — powering both a customer-facing application and an internal analytics suite.

What You’ll Do

Platform Architecture

  • Design the end-to-end Databricks Lakehouse Platform using Medallion Architecture (Bronze / Silver / Gold) standardized on Delta Lake.
  • Implement Unity Catalog with a three-level namespace (Catalog.Schema.Table) — grants, auditing, lineage.
  • Define Infrastructure as Code patterns using Databricks Asset Bundles (DABs) for automated environment promotion.
  • Resolve the architectural tension between an Application Serving Layer (low-latency, selective reads, API consumption) and an Analytics Layer (wide scans, historical depth, Power BI, dimensional modeling).

Insurance Data Modeling

  • Design bi-temporal models (SCD Type 2) tracking both Effective Time (real-world policy dates) and System/Booked Time (when data was recorded).
  • Define and pin down grains for Policy Versions, Coverages, Exposures, and Transactions ensuring accuracy in financial reporting.
  • Build semantic and dimensional models (Facts / Dimensions) for analytic consumption.

Ingestion & Integration

  • Define ingestion patterns from upstream SQL Server via JDBC / CDC.
  • Architect Auto Loader pipelines for Excel/CSV file landing into UC Volumes.
  • Design secure pathways for business-maintained reference data.

AI/ML Foundation

  • Collaborate on Mosaic AI + MLflow setup: experiment tracking, Model Registry, training and inference pipeline integration.

Data Quality & Trust

  • Design a multi-layered validation framework: Source-to-Target Reconciliation on Premium and Loss control totals, Referential Integrity checks (Policy ↔ Party ↔ Claim), freshness and completeness alerting across the Medallion pipeline.

Requirements

  • Proven experience with Databricks Lakehouse Platform, Unity Catalog, Delta Lake.
  • Strong data modeling background — dimensional modeling, SCD Type 2, bi-temporal patterns.
  • Experience designing Medallion Architecture end-to-end.
  • Solid cloud experience on at least one major hyperscaler (AWS / Azure / GCP).
  • Advanced SQL — JDBC, CDC, query optimization at scale.
  • Minimum 2 years working with insurance data (policy, coverage, exposure, transactions, premium, loss).
  • 7+ years in Data Architect or Lead Data Engineer roles.
  • English C1+ — direct communication with technical and business stakeholders.

Nice to Have

  • Mosaic AI / MLflow — ML lifecycle within Databricks.
  • Power BI as a downstream consumer.
  • Auto Loader / Structured Streaming.
  • Previous greenfield platform builds.
  • PII/PHI compliance in insurance.
  • Databricks certifications.

Why This Role

  • Greenfield — define the architecture from scratch, no legacy constraints.
  • High impact — your design decisions shape the platform for years to come.
  • Complex domain — insurance, bi-temporal modeling, dual-serving architecture.
  • Strong technical team — experienced Data Engineers and ML Engineers.

Hiring Process

  1. Screening call (30 min) — motivation, relevant experience, availability.
  2. Technical deep-dive (60–90 min) — architecture design exercise on a similar scenario.
  3. Stakeholder fit (30 min) — team compatibility.
← Back to Jobs