Senior Data Platform Engineer

RemoteIndividual ContributorFull-time

Overview

We are looking for a Senior Data Platform Engineer with strong experience in modern cloud data platforms, particularly Databricks and Microsoft Azure.

In this role, you will evaluate emerging platform capabilities, build proof-of-concepts, design integrations, and help define technical standards for enterprise data environments.

You will work closely with platform engineering and architecture teams to assess new technologies, improve data platform capabilities, and support modernization initiatives focused on scalability, governance, reliability, and developer experience.

Responsibilities

  • Evaluate new Microsoft Azure and Databricks platform capabilities and determine their suitability for enterprise adoption.
  • Design and execute proof-of-concepts (POCs) to assess scalability, security, governance, operability, and business value.
  • Build integrations and reusable frameworks leveraging APIs, platform services, and automation tooling.
  • Collaborate with platform engineering teams to define technical standards, best practices, and adoption recommendations.
  • Analyze emerging capabilities related to data governance, observability, AI-assisted operations, and platform automation.
  • Develop technical documentation, decision frameworks, and architecture recommendations for technical stakeholders.
  • Support platform modernization initiatives by identifying opportunities to improve reliability, operational efficiency, and developer experience.
  • Design and integrate enterprise data services and cloud-native platform components.
  • Contribute to automation initiatives across data and platform engineering workflows.
  • Leverage AI-assisted engineering tools to accelerate experimentation, development, and technical evaluations.
  • Present technical findings, risks, tradeoffs, and recommendations to engineering and architecture stakeholders.

Qualifications

  • Strong hands-on experience with Databricks.
  • Experience working with Unity Catalog and data governance concepts.
  • Strong experience with Azure Synapse Analytics and modern Microsoft Azure data services.
  • Solid background in API development, REST services, and system integrations.
  • Experience integrating enterprise platforms, data services, and cloud-native solutions.
  • Proficiency in at least one programming language such as Python, Java, or Scala.
  • Strong understanding of cloud architecture and modern data platform concepts.
  • Experience with automation and CI/CD practices.
  • Experience using GitHub or similar source control platforms.
  • Experience conducting technical evaluations, architectural assessments, pilots, or proof-of-concepts.
  • Strong understanding of scalability, security, governance, and operational considerations in enterprise environments.
  • Strong communication skills with the ability to present findings and technical recommendations clearly.