Role Overview
We are seeking a hands-on Senior Databricks Platform Engineer to operate and evolve our data and AI platform built on Azure Databricks. You will evaluate new Databricks features, conduct proofs of concept, assess security implications, ongoingly govern their adoption and ensure that can be deployed at scale in secure and productive manner. You will turn approved capabilities into secure configurations, automated guardrails, and practical guidance for platform users. You will also build and maintain reusable agent skills and instructions for platform users’ coding agents, embedding Databricks best practices into the AI-assisted software development lifecycle (SDLC).
What You’ll Do
- Feature Evaluation: Track Databricks roadmap in order to evaluate new features, conduct proofs of concepts, evaluate security risks, cost implication, and governed scalability readiness. Document recommendations and adoption requirements and work with Engineers, Architects and Product Owners to deploy it at scale in P&G.
- Adoption and AI-Assisted Engineering Enablement: Develop reusable configurations, implementation patterns, and documentation. Build, test, and maintain agent skills and instructions that help users’ coding agents apply Databricks security, governance, testing, and performance best practices throughout the SDLC.
- CI/CD and Automation: Build pipelines for databricks account configuration changes and safely perform these changes. Automate administration and validation using version control, peer review, and controlled deployment practices.
- Governed Self-Service Enablement: Build self-serve tools which teams to request and enable approved Databricks capabilities within predefined governance guardrails (e.g. via PRs to Terraform repos or APIs).
- Security Evaluation: Partner with Information Security to review capabilities before production adoption at scale. Implement access controls and technical guardrails. Promote reusable patterns, and periodically review existing implementations to address exceptions, retire obsolete approaches and reduce technical debt.
- Data-Driven Governance: Use SQL to analyze Databricks system tables. Build dashboards and define metrics to track feature adoption, usage patterns and costs. Use these insights to prioritize platform changes, measure their impact.
- Platform Operations: Manage databricks account configuration, monitoring, reliability, and costs. Troubleshoot complex platform issues and maintain operational runbooks. Advise users of the platform on best practices.
What We Offer
- Responsibilities as of day 1. You will have project ownership and autonomy to deliver change and results from the beginning.
- Dynamic and encouraging work environment. At P&G our employees are at the core, we value every individual and encourage initiatives, promoting agility and work/life balance.
- Continuous mentoring, you will work with hardworking people and receive ongoing coaching and mentoring from your line manager and other colleagues. Corporate and functional training will enable you to succeed and develop from day one.
- Industry Certifications (ITIL, DevOps, MS portfolio etc), full additional benefit program like private health care, P&G Dynamic Living programs like sport cards, in-office fitness center, PG stock options, saving plans, lunch subsidy, regular salary increases and possible promotions, flexible work arrangements, mentoring programs & trainings.
- Big Picture understanding of P&G IT and Product Supply organization and its Services in global multi-functional teams with several locations across continents.
- Hybrid work model: Employees can enjoy the option to work from home two days a week while also spending time in the office to foster teamwork and enhance communication.
Job Qualifications
- Strong (4 years+) hands-on Azure Databricks experience, including workspace administration, compute configuration, permissions, and cost management.
- Proficiency in Python and SQL sufficient to perform analysis of platform logs.
- Practical experience with using REST APIs, Terraform and Azure networking (Private Endpoints, vNETs), Microsoft Entra ID.
- Experience with CI/CD using Azure DevOps, GitHub Actions, or similar tools.
- Strong problem-solving, documentation, and cross-functional communication skills.
Preferred Qualifications
- Deep understanding of Databricks control plane, compute planes, model serving architecture, Genie etc.
- Experience governing Databricks at the enterprise scale.
- Experience in building scalable self-serve platforms for Engineers (platform engineering).
- Hands-on experience with AI coding agents and creating reusable context layer (e.g. skills.md) that encode engineering standards.
- Familiarity with policy-as-code, automated compliance checks, and configuration drift detection.
- Experience with Azure Monitor, Log Analytics, Databricks audit logs, and system tables.
- Understanding of security risks, including sensitive-data exposure, prompt injection, and excessive tool permissions.
- Relevant, current Databricks or Microsoft Azure certifications.
