Platform Engineer
Job Description
Data Engineering Platform Engineer Location: Atlanta, GA (Hybrid Local Candidates Preferred) Duration: 6-Month Contract-to-Hire Client: OpenKyber Job Summary We are seeking an experienced Data Engineering Platform Engineer to own, administer, and continuously improve our enterprise data platforms supporting analytics, reporting, and data product delivery across the organization. This role is focused on platform ownership and administration , not pure data pipeline development. The ideal candidate will have hands-on experience managing Databricks on Azure environments, supporting SQL Server data warehouse platforms, implementing governance and security controls, optimizing cloud infrastructure, and ensuring platform reliability and performance. You will play a key role in a multi-year cloud modernization initiative, helping migrate legacy SQL Server data warehouse environments to a modern Databricks Lakehouse architecture.
Key Responsibilities:- Databricks Platform Administration Administer and support Databricks workspaces in Azure.
- Manage Unity Catalog, data governance, access controls, and security policies.
- Configure and maintain cluster policies, compute resources, and workspace settings.
- Monitor platform health and troubleshoot production issues.
- Implement best practices for data governance, lineage, metadata management, and security.
- Evaluate and implement new Databricks features and capabilities.
- Azure Platform Management Manage Azure Data Lake Storage Gen2 (ADLS Gen2).
- Support Azure Data Factory (ADF), Azure Active Directory (AAD), and Azure Key Vault.
- Configure networking, private endpoints, service principals, and security controls.
- Monitor cloud infrastructure and optimize platform performance.
- SQL Server & Migration Support Support existing SQL Server Enterprise Data Warehouse environments.
- Maintain SSIS packages and SQL Server operations.
- Perform performance tuning, backup/recovery, and database maintenance.
- Assist with SQL Server to Databricks migration initiatives.
- Support migration planning, validation, and production cutovers.
- Security, Governance & Compliance Implement RBAC, access governance, and audit controls.
- Manage service principals, secrets, credential rotation, and Key Vault integrations.
- Ensure compliance with SOX, IT and enterprise security requirements.
- Partner with Security and Governance teams on platform standards and controls.
- Monitoring & Optimization Develop monitoring and alerting frameworks.
- Troubleshoot production platform issues and drive root cause analysis.
- Optimize Databricks clusters and Azure resources for performance and cost efficiency.
- Create platform health dashboards and operational reports.
- Participate in incident management and capacity planning activities.
- Platform Engineering & DevOps Support CI/CD processes and deployment automation.
- Collaborate with Data Engineering, Analytics, and Governance teams.
- Maintain platform documentation, runbooks, and operational procedures.
- Drive platform standardization and continuous improvement initiatives.
- 5+ years of experience in Data Engineering, Platform Engineering, Database Administration, or Cloud Engineering.
- Hands-on Databricks Administration experience.
- Strong experience with Unity Catalog, RBAC, Access Controls, and Data Governance.
- Experience administering Azure Data Services including: Azure Data Factory (ADF) Azure Data Lake Storage Gen2 (ADLS Gen2) Azure Active Directory (AAD) Azure Key Vault
- Strong SQL Server administration experience.
- Experience with SSIS, T-SQL, query optimization, and database performance tuning.
- Experience supporting enterprise production environments.
- Strong understanding of Delta Lake, Spark SQL, and modern Data Engineering architectures.
- Experience with monitoring, alerting, troubleshooting, and platform support.
- Experience with Git, Azure DevOps, and CI/CD practices.
- Knowledge of cloud security, compliance, and governance frameworks.
- Databricks Platform Administrator Certification.
- Databricks Data Engineer Certification.
- Microsoft Azure Data Engineer Associate (DP-203).
- Experience with SQL Server to Databricks migration programs.
- Experience with Terraform, ARM Templates, or Infrastructure as Code.
- Experience with Alteryx Server Administration.
- Retail, Supply Chain, or Enterprise Data Platform experience.
What We're Looking For This is not a pure Data Engineer or ETL Developer position. We are specifically seeking candidates who have: Owned and administered Databricks platforms in production. Managed platform security, governance, and access controls. Supported enterprise-scale Azure data environments. Worked with both Databricks and SQL Server platforms. Experience with production support, monitoring, troubleshooting, and platform optimization. If your background includes Databricks Administration, Azure Platform Engineering, SQL Server Administration, Platform Governance, and Cloud Modernization initiatives, we'd love to hear from you.
For applications and inquiries, contact: hirings@openkyber.com
This listing was syndicated from Adzuna. We strive to keep information accurate, but do not assume responsibility for the content of this posting.
- Use the Apply button above to contact the employer directly
- Verify the employer and position details before applying
- Review our Terms of Service for listing policies