As a Data Engineer (m/f/d), you are the driving force behind a powerful data platform. You combine infrastructure, data modeling, and automation to create a robust and scalable data landscape - from data ingestion to provisioning for analytics and AI. You will play a key role in the implementation and development of the SAP Business Data Cloud (BDC) environment, leveraging Azure and Databricks technologies. With your expertise and passion for data-driven solutions, you play a key role in positioning the HARTING Technology Group as an innovative partner and solution provider, strengthening data-based decision-making.
Responsibilities
-
Manage and operate Databricks workspace and Azure Data Lake Storage (ADLS)
-
Define and maintain Unity Catalog namespace (Bronze, Silver, Gold) and manage other Azure resources (e.g. Key Vault, Data Factory)
-
Build and maintain data pipelines and orchestrate their execution (scheduling, monitoring, alerting, recovery)
-
Support the introduction and ongoing development of SAP Business Data Cloud (BDC) as part of the data architecture and engineering team
-
Responsible for Silver to Gold layer transformation (Databricks) and creation of certified, documented Gold tables
-
Federate Databricks Gold data into SAP Datasphere Spaces (via Odata / Delta Sharing) for SAC consumption
-
Define and implement data modeling standards and naming conventions, including for SAP BDC data structures
-
Configure and maintain Unity Catalog (Databricks) and integrate the data catalog
-
Coordinate business glossary and metadata documentation with BI and AI/DS
-
Manage access requests and provisioning across Databricks and SAP BDC
Profile
-
Degree in computer science, business informatics, or equivalent qualification
-
5+ years of experience in data engineering, preferably with Azure, Databricks, and SAP environments
-
Experience with Python for data processing, automation, and integration tasks
-
Knowledge in data modeling, pipeline development, and cloud infrastructure
-
Experience with SAP Business Data Cloud (BDC) or similar SAP data platforms is an advantage
-
Analytical, solution-oriented working style with hands-on mentality
-
Strong communication skills and ability to work in an international team; fluent English (C1) required