Dataciders GmbH
Databricks Data Engineer (m/w/x)
Vollzeitmit HomeofficeBerufserfahren
Berlin, Dortmund, Frankfurt am Main, München, Neu-Ulm, Nürnberg
Neuer Job?Nejo!
Dein persönlicher KI-Karriere-Agent
ALAllianz Global Investors
Data Engineer for AI (m/w/x)
Vollzeitmit HomeofficeBerufserfahren
AI/ML
Data Science
Nejo KI-Zusammenfassung
Building robust batch and streaming data pipelines for AI/ML consumption on Databricks. Expert-level Databricks, Spark, Python, and SQL skills required. Hybrid model, flexible hours, relocation support.
Deine Match-Analyse
von deinem Karriere-Agenten
Warum dieser Job zu dir passt
Mögliche Lücken
Tipps für deine Bewerbung
Anforderungen
- Minimum 3 years building/operating data pipelines/products on Databricks
- Strong understanding of AI/ML data engineering concepts
- Expert-level skills in Databricks, Spark, Python, SQL
- Solid engineering practices: CI/CD, infrastructure-as-code on Azure
- Diploma in computer science or similar
- Very good understanding of data architecture and platform patterns
- Excellent analytical, planning, and organizational skills
- Good oral and written communication in English
- Ability to document and share knowledge effectively
- Working experience in financial industry, preferably asset management
- International work experience
- Certification “Databricks Certified Data Engineer Professional” or equivalent
- Optional: Certification “Databricks Certified Generative AI Engineer Associate”
- Hands-on exposure to Microsoft Foundry (Azure AI Foundry) or willingness to learn
Aufgaben
- Design, build, and operate data products and reusable data preparation components
- Develop, maintain, and enhance standardized pipeline patterns, templates, and utilities
- Build robust pipelines for structured and unstructured data with reproducible outputs
- Build and operate reliable batch and streaming pipelines to ingest data
- Curate datasets and publish trusted data products for AI, ML, and analytical consumption
- Establish controlled dataset evolution, enforce data quality and freshness
- Curate gold tables for analytical, ML, and AI use cases
- Design, build, and operate feature engineering pipelines
- Curate a ready-to-use feature store with proper versioning and documentation
- Build and operate pipelines for GenAI/RAG systems
- Update Bronze/Silver data, chunk data, refresh embeddings, and update indexes
- Enable systematic experimentation and support model retraining using user feedback
- Introduce and operationalize platform capabilities for ingestion, transformation, and serving
- Facilitate provisioning and rollout of Databricks Lakeflow connectors
- Integrate new data sources and standardize ingestion across domains
- Implement and enforce governance using Unity Catalog
- Ensure compliance with internal standards and regulations
- Establish automated data quality checks and validations
- Define SLAs/SLOs for freshness and reliability
- Implement monitoring and observability for data pipelines
- Optimize Spark workloads, storage layouts, and compute usage
- Ensure scalable, stable, and cost-efficient data pipelines
- Define data requirements with Data Scientists, ML Engineers, and AI CoE
- Promote reusable patterns and enable self-service through documentation, coaching, and reviews
- Provide L3 support for pipeline and data product incidents
- Perform root-cause analysis and drive continuous improvements to platform stability
- Integrate Databricks with cloud services, enterprise systems, and external providers
- Expose curated data products securely to downstream consumers
Berufserfahrung
3 Jahre
Ausbildung
Abgeschlossene Berufsausbildung
Sprachen
Englisch – fortgeschritten
Tools & Technologien
DatabricksSparkPythonSQLCI/CDTerraformAzureMicrosoft FoundryAzure AI Foundry
Benefits
Flexibles Arbeiten
- Flexible work arrangements
- Hybrid model
- Flexible working hours
Betriebliche Altersvorsorge
- Company pension/savings plans
Sonstige Vorteile
- Relocation support
Kinderbetreuung
- Childcare facilities
Attraktive Vergütung
- Company share purchasing plan
Mentale Gesundheitsförderung
- Mental health and wellbeing programs
Firmenfahrrad
- Jobrad bike leasing
Öffi Tickets
- Subvention Jobticket
Karriere- und Weiterentwicklung
- Career opportunities within Allianz Group
Weiterbildungsangebote
- Self-guided learning & development
Gemeinnützige Ausrichtung
- Volunteering time
Von Nejo automatisch aufbereitet
Nejo hat diesen Job automatisch von der Website des Unternehmens Allianz Global Investors erfasst und die Informationen auf Nejo mit Hilfe von KI für dich aufbereitet. Trotz sorgfältiger Analyse können einzelne Informationen unvollständig oder ungenau sein. Bitte prüfe immer alle Angaben in der Originalanzeige! Inhalte und Urheberrechte der Originalanzeige liegen beim ausschreibenden Unternehmen.
Zur Originalanzeige bei Allianz Global InvestorsÜber das Unternehmen
AL
FinancialServicesFrankfurt am Main
Allianz Global Investors is a leading global active asset manager focused on long-term value creation and sustainability.
Wie gut ist dein Lebenslauf?
Nejo bewertet ihn, und bringt ihn danach gemeinsam mit dir in Bestform.
Du hast noch keinen Lebenslauf?
Noch nicht perfekt?
- Jedox GmbHData Engineer (m/w/x)VollzeitRemoteSeniorFrankfurt am Main, Freiburg im Breisgau
- Ströer SE & Co. KGaA (Ströer Gruppe)Senior Data Engineer (m/w/x)Vollzeitmit HomeofficeSeniorFrankfurt am Main
- Alexander Thamm GmbHPrincipal Data Engineer (m/w/x)VollzeitRemoteSeniorMünchen, Frankfurt am Main, Berlin, Leipzig, Stuttgart, Essen, Nürnberg
- CapgeminiSenior Data & AI Engineer (m/w/x)Vollzeitmit HomeofficeSeniorBerlin, Hannover, München, Hamburg, Düsseldorf, Nürnberg, Frankfurt am Main, Köln, Stuttgart, Erfurt