adjoe logo
adjoe

Senior Data Engineer (f/m/d)

🕐 21 dias atrás📍 Hamburg

What You Will Do

  • Scale the Feature Store: Leverage Apache Flink to translate Data Science requirements into high-performance, real-time streams. Enable Data Scientists to contribute new features and implement them yourself when needed.
  • Ensure Data Quality, Observability & Integrity: Implement data validation, monitoring, and governance processes to maintain accuracy, consistency, and reliability across all datasets and features in Feature Store.
  • Optimize Pipelines Performance: Identify and eliminate bottlenecks in complex ETL jobs, transforming long-running processes into streamlined, rapid-iteration cycles.
  • Bridge Data Science & Backend Teams: Act as the key link between data science and backend engineering, ensuring seamless data integration and usage across the organization.
  • Explore new Data Sources: Partner with Data Scientists to build custom ingestion logic for unstructured or non-typical data sources, handling the heavy preprocessing needed for experimental research.
  • Evolve the Data Architecture: Maintain and optimize our Data Lake. You'll help us decide on the future of our storage (e.g., moving toward a Data Lakehouse model) and implement best practices.
  • Work in an International Environment: Join an international, English-speaking team focused on scaling our adtech platform to new heights.

Who you are:

  • You have 5+ years’ of software development experience, working on modern data engineering stack.
  • You have proven experience with Apache Flink for stateful stream processing and real-time feature computation.
  • You have worked extensively with real-time data streaming systems such as Kafka, Kinesis, or Pub/Sub.
  • You have experience with systems handling several TB of data per day and multiple thousand events per second.
  • You know how to identify bottlenecks in data pipelines and you have experience in optimizing them and scaling them up.
  • You have strong Java knowledge, Golang/Python knowledge would be a plus.
  • You have worked closely with Data Scientists on online ML systems with low latency.
  • You know how to move beyond "raw data" to design robust, multi-layered data architectures. You have hands-on experience using dbt to build these layers and can guide us on the best tools and formats to manage them at scale.
  • You know scheduling frameworks such as Airflow / Kubeflow.
  • You know the concepts of data quality and how to apply them in production.
  • You are familiar with relational and NoSQL databases.
  • You are open to relocating to Hamburg, Germany.
  • You have strong problem-solving skills and ability to tackle complex technical challenges.
  • Plus: You have hands-on experience in working with AWS, Terraform and Kubernetes.
  • Plus: You are familiar with the Medallion Architecture and have experience building Semantic Layers for downstream data consumption.

Fuel for the Journey: Benefits to Support Your Ambitions

  • Invest in Your Future: Regular feedback and our development program support your growth, helping you expand your skillset and achieve your career goals.
  • Easy Arrival to adjoe: From signing to settling in Hamburg, we’ve got you covered. Need a visa? No problem. Ready to build your new life and career at adjoe in Hamburg? We support every ambition—from learning German to a relocation bonus that helps you settle in and make Hamburg feel like home.
  • Live Your Best Life, at Work and Beyond: We work in a hybrid setup with 3 core office days, plus flexible working hours. Enjoy 30 vacation days, 3 weeks of remote work per year, and free access to an in-house gym with lots of different fitness classes and mental health support through our Employee Assistance Program (EAP).
  • Thrive Where You Work: Enjoy the Alster lake view from our central office with top-notch equipment, fun open spaces, and a large variety of snacks and drinks.
  • Join the Community!: Participate in regular team and company events, including hackathons and social gatherings. We work together, and we celebrate together, too.

🇧🇷 Essa vaga exige inglês. Você está pronto?

A DevSpeak Academy prepara desenvolvedores brasileiros para conquistar vagas internacionais. Domine o inglês técnico com professores que entendem o mundo dev.

Conheça a DevSpeak Academy