
Senior Data Engineer (Streaming)
NetherlandsInformation Technology
Job description
The Company – Milence
Established in July 2022, we are dedicated to making the future of road transport fossil-free. By building and managing reliable and secure high-performance charging solutions, our mission is to support and accelerate the transition to zero-emission heavy-duty vehicles in Europe. The team is working quickly to scale up operations and network deployment.
As a fast-growing company, we want to build diverse teams who are dedicated to our vision: a world of fossil-free transport, which will go on to combat climate change.
With a focus on sustainable growth and the best possible collaboration among all stakeholders, we are looking for colleagues eager to make an impact and ready to support and accelerate the zero-emission future of road transport in Europe.
While our Dutch offices are in Amsterdam and Arnhem, our focus is distinctly pan-European and our team is growing throughout the continent.
The Department
The Information Technology Team is responsible for the end-to-end support and development of all digital products and services needed to achieve our mission and support our clients and colleagues in the best way possible.
Our stack is Azure based and hosted and we are ramping up from a near-greenfield situation. We are looking to quickly set up a scalable infrastructure, a state-of-the-art DevSecOps process and to get all necessary business IT solutions in place. We will be working with fantastic data sets to facilitate and monitor charging sessions, network location planning, route optimization, real-time reservations, and smart charging.
We will implement and integrate solutions for the many capabilities we need as a company, such as Asset Management, Operations Centre, Deployment management and many others.
The Job
You will be responsible for operating and building stream infra and pipelines.
As a Senior Data Engineer, you will design, develop, and maintain our data infrastructure to support our organization's data-driven initiatives.
You will be responsible for designing, implementing and maintaining streaming processing architecture to support data integration and service interoperability in general.
In addition, you will:
- Understand the data sources, identify relevant data streams, and architect the pipeline to ensure seamless and reliable data ingestion (Data Pipeline Design).
- Set up and manage the infrastructure required for data streaming (Data Streaming Infrastructure).
- Define the data formats, API endpoints, and data schemas to ensure compatibility and consistency across the data ecosystem (Data Integration).
- Implement mechanisms for data validation, including schema validation, data completeness checks, and data anomaly detection. Also work on data cleansing and transformation to address data quality issues (Data Quality and Validation).
- Monitor system metrics, identify bottlenecks or failures, and implement optimizations to improve overall system performance (Monitoring and Troubleshooting).
- Analyse system bottlenecks, conduct performance tuning, and implement strategies like load balancing, parallel processing, and data partitioning to handle increasing data volumes (Scalability and Performance Optimization).
- Implement access controls, encryption mechanisms, and other security measures to protect the streaming data and comply with relevant data protection regulations, such as GDPR (Security and Data Privacy).
You will get to leverage your knowledge to enhance data organization, discoverability, and interoperability within our systems.
The job will be based in our Amsterdam and/or Arnhem office.
Job requirements
Who are we looking for?
You hold a Bachelor degree in computer science.
You have:
- a minimum of 5 years’ experience with SQL and Python;
- at least 2 years of experience with Events Hubs, Service Bus, Events Grid, or Kafka;
- demonstrable experience (2+ years) with event streaming transformations and schema registry is required;
- demonstrable experience (5+years) with service integration: interoperability between systems;
- at least 1 year of experience with Databricks, Azure Cloud, Terraform and CI/CD;
Experience with services integration or BPMN would be a plus.
Your English is excellent (and if you do not speak Dutch that is fine).
You look forward to learning new things and pick them up quickly, this includes -new skills, environments, people skills and are resilient.
You underline our mission and values (reliable, sustainable, approachable, progressive and fast-paced).
You radiate energy, are a positive thinker and easily connect with others in informal ways.
We are especially interested in diverse candidates.
What we offer:
We offer the opportunity to join us at the unique starting phase of a new company with a real purpose, high aspirations and strong team spirit. You can be there as it begins.
You will be part of a high-energy environment in which you can help shape various aspects. You will learn every day and have ample room for personal development and support.
We want you to join our company for a career – not for just a job – and support your personal career ambitions in or outside your department.
The base salary level (all in) is oriented towards 80.000 EUR; The on target annual incentive is 20% - with a maximum of 40%.
Furthermore, we offer a comprehensive pension plan and unlimited vacation days.
We have flexible (hybrid) working arrangements.
Ready to charge the future?
Please submit your resumé in English.
or
All done!
Your application has been successfully submitted!