
Senior Data Engineer
- Hybrid
- Netherlands
- Information Management
Job description
As a Senior Data Engineer, you will design, build and maintain scalable and efficient data pipelines. You will ensure the smooth flow of data from various sources into the data lake or warehouse and drive efficient data processing and analytics. You will warrant the reliability, scalability, and performance of our data infrastructure.
To gather requirements and implement data integration and transformation processes, you will collaborate with data engineers, data scientists, and other stakeholders. You will work with DevOps teams to automate deployment, monitoring, and scaling of Databricks clusters and associated infrastructure.
You will provide technical guidance and support to team members. You promote best practices in data engineering and ensure adherence to coding standards and documentation.
Your responsibilities will include:
· Optimize and fine-tune data pipelines to enhance performance, scalability, and reliability.
· Develop and maintain data models and schemas. You will support data processing and analytics, ensure data consistency and adherence to best practices.
· Monitor and troubleshoot data pipeline issues, performance bottlenecks, and data quality problems.
· Implement data governance and data lineage processes. Ensure the traceability and documentation of data movement and transformations.
· Implement and maintain data security and access controls within Databricks. Ensure compliance with data privacy regulations and company policies.
You will be expected to stay up to date with the latest advancements. You will evaluate and recommend tools and techniques to improve data processing efficiency and scalability.
The job will be based in our Amsterdam and/or Arnhem office.
Job requirements
Who are we looking for?
You have a bachelor's degree in computer science, engineering, or a related field would be beneficial.
You have at least 3 years of experience in data engineering or data operations roles, with a focus on Databricks (including cluster management, job scheduling, and performance optimization).
You are proficient in SQL and data modelling concepts and in using data lineage tools such as Purview, Apache Atlas, or Collibra.
You have hands-on experience with cloud environments (particularly Azure), and you are familiar with related services such as Azure Data Lake, Azure SQL Data Warehouse, or Azure Synapse Analytics.
Experience with additional data technologies such as CosmosDB, Kafka, Snowflake, graph databases, or semantic web databases is a plus.
Your English is excellent.You look forward to learning new things and pick them up quickly, this includes -new skills, environments, people skills and are resilient.
You underline our mission and values (reliable, sustainable, approachable, progressive and fast-paced).
What we offer:
The opportunity to join us at a unique scaling phase of a new company with a real purpose, high aspirations, and strong team spirit.
Flexible (hybrid) working arrangements. For this role we expect you to be around 3 times in the office per week.
A competitive salary and a company-based performance incentive.
Unlimited holidays.
Pension plan.
A one-time budget to set up your home office.
A monthly phone allowance.
A first-class NS Business Card (for public transport use).
Ready to Charge the Future?
At Milence, we value diversity and encourage applications from candidates of all backgrounds and nationalities. Compliance with local employment laws and non-discrimination policies is a priority for us.
Come charge the future and apply now! Please submit your resume in English.
We encourage applications from candidates of all backgrounds and nationalities, reflecting our commitment to diversity and equal opportunity. Compliance with local employment laws and non-discrimination policies is a priority for Milence.
We look forward to hearing from you!
or
All done!
Your application has been successfully submitted!