Data Engineer - Databricks
Join us in your quest to get busy living and make a difference. We make sure the people we hire naturally fit into our culture and share our values.
We usually respond within a week
![Dufrain_LinkedIn_Banners_AW_5.jpg](https://images.teamtailor-cdn.com/images/s3/teamtailor-production/gallery_picture-v6/image_uploads/29e841ef-6780-4637-8483-082c90c8568c/original.jpeg)
We are Dufrain. We’re a market-leading professional services consultancy delivering Data Engineering, Cloud, Data Strategy & Management and advanced BI & Analytics services to a range of large enterprise clients in data-rich industries.
Dufrain's Data Engineers provide expertise, guidance, and strategic advice to clients in order to help them effectively leverage their data assets for making informed decisions and achieving their business objectives.
Our Data Engineers play a pivotal role in supporting clients navigate the complexities of data management, analytics, and strategy.
OUR DATA ENGINEERS
- Possess a broad range of data engineering skills, with a focus on having delivered primarily in Databricks, although experience with other Spark engines is desirable.
- Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues.
- Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment.
- Deliver high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions.
- Support building the Dufrain consulting practice through contribution to ongoing initiatives. This can include knowledge-sharing activities and building accelerators.
- Have excellent problem-solving, analytical, and communication skills.
- Possess a strong desire to learn and adapt to new technologies.
ROLE DETAILS AND RESPONSIBILITIES
- Design, develop, and maintain Databricks solutions and databases.
- Create solutions to extract, transform, cleanse, and load data (ETL/ELT).
- Conduct unit, system, and performance tests and creating comprehensive documentation.
- Follow agile project delivery methodologies.
- Stay up to date on the latest data engineering trends and technologies.
ROLE SKILLS AND EXPERIENCE
Essential
- Databricks – hands on experience developing engineering solutions in Databricks ecosystem, including Unity Catalog.
- SQL – writing optimised and complex queries and understanding of relational databases.
- Python – we specialise in Python solutions.
- DevOps – hands on experience using tools like Terraform for IAC, and Azure DevOps for CI/CD.
- Requirements Gathering
Desirable
- Microsoft Azure – Data Factory, Data Lake, Azure SQL Server.
- Microsoft Fabric - or another spark engine.
- Visualisation tools – Power BI / Tableau.
- Data Governance – Purview.
- Application Platform Services – Azure Functions, Azure Logic Apps, Power Apps
- Consulting Experience
About You
- You will share our passionate about data and possess skills and expertise in the following areas:
- A high level of drive with the ability to work to tight deadlines.
- Experience of providing insightful solutions
- The ability to participate effectively in meetings with stakeholders.
- A team player who supports, encourages and shares knowledge with others.
- A self-starter with the ability to work under pressure and with limited supervision.
- A track record of accurate output and responsibility for elements of project delivery.
- The ability to work as part of an integrated team or on an individual basis.
- Awareness of industry standards, regulations and developments.
What we offer you
We have a working culture that rewards high performance and nurtures talent, while providing exciting opportunities and challenges to generate positive change for our clients.
You can expect guaranteed investment to your personal development. We have structed learning paths on a number of platform including Udemy and not to mention the in house knowledge that is shared by all of our consultants, our lunch and learn sessions are regular fixtures in the calendar.
Benefits
- Competitive base salary
- Annual Performance related bonus
- Hybrid home/onsite/office working – Edinburgh, Manchester & London
- 25 days annual leave (plus bank and public holidays)
- Birthday day off – celebrate with an extra holiday
- Career progress programme - guaranteed learning and development investment and your own career coach
- Life insurance
- Private medical health insurance
- Contributory pension
- Health and wellbeing group
- And many more.
If you’re passionate about data, and you’re looking to join a leading data and analytics company based in the UK, you could find your dream role at Dufrain.
Apply to join us in our quest to get busy living and make a difference.
We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
- Department
- Consulting
- Locations
- Edinburgh, Manchester, London
- Remote status
- Hybrid Remote
![Picture of Jacqueline Doyle](https://images.teamtailor-cdn.com/images/s3/teamtailor-production/square_226-v4/image_uploads/68408d36-5f88-4523-8f54-9edc807fcdec/original.jpeg)
Our Vision
To to be the world’s leading pure-play data consultancy, creating pioneering data solutions that give our clients unequalled advantage and set the standard others seek to follow.
To be the home for exceptional talent, enabling extraordinary careers.
Success in enabling clients to be data-driven all depends on our people.
We will nurture and invest in a pioneering culture.
We are committed to enabling our people to expand their knowledge and skills, and provide the resources they need to reach their full potential.
That’s why we have a working culture that rewards high performance and nurtures talent, while providing employees with exciting opportunities and challenges to generate positive change for our clients.
Our comprehensive suite of solutions is tailored to meet our clients needs. Our expertise spans industries such as retail, telecoms, healthcare as well as specialisms in Financial Services such as Banking and Insurance.
#GetBusyLiving
Join us in your quest to get busy living and make a difference. We make sure the people we hire naturally fit into our culture and share our values.
Data Engineer - Databricks
Join us in your quest to get busy living and make a difference. We make sure the people we hire naturally fit into our culture and share our values.
Loading application form
Already working at Dufrain?
Let’s recruit together and find your next colleague.