Senior Data Integration Engineer (Databricks)
We are looking for an experienced Senior Data Integration Engineer specializing in Databricks to join our team. As a key member of the team, you will lead the design of enterprise digital products and platforms that deliver value to users and achieve business goals. You will collaborate with various stakeholders and contribute to creating engaging and delightful solutions by leveraging your design skills and methods. Come and join us to promote the role of design and achieve positive design outcomes.
Responsibilities
- Develop, maintain and support ETL/ELT solutions
- Implement and manage Databricks on Microsoft Azure or AWS Cloud platforms
- Use SQL, PySpark or Scala to transform and analyze large datasets
- Own end-to-end delivery of data ingestion + transformation pipelines on Azure Databricks
- Works independently with minimal supervision
- Mentoring junior engineers
- Work collaboratively with the team on Microsoft Power BI
- Ensure the adherence to best practices in development, testing and deployment
- Create technical documentation related to the project
Requirements
- At least ...
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis.