Data Engineer
The Data Engineer is responsible for designing, developing, implementing, and supporting data engineering pipelines with a focus on PySpark and SQL. The ideal candidate must have hands-on experience with these technologies and should be familiar with modern UI technologies like React.js.
Main Accountabilities
- Analyzes business requirements and develops detailed, accurate technical specifications
- Designs and builds robust data models and ETL processes using Python and PySpark
- Maintains and enhances existing React.js user interfaces for business data acquisition
- Creates comprehensive technical documentation and operation manuals
- Develops unit tests and implements CI/CD processes for automated ETL validation
Requirements
- BSc degree in Computer Science or Electrical Engineering
- 2 years of proven experience in Data Engineering or similar position
- Experience with cloud technologies, particularly AWS, is a plus
- Experience with Databricks is a plus
- Knowledge of the Databricks platform is highly valued
- Exc...
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum.
Sed ut perspiciatis unde omnis iste natus error sit voluptatem accusantium doloremque laudantium, totam rem aperiam, eaque ipsa quae ab illo inventore veritatis.