Auftragsdetails

 

Azure Data Engineer will be responsible for implementing data ingestion and transformation pipelines. We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and delivering end-to-end production implementation.

Responsibilities:

• Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure tools
• Developing scalable and re-usable frameworks for ingesting of assorted data sets
• Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
• Manage and lead junior data engineers and provide guidance, support and mentor other members of the team as well as do hands-on work
• Working with event based / streaming technologies to ingest and process data
• Working with other team members for implementing data pipelines and solutions in production using DevOps for deployment/automation
• Working (familiar) with Azure CI/CD pipelines
• Delivering and presenting technical solutions to business users, technical teams and clients

Qualifications:

• Strong knowledge of Data Management principles
• Experience in building ETL / data warehouse transformation processes
• Direct experience of building data pipelines using one of the following Azure Data Factory, Azure Synapse, Azure Databricks
• Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Azure AI), Azure Storage, Azure SQL Data Warehouse, Azure Data Lake
• Ability to work seamlessly within a team, react quickly to a fast paced, and rapidly changing environment
• Strong capacity for logical thinking with the ability to understand complex applications
• 5+ years hands on experience using databases
• Excellent written and verbal communication skills

Education and Preferred Experience:

• Bachelor’s degree or combination of equivalent education and experience in related fields.
• 8+ years hands on experience providing solution design with BI systems and BI reports.
• Experience using geospatial frameworks on Apache Spark and associated design and development patterns
• Expert or professional level Azure certifications is a plus