Data Engineer
Job details
Position title: Data engineer
Reports to: Data and AI manager
Business line / department: Data and automation / IT
Job purpose
The job holder is responsible for building and maintaining data pipelines, ETL/ELT processes, and data integration solutions that move and transform data across the data platform to support analytics, reporting, and AI applications.
Job deliverables - accountability
- Pipeline success rate ? 99%
- Data freshness SLA meets agreed refresh schedule
- Data quality score ? 95%
- Pipeline documentation 100%
- Incident response ? 2 hours for pipeline failures
Know how (applying of knowledge & skills in job tasks)
Data pipeline development
- Design, build, and maintain ETL/ELT pipelines using Azure Data Factory, Synapse, or Databricks.
- Integrate data from D365 ERP, POS, e-commerce, and external sources into the data warehouse.
- Monitor pipeline performance and resolve data failures promptly.
Requirements
Data quality
- Implement data quality checks and validation within pipelines.
- Collaborate with data analysts and BI developers to resolve data issues.
- Maintain data lineage and documentation for all pipelines.
Note: The principal accountabilities listed above are an illustrative list and not an exhaustive list. Additional responsibilities may be added from time to time depending on organizational requirements.
Qualifications, experience
Minimum qualification
- Bachelor degree in Computer Science, Data Engineering, or IT.
- Certified in Azure Data Engineer Associate preferred
Minimum experience
- Minimum experience of 3–5 years in data engineering.
Other requirements (skills set)
- Azure Data Factory, Synapse Analytics, Databricks
- SQL, Python, Spark for data transformation
- D365 data integration: OData, Data Integrator, dual write
- Data quality and testing in pipelines
- Git and Azure DevOps for pipeline code management
Languages: Arabic (professional) · English (professional)