Data Engineer (Ref 20994D)

Responsibilities:

Creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across systems.
To build and maintain scalable pipelines on Azure Databricks, with strong SQL and relational database expertise and solid DevOps/SDLC practices from design through deployment.
Develop data connectors and pipelines to onboard agency datasets efficiently

Requirement :

Degree in Computer Science with 3 to 5 years hands on experience in Databricks
Hands-on experience building data pipelines and notebooks in Azure Databricks
Strong SQL skills — complex queries, stored procedures, performance tuning
Extensive experience working with relational databases (design, querying, optimization)
Working knowledge of Delta Lake and Lakehouse architecture
Experience with Azure Data Factory or similar orchestration tools
Familiarity with Azure DevOps and CI/CD pipelines
Solid understanding of data modeling concepts
Strong analytical and troubleshooting skills for pipeline/query performance
Comfortable leveraging Gen AI tools to boost day-to-day productivity
Good communication skills for cross-functional collaboration

Shortlisted candidates will be offered a 1 Year agency contract employment

License No : 12C6060

See also