Databricks Architect – Informatica, Spark & PySpark
Summary
Design and implement scalable Databricks Lakehouse data platforms using Spark, PySpark, Delta Lake, and Unity Catalog. Architect batch and real-time pipelines across Azure/AWS/GCP and lead ETL modernization from Informatica to Databricks.
Job Description:
Databricks Architect (with Informatica)-Databricks, Informatica PowerCenter
and/or IICS/IDMC, Spark, PySpark, SQL, Delta Lake, Unity Catalog.
Brampton, ON - Hybrid (4 Days WFO)
Role Descriptions: Design and implement scalable data
platforms using Databricks Lakehouse| Delta Lake| Spark| and PySpark.Architect
batch and real-time data pipelines on Azure/AWS/GCP.Lead ETL modernization and
migration from Informatica PowerCenter/IICS/IDMC to Databricks.Define data
governance| security| performance optimization| and best practices.Collaborate
with business and technical teams to deliver enterprise data solutions.
Essential Skills: Required Skills:-Strong expertise in
Databricks| Spark| PySpark| SQL| Delta Lake| Unity Catalog.Hands-on experience
with Informatica PowerCenter and/or IICS/IDMC.Experience in data warehousing|
data modeling| and cloud platforms (Azure preferred).Knowledge of CI/CD| Git|
and Agile methodologies.Preferred Skills:-Databricks and Cloud
certifications.Experience with Snowflake| Azure Synapse| Kafka| or Data
Governance tools.
Desirable Skills:
Keyword:
Skills: Digital : Databricks
Experience Required: 10 & Above