Data Engineer
We are seeking a Data Engineer. You build reliable batch and real-time pipelines that turn messy data into trusted datasets for products and analytics. You partner with engineers and analysts to integrate data across platforms while keeping performance, security and scalability in mind.
Responsibilities
- Design and deliver data tables, views and marts across data warehouse, data lake and operational data stores
- Build and maintain batch and real-time data pipelines using modern data processing frameworks
- Develop ETL and ELT workflows including extraction, cleansing, transformation and orchestration
- Integrate data from multiple systems in a scalable, compliant way
- Build and maintain Back-end APIs and database services that support applications
- Collaborate with project and product teams to deliver data-driven features end to end
- Improve quality through automated testing, code reviews and pair programming
- Contribute in Agile teams practicing continuous integration and continuous delivery
Requirements
- Proven experience building production-grade data pipelines and data integrations (ETL or ELT)
- Hands-on expertise in SQL for transformation, validation and performance tuning
- Hands-on experience with Python for data processing and automation
- Experience with cloud platforms such as Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform (GCP)
- Strong background in data modeling and storage patterns including data warehouse, data lake and data mart
- Knowledge of big data tools such as Apache Spark, Apache Kafka or Hadoop
- Familiarity with REST APIs and web protocols
- Understanding of data governance, access control and security best practices
Nice to have
- Experience with Apache Airflow and relational database integrations
- Experience with Snowflake, Databricks or similar platforms
- Experience with web scraping tools such as Selenium or BeautifulSoup
Benefits
By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023.
Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters
You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices
We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey
At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us