We are looking for Data Engineers to work remotely for an Adtech company that leverages machine learning and data science to build an identity graph that can scale to reach millions of users via brands with programmatically selected households. The work includes scaling our Big Data asset that combines billions of transaction data points including intent, conversions, first party data into an identity graph.
We value technical excellence and you will have both resources and time to deliver world-class code.
This is a 100% remote position, You will be working with team members in NYC.
If you like solving hard and technically challenging problems, join us to use those skills here to create real-time, concurrent, globally distributed systems applications and services.
• 8+ years of professional software engineering experience, with a focus on data engineering in big data environments.
• Expert-level proficiency in Python and at least one other high-level programming language (e.g., Java, Scala, C++, C#).
• Proven experience building and optimizing large-scale data pipelines using Apache Spark.
• Hands-on experience developing and deploying data solutions in a major cloud platform (AWS, GCP, or Azure).
• Experience working with AI, LLMs, Agents, and/or Generative AI technologies, both in product applications and for development productivity.
• Relevant technology experience working in the advertising industry.
• Experience with Scala
• Experience with big data visualization and analytics using OLAP tools.
• Familiarity with big data tools and frameworks such as MLFlow, dbt, Kafka, Airflow or Databricks.
• Experience with large-scale data management formats like Parquet, Delta Lake, or Iceberg.