Senior Data Engineer

San Francisco

Formation is seeking a Data Software Engineer to help develop our flagship product. We are using reinforcement learning to solve interesting problems at scale. You will be contributing to the development and maintenance of complex data pipelines as well as the Formation Data Platform.

Key Responsibilities:

  • Lead projects, including working across organizational boundaries to drive work to completion.
  • Design and develop framework to automate ingestion and integration of structured data from a wide variety of enterprise data sources, at scale
  • Design and develop data pipeline components and integrate them with the Formation Platform
  • Design data quality monitoring and automated data cleaning

Skills and Experience:

  • 5 years of software development experience
  • Experience with building scalable and reliable data pipelines using Big Data engine technologies like Spark, AWS EMR, Redshift, etc.
  • Experience with scalable data integration technologies like ETL or Data Virtualization
  • Competence with SQL

Bonus Points:

  • SaaS experience
  • Experience using Scala, or willingness to learn Scala and demonstrated competence with functional programming
  • Experience with cloud technologies such as AWS or Google Cloud

About Formation

Formation distills complex customer data into uniquely tailored experiences; we orchestrate physical and digital exchanges into one seamless journey. Our business is building lasting, trusted relationships between people and brands—and making it look easy.

We're already reaching millions of people a day, and we're just getting started. Our founding leadership is equal parts business, design, and engineering—because we believe differing perspectives + passionate discourse achieve the greatest outcomes. We are collectively talented, but also humble. We give our whole selves. We love learning new things.

Formation is committed to inclusion and diversity and is an equal opportunity employer. All applicants will receive consideration without regard to race, color, religion, gender, gender identity, sexual orientation, national origin, disability, or veteran status.

If you're up for the challenge of a lifetime, we're looking for outstanding talent to join our team.