Software Engineer - Data

San Francisco

Formation is seeking an experienced big data software engineer to help develop our flagship product. We are using reinforcement learning to solve interesting problems at scale. You will be leading the architecture, development, and maintenance of complex data pipelines that are integrated into the flagship Formation Platform. This is an exciting opportunity to work professionally in a purely functional language.
Key Responsibilities:
  • Architect and develop data pipeline components and integrate them with the Formation Platform
  • Scale pipelines to meet performance requirements
  • Provide leadership to junior Data Engineers
  • Design data quality monitoring and automated data cleaning
Skills and Experience:
  • 5+ years of software development experience
  • 3+ years of experience with building scalable and reliable data pipelines using Big Data engine technologies like Spark, AWS EMR, Kafka, Redshift, etc.
  • Significant experience writing the functional side of Scala or Haskell
  • Experience scaling ETL and machine learning pipelines
  • Experience with cloud technologies such as AWS or Google Cloud
Bonus Points:
  • SaaS experience
About Formation
Formation distills complex customer data into uniquely tailored experiences; we orchestrate physical and digital exchanges into one seamless journey. Our business is building lasting, trusted relationships between people and brands—and making it look easy.
We're already reaching millions of people a day, and we're just getting started. Our founding leadership is equal parts business, design, and engineering—because we believe differing perspectives + passionate discourse achieve the greatest outcomes. We are collectively talented, but also humble. We give our whole selves. We love learning new things.
Formation is committed to inclusion and diversity and is an equal opportunity employer.  All applicants will receive consideration without regard to race, color, religion, gender, gender identity, sexual orientation, national origin, disability, or veteran status.
If you're up for the challenge of a lifetime, we're looking for outstanding talent to join our team.