Formation is seeking an experienced big data software engineer to help develop our flagship product. We are using reinforcement learning to solve interesting problems at scale. You will be leading the architecture, development, and maintenance of complex data pipelines that are integrated into the flagship Formation Platform. This is an exciting opportunity to work professionally in a purely functional language.
Architect and develop data pipeline components and integrate them with the Formation Platform
Scale pipelines to meet performance requirements
Provide leadership to junior Data Engineers
Design data quality monitoring and automated data cleaning
Skills and Experience:
5+ years of software development experience
3+ years of experience with building scalable and reliable data pipelines using Big Data engine technologies like Spark, AWS EMR, Kafka, Redshift, etc.
Significant experience writing the functional side of Scala or Haskell
Experience scaling ETL and machine learning pipelines
Experience with cloud technologies such as AWS or Google Cloud
Formation distills complex customer data into uniquely tailored experiences; we orchestrate physical and digital exchanges into one seamless journey. Our business is building lasting, trusted relationships between people and brands—and making it look easy.
We're already reaching millions of people a day, and we're just getting started. Our founding leadership is equal parts business, design, and engineering—because we believe differing perspectives + passionate discourse achieve the greatest outcomes. We are collectively talented, but also humble. We give our whole selves. We love learning new things.
Formation is committed to inclusion and diversity and is an equal opportunity employer. All applicants will receive consideration without regard to race, color, religion, gender, gender identity, sexual orientation, national origin, disability, or veteran status.
If you're up for the challenge of a lifetime, we're looking for outstanding talent to join our team.