Senior Data Scientist - Synthetic Data Generation (Remote)

About the Role

We are looking for a Senior Data Scientist - Synthetic Data Generation to join our innovative team at Poolside. This remote role focuses on enhancing the quality of datasets used for training our models, with a particular emphasis on generating synthetic data at scale. Your expertise will be crucial in defining high-quality data needs that align with our model capabilities and use cases.

What You'll Do

• Lead initiatives to improve the quality of pretraining datasets by leveraging your experience in synthetic data generation.
• Design and implement complex data pipelines that generate large volumes of diverse data while optimizing resource usage.
• Collaborate closely with teams such as Pretraining, Posttraining, Evals, and Product to ensure alignment on model quality.
• Continuously measure and refine dataset quality through quantitative data ablation experiments.
• Stay updated with the latest research in synthetic data generation and large language models (LLMs).

Requirements

• Strong background in machine learning and engineering.
• Experience with LLMs, including understanding their learning processes and scaling laws.
• Proficient in designing cost-efficient pipelines for generating synthetic datasets.
• Excellent programming skills in Python.
• Experience working with large-scale GPU clusters and distributed data pipelines.
• Strong obsession with data quality and experience in building trillion-scale pretraining datasets.

Nice to Have

• Research experience with publications in applied deep learning or LLMs.
• Familiarity with concepts like data curation, deduplication, and tokenization.

What We Offer

• Fully remote work with flexible hours.
• 37 days of vacation and holidays per year.
• Health insurance allowance for you and your dependents.
• Company-provided equipment and home office allowances.
• A culture that prioritizes wellbeing and continuous learning.
• Frequent team get-togethers to foster collaboration.