About this role
Build and scale the data infrastructure behind AI-driven products and research, enabling reliable data processing, experimentation, and model development across large, distributed datasets.
Key Responsibilities- Design, build, and maintain scalable pipelines that ingest, process, and transform large datasets from multiple sources.
- Develop and optimize distributed processing workflows with Spark and cloud-native technologies.
- Build and maintain scalable, high-performing, reliable SQL and NoSQL data storage solutions.
- Design AWS data architectures for high-volume ingestion, processing, and distribution.
- Write efficient Python and SQL for data extraction, transformation, validation, and analysis.
- Maintain data quality, integrity, monitoring, and operational reliability across pipelines and storage layers.
- Partner with AI researchers, data scientists, and engineers on data-intensive applications and experimentation.
- Implement automation, orchestration, and monitoring to support efficient, scalable data operations.
- Strong Python, SQL, and Apache Spark skills.
- Hands-on experience with AWS data services and cloud-native data architecture.
- Experience with SQL and NoSQL databases and large-scale distributed data processing.
- Strong knowledge of data partitioning, performance optimization, and scalable data architectures.
- Exposure to AI or machine learning workflows or research environments.
- Experience with Matplotlib, Seaborn, Plotly, or similar data visualization tools.
- Familiarity with data workflows for LLM training, evaluation, or prompt experimentation.
- Full-time, remote position.
- Advertised compensation is $140, 000 to $180, 000 annually.
- The national base salary range is $100, 000 to $150, 000 USD annually.
- Eligible for equity compensation and, depending on role and company policies, performance-based bonuses.
- Benefits include up to 100% reimbursement of health insurance premiums, paid time off, a 401(k) plan with company match, and additional remote-workforce benefits.
- Qualified applicants receive consideration without regard to protected characteristics under applicable laws.
Applicants who need assistance or a reasonable accommodation during the application process may contact the hiring support team.