About this role
In this role, you will contribute to a groundbreaking project aimed at testing the capabilities of advanced AI systems in solving complex scientific and engineering challenges. As a task designer, your primary responsibility will be to create original, graduate-level computational problems that evaluate whether AI can effectively utilize real scientific software for research purposes, including running simulations, interpreting results, designing experiments, and extracting hidden insights from data.
This position goes beyond typical data-labeling tasks. You will design intricate problems based on authentic scientific workflows, rigorously test them against state-of-the-art AI models, and refine them to achieve the appropriate level of difficulty.
Key Responsibilities- Develop problems that necessitate the adept use of specialized scientific software, requiring the AI to compute precise answers from a fully defined setup or to strategically plan queries or experiments to uncover non-visible information.
- Engage in a testing loop with advanced AI models, refining problems until they meet the desired difficulty level.
We are particularly interested in candidates with extensive, hands-on experience in:
- Electrical Engineering & RF/Circuit Design, Proficiency with scikit-rf for RF and microwave network analysis, S-parameter characterization, and transmission-line modeling, or ngspice for circuit simulation, operating point analysis, and frequency response characterization. Candidates should be adept at designing problems that involve recovering circuit parameters from measurement data.
The ideal candidate will possess graduate-level expertise (MS or PhD preferred) in the relevant domain, along with practical experience using the specified tools. You should have a proven track record of writing code with these libraries to address real research problems, understanding their limitations, edge cases, and the nuances that make a problem genuinely challenging.
Additionally, successful candidates will exhibit puzzle-design thinking, crafting problems where the challenge stems from intelligent reasoning rather than mere computation, and where careful analysis is required to discern the correct approach.
Requirements- Graduate-level training in a relevant STEM field (MS, PhD, or equivalent research experience)
- Demonstrated proficiency with at least one of the specified scientific software libraries, evidenced by research publications, open-source contributions, or professional experience
- Strong Python programming skills for writing problem setups, oracle functions, and solution validators
- Ability to work independently and iterate on problem designs based on feedback
- Comfortable operating in a Linux/terminal environment with remote compute sandboxes
- Availability for at least 15, 20 hours per week
- Experience across multiple listed domains or tools
- Familiarity with benchmark or evaluation design
- Background in scientific teaching or exam/problem-set design
- Experience with computational reproducibility and containerized environments
Please note: This application includes a coding assessment as part of the evaluation process.