Finance and Operations Expert for AI Model Evaluation
from $50/hour
About this role
Role Overview:
This position offers an exciting opportunity for experienced finance and accounting professionals to leverage their expertise in the realm of artificial intelligence. You will play a crucial role in contributing senior domain knowledge to data curation for frontier AI models and labs, supporting a longitudinal finance and business operations dataset utilized by AI developers, enterprise teams, and research groups.
As part of the senior reviewer track, you will lead the review of complex financial and operational scenarios, develop evaluation frameworks, and serve as an expert advisor for client teams assessing AI model outputs. This role is ideal for finance professionals eager to influence AI evaluation methodologies and contribute to the foundational infrastructure of financial AI systems.
Key Responsibilities- Lead senior-level reviews of complex or ambiguous finance, accounting, and operational business cases.
- Facilitate structured resolution of disagreements among reviewers.
- Contribute to the development of financial evaluation frameworks.
- Provide expert advisory hours to client teams reviewing AI model outputs.
- Author standards-aligned financial and operational commentary on cases as needed.
- Provide subject matter expertise across accounting, finance, tax, and business operations as appropriate.
- 5+ years of hands-on experience in finance, accounting, or operations at a US-based company, with exposure to retail, e-commerce, or consumer brands.
- Background in one or more of the following: Investment Banking (Retail/Consumer Coverage), Big 4 Audit or Advisory, Corporate FP&A, Controllership, DTC/E-commerce Operations.
- CPA and/or CFA strongly preferred.
- Direct familiarity with US GAAP and financial reporting standards, US tax structures (sales tax nexus, 1099s, W-2s), and US employment practices (I-9s, at-will employment, benefits administration).
- Practical knowledge of month-end close processes, board reporting, vendor negotiations, and fulfillment cycles.
- Experience using tools such as Shopify, QuickBooks, Zendesk, HubSpot, Workday, Slack, and Google Workspace.
- Strong written communication skills with the ability to adapt communication style to different audiences.
- High attention to numerical detail and ability to reconcile data across multiple interconnected documents and systems.
- Strong written articulation of financial reasoning suitable for review and evaluation.
- Ability to lead and document reviewer consensus.
- Disciplined adherence to project protocols.
- Prior exposure to AI evaluation, digital transformation initiatives, financial technology, or business process automation.
- Experience reviewing financial documentation, operational workflows, audit materials, or business process outputs.
- Experience mentoring, training, or managing finance teams.