AI training & evaluation
AWS Serverless & Infrastructure-as-Code Task Auditor
Mercor
Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models.
- Work arrangement & location
- Remote · Current location: United States
- Engagement
- hourly
Location and residence requirements
- Current location
- United States
Employer’s location wording: Remote — United States
- Software Engineering
Employer description and requirements
Evaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and cross-service integration correctness — and provide clear, rubric-based written feedback.
Basic Qualifications • 3+ years hands-on experience building multi-service AWS serverless applications (Lambda, API Gateway, DynamoDB/Streams, S3, EventBridge, SNS/SQS, Step Functions) • Strong experience with infrastructure-as-code (AWS CDK, CloudFormation, or SAM) • Demonstrated ability to assess event-driven architecture correctness, IAM/permission boundaries, and failure/retry semantics • Familiarity with local emulation/testing fidelity (e.g., LocalStack) versus real AWS behavior
Preferred Qualifications • AWS certifications (Solutions Architect / Developer) • Experience with observability and cost-optimization for serverless workloads • Prior code-review or task-grading experience