Assessment for AI Application Builders
Design beginner-friendly AI assessment challengesc for CS students, bootcamp graduates, and career changers
Create a free account to upload your work. Your progress saves as a draft until you submit.
What You'll Be Doing
Traditional hiring misses brilliant talent because it focuses on credentials over capabilities. Your mission is to design a beginner-friendly AI challenge that works for both computer science students and career changers. Using AI tools like Claude or ChatGPT, you'll create one complete challenge with basic support materials.
Your Challenge: Design a 1-hour AI challenge for entry-level candidates, including the problem statement, evaluation criteria, and beginner guidance—all created with AI assistance.
Core Deliverable: One Complete AI Challenge Package
Challenge Problem Statement (10 minutes)
Pick one AI application area (customer service chatbot, document analysis, or data insights) Write clear instructions that work for both CS students and career changers Include starter context/data that candidates can work with
Beginner Support Materials (10 minutes)
- Create 2-3 helpful hints or examples using AI assistance
- Write a brief "Getting Started" guide for non-technical backgrounds
- Include success criteria that candidates can self-assess against
Simple Evaluation Rubric (5 minutes)
- Design 3-4 scoring criteria focused on problem-solving approach
- Emphasize thought process over technical sophistication
- Include examples of what "good" looks like at different experience levels
Video Walkthrough (5 minutes)
- Record yourself explaining the challenge from a beginner's perspective
- Show how AI tools helped you create inclusive content
- Demonstrate one key piece of your support materials
Recommended AI Usage:
- Content Creation: Use ChatGPT/Claude to generate challenge scenarios, sample data, and example solutions
- Accessibility Review: Ask AI to review your content for jargon, assumptions, and accessibility barriers
- Multiple Perspectives: Generate content variations for different candidate backgrounds
- Rubric Development: Create scoring criteria that measure potential over polish
Strong Challenge Characteristics:
- Problem feels realistic and engaging (not academic)
- Instructions are jargon-free but still rigorous
- Support materials reduce anxiety without giving away answers
- Evaluation focuses on problem-solving logic over perfect syntax
- AI assistance is documented and strategic
Career Impact: This challenge prepares you for roles in educational technology, learning & development, and inclusive product design—fast-growing fields where companies need people who understand both technical content and accessibility. Experience with AI-assisted content creation is becoming essential as 68% of educational content creators now use these tools
Challenge Guidelines
Recommended AI Usage:
- Content Creation: Use ChatGPT/Claude to generate challenge scenarios, sample data, and example solutions
- Accessibility Review: Ask AI to review your content for jargon, assumptions, and accessibility barriers
- Multiple Perspectives: Generate content variations for different candidate backgrounds
- Rubric Development: Create scoring criteria that measure potential over polish
Anti-Gaming Note Challenge scenarios will be randomized (different AI applications, target industries, candidate backgrounds) to ensure authentic responses. The video component makes generic submissions impossible since you must demonstrate understanding of your specific scenario and design choices.
What You'll Accomplish
- Collaborate with AI to build impactful educational content
- Learn how to develop assessments that are fair and unbiased
- Understand how to conduct an accessibility review of content
How Your Work Will Be Scored
What to Submit
Beginner Support Materials (15 minutes)
- Create 2-3 helpful hints or examples using AI assistance
- Write a brief "Getting Started" guide for non-technical backgrounds
- Include success criteria that candidates can self-assess against
Simple Evaluation Rubric (10 minutes)
- Design 3-4 scoring criteria focused on problem-solving approach
- Emphasize thought process over technical sophistication
- Include examples of what "good" looks like at different experience levels
Video Walkthrough (5 minutes)
- Record yourself explaining the challenge from a beginner's perspective
- Show how AI tools helped you create inclusive content
- Demonstrate one key piece of your support materials
Beginner Support Materials
Format: .pdf, .doc, .docx, .rtf, .txt, .md
Include:
- 2-3 helpful hints or examples using AI assistance
- A brief "Getting Started" guide for non-technical backgrounds
- Success criteria candidates can self-assess against
- 3-4 scoring criteria focused on problem-solving approach with examples of what "good" looks like at different experience levels
Sign in to upload files
Video Recording
Format: .mp4, .mov, .webm
Record yourself explaining the challenge from a beginner's perspective. Show how AI tools helped you create inclusive content and demonstrate one key piece of your support materials.
Sign in to upload files
Create a free account to upload your work. Your progress saves as a draft until you submit.
On this page