Challenges/Provn/General/Assessment for AI Application Builders

Assessment for AI Application Builders

Design beginner-friendly AI assessment challengesc for CS students, bootcamp graduates, and career changers

content management
marketing
learning & development
Estimated Time:
30 minutes
Difficulty:Intermediate
Status:Not started
Start this challenge

Create a free account to upload your work. Your progress saves as a draft until you submit.

What You'll Be Doing

Traditional hiring misses brilliant talent because it focuses on credentials over capabilities. Your mission is to design a beginner-friendly AI challenge that works for both computer science students and career changers. Using AI tools like Claude or ChatGPT, you'll create one complete challenge with basic support materials.

Your Challenge: Design a 1-hour AI challenge for entry-level candidates, including the problem statement, evaluation criteria, and beginner guidance—all created with AI assistance.

Core Deliverable: One Complete AI Challenge Package

Challenge Problem Statement (10 minutes)

Pick one AI application area (customer service chatbot, document analysis, or data insights) Write clear instructions that work for both CS students and career changers Include starter context/data that candidates can work with

Beginner Support Materials (10 minutes)

  • Create 2-3 helpful hints or examples using AI assistance
  • Write a brief "Getting Started" guide for non-technical backgrounds
  • Include success criteria that candidates can self-assess against

Simple Evaluation Rubric (5 minutes)

  • Design 3-4 scoring criteria focused on problem-solving approach
  • Emphasize thought process over technical sophistication
  • Include examples of what "good" looks like at different experience levels

Video Walkthrough (5 minutes)

  • Record yourself explaining the challenge from a beginner's perspective
  • Show how AI tools helped you create inclusive content
  • Demonstrate one key piece of your support materials

Recommended AI Usage:

  • Content Creation: Use ChatGPT/Claude to generate challenge scenarios, sample data, and example solutions
  • Accessibility Review: Ask AI to review your content for jargon, assumptions, and accessibility barriers
  • Multiple Perspectives: Generate content variations for different candidate backgrounds
  • Rubric Development: Create scoring criteria that measure potential over polish

Strong Challenge Characteristics:

  • Problem feels realistic and engaging (not academic)
  • Instructions are jargon-free but still rigorous
  • Support materials reduce anxiety without giving away answers
  • Evaluation focuses on problem-solving logic over perfect syntax
  • AI assistance is documented and strategic

Career Impact: This challenge prepares you for roles in educational technology, learning & development, and inclusive product design—fast-growing fields where companies need people who understand both technical content and accessibility. Experience with AI-assisted content creation is becoming essential as 68% of educational content creators now use these tools

Challenge Guidelines

Recommended AI Usage:

  • Content Creation: Use ChatGPT/Claude to generate challenge scenarios, sample data, and example solutions
  • Accessibility Review: Ask AI to review your content for jargon, assumptions, and accessibility barriers
  • Multiple Perspectives: Generate content variations for different candidate backgrounds
  • Rubric Development: Create scoring criteria that measure potential over polish

Anti-Gaming Note Challenge scenarios will be randomized (different AI applications, target industries, candidate backgrounds) to ensure authentic responses. The video component makes generic submissions impossible since you must demonstrate understanding of your specific scenario and design choices.

What You'll Accomplish

  • Collaborate with AI to build impactful educational content
  • Learn how to develop assessments that are fair and unbiased
  • Understand how to conduct an accessibility review of content

How Your Work Will Be Scored

Clear Communication (40%): Can a career changer understand what to do?AI-Assisted Design (30%): Smart use of AI for content creation and accessibilityPractical Assessment (20%): Would this actually help employers identify talent?Inclusive Approach (10%): Does this work for diverse backgrounds

What to Submit

Beginner Support Materials (15 minutes)

  • Create 2-3 helpful hints or examples using AI assistance
  • Write a brief "Getting Started" guide for non-technical backgrounds
  • Include success criteria that candidates can self-assess against

Simple Evaluation Rubric (10 minutes)

  • Design 3-4 scoring criteria focused on problem-solving approach
  • Emphasize thought process over technical sophistication
  • Include examples of what "good" looks like at different experience levels

Video Walkthrough (5 minutes)

  • Record yourself explaining the challenge from a beginner's perspective
  • Show how AI tools helped you create inclusive content
  • Demonstrate one key piece of your support materials

Beginner Support Materials

DocumentRequired

Format: .pdf, .doc, .docx, .rtf, .txt, .md

Include:

  1. 2-3 helpful hints or examples using AI assistance
  2. A brief "Getting Started" guide for non-technical backgrounds
  3. Success criteria candidates can self-assess against
  4. 3-4 scoring criteria focused on problem-solving approach with examples of what "good" looks like at different experience levels

Sign in to upload files

Video Recording

Video · 5 min maxRequired

Format: .mp4, .mov, .webm

Record yourself explaining the challenge from a beginner's perspective. Show how AI tools helped you create inclusive content and demonstrate one key piece of your support materials.

Sign in to upload files