Challenges/Provn/General/Assessment for AI Application Builders

    Assessment for AI Application Builders

    Design beginner-friendly AI assessment challengesc for CS students, bootcamp graduates, and career changers

    content management
    marketing
    learning & development
    Estimated Time:
    30 minutes
    Difficulty:Intermediate
    Status:Not started
    Start this challenge

    Create a free account to upload your work. Your progress saves as a draft until you submit.

    What You'll Be Doing

    Traditional hiring misses brilliant talent because it focuses on credentials over capabilities. Your mission is to design a beginner-friendly AI challenge that works for both computer science students and career changers. Using AI tools like Claude or ChatGPT, you'll create one complete challenge with basic support materials.

    Your Challenge: Design a 1-hour AI challenge for entry-level candidates, including the problem statement, evaluation criteria, and beginner guidance—all created with AI assistance.

    Core Deliverable: One Complete AI Challenge Package

    Challenge Problem Statement (10 minutes)

    Pick one AI application area (customer service chatbot, document analysis, or data insights) Write clear instructions that work for both CS students and career changers Include starter context/data that candidates can work with

    Beginner Support Materials (10 minutes)

    • Create 2-3 helpful hints or examples using AI assistance
    • Write a brief "Getting Started" guide for non-technical backgrounds
    • Include success criteria that candidates can self-assess against

    Simple Evaluation Rubric (5 minutes)

    • Design 3-4 scoring criteria focused on problem-solving approach
    • Emphasize thought process over technical sophistication
    • Include examples of what "good" looks like at different experience levels

    Video Walkthrough (5 minutes)

    • Record yourself explaining the challenge from a beginner's perspective
    • Show how AI tools helped you create inclusive content
    • Demonstrate one key piece of your support materials

    Recommended AI Usage:

    • Content Creation: Use ChatGPT/Claude to generate challenge scenarios, sample data, and example solutions
    • Accessibility Review: Ask AI to review your content for jargon, assumptions, and accessibility barriers
    • Multiple Perspectives: Generate content variations for different candidate backgrounds
    • Rubric Development: Create scoring criteria that measure potential over polish

    Strong Challenge Characteristics:

    • Problem feels realistic and engaging (not academic)
    • Instructions are jargon-free but still rigorous
    • Support materials reduce anxiety without giving away answers
    • Evaluation focuses on problem-solving logic over perfect syntax
    • AI assistance is documented and strategic

    Career Impact: This challenge prepares you for roles in educational technology, learning & development, and inclusive product design—fast-growing fields where companies need people who understand both technical content and accessibility. Experience with AI-assisted content creation is becoming essential as 68% of educational content creators now use these tools

    Challenge Guidelines

    Recommended AI Usage:

    • Content Creation: Use ChatGPT/Claude to generate challenge scenarios, sample data, and example solutions
    • Accessibility Review: Ask AI to review your content for jargon, assumptions, and accessibility barriers
    • Multiple Perspectives: Generate content variations for different candidate backgrounds
    • Rubric Development: Create scoring criteria that measure potential over polish

    Anti-Gaming Note Challenge scenarios will be randomized (different AI applications, target industries, candidate backgrounds) to ensure authentic responses. The video component makes generic submissions impossible since you must demonstrate understanding of your specific scenario and design choices.

    What You'll Accomplish

    • Collaborate with AI to build impactful educational content
    • Learn how to develop assessments that are fair and unbiased
    • Understand how to conduct an accessibility review of content

    How Your Work Will Be Scored

    Clear Communication (40%): Can a career changer understand what to do?AI-Assisted Design (30%): Smart use of AI for content creation and accessibilityPractical Assessment (20%): Would this actually help employers identify talent?Inclusive Approach (10%): Does this work for diverse backgrounds

    What to Submit

    Beginner Support Materials (15 minutes)

    • Create 2-3 helpful hints or examples using AI assistance
    • Write a brief "Getting Started" guide for non-technical backgrounds
    • Include success criteria that candidates can self-assess against

    Simple Evaluation Rubric (10 minutes)

    • Design 3-4 scoring criteria focused on problem-solving approach
    • Emphasize thought process over technical sophistication
    • Include examples of what "good" looks like at different experience levels

    Video Walkthrough (5 minutes)

    • Record yourself explaining the challenge from a beginner's perspective
    • Show how AI tools helped you create inclusive content
    • Demonstrate one key piece of your support materials

    Beginner Support Materials

    DocumentRequired

    Format: .pdf, .doc, .docx, .rtf, .txt, .md

    Include:

    1. 2-3 helpful hints or examples using AI assistance
    2. A brief "Getting Started" guide for non-technical backgrounds
    3. Success criteria candidates can self-assess against
    4. 3-4 scoring criteria focused on problem-solving approach with examples of what "good" looks like at different experience levels

    Sign in to upload files

    Video Recording

    Video · 5 min maxRequired

    Format: .mp4, .mov, .webm

    Record yourself explaining the challenge from a beginner's perspective. Show how AI tools helped you create inclusive content and demonstrate one key piece of your support materials.

    Sign in to upload files