Activities
If you choose to participate, you will complete the following sequence of activities during your session:
- Pre-Assessment Survey (10 minutes): You will complete a brief questionnaire capturing your demographic data and baseline programming experience to ensure the tool is evaluated fairly across diverse learner backgrounds.
- Familiarization Phase (10 minutes): You will practice using the system on simple, low-stakes problems to get comfortable with the drag-and-drop interface, code indentation, and the sequential lock-in mechanism.
- Jielewe AI Assessment (40-50 minutes): You will select a Python concept and solve a series of dynamically generated coding puzzles. For each problem, you will complete a Four-Tier Diagnostic Test (FTDT): you will arrange the code blocks, rate your confidence in your solution, select an AI-generated reasoning option explaining why your logic is correct, and rate your confidence in that reasoning.
- Post-Assessment Survey (10 minutes): You will complete a final survey utilizing the NASA Task Load Index (TLX) to measure the subjective mental workload you experienced and to provide feedback on the platform's usability.