📈 Impact Metrics and Evaluation¶
Purpose¶
This document defines how the effectiveness of IT1009C: Introduction to Python for Information Technology and its reusable Python foundations materials is measured.
The goal is to evaluate: - student learning - skill development - confidence growth - program usability and scalability
This framework supports instructors, program coordinators, and external stakeholders (e.g., grant reviewers).
📊 Participation Metrics¶
These metrics track student engagement and completion:
- % of students completing all required notebooks
- % of students completing the final mini project
- % of students actively participating in notebook exercises
🧠 Skill Development Metrics¶
These metrics evaluate core programming abilities:
- % of students able to run a Python program independently
- % of students able to modify code correctly
- % of students able to produce expected output after making changes
- % of students able to complete guided tasks with minimal support
🧪 Debugging and Problem-Solving Metrics¶
- % of students able to identify a syntax error
- % of students able to fix at least one error independently
- % of students demonstrating persistence in debugging tasks
🎯 Learning Outcome Metrics¶
These align with course-level learning outcomes:
- % of students demonstrating understanding of:
- variables
- input/output
- conditionals
- loops
- lists
💬 Reflection and Understanding Metrics¶
- % of students able to explain what their code does in their own words
- % of students able to describe how their program solves a problem
- quality of reflection responses (clarity, correctness, completeness)
🚀 Mini Project Success Metrics¶
- % of students completing a functional program
- % of students meeting core project requirements
- % of students demonstrating correct logic in their program
📉 Confidence and Attitude Metrics¶
Collected through short surveys:
- % of students reporting increased confidence in programming
- % of students reporting reduced fear or anxiety about coding
- % of students expressing willingness to continue learning programming
🌍 Career Awareness Metrics¶
- % of students able to identify at least one field where Python is used
- % of students expressing interest in areas such as:
- data analysis
- artificial intelligence
- IT systems or software development
👩🏫 Instructor Observations¶
Instructors may document:
- common student challenges
- engagement levels
- pacing effectiveness
- areas needing improvement
📈 Program Success Indicators¶
The program is considered successful if:
- most students complete the course
- students demonstrate basic programming understanding
- students show increased confidence interacting with code
- students recognize the real-world relevance of programming
🔁 Continuous Improvement¶
Collected data should be used to:
- refine notebook content
- adjust pacing and activities
- improve instructional guidance
- enhance student support materials
📌 Final Note¶
The goal of this program is not mastery, but:
- access
- confidence
- foundational understanding
These metrics are designed to reflect that purpose.