Usability Test Observation Checklist

Session Information

Test Date: **___** Participant ID: P_ (e.g., P01, P02) Facilitator: ****_**** Observer/Note-Taker: **___** Feature Tested: **___** Session Start Time: **___** Session End Time: **___**

Participant Profile

Role: ☐ Application Developer ☐ Platform Engineer ☐ DevOps ☐ SRE ☐ Other: **__** Experience Level: ☐ Junior (0-2 years) ☐ Mid (3-5 years) ☐ Senior (6+ years) Platform Familiarity: ☐ New User ☐ Occasional ☐ Regular ☐ Power User Tech Stack: **___**

Task Performance Tracking

Task 1: [Task Name]

Time Started: ___ Time Completed: ___ Duration: ___ min

Task Status: ☐ Success - Completed without assistance ☐ Partial Success - Completed with hints/help ☐ Failure - Could not complete

Confidence Rating (1-5): [ ] Assistance Needed: ☐ None ☐ Minor Hint ☐ Significant Help ☐ Task Abandoned

Path Taken:

First action: **___**
Second action: **___**
Third action: **___**
[Continue as needed]

Expected Path: ☐ Followed expected path ☐ Deviated but recovered ☐ Completely different approach

Errors/Wrong Turns:

[ ] ***
[ ] ***
[ ] ***

Direct Quotes:

"**********___**********"

"**********___**********"

Observed Behaviors: ☐ Hesitation (where? **__**) ☐ Backtracking (from where? **__**) ☐ Scanning/searching (for what? **__**) ☐ Confusion (about what? **__**) ☐ Frustration (when? **__**) ☐ Delight/satisfaction (when? **__**) ☐ Surprise (at what? **__**)

Issues Encountered:

Severity	Description	Impact
☐ Critical ☐ Major ☐ Minor
☐ Critical ☐ Major ☐ Minor

Task 2: [Task Name]

[Repeat the same structure as Task 1]

Time Started: ___ Time Completed: ___ Duration: ___ min

Task Status: ☐ Success ☐ Partial Success ☐ Failure

Confidence Rating (1-5): [ ] Assistance Needed: ☐ None ☐ Minor Hint ☐ Significant Help ☐ Task Abandoned

Path Taken:

First action: **___**
Second action: **___**
Third action: **___**

Expected Path: ☐ Followed expected path ☐ Deviated but recovered ☐ Completely different approach

Errors/Wrong Turns:

[ ] ***
[ ] ***

Direct Quotes:

"**********___**********"

"**********___**********"

Observed Behaviors: ☐ Hesitation ☐ Backtracking ☐ Scanning/searching ☐ Confusion ☐ Frustration ☐ Delight ☐ Surprise

Issues Encountered:

Severity	Description	Impact
☐ Critical ☐ Major ☐ Minor

Task 3: [Task Name]

[Repeat the same structure]

Behavioral Observations

Emotional Reactions

Frustration Moments:

Timestamp: ___ - Trigger: **___**
Timestamp: ___ - Trigger: **___**

Confusion Points:

Timestamp: ___ - About: **___**
Timestamp: ___ - About: **___**

Delight/Positive Reactions:

Timestamp: ___ - When: **___**
Timestamp: ___ - When: **___**

Surprise/Unexpected:

Timestamp: ___ - At: **___**
Timestamp: ___ - At: **___**

Think-Aloud Quality

☐ Excellent - Constant narration, very revealing ☐ Good - Regular commentary with prompting ☐ Fair - Occasional thoughts, needed frequent reminders ☐ Poor - Minimal verbalization despite prompting

Notes on thought process:

Menu/Navigation Usage:

Relied heavily on: **___**
Avoided: **___**
Expected to find but didn't: **___**

Search Behavior: ☐ Used search feature ☐ Did not use search ☐ Tried but failed to find search Search terms used: **___**

Visual Scanning:

Where did eyes go first? **___**
What did they overlook? **___**
What caught attention immediately? **___**

Usability Issues Log

Issue 1

Severity: ☐ Critical ☐ Major ☐ Minor ☐ Enhancement Task: [Task number and name] Timestamp: ___ Description: **___** User Quote: "**********___**********" Impact: ☐ Blocked task ☐ Significant delay ☐ Minor frustration ☐ Suggestion Frequency: ☐ First time seen ☐ Seen before ☐ Pattern emerging Workaround Found: ☐ Yes ☐ No Recommendation: **___**

Issue 2

[Repeat structure for each issue]

Post-Task Questions Summary

Overall Ease of Use Rating (1-5): [ ] Rationale: **___**

Most Difficult Task: **___** Why: **___**

Easiest Task: **___** Why: **___**

Biggest Surprise (positive or negative): **___**

What's Missing: **___**

One Thing to Change: **___**

Likelihood to Recommend (1-5): [ ] Why: **___**

Overall Assessment

Success Metrics Summary

Metric	Result
Overall task success rate	*% (*/___)
Average task completion time	___ minutes
Average confidence rating	___/5
Number of critical issues	___
Number of major issues	___
Number of minor issues	___
Overall ease of use rating	___/5
Likelihood to recommend	___/5

Key Takeaways

Top 3 Insights:

Critical Issues to Address:

[ ] ***
[ ] ***

Positive Findings:

[ ] ***
[ ] ***

Quotes for Report:

"**********___**********"

"**********___**********"

"**********___**********"

Next Steps

Immediate Actions:

[ ] File detailed session notes within 24 hours
[ ] Create GitHub issues for critical problems
[ ] Share urgent findings with team
[ ] Update issue tracking spreadsheet
[ ] Add to pattern analysis

Follow-Up:

[ ] Schedule debrief with facilitator
[ ] Review recording for missed details
[ ] Cross-reference with other sessions
[ ] Prepare for next participant

Additional Notes

Technical Issues:

Participant Feedback on Process:

Observer Insights:

Ideas for Improvement:

Checklist Version: 1.0 Last Updated: December 2025 Owner: Product Team