Usability of Interactions

<body topmargin=0 leftmargin=0 marginheight=0 marginwidth=0> <table cellpadding=0 cellspacing=0 border=0><tr> <td valign="top" colspan=2 height=95 BGCOLOR="#999999" TEXT="#080000" bgproperties="fixed" background="061005f0ermwup.png"> <div> <FONT SIZE="5" COLOR="#FFFFFF" FACE="Arial" ><B>EDIT 797 - Performance Based Design</B></FONT><B>     </B><B>|     </B><A HREF="index.htm" TARGET="_top" TITLE="EDIT 797 Performance Based Design"><U><B>home</B></U></A></div> <div> back to the start of<B>  </B><A HREF="id285.htm" TARGET="_top" TITLE="11/04/2002"><U><B>11/04/2002</B></U></A></div> </td> </tr><tr> <td valign="top" width=190 BGCOLOR="#FFFFFF" TEXT="#080000"> <div> <IMG BORDER="0" SRC="1x1.gif" HEIGHT="14" ALIGN="BOTTOM" HSPACE="0" VSPACE="0" WIDTH="14"><B>  </B><A HREF="id285.htm" TARGET="_top" TITLE="11/04/2002"><U><B><IMG SRC="05e0e0e0.png" border=0 width="14" height="14" ALIGN="BOTTOM" HSPACE="0" VSPACE="0"></B></U></A><B>      </B><A HREF="id238.htm" TARGET="_top" TITLE="Appropriate Interactions"><U><B><IMG SRC="05f0e0e0.png" border=0 width="14" height="14" ALIGN="BOTTOM" HSPACE="0" VSPACE="0"></B></U></A><B>  </B><A HREF="id240.htm" TARGET="_top" TITLE="Objects"><U><B><IMG SRC="0600e0e0.png" border=0 width="14" height="14" ALIGN="BOTTOM" HSPACE="0" VSPACE="0"></B></U></A></div> <div> <A HREF="id223.htm" TARGET="_top" TITLE="Typical"><U>Typical</U></A></div> <div> <A HREF="id225.htm" TARGET="_top" TITLE="Desired "><U>Desired </U></A></div> <div> <A HREF="id226.htm" TARGET="_top" TITLE="PerformanceCentered UI Design"><U>Performance-Centered UI Design</U></A></div> <div> <A HREF="id227.htm" TARGET="_top" TITLE="Interface Design Approach"><U>Interface Design Approach</U></A></div> <div> <A HREF="id228.htm" TARGET="_top" TITLE="Another Lifecycle..."><U>Another Lifecycle...</U></A></div> <div> <A HREF="id229.htm" TARGET="_top" TITLE="Orienting the Team"><U>Orienting the Team</U></A></div> <div> <A HREF="id230.htm" TARGET="_top" TITLE="ObjectAction Paradigm"><U>Object-Action Paradigm</U></A></div> <div> <A HREF="id231.htm" TARGET="_top" TITLE="Tasks"><U>Tasks</U></A></div> <div> <A HREF="id232.htm" TARGET="_top" TITLE="Interactions"><U>Interactions</U></A></div> <div> <A HREF="id233.htm" TARGET="_top" TITLE="Interactions: Personal Goals"><U>Interactions:  Personal Goals</U></A></div> <div> <A HREF="id234.htm" TARGET="_top" TITLE="Interactions: Business Goals"><U>Interactions:  Business Goals</U></A></div> <div> <A HREF="id235.htm" TARGET="_top" TITLE="Interactions: Practical Goals"><U>Interactions:  Practical Goals</U></A></div> <div> <A HREF="id236.htm" TARGET="_top" TITLE="Interactions: False Goals"><U>Interactions:  False Goals</U></A></div> <div> <A HREF="id237.htm" TARGET="_top" TITLE="Polite Interactions"><U>Polite Interactions</U></A></div> <div> <A HREF="id238.htm" TARGET="_top" TITLE="Appropriate Interactions"><U>Appropriate Interactions</U></A></div> <div> <B><IMG BORDER="0" SRC="Symb075c00b700c8bf000000.png" HEIGHT="13" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Usability of Interactions</B></div> <div> <A HREF="id240.htm" TARGET="_top" TITLE="Objects"><U>Objects</U></A></div> <div> <A HREF="id241.htm" TARGET="_top" TITLE="Actions"><U>Actions</U></A></div> <div> <A HREF="id242.htm" TARGET="_top" TITLE="The Interface"><U>The Interface</U></A></div> <div> <A HREF="id243.htm" TARGET="_top" TITLE="Test / Ensure Usability"><U>Test / Ensure Usability</U></A></div> </td> <td valign="top" height=385 BGCOLOR="#FFFFFF" TEXT="#080000"> <div> Usability of Interactions</div> <div> <IMG SRC="23568700.png" border=0 width="104" height="112" ALIGN="BOTTOM" HSPACE="0" VSPACE="0"></div> <bR> <div> <IMG BORDER="0" SRC="Symb075c00b70118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">A usability goal is specific and has measurable business value </div> <div> <IMG BORDER="0" SRC="Symb075c00b70118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Usability goals consist of attributes and measurement criteria</div> <div> <IMG BORDER="0" SRC="Symb075c00b70118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Attributes having business value:</div> <div> <IMG BORDER="0" SRC="Symb075c002d0118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Ease of learning</div> <div> <IMG BORDER="0" SRC="Symb075c002d0118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Ease of use </div> <div> <IMG BORDER="0" SRC="Symb075c002d0118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Ease of navigation</div> <div> <IMG BORDER="0" SRC="Symb075c002d0118bf000000.png" HEIGHT="19" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Usefulness (matches job function to workflow)</div> <bR> <div> Preview:  A Usability Process</div> <bR> <div> <I><B>A Quick View of Steps, Deliverables, and Tips for Usability Evaluations</B></I></div> <div>  </div> <div> <B>Step 1 - Quick View: Determine Test Site</B> </div> <div> <I><B>Deliverable</B></I>: Commitment for a suitable location to conduct the performance support test </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Select a usability lab or identify a location suitable for a test. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Consider connectivity, set up and testing. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Consider evaluator travel and parking (evaluators are performers: those who do work using the system) </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Get commitments for space and equipment for the times you intend to conduct the lab plus some time before and after. </div> <div> <B>Step 2 - Quick View: Select Evaluators (aka Performers)</B> </div> <div> <I><B>Deliverable</B></I>: Commitment by suitable evaluators to participate in the test </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine an appropriate number of evaluators. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine the levels of evaluator necessary for the test. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Consider evaluator travel, parking, and other needs. </div> <bR> <div> <B>Step 3 - Quick View: Document Performance and Usability Goals</B> </div> <div> <I><B>Deliverable</B></I>: Set of measurable goals that reflect business performance and usability </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine measurement criteria to evaluate performance and usability. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine attributes of concern. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine the measurements of concern. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Document goals. </div> <div> <B>Step 4 - Quick View: Develop Scenarios</B> </div> <div> <I><B>Deliverable</B></I>: Set of business scenarios suitable to test the performance and usability goals </div> <div> <I>Consider processes, tasks, and activities which:</I> </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">enable measurement of performance (e.g., time for task completion, accessiblity and use of embedded support) </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">enable measurement of usability goals; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">reflect the performers' environment; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">are realistic with respect to frequency of tasks; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">are appropriate for the diversity of performers; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">will be performed in production; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">have representative degrees of complexity; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">impact business performance if not performed correctly; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">represent business criticality; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">accurately represent volumes; and </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">considers performers outside of your organization if appropriate. </div> <bR> <div> <B>Step 5 - Quick View: Develop Evaluator Briefing</B> </div> <div> <I><B>Deliverable</B></I>: Briefing document and plan for delivering the briefing </div> <div> <I>The briefing is designed to orient evaluators to:</I> </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">what they will do; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">what will be done with the results. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">the sequence of events; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">understand that the <I>product</I> is being tested, <U>not</U> them; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">that the test is being filmed; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">advance training; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">how to get help; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">how to proceed through the scenarios; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">pencil and paper for making notes; </div> <div> <I><IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">verbalize </I>their thoughts; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">taking breaks as they would on the job. </div> <bR> <div> <B>Step 6 - Quick View: Develop Evaluator Debriefing</B> </div> <div> <I><B>Deliverable</B></I>: Debriefing document and a plan for delivering the debriefing </div> <div> <I>The debriefing is designed to capture information critical to determining whether or not the performance and usability goals are met. It should capture attributes like:</I> </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">visual clarity; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">consistency; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">compatibility; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">informative feedback; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">explicitness; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">flexibility and control; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">error prevention and control; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ease of use; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">intuitiveness of labels and messages;; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">layout of elements; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ease of learning; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">likes /dislikes; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">affordance; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">use of specific system features; and </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">use of color. </div> <bR> <div> <B>Step 7 - Quick View: Schedule Evaluators</B> </div> <div> <I><B>Deliverables</B></I>: Evaluator schedule, memo to evaluators, and commitments from evaluators </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Create a schedule based on evaluators arriving 1 - 1.5 hours apart. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Base time per evaluator on anticipated scenario time x 1.5, plus 30 minutes total for brief & debrief. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine schedule for evaluation based on lab availability, product readiness, availability of evaluators. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Send invitation to each evaluator </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Confirm changes to schedule. </div> <div> <B>Step 8 - Quick View: Set Up Lab or Evaluation Area</B> </div> <div> <I><B>Deliverables</B></I>: Evaluation area, completely tested and ready for the evaluation </div> <div> Consider the following: </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">connectivity requirements; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">software functionality (that it behaves as in the workplace); </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">simulated work environment and sufficient privacy to conduct an evaluation; and </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ability to observe without disturbing the evaluator or invalidating the test. </div> <div> <B>Step 9 - Quick View: Select Observation Team</B> </div> <div> <B>Deliverables</B>: Commitments from an appropriate number and type of people to serve as usability test observers </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Consider the following: </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">representatives from business, technical/developer, and management roles; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">not too many; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">keep them out of view of the evaluators; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">roles and responsibilities; and </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">need to observe. </div> <bR> <div> <B>Step 10 - Quick View: Conduct Dry Run</B> </div> <div> <I><B>Deliverables</B></I>: Final versions of Briefing, Scenarios, Debriefing, and Roles / Responsibilities </div> <div> The Dry Run must: </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">be run as an actual performance/usability evaluation; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">objectively evaluate if the <I>test</I> is workable; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ensure that all connectivity, hardware, and software functions as expected; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ensure that briefing accomplishes objectives; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ensure that scenarios are easy to follow; </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">ensure that debriefing questions make sense; and </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">be viewed as an opportunity to make changes to all materials, roles, and responsibilities. </div> <div> <I><B>The Dry Run is a usability test of this test!</B></I> </div> <div> <B>Step 11 - Quick View: Conduct Usability Evaluation</B> </div> <div> <I><B>Deliverables</B></I>: Video tapes, logger sheets, and observer comments </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Provide a waiting area for evaluators away from observation team. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Try to stay on schedule, but if this is not possible set expectations for next evaluator. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Brief evaluator in a relaxed, friendly manner. Stick to prepared briefing. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Observers must not be heard by evaluators. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Stay focused on the test goals and record what you see. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Debrief evaluator in a relaxed, friendly manner. Stick to prepared questions. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Do not share the goals with evaluators. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Do not lead evaluators. </div> <div> <B>Step 12: Document Test Findings</B> </div> <div> <I><B>Deliverables</B></I>: Documentation of test results and recommendations for improvement </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Document what was observed, not speculation. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Determine which goals were met and which were not met. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">For goals that were not met, recommend changes to enable performance and make the application usable. </div> <div> <IMG BORDER="0" SRC="Symb075c00b700f000000000.png" HEIGHT="16" WIDTH="24" ALIGN="bottom" HSPACE="0" VSPACE="0">Distribute findings to all stakeholders. </div> <bR> </td> </tr></table></body>