EMR (electric medical records)
Description
Topic: EMR (electric medical records) Conduct a usability test (also known as a usability study and also a usability evaluation) and write a usability evaluation report. The usability evaluation involves you selecting an interface (it can be the same one you chose for the inspection assignment) and observing three participants to complete tasks with parts or the whole of the interface. If the evaluation is planned and executed effectively according to standard usability testing procedures, the results of the usability evaluation can lead to valuable recommendations INSTRUCTIONS FOR COMPLETING ASSIGNMENT #2: Usability Evaluation Associated Learning Outcomes with Assignment #2: Inspect and contextualize major considerations of user experience (UX), including defining the user, user experience levels, and various usability attributes (e.g., ease of use, user satisfaction, other). Explain the major aspects of usability engineering and user testing. Specify established methods for identifying users’ requirements and analyzing users’ tasks in developing usability test plans. Produce usability tests with participants on current technology designs. General Directives: (1) Review recommended texts or articles for background on usability evaluation, (2) Review professor’s notes on usability evaluation, (3) Review NSU IRB policy on Student Research (below), and (4) Locate your own usability articles or sources to integrate into the paper.
Overall Task: You will conduct a usability evaluation, commonly known as a usability test or a user test or a user study. The results of the usability evaluation can lead to valuable recommendations for improving the quality of the interface under evaluation. This exercise will also give you, the novice researcher, direct experience in assessing user interface design, through systematic and direct observation of other users (participants) working through the interface. Note: these instructions are a general guide to setting up a usability evaluation. Your usability evaluation will have to expand this general method. I recommend Rubin and Chisnell’s text for details on conducting usability testing. Some of these issues presented here as examples may or 7/9/2019 may not be applicable to how you will plan and conduct your particular usability test. General Guide to the Usability Evaluation General Method You will need a minimum of three human subjects (participants) for this exercise. Choose an interface (e.g., anything — some specific technology device, hardware or software or website, or smart device app, other) that is manageable, an interface that you can arrange for your participants to work through independently (while you observe them in person) the major features of the user interface you have chosen to evaluate. The goal of the usability evaluation is to locate usability problems and to recommend improvements to the interface. To do this you need to devise a usability task list for participants to work through independently to help you discover usability problems (and/or good design achievements) with the interface. You will prepare a list of tasks that each participant will perform. The task list includes a brief description of each task to be performed with the interface as the focus of the evaluation. You may (if appropriate) prepare a flowchart showing the order tasks are to be performed and other important events and sequences. Your job, as the student researcher, is to give each participant appropriate written and/or verbal directions on how to complete the task list; observe the participant working through each task and record (on paper) the sequence of events and data observed. Upon collecting data from all invited participants, prepare a usability evaluation report (paper) describing the details of the entire evaluation process (from planning to recommendations), including the results of the usability evaluation. This paper must have substantial literature integration throughout to support your process. Important Policy on Human Subjects Research — NSU Institutional Research Board (IRB) Policy on Course-related Research Activities According to NSU IRB policy, research conducted by students as part of classroom assignments does not usually fall under the federal regulation of research because it is not intended or likely to lead to generalizable results. Rather, the activities are resources of teaching, which facilitate learning of concepts and the opportunity to practice various procedures, including research methods (interviewing, observation and survey techniques, as well as data analysis). While most assignments for class do not require IRB review, some do as a result of the vulnerability of subjects or the potential risk to subjects including: • Studies in which children will be interviewed or surveyed. • Studies in which children are being observed, and data collected, where the investigator is also a part of the activities being observed. • Studies involving prisoners, the mentally disabled, or pregnant women. • Studies that ask subjects about illegal activities and which place the data at risk for subpoena and/or the subject at risk for loss of civil liberties. • Studies in which subjects are at risk of breach of confidentiality, such as ones that ask sensitive or intrusive questions about behaviors. • Studies that place students at risk due to emotionally charged subject matter. • Studies which will be published by the researcher (including theses and dissertations). In conducting responsible usability evaluation, the student researcher must ensure that minimal risk in working with human subjects (e.g., our usability test participants) is achieved. Students must NOT conduct their usability evaluations that would fall into one or more of the seven exceptions (listed above) to IRB exemption on course-related activities. It is required that invited participants are of adult age (18 years or older). A Participant Informed Consent Form should be signed by all participants and included in the Appendices of the UE paper. (Example consent forms that are appropriate for usability tests/evaluations are available in most usability evaluation texts.) Students should review the NSU IRB policies as stated in full. These are posted on a link from the CEC IRB website. In addition, if the student wishes to publish or share results of the evaluation, in any form, outside of the course assignment and environment protocols established for this class, then IRB approval, prior to conducting the usability research, may be necessary. According to NSU IRB policy, IRB approval must be secured prior to conducting the research activities. (Given the short duration of this course and the involved process of seeking IRB approval, the professor does not recommend any outside publication or sharing of the results of this exercise with any third party.) A reminder to student researchers in HCI: It is the product/interface that is being evaluated, not the participants! It is important that your invited participants are informed that they are not being tested or evaluated, but rather the interface is being evaluated to help you locate potential usability problems! General guidelines for conducting the usability evaluation The following general guidelines have been adapted from several resources on usability evaluation and testing to give you a general scope and initial ideas for organizing your usability evaluation. Some guidelines will be applicable to your evaluation; some will not. Conversely, you may have other ideas not mentioned here that would appropriately fit your interface choice and evaluation objective. As you plan, conduct, analyze, and report your usability evaluation or test, follow this format as appropriate: Planning Stage 1. Identify the test goals. 2. Describe what test method(s) you will use to reach your test goals. 3. Identify participants to perform the usability evaluation. (See IRB Policy stated above.)
This process should give attention to prescreening: * a. user experience level/skills/capabilities * b. education * c. attitudes/willingness * d. demographics (age, gender, language, etc.). Invite those only of adult-age (18 years or older). Do not ask any intrusive information about the individual. * e. user satisfaction of the product *Note: This information is normally generated through a questionnaire. Use a paper questionnaire or a list of interview questions to help you collect this information from your participants. (Usability texts will often include examples so that you have something to work with. In planning your UE, you may also need to determine the requirements of users that fit the objective of evaluating the interface, in regard to: • speed required of user • skill required of user • physical capability of user • responsibility required of user • ease of use considered for the user • the user’s potential for misuse or error 4. Create a task list. Create workable tasks that help the user evaluate the usability of the product design. (This will vary in number and complexity depending on the interface you choose to evaluate.) 5. Order and prioritize the tasks. 6. Determine which user performance and usability measures will be taken. 7. Create the scenario (test lab) needed to conduct the evaluation (The “test lab” can be your office, home, or wherever you can set up the hardware and software.) Remember to establish and detail the following: . workstation arrangement b. comfort/space of the testing lab c. modifiability of the testing environment d. room details (lighting/heat/air/cleanliness/noise/distractions) 8. In regard to tasks and task lists, be sure to: a. Provide a general description of each task to be performed. b. Describe what steps are in each task. c. Distinguish interaction with other tasks. d. Identify if it is an independent or group task (as applicable). Conducting the Test/Collecting Data There are different strategies for structuring the evaluation for your participants. You can arrange for all participants work together at one time (if you have access to multiple workstations or devices), co-pair the participants at one time (if you have at least two workstations or devices), or observe one participant at a time. Whichever option is workable for you, your main role will be to observe each participant and take notes during the evaluation process. (If you decide to video or audio to record the participants, you MUST get their written permission to do so and you must maintain confidentiality by not sharing the recordings with anyone or by posting them anywhere for public view.) However, I highly suggest that you take notes during the observations and not rely on recordings. (Recordings take a long time for you to review.) This means you will need to write down their actions on paper. It is recommended that you do not offer assistance to participants during the evaluation, though you will prompt them to describe verbally what they are doing through the Think Aloud protocol.
Leave a Reply
Want to join the discussion?Feel free to contribute!