Important Message

Dear visitor,

This web site is no longer run by First Accessibility (Test Partners Ltd). A new site is coming shortly. In the meantime, the content of the old web site is available below.

Thank you for your patience.

accessibility.co.uk

User Testing

Why Test With Real Users?

Manual and automated tests are important but they only give an indication of what the level of accessibility should be, not what it actually is. The only way to determine the actual accessibility of a website is to test it with a range of users with different disabilities and assistive technologies.

One of the biggest limitations of manual and automated tests is that they test each page in isolation, but typically this is not how people use a website. Most website use is based around tasks, and this is how our user testing is conducted.

For a free quotation please email us, telephone 0870 855 3370 or fill in the form on our Contact page

Scenario Based User Testing

The most effective method of user testing is to conduct scenario based tests in facilitated sessions. The following paragraphs describe this methodology.

Identifying the Scenarios

The first step is to identify the most important tasks or usage scenarios. In addition to the homepage, key scenarios on most websites usually include locating and using the sitemap, contact page and search facility. Other typical scenarios include registration, the login process and completing a purchase.

In some cases the tester will be instructed to test a specific page. However, the process of locating a page or functional area must be as accessible as the page or function itself so they will usually be given a task and left to complete it, starting from the homepage.

Facilitated Sessions

The tester works in conjunction with a facilitator. The tester will not have seen the site previously, but will have been briefed on its content and purpose. The facilitator has detailed knowledge of the site but is careful not to influence the tester's behaviour.

The tester works through each scenario in turn, describing their approach and reasoning throughout, while the facilitator takes notes and prompts the tester where more detail is required. The sessions may be video recorded for further analysis if required.

Facilitated sessions capture a great deal of important information that is lost when other methodologies are used. Although it would be cheaper for the tester to work alone we do not recommend it for the following reasons.

The tester cannot comment on what they cannot see, and it is not uncommon for some content to be invisible to screen readers. Also testers may be unaware of the presence of some content or functionality or may misinterpret its meaning or function. If the tester is working alone they will be unable to report these issues, but they will be obvious to a skilled facilitator.
The facilitator can adapt and extend the test scenario while it is in progress in response to the tester's behaviour. This allows problems to be investigated in greater detail as they occur. In particular it allows information to be gathered after the tester encounters a problem that would otherwise be a showstopper.
First impressions are very important, as is observation of the process by which the tester resolves any difficulties they experience. The facilitator can capture this information accurately in real time, whereas the process of keeping notes is disruptive for a tester working alone, potentially invalidating the results.

Interpreting the Results

When interpreting the results it is important to take into account factors including the type, severity and history of the tester's disability, the type of assistive technology they use, their level of computer literacy and possibly demographic factors such as their age and occupation.