Website Evaluation  «Prev  Next»
Lesson 5 Evaluating Web site functionality
ObjectiveDescribe the Various Functional Elements that should be Tested when evaluating a site.

Evaluating Website Functionality

Users expect Web sites to function properly. They quickly leave sites that do not. If a server is overloaded or down, the user may or may not return in the future. For that reason, tests of the overall functionality of the system are critical.

Testing the system

Testing of the system should be performed throughout the development of the site by a Quality Assurance specialist or team. This will help find errors early and correct them before the site goes live. In addition, ongoing and systematic testing of the site should take place on a regular basis. A test plan to assess the technical functionality of the site should examine, at a minimum, the following points:
  1. Overall functionality of the site
  2. Functionality of links
  3. Display of the site on different browsers
  4. Availability of database information
  5. Site performance
  6. Accessibility
  7. New components
The following series of images illustrates the kinds of questions that a Quality Assurance team will be asking to tackle these points.

1) Does the site work as intended
1) Does the website work as intended ?

2) Are any of the links broken or dead
2) Are any of the links broken?

3) Does the site display equally well on different platforms and with different browsers
3) Does the site display equally well on different platforms and with different browsers?

4) Can the information be retrieved and updated? Is it secure?
4) Can the information be retrieved and updated? Is it secure?

5) Are download and response times acceptable at any time of day and with different connection types ? How many users can the system handle?
5) Are download and response times acceptable at any time of day and with different connection types ? How many users can the system handle?

6) Is the system always online?
6) Is the system always online?

7) Are the new components added to the website corrupting the system?
7) Are the new components added to the website corrupting the system?

Testing the Functionality of the System

Functional testing is a quality assurance (QA) process and a type of black-box testing that bases its test cases on the specifications of the software component under test. Functions are tested by feeding them input and examining the output, and internal program structure is rarely considered.
Functional testing usually describes what the system does. Functional testing [1] differs from system testing in that functional testing "verifies a program by checking it against
  1. design documents or
  2. specifications,
while system testing "validates a program by checking it against the published user or system requirements" .

We recommend that designers, whenever possible, try a free software download and do a quick test of their own site or product. While designers cannot exactly simulate the usage of the device, trying will help them find the most grievous design errors. An interesting idea is to create a lowtech packet that designers can use to do a simple test of their designs. Such tests include:
  1. to simulate physical manipulation difficulties,
  2. try simple tasks while wearing a pair of oven mitts or unplug the mouse;
  3. to simulate no vision, wear a blindfold or turn off the computer monitor; and,
  4. to simulate low vision, wear goggles with tape over them.
These ideas may seem peculiar, but trying some of them can help designers uncover the most severe errors before the products either go through usability evaluations or are put in front of real users. Of course you cannot simulate a real user experience with these models; they are intended just for simulated testing and not as a replacement for usability evaluations.
In the next lesson you will learn what the goals and trends of usability testing are.

[1] Functional testing:Functional testing does not imply that you are testing a function (method) of your module or class. Functional testing tests a slice of functionality of the whole system.