Prototyping and Usability Testing Presentation presented at BA World

I attended the 2011 Business Analyst World conference held in Vancouver over the past week. I shared my ideas, research and practices on Prototyping and Usability Testing in a symposium presentation to an audience of primarily Business Analysts.

Recruiting users for usability testing

When you select users for usability testing, you have to ensure that their background and abilities are representative of your product’s intended user profile. Your test results will only be valid if the people who participate in the test are typical users of the product.

How do you recruit users for usability testing?
Recruiting the target audience or user profile for usability testing usually takes two to three weeks. Some sources of test participants include the below:

1. Your own company’s list of existing customers
Marketing usually has access to this list and can generate a spreadsheet of these users. Most of the users that are registered are the systems administrators; however, they are good contacts and can often refer you to other user profiles you maybe recruiting for.

2. Referrals from Sales and Marketing
Sales and marketing employees usually foster good relationships with customers. It is also to your advantage to develop a good relationship with these folks as they can help you out. You do need to watch out and ensure that you are not re-using the same customers that the Marketing department talk to frequently for requirements elicitation.

3. Craigslist
Another great source of participants is advertising in the et cetera section of the jobs section of Craigslist. Most cities in the US have started charging for advertising. This is still a very cost-effective method to recruit users that may also use competitive products.

4. Company web site or blog
You can also advertise for test participants in your company web site or blog. This is a great way to build a database of prospective participants. The prospective users can register their information onto the web site which you regularly mine data from each time you are ready to recruit.

5. Societies and Associations
Professional societies and associations are a good source of contacts if you are looking for participants from specific professions (e.g. accountants). These groups often have forums, blogs or other social media and maybe willing to advertise your upcoming usability test on your behalf.

ACM CHI Conference on Human Factors is coming to Vancouver

I just found out recently that CHI 2011 will be held in Vancouver during May 7-111, 2011.  ACM CHI Conference on Human Factors in Computing Systems is the premier international conference of human-computer interaction. CHI 2011 focuses on leveraging our diversity and connecting people, cultures, technologies, experiences, and ideas. They are looking for conference speakers, workshop presenters and papers. The agenda details are to be determined later on this year.

Quantitative Information Architecture by Don Turnbull

Yesterday, I attended Don Turnbull’s presentation about “Quantitative Information Architecture” sponsored by VanUE. This is a phrase that Don coined himself. His presentation focused on the value of collecting quantitative over qualitative data.

The key takeaways that I learned were:

  • Become better at quantitative analysis as this is a valuable skill set that pays well. Examples of quantitative skills are web analytics, Google analytics, and quantitative usability testing.
  • Data scientists or Statisticians are today’s hot new rising profession. Companies such as Google, eBay and Facebook have reams of data that need to be analyzed to make better business decisions.
  • Numbers speak the language of business and technology (C-level executives)

I did ask Don how many individuals he would suggest for a quantitative usability study.  Don recommended 32 individuals for a quantitative study. However, he suggested that you could do several smaller studies over a longer period of time. Interestingly, he mentioned that Quality Assurance team could be involved in these quantitative tests.

What’s Quantitative good for?
- Understanding what users actually do instead of what they said they do
- Making comparisons over time
- Generalizable and extensible
- Useful for interpreting and analyzing other results

What you should go quantitative?

  • It is a discipline
  • Hypothesis based
  • more applicable to peer review
  • it requires a set of skills that have a (much) higher market value
  • it examines characteristics that are constants (behaviour, physical traits and abilities)

The power of quantitative

  • fight fire with fire
  • almost infallible results
  • qualitative decisions for quantitative measurements

What about qualitative?

  • hard to replicate, hard to validate, easier to do
  • domain of study (who) is main focus
  • variability is often wide
  • technique is critical

Usability Testing 101

Last week, I presented a Usability Testing 101 – introduction to usability testing at VanQ. VanQ is a community association in Metro Vancouver that focuses on encouraging the exchange of software quality assurance and testing knowledge and fostering networking among meeting participants. The meetings are held on the last Thursday of each month to share information regarding quality assurance and testing best practices. The slides from that presentation have been uploaded to slideshare. In this presentation, I discuss what usability is, why it is important, the information that goes into a test plan and the two types of tests that are typically conducted — formative and summative tests.

Remote Usability Testing presentation

Here are the slides to the presentation from last week’s UX Camp Vancouver. I presented on remote usability testing. The premise of the presentation is that traditional lab testing is fine for companies that have time, budgets and resources; however, remote usability testing is the direction that most companies and practitioners are moving towards. Studies after studies have proven that you can still identify the same number of usability issues in a remote usability study versus a face-to-face study.

UX Camp Vancouver

The first ever UX Camp was held in Vancouver on December 5, 2009. I was invited to present as one of the keynote speakers during the morning. The topic I presented was Remote Usability Testing, an area that I feel strongly about. I started conducting usability studies since 2003 as an observer with one of PMC-Sierra’s tier 1 customers. Since then, I have conducted and moderated hundreds of remote usability sessions with customers and partners from around the world.

I thoroughly enjoyed meeting the UX community in Vancouver and to share my experiences with such an engaged audience early on a Saturday morning. I will be making my slides available on SlideShare shortly.