Results: Report and Suggestions
Period: 27 May - 12 June 2014
Interviewees:  9 members of the community (Beginners - 78%, Medium - 22%)
Version: XWiki 6.0
Feature: Documents, Wikis
Type: Tasks, Questions


Part 1 - Introduction

We're testing the project that we're working on so we can see what it's like for actual people to use it.

Just to make things clear we are testing the project, not you. You can't do anything wrong here. 

We want to hear exactly what you think, so please don't worry that you're going to hurt our feelings. We want to improve it, so we need to know honestly what you think. 

As we go along, I'm going to ask you to think out loud, to tell me what's going through your mind. This will help us. 

With your permission, we're going to record the computer screen and what you have to say. The recording will be used only to help us figure out how to improve the project, and it will be seen by community members working on the project. 

XWiki is an open source project so this means we are doing everything in the open and we value each contribution. With your permission we would like to mention your name on our Hall of Fame.

Part 2 - Participant

First, we want to know more things about you. We collect this data in order to make statistics about the usage of the product and the target.

Can you please tell me about: 

  • gender
  • age
  • occupation
  • technology exposure

Part 3 - Tasks and Questions

Now we will ask you to do some tasks. In this session we have X tasks. You have 45 minutes time to complete them.

We don't need to finish all the tasks. There are multiple tasks in order to make sure our time will be filled. 

We can end the session at any time. Also, if there is a task that you don't want to finish, we can always go to the next. 

Task 1


What are your first impressions of XWiki? 

What do you think you can do with it?

You can scroll, hover, but please don't click on anything yet.

Testing: Homepage 

Status: Not-logged-in

Task 2

Imagine this is your first day at work and XWiki is used internally. 

You want to customise your profile and add some information about yourself. How can you do that?

You know that the admin made an account for you. Use the following credentials to sign in: username=X, password=X.

UC: Measure the performance of 'menu-button' vs. 'icon-link' (#tmEdit vs .editProfileCategory)

Testing: Profile

Prereq: X simple user account creation

Task 3

You've been given the assignment to add some content (text+image) for the Marketing team.

Task 3.1

First let's browse a bit the product and locate where the Marketing material is found.

UC: Measure the performance of Search, Search Suggest vs. Wiki Index

Testing: Navigation

Prereq: X wiki creation

Task 3.2

You need to create a page called 'XWiki Enterprise'.

As a result, the page should look similar to:


You've been given the:

UC: In order to edit, you need to be a member of the wiki. Measure task success.
UC: Measure 'Add image' dialog naming.
UC: Measure table performances.

Testing: Page Creation

Testing: Page Editing

Prereq: resources 

Extended: wiki syntax

Extended: macro usage

Task 3.3

Create another page called 'Products'.
Link the 2 pages one from another in order to be able to navigate between them.

Is it possible also to make an hierarchy?
(where 'Products' page is on an upper level than 'XWiki Enterprise' page)

UC: Measure discoverability for 'Page Parent' functionality.
UC: Asses the clearness of hierarchy display (breadcrumb, document index tree, document information, etc.).

Testing: Page Linking

Testing: Page Parent

Task 3.4

Before going to the next task, is there something else you would like to try out? 

Please go ahead and try to do that now. 

Extended: Page Management

Extended: Page History

Task 4

You would like to let the manager know that the content has been added and the page is ready. 

How would you do that?

UC: Evaluate alternative communication methods.

Testing: Send Message

Testing: Page Comments

Testing: Send Page by e-mail

Prereq: Y user account creation

Extra Tasks?

Task 5

Thinking about your overall experience with XWiki, what did you like about the product? What did you not like?

Would you use it in the future? Why or why not?

Extra Tasks

Extra Task 6

Go to the Home page and remove the first paragraph from the 'Welcome to your wiki' section. 

UC: As simple users the ability to edit inline is not available. Since the default editor is WYSIWYG, the user will not be able to remove the paragraph without removing the whole Dashboard macro.

Testing: Dashboard

Testing: Inline Editing

Extra Task 7

Extra Task 7.1

You would like to create a dedicated place for Development material, just like the one existing for the Marketing team.

Create such a location.

UC: Evaluate the preference for wiki or space solution.
UC: Evaluate Distribution Wizard's impact and friendliness.

Testing: Wiki Creation

Testing: Space Creation

Testing: Distribution Wizard

Prereq: X user has 'Add Wiki' right

Extra Task 7.2

The Development team could use a Calendar application. 

Find out how to install this application on your wiki.

UC: Evaluate multiple Calendar applications naming ambiguity.

Testing: Administration

Testing: Application Panel

Testing: Extension Manager

Extra Task 7.3

What other applications would you like to install on your wiki?



Get Connected