Usability Scenario #6

Last modified by Vincent Massol on 2024/11/19 16:15

Description

Warning
Period: Dec 2018 - Jan 2019
Interviewees: 3 members of the community (18 - 35 years old)
Version: XWiki 10.10
Warning
Target: Beginner Admin
Features: Page, Administration
Type: Tasks
Duration:1:00 - 1:30 hours

Tasks Status

Participant T1 1 T2 2 T3 3 T4 4 T5 5 T6 6 T7 7 T8 8 T9 9 T10 10 
TableChart
User#1BXWiki 10.10bullet_greenS< 3 minbullet_greenM< 10 minbullet_greenS< 3 minbullet_greenS< 3 minbullet_greenS< 3 minbullet_redH-bullet_greenS< 3 minbullet_greenM< 3 minbullet_greenS< 1 minbullet_greenS< 5 minbullet_greenS< 5 min
User#2MXWiki 10.10bullet_greenS< 1 minbullet_redH< 10 minbullet_greenS< 1 minbullet_greenS< 3 minbullet_greenS< 3 minbullet_redH-bullet_greenS< 1 minbullet_greenS< 1 minbullet_greenH< 1 minbullet_greenS< 3 minbullet_greenH< 10 min
User#3B - MXWiki 10.11bullet_greenS< 1 minbullet_greenM< 3 minbullet_greenS< 1 minbullet_greenS< 3 minbullet_greenS-bullet_orangeM< 10 minbullet_greenS< 1 minbullet_greenS< 1 minbullet_greenS< 1 minbullet_greenS< 5 minbullet_greenS< 5 min 
 
Average  bullet_greenS<1 minbullet_orangeM<7
 min
bullet_greenS<1 minbullet_greenS<3 minbullet_greenS<3 minbullet_redH<10 minbullet_greenS<1 minbullet_greenS<1 minbullet_greenM<1 minbullet_greenS<4 minbullet_greenM<6 min
 
User#4B-MXWiki 11.5 bullet_green< 1 min bullet_green< 5 min bullet_orangeM  < 3 min bullet_green< 1 min bullet_green< 1 min bullet_orange< 5 min bullet_green< 1 min bullet_orange< 10 min bullet_green< 5 min bullet_orange< 5 minbullet_red< 10 min
 
Hypothesis  bullet_white<3 minbullet_whiteH<10 minbullet_whiteM<3 minbullet_whiteS<1 minbullet_whiteS<3 minbullet_whiteM<5 minbullet_whiteS<1 minbullet_whiteM<3 minbullet_whiteS<1 minbullet_whiteH<5 minbullet_whiteM<5 min
Desired  bullet_white<1 minbullet_whiteS<1 minbullet_whiteS<3 minbullet_whiteS<1 minbullet_whiteS<1 minbullet_whiteM<3 minbullet_whiteS<1 minbullet_whiteS<1 minbullet_whiteS<1 minbullet_whiteM<3 minbullet_whiteM<3 min

Legend: bullet_white Not started bullet_green Success bullet_orange Partial bullet_red Fail S = Simple / Easy, M = Medium, H = Hard;  B = Beginner, M = Medium, A = Advanced

Tasks Analysis

Major

Error

2 / 10 Tasks with major difficulties or unable to complete:

Medium

Warning

2 / 10 Tasks with medium difficulties:

Minor

Success

6 / 10 Tasks Successful:

  • T1: Log-in
  • T3: Create user
  • T4: Create page
  • T6: Page relations
  • T7: Adding attachments
  • T9: Adding rights
  • T5: Advanced editing - Table

 


Issues

Notes

  • The average time to complete this task is very high (average 7min) and users might abandon it and get frustrated.
  • The flow needs simplification.
  • Confusion between Skin and Theme.

Improvements

UC: Provide a direct place to change the logo from Administration

 

T5: Advanced editing - Chart

Issues

Notes

  • Users don't know what values to fill for the macro parameters. 
  • Ideally, they would just press "Insert" and adjust later; or have a "Preview" of the values they provide.
  • All users mentioned that they would need to read the documentation first.
  • One user wanted to right-click the editor content and using a table selection to add a chart macro.
  • 2 users mentioned that they expect something similar to the Office Word behaviour.

Improvements

UC: Provide good defaults for the macro parameters.
UC: Provide a preview for the available macros.

 

T7: Adding attachments

Issues

Notes

  • Some confusions on the way images are attached from the WYSIWYG editor.
  • One user didn't knew she needs to press the "Send it to the Server" button in order for the image to be uploaded. Kept pressing the modal's "Ok".

Improvements

UC: Improve the editor's image upload modal.
  • Use "Upload" verb instead in order to be consistent with the Tab name. Also provide a primary button state for the action.

     

    Proposal
    UploadAfter.png

    Current
    UploadBefore.png

 

T8: Creating navigation

Issues

Notes

  • The majority of users tested were satisfied with the Navigation Panel and didn't felt the need to create Menus. 
  • Confusion between Panel and Menu.

Improvements

UC: Consistency between Breadcrumb and Navigation Panel for the 'Home' entry
  • One user was confused about the alphabetical sorting and expected the "Home" entry to be always first, and marked accordingly:

     

    Proposal
    NavigationHomeFirst.png

    Current
    NavigationCurrent.png

 

T9: Adding rights

Issues

Notes

  • Confusion between Rights: Page & Children and Rights: Page.
    • We got one comment that we should rename the entry to "Page & People" or "Page & Users" instead of "Page & Children".
  • Comment about having a "Save" button when setting the Rights.

Improvements

  • Users set the rights, but they were not very sure that what they did will have the expected behaviour.
  • Confused about giving Deny for the Admin user and what effect that will have. 
  • Confused if adding some rights will have effects on other users.
  • See related proposal Rights Checker.

 

T10: Installing extension

Issues

Calendar:

  • #59: Notification bell is not marked differently when Silk Icon Theme is used
  • #26: Translation console warning for Mocca Calendar Macro 
  • #27: Better differentiate the purpose of the two macros provided by the Calendar app 
  • #28: Calendar macros are accessible / usable even if the license has not been activated
  • #29: Using the 'moccacalendar' macro breaks the JavaScript on the page

Notes

  • We got a comment that the "Application" term would be better than "Extension".
  • After the extension is installed, the user is confused on where is supposed to go next:
    • The application is not added to the AppBar and refreshed automatically.
    • There is no button in Extension Manager to encourage the user to go to his newly installed application.

Improvements

  • One user pressed "All Extensions" button when wanting to "Search" for extensions names. The proximity and position of the "All Extensions" button can cause confusion.

    Proposal
    ExtensionsAfter.png

    Current
    ExtensionsBefore.png

 

General

 

 

Other User Suggestions

UC: Simplify the interface.
  • For example: remove the "Last modified", "Created by" elements.
    • They could be listed in the "Information" tab.
UC: Update and keep the documentation consistent.
  • For example: inconsistencies between "Administer Wiki" and "Wiki Administration" wording used in documentation causes confusion.

 


Tasks Description

T1. Log-in

You've been assigned to handle the initial setup of XWiki in order to start gathering your team knowledge.
First thing you need to do is log-in to the wiki.

Make the wiki more cozy by changing the default logo with one that your team could identify with.
What other things you'd like to customize?

T3. Create user

Create an user for one of your team members. They will need the credentials after your setup is finished so you should make sure everything will be ready.

T4. Create page

Create a page that will contain the starting point for your team members. Add some basic information in the page that might be useful for them. 

T5. Advanced editing

To your new created page, add more advanced content: like a table or a pie chart displaying 2 sections: 50% and 50%. 

T6. Page relations

Since the page is starting to look crowded, create another page that could hold information.

T7. Adding attachments

Attach a funny image or an important file to your team page so that they will find it when they will need it.

T8. Creating navigation

Make sure the pages you've created are accessible from the main navigation. If not, create a navigation containing your pages, so that your team can easily find them.

T9. Adding rights

Add custom rights to the page with attachments so that only the new user you've created has access to it.

T10. Installing extension

Your team will also need a calendar.


 

Get Connected