Usability Scenario #6
- Usability Testing - Beginner Admin https://forum.xwiki.org/t/usability-testing-beginner-admin/4037 (5 Dec 2018)
- Usability 10.x analysis and 11.x suggestions https://forum.xwiki.org/t/usability-10-x-analysis-and-11-x-suggestions/4010 (18 Nov 2018)
- Your XWiki usability pain points (16 Aug '17)
- [Brainstorming] XWiki 10.x cycle roadmap (Jan 11 '18)
- [Brainstorming] XWiki 11.x cycle roadmap (Nov 23 '18)
Description
Tasks Status
| Participant | T1 1 | T2 2 | T3 3 | T4 4 | T5 5 | T6 6 | T7 7 | T8 8 | T9 9 | T10 10 | ||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Table | Chart | |||||||||||||||||||||||||||||||||||||
| User#1 | B | XWiki 10.10 |  | S | < 3 min | | M | < 10 min | | S | < 3 min | | S | < 3 min | | S | < 3 min |  | H | - | | S | < 3 min | | M | < 3 min | | S | < 1 min | | S | < 5 min | | S | < 5 min | |||
| User#2 | M | XWiki 10.10 | | S | < 1 min | | H | < 10 min | | S | < 1 min | | S | < 3 min | | S | < 3 min | | H | - | | S | < 1 min | | S | < 1 min | | H | < 1 min | | S | < 3 min | | H | < 10 min | |||
| User#3 | B - M | XWiki 10.11 | | S | < 1 min | | M | < 3 min | | S | < 1 min | | S | < 3 min | | S | - |  | M | < 10 min | | S | < 1 min | | S | < 1 min | | S | < 1 min | | S | < 5 min | | S | < 5 min | |||
| Average | | S | <1 min | | M | <7 min | | S | <1 min | | S | <3 min | | S | <3 min | | H | <10 min | | S | <1 min | | S | <1 min | | M | <1 min | | S | <4 min | | M | <6 min | |||||
| User#4 | B-M | XWiki 11.5 | | M | < 1 min | | H | < 5 min | | M | < 3 min | | S | < 1 min | | S | < 1 min | | H | < 5 min | | S | < 1 min | | M | < 10 min | | M | < 5 min | | H | < 5 min | | H | < 10 min | |||
| Hypothesis |  | S | <3 min | | H | <10 min | | M | <3 min | | S | <1 min | | S | <3 min | | M | <5 min | | S | <1 min | | M | <3 min | | S | <1 min | | H | <5 min | | M | <5 min | |||||
| Desired | | S | <1 min | | S | <1 min | | S | <3 min | | S | <1 min | | S | <1 min | | M | <3 min | | S | <1 min | | S | <1 min | | S | <1 min | | M | <3 min | | M | <3 min | |||||
| Legend: | Not started Success Partial Fail | S = Simple / Easy, M = Medium, H = Hard; | B = Beginner, M = Medium, A = Advanced |
Tasks Analysis
Major
Medium
Minor
Recommendations
T2: Change Logo
Issues
Notes
- The average time to complete this task is very high (average 7min) and users might abandon it and get frustrated.
- The flow needs simplification.
- Confusion between Skin and Theme.
Improvements
- See related proposal Change Logo.
Proposal
T5: Advanced editing - Chart
Issues
Notes
- Users don't know what values to fill for the macro parameters.
- Ideally, they would just press "Insert" and adjust later; or have a "Preview" of the values they provide.
- All users mentioned that they would need to read the documentation first.
- One user wanted to right-click the editor content and using a table selection to add a chart macro.
- 2 users mentioned that they expect something similar to the Office Word behaviour.
Improvements
- See related proposal Macro Parameters.
Proposal
- See related proposal Macro Preview.
T7: Adding attachments
Issues
Notes
- Some confusions on the way images are attached from the WYSIWYG editor.
- One user didn't knew she needs to press the "Send it to the Server" button in order for the image to be uploaded. Kept pressing the modal's "Ok".
Improvements
- Use "Upload" verb instead in order to be consistent with the Tab name. Also provide a primary button state for the action.
Proposal
Current
T8: Creating navigation
Issues
Notes
- The majority of users tested were satisfied with the Navigation Panel and didn't felt the need to create Menus.
- Confusion between Panel and Menu.
Improvements
- One user was confused about the alphabetical sorting and expected the "Home" entry to be always first, and marked accordingly:
Proposal
Current
T9: Adding rights
Issues
Notes
- Confusion between Rights: Page & Children and Rights: Page.
- We got one comment that we should rename the entry to "Page & People" or "Page & Users" instead of "Page & Children".
- Comment about having a "Save" button when setting the Rights.
Improvements
- Users set the rights, but they were not very sure that what they did will have the expected behaviour.
- Confused about giving Deny for the Admin user and what effect that will have.
- Confused if adding some rights will have effects on other users.
- See related proposal Rights Checker.
T10: Installing extension
Issues
Calendar:
- #59: Notification bell is not marked differently when Silk Icon Theme is used
- #26: Translation console warning for Mocca Calendar Macro
- #27: Better differentiate the purpose of the two macros provided by the Calendar app
- #28: Calendar macros are accessible / usable even if the license has not been activated
- #29: Using the 'moccacalendar' macro breaks the JavaScript on the page
Notes
- We got a comment that the "Application" term would be better than "Extension".
- After the extension is installed, the user is confused on where is supposed to go next:
- The application is not added to the AppBar and refreshed automatically.
- There is no button in Extension Manager to encourage the user to go to his newly installed application.
Improvements
- One user pressed "All Extensions" button when wanting to "Search" for extensions names. The proximity and position of the "All Extensions" button can cause confusion.
Proposal
Current
General
Other User Suggestions
- For example: remove the "Last modified", "Created by" elements.
- They could be listed in the "Information" tab.
- For example: inconsistencies between "Administer Wiki" and "Wiki Administration" wording used in documentation causes confusion.
Tasks Description
T1. Log-in
You've been assigned to handle the initial setup of XWiki in order to start gathering your team knowledge.
First thing you need to do is log-in to the wiki.
T2. Change logo
Make the wiki more cozy by changing the default logo with one that your team could identify with.
What other things you'd like to customize?
T3. Create user
Create an user for one of your team members. They will need the credentials after your setup is finished so you should make sure everything will be ready.
T4. Create page
Create a page that will contain the starting point for your team members. Add some basic information in the page that might be useful for them.
T5. Advanced editing
To your new created page, add more advanced content: like a table or a pie chart displaying 2 sections: 50% and 50%.
T6. Page relations
Since the page is starting to look crowded, create another page that could hold information.
T7. Adding attachments
Attach a funny image or an important file to your team page so that they will find it when they will need it.
T8. Creating navigation
Make sure the pages you've created are accessible from the main navigation. If not, create a navigation containing your pages, so that your team can easily find them.
T9. Adding rights
Add custom rights to the page with attachments so that only the new user you've created has access to it.
T10. Installing extension
Your team will also need a calendar.
