2015-02-27 Matthias Huber

User level = Expert

Matthias is experience inspectIT user. Plus he wrote his thesis on the CI himself. I expect him not to have any problems with understanding the concept, but focus should be on his effectiveness to execute give tasks from the scenario.

Checklist notes

StepComment
Checkpoint 1 (time 3:30) - Perspective, CI View
Find perspective, notice CI view
  • Easy finds perspective
  • tried to click on the add button, problems noticing the arrow on the right
  • a bit difficult to find profiles in the CI view
  • looked for the tool-tip in the table header (CI view) for information on active/default
  • but understood active by intuition
Create profiles(s)
Checkpoint 2 (time 8:30) - Timer sensor assignments
Annotation assignment
  • not going immediately for info icon when does not understand, but gets it after some time
  • looking for save button after added assignment, does not know what should be done to start with the next
  • did not notice not valid descriptor on the text widget, tried to "save" non valid assignment
  • understands the images in the sensor assignment table, checked the tool-tip for more info
  • complained for not having horizontal scroll bar in the details part
Public method assignment
Abstract class assignment
Checkpoint 3 (time 7:00) - Timer sensor assignments with context capture
Context capture parameter
  • for first parameter did not use 0 index
  • complains no edit exists for context definitions
  • definition of context paths look weird, but no better solution proposed, fine after understanding
  • confusing context captures with parameters of the method
Context capture return value with navigation
Checkpoint 4 (time 3:00) - Exception sensor assignments
Wild-card exception assignment
  • in order, saving again problematic
Super-class exception assignment
Checkpoint 5 (time 1:00) - Exclude rules
Add one rule
  • trouble to find exclude rule page
  • not added star on the exclude rule package definition, maybe missing explanation
Checkpoint 6 (time 6:00) - Environment
Create environment
  • expects when environment (or profile) is created to open the created one in the editor
  • also expects that the CI view switches to the environment list if environment is created
  • first impression of environment editor: "lots of stuff"
  • searching for select/deselect all on the platform sensors
  • complains for no time unit next to the time sending strategy
Profile selection
Disable platform sensors
No string limit
Strategy properties change
Checkpoint 7 (time 4:00) - Mappign
Mapping with agent name wild-card
  • agent mapping table too big when inspectIT is not maximized
  • active should be selected by default when new mapping is added
  • confused about wild-cards (especially for IP), searched for the explanation
  • was not sure if defined is OK/valid
Mapping with IP wild-card

 

Suggestions

WhatPriorityWhen*Done?
Change combo box in the CI view to the radio buttons, one click less, easy to notice what can be selected(thumbs up)Now(tick)
When creating profile or environment, open the editor immediately(thumbs up)Now(tick)
Maybe make profiles default selection, since on empty CMR you don't have any environment (save selection to the preferences)(thumbs up)Soon(error) will have default profile
Add tool-tips to the table column headers (especially in the CI views tables)(thumbs up)Now(tick)
Ability to create new profile from the Environment profile selection table(thumbs down)Future 
When new profile is created add it to the opened Environment Future (hard to implement, but nice) 
Not editable profiles should have different icon, warning icon can be gone then(thumbs up)Soon(tick)
Breadcrumbs for the editors(thumbs up)Now(error) not nice
Filtering possibilities in the CI view (similar to storage ones)(thumbs up)Soon 
Edit possibilities for parameters and context capture Soon(tick)
For parameter and field capture when selected focus the text widget and enter example text (like '0' for parameter def)(thumbs up)Now(tick)
Don't enable selection on the paths text, but when selected move focus to add path(thumbs up)Now(tick)
Improve tool-tips for the sensor option images (example for the annotation specify annotation, for parameter index, etc)(thumbs up)Now(tick)
Maybe move visibility pics to the separate column??(error) not for now
Add info about primitive types for the parameters(thumbs up)Now(tick)
Check for the correct FQN on classes and parameters (don't allow 123myClass.*, also in instrumentation we don't check the wrongly specified FQNs, thus much faster)(thumbs up)Soon(tick)
Page tabs in the editor on the top (maybe, check) Soon(error) Not nice
Add menu item in the repository manager to go to the configuration interface for that repository (rename "Configure repository" to "Repository settings" for the properties)(thumbs up)Soon 
Delete environment missing(thumbs up)Now(tick)
Update welcome screen to have simple info about the CI(thumbs down)Future 
Duplicate assignment action (like this one very much)(thumbs up)Now(tick)
Add OK button to the assignment details part(thumbs up)Now(tick)
On delete close open editors containing deleted item(thumbs up)Now(tick)
Select all in platform sensors(thumbs up)Now(error) Not possible
Mapping enabled by default(thumbs up)Now(tick)
Info for the mapping agent and IP wild-cards(thumbs up)Now(tick) in the tool-tip
Disable/enable profile action(thumbs up)Now(tick)
Add profile selection to the Environment wizard(thumbs up)Now(error) no

*  Now should be finished by next test subject, Soon should be fixed by the integration time, Future is future