Explorative Testing v1.7

Owned by Christian Vögele
Last updated: May 18, 2017 by Isabel Vico Peinado
6 min read

As the part of the release process it was agreed that prior to release one complete day is reserved for explorative testing that should prove that we don't have any critical bugs. In addition this testing should make us aware of some minor bugs that are always present. These minor bugs should be documented on JIRA and planned for next version.

The steps that are described on this page were used for explorative testing for version 1.5. Please update this page and add additional steps for versions to come.

Explorative testing should perform same steps on both Linux and Windows machines. It's in most cases duplication of work, but it happens often that bug is related to only one platform, especially for the User interface.

Steps

Perform these steps in chronological order (grouping is just for better understanding). Add the person who tests the functionality, if any vulnerability was found and the JIRA ticket if it exists:


TaskChristian Vögele (Win 7)Isabel Vico Peinado (Ubuntu)

Ivan Senic (Ubuntu)

Marius Oehler (Win 7)FoundTicket / Comment


Installers

Use installers to install inspectIT(Haken)(tic)(tic)


Select all components and creation of all shortcuts(Haken)(tic)(tic)


Test if shortcuts work(Haken)(tic)(tic)






UI


Welcome screen

Test all internal links(Haken)(advertencia)(tic)

After installing, the Welcome screen is showing a link, when I clicked on it I am redirected to a browser where I see a local web with the information (Isabel Vico Peinado) image2017-5-10_11-26-7.png & image2017-5-10_11-26-50.png

This is due to the Ubuntu version you have. We can not address this as it's solved with newer versions anyway.
Test all external links(Haken)(tic)(advertencia)
Mailto links are not working for me in Ubuntu, as it tries to open this in internal browser. Samples link is wrong.
Prove search works(Haken)(tic)(tic)


Main menuClick on every item in the main menu, prove all works as expected(Haken)(tic)(tic)



Repository Manager

Add repository(Haken)(tic)(tic)(tic)

Edit repository(advertencia)(advertencia) - (tick) (Tested in fixed version)(advertencia)(tic) (used fixed version)Edit is not enabled (Christian Vögele, Isabel Vico Peinado)

INSPECTIT-2416 - Getting issue details... STATUS

Remove repository(Haken)(tic)(tic)(tic)

Double-click on offline repository(Haken)(tic)(tic)(tic)

CMRStart CMR(Haken)(tic)(tic)


UIRepository ManagerRestart CMR(Haken)(tic)(advertencia)


Shutdown CMR(Haken)(advertencia)(advertencia)

After click on Stop button I got this error (I've stored the log), however the CMR is stopped (Isabel Vico Peinado) image2017-5-10_11-39-39.png

I get the same. However this is not related to restarting or shut down, but more to problem of repository becoming unavailable.

INSPECTIT-2418 - Getting issue details... STATUS

CMRStart CMR again (as service in Win)(Haken)(pregunta)(pregunta)




UI

Label ManagementAdd new label type(Haken)(tic)(tic)


Add new label of existing type(Haken)(tic)(tic)


Remove label of existing type(advertencia)(tic)(tic)

Label cannot be removed after label type is deleted image2017-5-10_15-21-35.png. Windows only bug confirmed.


Prove it's saved correctly(Haken)(tic)(tic)

Start recording, limit time
(tic)(tic)(tic)

Stress CMR for 10-15 mins (best with Invoker sample application)
(pregunta)(tic)(warning)

UIStop recording manually
(tic) (without Invoker sample application)(tic) (tic)

Check recorded storage
(pregunta)(tic)(tic)

Start one more additional sample app (DVD Store with load test or Test App)(Haken)(tic)(tic)


















UI











Copy buffer to storage with agent filter(Haken)(tic)(tic)


Open both agents in the Data explorer(Haken)(tic)(tic)


Make sure agent tree structure saving works as agents are switched(Haken)(tic)(tic)




Platform sensors view

Check every view(Haken)(tic)(tic)


Test time-frame(Haken)(tic)(tic)


Test sampling rate(advertencia)(tic)(advertencia)
When I applied it for CPU it had no effect. Needs manual refresh after setting the value.
Check data below graph(Haken)(tic)(tic)


Play around with Invocation browser(Haken)(tic)(tic)









Invocation sequence

Show All

Filters - all types(Haken)(tic)(advertencia)
Seams there is a problem if I filter when menu is opened via the arrow and not icon.
Show hide columns(Haken)(tic)(tic)


Minimize / maximize view(Haken)(tic)(tic)


Change property like refresh time, close UI and check changes are remembered on restart(Haken)(tic)(tic)


Sorting(Haken)(tic)(tic)


Searching(Haken)(tic)(tic)




Call hierarchy

Expand / collapse(Haken)(tic)(tic)


Locate in Hierarchy (multiple items)(Haken)(tic)(tic)


Copy(Haken)(tic)(tic)


Navigation (multiple items)(Haken)(tic)(tic)


Details(Haken)(tic)(tic)


Parameters on context capturing (Haken)(tic)




SQL / Method / Exceptions

Test raw / aggregated(Haken)(tic)(tic)


Locate in Hierarchy (one raw item, one aggregated)(Haken)(tic)(tic)


Navigation(Haken)(tic)(tic)


Copy(Haken)(tic)(tic)


Combine data (select as much as possible invocations)(Haken)(tic)(tic)




SQL view

Double-click both views(Haken)(tic)(tic)


Decimal places(Haken)(tic)(tic)


Navigation(Haken)(tic)(tic)


Sorting(tic)(tic)
Error Sorting the Column Database SQL in the SQL Tab of a InvocationSequence. Confirmed with the screenshot.

INSPECTIT-2429 - Getting issue details... STATUS

Other menu options(Haken)(tic)(tic)


Save SQLs to Server with no invocations included(Haken)(tic)(tic)



Timer Data view

Display in chart(Haken)(tic)(tic)


Navigation(Haken)(tic)(tic)


Sorting(Haken)(tic)(tic)


Save Timers to Server with invocations(Haken)(tic)(tic)





HTTP


URI

Split method(Haken)(tic)(tic)


URI Regex---
-Not supported at the moment.
Display in chart(Haken)(tic)(tic)


Navigation(Haken)(tic)(tic)


Tag

Display in chart(pregunta)
(tic)
Tag name has changed to x-inspectit-tag. This is wrong. It must either remain inspectit or be in the baggage form inspectit_tag.

INSPECTIT-2424 - Getting issue details... STATUS

Navigation(pregunta)
(tic)



Exceptions

(Single and Grouped)

Double clicks(pregunta)(tic)
Exception of the remoting http - Web application running on 8001 are not shown up? Ivan Senic: Exception was not instrumented.

INSPECTIT-2407 - Getting issue details... STATUS

Check stack traces
(tic)


Details
(tic)


Navigation
(tic)


Tracing















Overview





Sort(Haken)(tic)
Tracing profiles are not default.

INSPECTIT-2423 - Getting issue details... STATUS

Copy(Haken)(Haken)


Search(Haken)(Haken)


Details(Haken)(Haken)


Save to Storage (full trace must be saved)
Save on server is not enabled

INSPECTIT-2404 - Getting issue details... STATUS

Open details (double-click)(Haken)(Haken)


Open details (navigate-to)(Haken)(Haken)


Trace (top)



Search(Haken)(Haken)


Copy complete(Haken)(Haken)


Details(Haken)(Haken)


Save to Storage (full trace must be saved)

INSPECTIT-2404 - Getting issue details... STATUS

Locate span using double-click
Object to locate, i.e. send message was correctly show but it says 0 occurrences? But there is one. Can confirm this, some are not located. Creating a ticket but not high prio imo
Trace (bottom)



Locate in hierarchy (SQL, Method)
(Haken)(tic)

Search call hierarchy(Haken)(Haken)


Details(Haken)(Haken)


Navigate from sub-views(Haken)(Haken)


Copy complete call hierarchy(Haken)(Haken)


Rename few editors(Haken)(tic)(Haken)


Delete an agent from Repository(Haken)(tic)(Haken)










Storage

Add new
(tic)(tic)(tic)

Edit
(tic)(tic)(tic)

Delete (test both finalized and not-finalized one)
(tic)(tic)(tic)

Filters and grouping
(tic)(tic)(tic)

Finalize open storage
(tic)(tic)(tic)

Add all available label types to one storage (boolean, date, number and text)
(tic)(tic)(tic)

Test changing of all label values in the table
(tic)(tic)(warning)It is only possible to change a label value if the respective label type cell is selected INSPECTIT-2433 - Getting issue details... STATUS
Remove label from storage
(tic)(tic)(tic)

Delete label that exists in storage from Label management
(tic)(tic)(tic)

Download storageCompressed
(tic)(tic)(tic)

Not-compressed
(tic)(tic)(tic)

Upload storage
(tic)(tic)

Isabel Vico Peinado: You need to delete the one trying to upload from the CMR. We don't allow uploading of existing storage.

Great, thanks for the clarification Ivan Senic

Export
(tic)(tic)(tic)

ImportLocal
(tic)(tic)(tic)

To repository
(tic)(tic)(tic)

ToolbarTest all actions(Haken)(tic)(tic)

We could change the support to link to our official commercial support
TracesOpen Tracing View(Haken)(tic)(tic)


Sort(tick)(tick)(tic)

Sort is not working correctly. The shown information is different. image2017-5-10_15-7-8.png

After click on column Start Time: image2017-5-10_15-8-37.png

Christian Vögele: not sure what happend here for u?

Can not reproduce.

Check that spans integrated in the code are shown correctly with the associated tags. (i.e. use remote demo application)(Haken)(pregunta) no remote app(tic)


Navigation(Haken)(tic)(tic)


Details (Elements) are shown up correctly(Haken)(tic)(tic)


Tracing View is empty when Remote Tracing is not activated(tic)

When remote tracing is not active the spans are shown in trace view. Maybe it is better to show nothing then? image2017-5-10_15-27-10.png

This is correct imo. Resolved as correct.
Disable/ Enable Remote Sensors for HTTP / JMS(Haken)(tic)(tic)


Connect to influxDB(Haken)(tic)(tic)


Prove data is written in influxDB (Grafana or influx command)(Haken)(tic)


Configuration Interface




















































Switch between profiles / environments
(tic)(tic)(tic)

Environments



Create
(tic)(tic)(tic)

Edit
(tic)(tic)(warning)The "Edit" entry of the context menu is always disabled.

INSPECTIT-2434 - Getting issue details... STATUS

Export
(tic)(tic)(tic)

Delete
(tic)(tic)(tic)

Import
(advertencia) - (tick) (Tested in fixed version)(advertencia)(tic) (used fixed version)

Got an error when importing (Isabel Vico Peinado) - ImportingEnvironment.PNG. Confirmed!

INSPECTIT-2425 - Getting issue details... STATUS

Environment editor








Filter profiles
(tic)(tic)(tic)

Select / deselect profiles
(tic)(tic)(tic)

Open profile (double click)
(tic)(tic)(tic)

Open profile (menu item)
(tic)(tic)(tic)

Change strategies
(tic)(tic)(tic)

Deselect some platform sensors
(tic)(tic)(tic)

Change sensor options
(tic)(tic)(tic)

Save & close
(tic)(tic)(tic)

Reload
(tic)(tic)(tic)

Edit (F2)
(tic)(tic)(warning)

Related to INSPECTIT-2434 - Getting issue details... STATUS


Profiles






Create different profile types
(tic)(tic)(tic)

Edit
(tic)(tic)(tic)

Export
(tic)(tic)(tic)

Delete
(tic)(tic)(tic)

Import
(advertencia) - (tick) (Tested in fixed version)(tic) (used fixed version)Got an error when importing (Isabel Vico Peinado) - ImportingProfile.PNG

INSPECTIT-2425 - Getting issue details... STATUS

Set as Default (create new Environment to prove)
(tic)(tic)(tic)

Deactivate (confirm by Dynamic instrumentation)
(tick)(tic)(tic)

Duplicate
(tic)(tic)(tic)

Sensor profile











Add sensor type
(tick)(tic)(tic)

Show / hide advances sensors

(tic)(tic)

Save not possible when not correct input
(tick)(tic)(tic)

One wildcard definition
(tick)(tic)(tic)

One interface/super-class definition
(tick)(tic)(tic)

One method with parameters (test add/remove/edit parameter)
(tick)(tic)(tic)

One with custom modifiers
(tick)(tic)(tic)

One with context capturing (test add/remove/edit capturing)
(tick)(tic)(tic)

Remove assignment (mouse + DEL)
(tick)(tic)(tic)

Duplicate assignment
(tick)(tic)(tic)

Add second sensor type
(tick)(tic)(tic)

Save
(tick)(tic)(tic)

Reopen
(tick)(tic)(tic)

Exclude rule profile



Add exclude rule
(tic)(tic)(tic)
Isabel Vico Peinado: Profile type is an option in the create Profile wizard.
Edit exclude rule
(tic)(tic)(tic)

Close (with save)
(tic)(tic)(tic)

Reopen
(tic)(tic)(tic)

Remove exclude rule
(tic)(tic)(tic)

Test exclude rules with agent restart (check instrumentation browser)
(advertencia) - (tick) (Tested in fixed version)(advertencia)(tic) (used fixed version)As reported by Isabel Vico Peinado classes excluded are not marked inactive even after agent is restarted.

INSPECTIT-2431 - Getting issue details... STATUS

JMX profile


Add one assignment
(tick)(tic)


Set specific attributes
(tick)(tic)


Close (with save)
(tick)(tic)


Reopen
(tick)(tic)


Test exclude rules with agent restart (check JMX browser and/or influxDB)
(tick)(tic)


Mappings





Deactivate mapping
(tick)(tic)(tic)

Activate mapping
(tick)(tic)(tic)

Change mapping to another environment (don't update with DI)
(tick)(tic)(tic)

Add mapping
(tick)(tic)(tic)

Save
(tick)(tic)(tic)

Reopen
(tick)(tic)(tic)

Remove mapping
(tick)(tic)(tic)

Use instrumentation dialog from Repository manager to refresh agent
(tick)(tic)(tic)

Business Context






















Application










Create application(Haken)(tick)(tick)


Move application(Haken)(tick)(tic)


Add several matching rules(Haken)(tick)(tick)


Switch to advanced mode(Haken)(tick)(tick)


Add some AND & OR operator(Haken)(tick)(tick)


Add some more rules into ADD and OR(Haken)(tick)(tick)


Save & Close(Haken)(tick)(tick)


Reopen(Haken)(tick)(tick)


Delete added AND & OR(Haken)(tick)



Switch back to simple mode(Haken)(tick)(tic)


Edit (F2)(Haken)(tick)(tick)


Save(Haken)(tick)(tick)


Business transaction










Add BTs (test insert before option)(Haken)(tick)(tick)


Move BTs(Haken)(tick)(tick)


Delete BTs(Haken)(tick)(tic)


Add several matching rules(Haken)(tick)



Add some AND & OR operator(Haken)(tick)



Add some more rules into ADD and OR(Haken)(tick)



Save & Close(Haken)(tick)(tick)


Reopen(Haken)(tick)(tick)


Enable extract name dynamically (parameter value SearchForm:SearchQuery for DVD store)(warning)(warning) - (tick) (Tested in fixed version)(tick) (fixed version)
Got an error when changing the String Source Selection: ExtractingParameter.PNG

INSPECTIT-2428 - Getting issue details... STATUS

Test BTs on incoming data(Haken)
(tick)


Edit (F2)(Haken)(tick)(tick)


Save & Close(Haken)(tick)(tick)


Delete created application(Haken)(tick)(tic)


Alerting





Connect to email service (NT-VPN host: stmp or your google account)
(tic) (Tested in fixed version)(warning)
All passwords are visible. We could easily change this.

INSPECTIT-2435 - Getting issue details... STATUS

Alert




Create
(tic)(tic)


Use suggestions from influxDB
(tic)(tic)


Add mail address
(tic)(tic)


Test with performance problems (Slow Search)
(tic)(tic)


Create one with lower bound
(tic)



Delete
(tic)(tic)


Search alert
(warning)

Got an error when try to find an alert AlertingSearch.PNG - SearchAlertLog.log

I received the id in the email just for some of the alerts (BT ones), not for all of them.

INSPECTIT-2437 - Getting issue details... STATUS

Stop CMR service (Win only)(Haken)




UninstallersRun uninstaller(Haken) (Some folder will not be deleted, i.e. configuration or workspace)(advertencia)

If I do not select "Force the deletion of …." the uninstaller tries to delete the folder, giving an error that the folders cannot be removed if they are not empty (Isabel Vico Peinado)




(Haken)