Explorative Testing v1.7

As the part of the release process it was agreed that prior to release one complete day is reserved for explorative testing that should prove that we don't have any critical bugs. In addition this testing should make us aware of some minor bugs that are always present. These minor bugs should be documented on JIRA and planned for next version.

The steps that are described on this page were used for explorative testing for version 1.5. Please update this page and add additional steps for versions to come.

Explorative testing should perform same steps on both Linux and Windows machines. It's in most cases duplication of work, but it happens often that bug is related to only one platform, especially for the User interface.

Steps

Perform these steps in chronological order (grouping is just for better understanding). Add the person who tests the functionality, if any vulnerability was found and the JIRA ticket if it exists:

Task				Christian Vögele (Win 7)	Isabel Vico Peinado (Ubuntu)	Ivan Senic (Ubuntu)	Found	Ticket / Comment
Installers	Use installers to install inspectIT
	Select all components and creation of all shortcuts
	Test if shortcuts work
UI	Welcome screen	Test all internal links					After installing, the Welcome screen is showing a link, when I clicked on it I am redirected to a browser where I see a local web with the information (Isabel Vico Peinado) image2017-5-10_11-26-7.png & image2017-5-10_11-26-50.png	This is due to the Ubuntu version you have. We can not address this as it's solved with newer versions anyway.
		Test all external links					Mailto links are not working for me in Ubuntu, as it tries to open this in internal browser. Samples link is wrong.
		Prove search works
	Main menu	Click on every item in the main menu, prove all works as expected
	Repository Manager	Add repository
		Edit repository					Edit is not enabled (Christian Vögele, Isabel Vico Peinado)	INSPECTIT-2416 - Getting issue details... STATUS
		Remove repository
		Double-click on offline repository
CMR	Start CMR
UI	Repository Manager	Restart CMR
UI	Repository Manager	Shutdown CMR					After click on Stop button I got this error (I've stored the log), however the CMR is stopped (Isabel Vico Peinado) image2017-5-10_11-39-39.png I get the same. However this is not related to restarting or shut down, but more to problem of repository becoming unavailable.	INSPECTIT-2418 - Getting issue details... STATUS
CMR	Start CMR again (as service in Win)
UI	Label Management	Add new label type
		Add new label of existing type
		Remove label of existing type					Label cannot be removed after label type is deleted image2017-5-10_15-21-35.png. Windows only bug confirmed.
		Prove it's saved correctly
	Start recording, limit time
Stress CMR for 10-15 mins (best with Invoker sample application)
UI	Stop recording manually				(without Invoker sample application)
UI	Check recorded storage
Start one more additional sample app (DVD Store with load test or Test App)
UI	Copy buffer to storage with agent filter
	Open both agents in the Data explorer
	Make sure agent tree structure saving works as agents are switched
	Platform sensors view	Check every view
		Test time-frame
		Test sampling rate					When I applied it for CPU it had no effect. Needs manual refresh after setting the value.
		Check data below graph
	Play around with Invocation browser
	Invocation sequence Show All	Filters - all types					Seams there is a problem if I filter when menu is opened via the arrow and not icon.
		Show hide columns
		Minimize / maximize view
		Change property like refresh time, close UI and check changes are remembered on restart
		Sorting
		Searching
		Call hierarchy	Expand / collapse
			Locate in Hierarchy (multiple items)
			Copy
			Navigation (multiple items)
			Details
			Parameters on context capturing
		SQL / Method / Exceptions	Test raw / aggregated
			Locate in Hierarchy (one raw item, one aggregated)
			Navigation
			Copy
		Combine data (select as much as possible invocations)
	SQL view	Double-click both views
		Decimal places
		Navigation
		Sorting					Error Sorting the Column Database SQL in the SQL Tab of a InvocationSequence. Confirmed with the screenshot.	INSPECTIT-2429 - Getting issue details... STATUS
		Other menu options
		Save SQLs to Server with no invocations included
	Timer Data view	Display in chart
		Navigation
		Sorting
		Save Timers to Server with invocations
	HTTP	URI	Split method
			~~URI Regex~~	-	-	-	-	Not supported at the moment.
			Display in chart
			Navigation
		Tag	Display in chart				Tag name has changed to x-inspectit-tag. This is wrong. It must either remain inspectit or be in the baggage form inspectit_tag.	INSPECTIT-2424 - Getting issue details... STATUS
		Tag	Navigation
	Exceptions (Single and Grouped)	Double clicks					Exception of the remoting http - Web application running on 8001 are not shown up? Ivan Senic: Exception was not instrumented.	INSPECTIT-2407 - Getting issue details... STATUS
		Check stack traces
		Details
		Navigation
	Tracing	Overview	Sort				Tracing profiles are not default.	INSPECTIT-2423 - Getting issue details... STATUS
			Copy
			Search
			Details
			Save to Storage (full trace must be saved)				Save on server is not enabled	INSPECTIT-2404 - Getting issue details... STATUS
			Open details (double-click)
			Open details (navigate-to)
		Trace (top)	Search
			Copy complete
			Details
			Save to Storage (full trace must be saved)					INSPECTIT-2404 - Getting issue details... STATUS
			Locate span using double-click				Object to locate, i.e. send message was correctly show but it says 0 occurrences? But there is one. Can confirm this, some are not located. Creating a ticket but not high prio imo
		Trace (bottom)	Locate in hierarchy (SQL, Method)
			Search call hierarchy
			Details
			Navigate from sub-views
			Copy complete call hierarchy
	Rename few editors
	Delete an agent from Repository
Storage	Add new
	Edit
	Delete (test both finalized and not-finalized one)
	Filters and grouping
	Finalize open storage
	Add all available label types to one storage (boolean, date, number and text)
	Test changing of all label values in the table
	Remove label from storage
	Delete label that exists in storage from Label management
	Download storage	Compressed
	Download storage	Not-compressed
	Upload storage						Isabel Vico Peinado: You need to delete the one trying to upload from the CMR. We don't allow uploading of existing storage. Great, thanks for the clarification Ivan Senic
	Export
	Import	Local
	Import	To repository
Toolbar	Test all actions						We could change the support to link to our official commercial support
Traces	Open Tracing View
	Sort					Sort is not working correctly. The shown information is different. image2017-5-10_15-7-8.png After click on column Start Time: image2017-5-10_15-8-37.png	Christian Vögele: not sure what happend here for u? Can not reproduce.
	Check that spans integrated in the code are shown correctly with the associated tags. (i.e. use remote demo application)			no remote app
	Navigation
	Details (Elements) are shown up correctly
	Tracing View is empty when Remote Tracing is not activated					When remote tracing is not active the spans are shown in trace view. Maybe it is better to show nothing then? image2017-5-10_15-27-10.png	This is correct imo. Resolved as correct.
	Disable/ Enable Remote Sensors for HTTP / JMS
Connect to influxDB
Prove data is written in influxDB (Grafana or influx command)
Configuration Interface	Switch between profiles / environments
	Environments	Create
		Edit
		Export
		Delete
		Import				Got an error when importing (Isabel Vico Peinado) - ImportingEnvironment.PNG. Confirmed!	INSPECTIT-2425 - Getting issue details... STATUS
	Environment editor	Filter profiles
		Select / deselect profiles
		Open profile (double click)
		Open profile (menu item)
		Change strategies
		Deselect some platform sensors
		Change sensor options
		Save & close
		Reload
		Edit (F2)
	Profiles	Create different profile types
		Edit
		Export
		Delete
		Import				Got an error when importing (Isabel Vico Peinado) - ImportingProfile.PNG	INSPECTIT-2425 - Getting issue details... STATUS
		Set as Default (create new Environment to prove)
		Deactivate (confirm by Dynamic instrumentation)
		Duplicate
	Sensor profile	Add sensor type
		Show / hide advances sensors
		Save not possible when not correct input
		One wildcard definition
		One interface/super-class definition
		One method with parameters (test add/remove/edit parameter)
		One with custom modifiers
		One with context capturing (test add/remove/edit capturing)
		Remove assignment (mouse + DEL)
		Duplicate assignment
		Add second sensor type
		Save
		Reopen
	Exclude rule profile	Add exclude rule					Isabel Vico Peinado: Profile type is an option in the create Profile wizard.
		Edit exclude rule
		Close (with save)
		Reopen
		Remove exclude rule
		Test exclude rules with agent restart (check instrumentation browser)				As reported by Isabel Vico Peinado classes excluded are not marked inactive even after agent is restarted.	INSPECTIT-2431 - Getting issue details... STATUS
	JMX profile	Add one assignment
		Set specific attributes
		Close (with save)
		Reopen
		Test exclude rules with agent restart (check JMX browser and/or influxDB)
	Mappings	Deactivate mapping
		Activate mapping
		Change mapping to another environment (don't update with DI)
		Add mapping
		Save
		Reopen
		Remove mapping
	Use instrumentation dialog from Repository manager to refresh agent
Business Context	Application	Create application
		Move application
		Add several matching rules
		Switch to advanced mode
		Add some AND & OR operator
		Add some more rules into ADD and OR
		Save & Close
		Reopen
		Delete added AND & OR
		Switch back to simple mode
		Edit (F2)
		Save
	Business transaction	Add BTs (test insert before option)
		Move BTs
		Delete BTs
		Add several matching rules
		Add some AND & OR operator
		Add some more rules into ADD and OR
		Save & Close
		Reopen
		Enable extract name dynamically (parameter value SearchForm:SearchQuery for DVD store)				Got an error when changing the String Source Selection: ExtractingParameter.PNG	INSPECTIT-2428 - Getting issue details... STATUS
		Test BTs on incoming data
		Edit (F2)
		Save & Close
	Delete created application
Alerting	Connect to email service (NT-VPN host: stmp or your google account)
	Alert	Create
		Use suggestions from influxDB
		Add mail address
		Test with performance problems (Slow Search)
		Create one with lower bound
		Delete
Stop CMR service (Win only)
Uninstallers	Run uninstaller			(Some folder will not be deleted, i.e. configuration or workspace)			If I do not select "Force the deletion of …." the uninstaller tries to delete the folder, giving an error that the folders cannot be removed if they are not empty (Isabel Vico Peinado)