Explorative Testing v1.7

As the part of the release process it was agreed that prior to release one complete day is reserved for explorative testing that should prove that we don't have any critical bugs. In addition this testing should make us aware of some minor bugs that are always present. These minor bugs should be documented on JIRA and planned for next version.

The steps that are described on this page were used for explorative testing for version 1.5. Please update this page and add additional steps for versions to come.

Steps

Perform these steps in chronological order (grouping is just for better understanding). Add the person who tests the functionality, if any vulnerability was found and the JIRA ticket if it exists:

Task				Christian Vögele (Win 7)	Isabel Vico Peinado (Ubuntu)	Ivan Senic (Ubuntu)	Found	Ticket
Installers	Use installers to install inspectIT
	Select all components and creation of all shortcuts
	Test if shortcuts work
UI	Welcome screen	Test all internal links					After installing, the Welcome screen is showing a link, when I clicked on it I am redirected to a browser where I see a local web with the information (Isabel Vico Peinado) image2017-5-10_11-26-7.png & image2017-5-10_11-26-50.png
		Test all external links
		Prove search works
	Main menu	Click on every item in the main menu, prove all works as expected
	Repository Manager	Add repository
		Edit repository					Edit is not enabled (Christian Vögele, Isabel Vico Peinado)
		Remove repository
		Double-click on offline repository
CMR	Start CMR
UI	Repository Manager	Restart CMR
		Shutdown CMR					After click on Stop button I got this error (I've stored the log), however the CMR is stopped (Isabel Vico Peinado) image2017-5-10_11-39-39.png
CMR	Start CMR again (as service in Win)
UI	Label Management	Add new label type
		Add new label of existing type
		Remove label of existing type					Label cannot be removed after label type is deleted image2017-5-10_15-21-35.png
		Prove it's saved correctly
	Start recording, limit time
Stress CMR for 10-15 mins (best with Invoker sample application)
UI	Stop recording manually				(without Invoker sample application)
	Check recorded storage
Start one more additional sample app (DVD Store with load test or Test App)
UI	Copy buffer to storage with agent filter
	Open both agents in the Data explorer
	Make sure agent tree structure saving works as agents are switched
	Platform sensors view	Check every view
		Test time-frame
		Test sampling rate		?			When I applied it for CPU it had no effect
		Check data below graph		?
	Play around with Invocation browser
	Invocation sequence Show All	Filters - all types
		Show hide columns
		Minimize / maximize view
		Change property like refresh time, close UI and check changes are remembered on restart
		Sorting
		Searching
		Call hierarchy	Expand / collapse
			Locate in Hierarchy (multiple items)
			Copy
			Navigation (multiple items)
			Details
			Parameters on context capturing
		SQL / Method / Exceptions	Test raw / aggregated
			Locate in Hierarchy (one raw item, one aggregated)
			Navigation
			Copy
		Combine data (select as much as possible invocations)
	SQL view	Double-click both views
		Decimal places
		Navigation
		Sorting					Error Sorting the Column Database URL in the SQL Tab of a InvocationSequence
		Other menu options
		Save SQLs to Server with no invocations included
	Timer Data view	Display in chart
		Navigation
		Sorting
		Save Timers to Server with invocations
	HTTP	URI	Split method
			URI Regex
			Display in chart
			Navigation
		Tag	Display in chart	?
			Navigation	?
	Exceptions (Single and Grouped)	Double clicks					Exception of the remoting http - Web application running on 8001 are not shown up??
		Check stack traces
		Details
		Navigation
	Tracing	Overview	Sort
			Copy
			Search
			Details
			Save to Storage (full trace must be saved)	save on server is not enabled
			Open details (double-click)
			Open details (navigate-to)
		Trace (top)	Search
			Copy complete
			Details
			Save to Storage (full trace must be saved)
			Locate span using double-click				Object to locate, i.e. send message was corretly show but it says 0 occurences? But there is one...
		Trace (bottom)	Locate in hierarchy (SQL, Method)
			Search call hierarchy
			Details
			Navigate from sub-views
			Copy complete call hierarchy
	Rename few editors
	Delete an agent from Repository
Storage	Add new
	Edit
	Delete (test both finalized and not-finalized one)
	Filters and grouping
	Finalize open storage
	Add all available label types to one storage (boolean, date, number and text)
	Test changing of all label values in the table
	Remove label from storage
	Delete label that exists in storage from Label management
	Download storage	Compressed
		Not-compressed
	Upload storage					Disabled (Isabel Vico Peinado)
	Export
	Import	Local
		To repository
Toolbar	Test all actions
Traces	Open Tracing View
	Sort					Sort is not working correctly. The shown information is different. image2017-5-10_15-7-8.png After klick on column Start Time: image2017-5-10_15-8-37.png
	Check that spans integrated in the code are shown correctly with the associated tags. (i.e. use remote demo application)			?
	Navigation
	Details (Elements) are shown up correctly
	Tracing View is empty when Remote Tracing is not activated			?		When remote tracing is not active the spans are shown in trace view. Maybe it is better to show nothing then? image2017-5-10_15-27-10.png
	Disable/ Enable Remote Sensors for HTTP / JMS
Connect to influxDB
Prove data is written in influxDB (Grafana or influx command)				?
Configuration Interface	Switch between profiles / environments
	Environments	Create
		Edit
		Export
		Delete
		Import				Got an error when importing (Isabel Vico Peinado) - ImportingEnvironment.PNG
	Environment editor	Filter profiles
		Select / deselect profiles
		Open profile (double click)
		Open profile (menu item)
		Change strategies
		Deselect some platform sensors
		Change sensor options
		Save & close
		Reload
		Edit (F2)
	Profiles	Create different profile types
		Edit
		Export
		Delete
		Import				Got an error when importing (Isabel Vico Peinado) - ImportingProfile.PNG
		Set as Default (create new Environment to prove)
		Deactivate (confirm by Dynamic instrumentation)
		Duplicate
	Sensor profile	Add sensor type
		Show / hide advances sensors
		Save not possible when not correct input
		One wildcard definition
		One interface/super-class definition
		One method with parameters (test add/remove/edit parameter)
		One with custom modifiers
		One with context capturing (test add/remove/edit capturing)
		Remove assignment (mouse + DEL)
		Duplicate assignment
		Add second sensor type
		Save
		Reopen
	Exclude rule profile	Add exclude rule
		Edit exclude rule
		Close (with save)
		Reopen
		Remove exclude rule
	JMX profile	Add one assignment
		Set specific attributes
		Close (with save)
		Reopen
	Mappings	Deactivate mapping
		Activate mapping
		Change mapping to another environment (don't update with DI)
		Add mapping
		Save
		Reopen
		Remove mapping
	Use instrumentation dialog from Repository manager to refresh agent
Business Context	Application	Create application
		Move application
		Add several matching rules
		Switch to advanced mode
		Add some AND & OR operator
		Add some more rules into ADD and OR
		Save & Close
		Reopen
		Delete added AND & OR
		Switch back to simple mode
		Edit (F2)
		Save
	Business transaction	Add BTs (test insert before option)
		Move BTs
		Delete BTs
		Add several matching rules
		Add some AND & OR operator
		Add some more rules into ADD and OR
		Save & Close
		Reopen
		Enable extract name dynamically (parameter value SearchForm:SearchQuery for DVD store)
		Test BTs on incoming data
		Edit (F2)
		Save & Close
	Delete created application
Alerting	Connect to email service (NT-VPN host: stmp or your google account)
	Alert	Create
		Use suggestions from influxDB
		Add mail address
		Test with performance problems (Slow Search)
		Create one with lower bound
		Delete
Stop CMR service (Win only)
Uninstallers	Run uninstaller						If I do not select "Force the deletion of …." the uninstaller tries to delete the folder, giving an error that the folders cannot be removed if they are not empty (Isabel Vico Peinado)