GROUND REPORT 1.5 DOCUMENTATION

GROUND REPORT CONFIGURATION

Environment Properties File

Property file location:

   $GROUNDREPORT_HOME/etc/environment.properties

Environment options:

OptionValueComment
GROUNDREPORT_HOMEstringset the absolute path to the directory in which ground report is installed.
JAVA_HOMEstringset the absolute path to the JVM installation to be used
JAVA_ARGSstringset the JVM runtime options
JYTHON_HOMEstringset the absolute path to the Jython installation to be used

NB.: Set the size of the JVM relevant to the size of report and the report output type.
         For a report containing approximately 2000 elements and of PDF output type a JVM size of 512MB is recommended.
         For a report containing svg graphs and of PDF output type a JVM size greater than 512MB may be required .
         Playing with other JVM parameters may well improve post processing performance.

Database Properties File

Property file location:

   $GROUNDREPORT_HOME/etc/database.properties

Database options:

OptionValueComment
jdbc.serverstringset the Database server IP Address or hostname
jdbc.portintegerset the Database server port number
jdbc.databasestringset the Database Name (SID)
jdbc.userstringset the Database user
jdbc.passstringset the Database user password
jdbc.driverstringset the Database driver

Data Properties File

Property file location:

   $GROUNDREPORT_HOME/etc/data.properties

Data options:

OptionValueComment
fileTypedata || descrselect the type of file you are uploading
dataTypehttp || normselect the type of data contained within the data files and therefore database
uploadMethodlist || directoryselect the method for uploading data to the database.
fileList["/path/to/data/data.log"]enter the list of files that you'd like to upload. Jython list.(uploadMethod = list)
fileDirectory["/path/to/data/directory"]enter the path to the directory where the data files sit. (uploadMethod = directory)

NB : ensure that filenames are enclosed in quotes
         ensure that fileList list is encapsulated with a pair of [] braces
         separate filenames with a comma "," and no whitespaces
         ensure that you always use a "/" for a directory separator even on Windows
         ensure that there is at least 10 seconds worth of data in the data files otherwise the upload will fail a validation check

Ground Report Properties File

Property file location:

   $GROUNDREPORT_HOME/etc/groundReport.properties

Data options:

OptionValueComment
load runintegerselect which load run you'd like to report or graph
loadRunList[1,2,3]enter the list of load runs you want to compare. Jython list.
testintegerselect which test/element you would like to produce an individual test/element graph or report.
pagePair[100,200]set Page Pair List (for individual page graphs and reports). Jython list.

NB: First member of the pagePair is the target page for graphing/reporting (eg. 100)
        Second member of pair is the test number denoting the next page (eg. 200)
        If target page is last page in load run then enter "end" as second member of pair.

Runtime options:

OptionValueComment
useConcurrentUserComparisonGraphsy || nFlag to Enable/Disable concurrent user comparison graphs
Enable if your load run varies the number of concurrent users over time.
Disable if the number of concurrent users in a test run is static.
Includes graphs which show how various metrics change with a changing # of concurrent users.

Output options:

OptionValueComment
projectstringSet the name of the project.
outputFormatpdf || rtf || xml || xhtmlSet Article/Report Format
langenSet Article/Report Language
archivey || nSet Article/Report Archiving
useWatermarky || nSet use of watermark (pdf and rtf output formats only)
watermarkImagestringSet image to use as watermark.
Image file must be in $GROUNDREPORT_HOME/watermark directory
imageFormatsvg || pngSet image output format

Article/Report types:

OptionValueComment
SummaryArticley || nGives an overview of the test data and a table similar to the table in the grinder console.
It tries to identify the worst performing tests in the load run.
It gives information on time/date of test, TPS, bandwidth, response time, # of concurrent users etc.
This information is mostly aggregate data for all the tests combined.
IndividualTestArticley || nThis gives a summary report on a specific test that was in the load run.
All the data and graphs are specific to that test.
IndividualPageArticley || nThis gives a summary report on a composite test (representative of an html page) containing a number of individual tests (elements).
It details all the information for the individual tests and attempts to give a picture of the performance of the page.
All the data and graphs are specific to that composite test (page).
PageBreakdownArticley || nThis gives a summary report for all the composite tests (pages) within a particular load run and follows that by a page by page breakdown of elements and relevant information.
LoadRunComparisonArticle y || nThis report compares the results of various load runs of the same suite of tests against a baseline set of results.
It shows the differences and attempts to work out of there is any statistical significance in the change observed by using effect size.

Report/Article Format:

The format of a report/article is of a DocBook 5 XML article.
This XML format can be transformed into a number of other formats, such as pdf, xhtml and rtf.

Report/Article Output Location:

All reports are generated in the following location:

   $GROUNDREPORT_HOME/output/reports

If report archiving has been enabled the archives are stored in the following location:

   $GROUNDREPORT_HOME/output/archives

Report/Article Text Location:

The text for headings, tables and units is stored in the following file in the following location:

   $GROUNDREPORT_HOME/includes/en/standardArticle.txt

Graph Types:

There are 5 categories of graph:

   Summary
   Breakdown
   Individual
   Comparison
   Load Run Comparison

Those graphs with "HTTP" in their name are valid only for the http data type.

Hopefully the naming of the graphs gives you a clue as to what they display.

Summary graphs:

OptionValueComment
TPSCharty || nThis option will produce a graph which shows the overall Transactions Per Second profile for all elements for the specified load run.
Plotted against concurrent user load.
TotalBandwidthCharty || nThis option will produce a graph which shows the overall Bandwidth Per Second profile for all elements for the specified load run.
TotalResponseTimeCharty || nThis option will produce a graph which shows the overall mean Response Time profile for all elements for the specified load run.
Plotted against concurrent user load.
ElementResponseTimePercentileCharty || nThis option will produce a graph which shows the distribution of Response Times as a percentile plot for all elements for the specified load run.
ElementHeatCharty || nThis option will produce a graph which shows the Response Time profile for all elements for the specified load run by means of a heat map.
SummaryHTTPBarCharty || nThis option will produce a bar chart which shows the timing breakdowns of the worst performing elements in the specified load run.
StaticElementHeatHTTPCharty || nThis option will produce a graph which shows the Response Time profile for all static elements for the specified load run by means of a heat map.
DynamicElementHeatHTTPCharty || nThis option will produce a graph which shows the Response Time profile for all dynamic elements for the specified load run by means of a heat map.
StaticTPSHTTPCharty || nThis option will produce a graph which shows the overall Transactions Per Second profile for all static elements for the specified load run.
Plotted against concurrent user load.
DynamicTPSHTTPCharty || nThis option will produce a graph which shows the overall Transactions Per Second profile for all dynamic elements for the specified load run.
Plotted against concurrent user load.
StaticBandwidthHTTPCharty || nThis option will produce a graph which shows the overall Bandwidth Per Second profile for all static elements for the specified load run.
DynamicBandwidthHTTPCharty || nThis option will produce a graph which shows the overall Bandwidth Per Second profile for all dynamic elements for the specified load run.
StaticResponseTimeHTTPCharty || nThis option will produce a graph which shows the overall mean Response Time profile for all static elements for the specified load run.
Plotted against concurrent user load.
StaticResponseTimePercentileHTTPCharty || nThis option will produce a graph which shows the distribution of Response Times as a percentile plot for all static elements for the specified load run.
DynamicResponseTimeHTTPCharty || nThis option will produce a graph which shows the overall mean Response Time profile for all dynamic elements for the specified load run.
Plotted against concurrent user load.
DynamicResponseTimePercentileHTTPCharty || nThis option will produce a graph which shows the distribution of Response Times as a percentile plot for all dynamic elements for the specified load run.
PPSHTTPCharty || nThis option will produce a graph which shows the overall Pages Per Second profile for the specified load run.
Plotted against concurrent user load.
PageHeatHTTPCharty || nThis option will produce a graph which shows the Response Time profile for all pages for the specified load run by means of a heat map.
PageResponseTimeHTTPCharty || nThis option will produce a graph which shows the overall mean Response Time profile for all pages for the specified load run.
Plotted against concurrent user load.
PageResponseTimePercentileHTTPCharty || nThis option will produce a graph which shows the distribution of Response Times as a percentile plot for all pages for the specified load run.
ConcurrentUsersCharty || nThis option will produce a graph which shows the concurrent user profile (load) for the specified load run.

Breakdown graphs:

OptionValueComment
PerElementBandwidthHTTPCharty || nThis option will produce Bandwidth profile charts for all elements within the specified load run.
PerElementResponseTimeCharty || nThis option will produce Response Time profile charts for all elements within the specified load run.
PerElementAverageResponseTimePerMinuteCharty || nThis option will produce Response Time profile charts averaged by minute for all elements within the specified load run.
PerElementResponseTimePercentileCharty || nThis option will produce individual charts showing the distribution of Response Times as a percentile plot for all elements for the specified load run.
PerElementResponseTimeDistributionCharty || nThis option will produce Distribution charts of Response Time for all elements for the specified load run.
PerPageResponseTimeHTTPCharty || nThis option will produce Response Time profile charts for all pages within the specified load run.
PerPageAverageResponseTimePerMinuteHTTPCharty || nThis option will produce Response Time profile charts average by minute for all pages within the specified load run.
PerPageResponseTimePercentileHTTPCharty || nThis option will produce individual charts showing the distribution of Response Times as a percentile plot for all pages for the specified load run.
PerPageResponseTimeDistributionCharty || nThis option will produce Distribution charts of Response Time for all pages for the specified load run.
PerPageSummaryHTTPBarCharty || nThis option will produce Timing Breakdown bar charts for all pages within the specified load run.

Individual graphs:

OptionValueComment
IndividualElementBandwidthCharty || nThis option will produce a Bandwidth profile chart for the specified element for the specified load run.
IndividualElementResponseTimeCharty || nThis option will produce a Response Time profile chart for the specified element for the specified load run.
IndividualElementAverageResponseTimePerMinuteCharty || nThis option will produce a Response Time profile chart averaged by minute for the specified element for the specified load run.
IndividualElement95ResponseTimeCharty || nThis option will produce a Response Time profile chart at the 95% confidence level for the specified element for the specified load run.
IndividualElementResponseTimeDistributionCharty || nThis option will produce a Distribution chart of Response Time for the specified element for the specified load run.
IndividualElementResponseTimePercentileCharty || nThis option will produce a Percentile chart of Response Time for the specified element for the specified load run.
IndividualPageResponseTimeHTTPCharty || nThis option will produce a Response Time profile chart for the specified page for the specified load run.
IndividualPageAverageResponseTimePerMinuteHTTPCharty || nThis option will produce a Response Time profile chart averaged by minute for the specified page for the specified load run.
IndividualPageResponseTimeDistributionHTTPCharty || nThis option will produce a Distribution chart of Response Time for the specified page for the specified load run.
IndividualPageResponseTimePercentileHTTPCharty || nThis option will produce a Percentile chart of Response Time for the specified page for the specified load run.
IndividualPageSummaryHTTPBarCharty || nThis option will produce Timing Breakdown bar charts for the specified page within the specified load run.

Comparison graphs:

OptionValueComment
TPSVsUsersCharty || nThis option will produce a graph that plots TPS against the number of Concurrent Users for the specified load run.
StaticTPSVsUsersCharty || nThis option will produce a graph that plots static element TPS against the number of Concurrent Users for the specified load run.
DynamicTPSVsUsersCharty || nThis option will produce a graph that plots dynamic element TPS against the number of Concurrent Users for the specified load run.
TotalResponseTimeVsUsersCharty || nThis option will produce a graph that plots overall element Response Time against the number of Concurrent Users for the specified load run.
StaticResponseTimeVsUsersCharty || nThis option will produce a graph that plots static element Response Time against the number of Concurrent Users for the specified load run.
DynamicResponseTimeVsUsersCharty || nThis option will produce a graph that plots dynamic element Response Time against the number of Concurrent Users for the specified load run.
StaticVsDynamicResponseTimeHTTPCharty || nThis option will produce a graph that plots the static element Response Time profile against the dynamic element Response Time profile for the specified load run.
StaticVsDynamicBandwidthHTTPCharty || nThis option will produce a graph that plots the static element Bandwidth profile against the dynamic element Bandwidth profile for the specified load run.
StaticVsDynamicTPSHTTPCharty || nThis option will produce a graph that plots the static element TPS profile against the dynamic element TPS profile for the specified load run.
PPSVsUsersCharty || nThis option will produce a graph that plots PPS against the number of Concurrent Users for the specified load run.
PageResponseTimeVsUsersCharty || nThis option will produce a graph that plots overall page Response Time against the number of Concurrent Users for the specified load run.
TPSVsPPSHTTPCharty || nThis option will produce a graph that plots the TPS profile against the PPS profile for the specified load run.
TotalResponseTimeVsPageResponseTimeHTTPCharty || nThis option will produce a graph that plots the overall element Response Time profile against the overall page Response Time profile for the specified load run.

Load run comparison graphs:

OptionValueComment
LoadRunComparisonTPSCharty || nThis option will produce a graph that plots the TPS profiles for all specified load runs.
LoadRunComparisonTPSVsUsersCharty || nThis option will produce a graph that plots the TPS against number of Concurrent Users profiles for all specified load runs.
LoadRunComparisonBandwidthCharty || nThis option will produce a graph that plots the Bandwidth profiles for all specified load runs.
LoadRunComparisonResponseTimeCharty || nThis option will produce a graph that plots the overall element Response Time profiles for all specified load runs.
LoadRunComparisonResponseTimeVsUsersCharty || nThis option will produce a graph that plots the overall element Response Time against number of Concurrent Users profiles for all specified load runs.
LoadRunComparisonResponseTimePercentileCharty || nThis option will produce a graph that plots the overall element Response Time Percentile profiles for all specified load runs.
LoadRunComparisonPPSHTTPCharty || nThis option will produce a graph that plots the PPS profiles for all specified load runs.
LoadRunComparisonPPSVsUsersHTTPCharty || nThis option will produce a graph that plots the PPS against number of Concurrent Users profiles for all specified load runs.
LoadRunComparisonPageResponseTimeHTTPCharty || nThis option will produce a graph that plots the page Response Time profiles for all specified load runs.
LoadRunComparisonPageResponseTimeVsUsersHTTPCharty || nThis option will produce a graph that plots the page Response Time against number of Concurrent Users profiles for all specified load runs.
LoadRunComparisonPageResponseTimePercentileHTTPCharty || nThis option will produce a graph that plots the page Response Time Percentile profiles for all specified load runs.

Graph Output Location:

All graphs are generated in the following location:

   $GROUNDREPORT_HOME/output/images

Graph Text Location:

The text for titles and labels is stored in the following file in the following location:

   $GROUNDREPORT_HOME/includes/en/standardGrapher.txt

Resource Properties File

Property file location:

   $GROUNDREPORT_HOME/etc/resource.properties

Directory options:

OptionValueComment
reportHomestringRelative path for output directory for reports.
imageHomestringRelative path for output directory for graphs.
archiveHomestringRelative path for output directory for archive files.
watermarkHomestringRelative path for location of watermark images.
includeHomestringRelative path for location of include files.
xsltHomestringRelative path for location of xslt files.
cssHomestringRelative path for location of css files.

Include options:

OptionValueComment
articleIncludestringInclude file containing article text.
graphIncludestringInclude file containing graph text.
menuIncludestringInclude file containing menu text.
mainIncludestringInclude file containing general application text.

XSLT options:

OptionValueComment
pdfXSLTstringXSLT for transforming docbook 5 XML to PDF & RTF formats.
xhtmlXSLTstringXSLT for transforming docbook 5 XML to XHTML format.

CSS options:

OptionValueComment
xhtmlCSSstringCSS for XHTML format reports.

Variable validation options:

OptionValueComment
httpDataTypeCheckstringValidation text for HTTP data type variable.
normDataTypeCheckstringValidation text for NORM data type variable.
dataFileTypeCheckstringValidation text for data file type variable.
descrFileTypeCheckstringValidation text for description file type variable.
AffirmativeMarkerstringValidation text for affirmative marker variable.
NegativeMarkerstringValidation text for negative marker variable.

Time output options:

OptionValueComment
timerOutputstringOutput string format for application timers.