Glossary

.jte Files

   See environment files.


.jti Files

   See configuration file.


.jtp Files

   See parameter files.


.jtr File

   See test result files.


.jtx Files

   See exclude list.


.kfl Files

   See Known Failures List File.


A

All Tests View Filter

   A test tree view filter that displays all folders and tests in the test suite.


Audit

   The JT harness includes an audit tool that you can use to analyze the test results in a work directory. The audit tool verifies that all tests in a test suite ran correctly and identifies any audit categories of a test run that had errors.

   You can use the GUI or the command-line interface to audit a test run.


B

C

Class

   The prototype for an object in an object-oriented language. A class might also be considered a set of objects that share a common structure and behavior. The structure of a class is determined by the class variables that represent the state of an object of that class and the behavior is given by a set of methods associated with the class.


Configuration

   Information about the computing environment required to execute a test suite.

   In the GUI, you can use the Configuration Editor to collect or modify configuration information or to load an existing configuration. See Configuration Editor. The Configuration Editor collects the following two types of data in a configuration file:

   In the command-line interface, you can perform the following tasks:


Configuration Editor

   The Configuration Editor provides two editing modes, the Question mode and the Quick Set mode. Use the Question mode to create a configuration file for the test run and to search interview titles, questions, and answers for character strings. Use the Quick Set mode to modify specific runtime values.

   To open the Configuration Editor, choose Configure -> Edit Configuration from the Test Manager menu bar.


Configuration File

   Contains all of the information collected by the configuration editor about the test platform.

   The harness derives the configuration values required to execute the test suite from environment entries in a configuration file (.jti).

   Use the Configuration Editor or EditJTI to change configuration values in a .jti file.

   You can also set specific values in the command line.


Configuration Value

   A value specified by the user for the purpose of configuring a test run.

   Configuration values are derived from environment entries in a configuration file (.jti) and used by test suite specific plugin code to execute and run tests.

  Use the Configuration Editor or EditJTI to change the configuration values in the .jti file. You can also set specific configuration values in the command line.

  For legacy test suites the configuration value is read from an environment file (.jte). Current test suites do not use or support the environment file.


Current Configuration

   The configuration containing the test environment and standard values currently loaded in the test manager or specified in the command line for use in running tests and displaying test status.


Current Configuration Filter

  A filter that only displays or generates reports for the folders and tests that have not been filtered out in the configuration.


D

Desktop

   The configuration and layout of the windows used by the JT harness.

   The desktop is saved when you exit from the harness and is automatically restored in your next session.

   The JT harness desktop is displayed using tabs.


E

Environment

   See Test Environment.


Environment Entry

   A name-value pair derived from a configuration file and used by test suite specific plugin code to execute and run tests. These name-value pairs provide information (configuration values) about how to run tests of a test suite on a particular platform.

   For legacy test suites, the name-value pairs are read from an environment file (.jte) and derived from the configuration file (.jti). Current test suites do not use or support the environment file.


Environment Files

  Contain one or more test environments used by legacy test suites. Environment files are identified by the .jte extension in the file name. Current test suites do not use or support the environment file.


Error

   The test is not filtered out and the JT harness could not execute it. There are no test results for tests having errors. Errors usually occur because the test environment is not properly configured.

   In the GUI, the JT harness displays error icons for tests with errors and for folders containing any tests with errors. Folders marked with error icons can also contain tests and folders that are Failed, Not Run, Passed, and Filtered out.


Exclude List

   Exclude list files (*.jtx), supply a list of invalid tests to be filtered out of a test run by the test harness. The exclude list provides a level playing field for all implementors by ensuring that when a test is determined to be invalid, then no implementation is required to pass it. Exclude lists are maintained by the technology specification Maintenance Lead and are made available to all technology licensees.

   In the GUI, use the configuration editor to add or remove exclude lists from a test run. In the command line, you can specify an exclude list in the command.

   To view the contents of an exclude list, choose Configure -> Show Exclude List from the Test Manager menu bar. Exclude lists can only be edited or modified by the test suite Maintenance Lead.


F

Fail

   Test results determined by the JT harness that do not meet passing criteria.

   In the GUI, the JT harness displays Failed icons for tests that the test suite has determined have failing results and for folders containing any tests with fail results. Folders marked with Failed icons can also contain tests and folders that are Not Run, Passed, and Filtered out.


Filtered Out

   Folders and their tests that are excluded from the test run by one or more test run filters.

   In the GUI, Filtered Out folders and tests are identified in the test tree by grey Gray folder icon folder and Gray test icon test icons.


Filters

   A facility in the JT harness that accepts or rejects tests based on a set of criteria. There are two types of filters in the JT harness, view filters and run filters. View filters are set in the Test Manager to display the results for specific folders and tests and to create test reports. Run filters are set in the Configuration Editor or are specified as commands in the command-line to specify which tests are run.


G

Glossary

   Use the Glossary tab in the left pane of the help viewer to open the glossary.

   The glossary pane is divided into two areas. The top area displays the list of terms and the bottom area displays their definition.

   Glossary entries are listed in alphabetical order. You can scroll through the list or search for a specific term.

   To search for a specific term, enter it in the Find field and press Return. If the term is in the glossary, the harness highlights it in the list and displays its definition. Press Return to repeat the search.


H

I

Interview

   For the JT harness to execute a test suite, it requires information about how your computing environment is configured. The Configuration Editor uses an interview to simplify the process of collecting this information.

   Because the quantity and scope of this information depends on the test suite, a test suite might include a specific interview for the Configuration Editor to use.

   The information collected by the interview is written to a configuration file (.jti) and used by the JT harness to derive the environment variables required execute the test suite.


Interview File

   See configuration file.


J

JavaTest Harness Preferences

   A dialog box that you can use to set the window style and tool tip options used by the JT harness. To open the Preferences dialog box, choose File -> Preferences from the Test Manager menu bar.


JTI

   Standard file extension for a configuration file. See configuration file.


K

Keywords

   Special values in a test description that describe how the test is executed.

   Keywords are provided by the test suite for use in the Configuration Editor or command line as a filter to exclude or include tests in a test run.


Known Failures List Files

  

   Known Failures List (KFL) files (*.kfl), list tests that are known to fail.

   The purpose of this option is to enrich the reporting output so you can monitor the status of certain tests across test runs. If a KFL is specified, the HTML report includes a Known Failure Analysis section. This section provides hypertext links to the tests listed in the KFL. Also, if bug IDs are specified in the KFL the IDs are hypertext linked to a bug tracking system (specified as a URL in File > Preferences > Test Manager > Reporting).

  One or more KFLs can be specified as a parameter in the configuration editor. KFLs can also be specified from the command line.


L

Last Test Run View Filter

   A filter that displays the results of those tests and folders included in the last test run either in views of the test tree or in test reports.


Log Level

   A descriptive criteria (Critical, Warning, Monitoring Info, and Debug Info) applied to each message within a log.


M

N

Not Run

   The test is not filtered out but the JT harness has not yet run it.

   The JT harness displays Not Run icons for tests that have not yet been run. Folders containing tests that have not been run are displayed with the Not Run icon only when they do not also contain tests or folders with Error or Failed results.


O

P

Parameter Files

  Legacy files used to configure how the harness runs legacy test suites on your system. Parameter files use the file name extension .jtp.

  Although parameter files are deprecated, the harness provides support for those test suites that use parameter files. Current test suites do not use or support the parameter files.


Pass

   Test results determined by the JT harness to meet passing criteria.

   The JT harness displays Passed icons for tests that the test suite has determined have passing results and for folders containing only tests with passing results.


Port Number

   A number assigned to the JT harness that is used to link specific incoming data to an appropriate service.


Prior Status

   A filter used to restrict the set of tests in a test run based on the last test result information stored in the test result files (.jtr) in the work directory.

   Use the configuration editor or command line to enable the Prior Status filter for a test run.


Progress Monitor

   A dialog box that displays detailed information about the current configuration of a test run. Information displayed in the Progress Monitor is not altered by view filter settings.


Q

R

Report Directory

   The directory in which the harness writes test reports.

   The location of the report directory is set in the GUI or from the command line by the user when generating test reports.


S

Standard Values

   The Quick Set mode of the Configuration Editor displays the standard values of a configuration.


T

Tabbed

   A window style in which the JT harness desktop is a single top-level window that displays all JT windows as tabbed panes.


Test Case

   A subsection inside of a test. The terminology for a 'test case' varies among test harnesses, but in this harness, a test is a larger entity than the test case. A test contains zero or more test cases; a test with no test cases is simply a basic test entity in this harness. The 'test' is the primary entity rendered in the main tree display, summaries, etc. 'Test cases' are currently only recognized in limited areas of the harness.


Test Description

   Machine readable information that describes a test to the JT harness so that it can correctly process and run the related test. The actual form and type of test description depends on the attributes of the test suite. When using the JT harness, the test description is a set of test-suite-specific name-values pairs.

   Each test in a test suite has a corresponding test description that is typically contained in an HTML file.


Test Environment

   A collection of configuration values derived from environment entries in the configuration file that provide information used by test suite specific plugin code about how to execute and run each test on a particular platform.

  When a test in a legacy test suite is run, the harness gives the script a test environment containing environment entries from configuration data collected by the configuration editor. See configuration.

  For legacy test suites, the environment entries were read from an environment file. Use of environment files is deprecated, but the harness continues to provide support for test suites that use environment files. See environment file.

  Current test suites do not use or support environment files.


Test Manager

   The JT harness window used to configure, run, monitor, and manage tests from its panels, menus, and controls.

   The Test Manager window is divided into two panes. It displays the folders and tests of a test suite in the tree pane on the left and provides information about the selected test or folder in the information panes on the right.

   A new Test Manager window is used for each test suite that is opened.


Test Paths

   The locations of the test folders and tests in the test tree specified in the Configuration Editor for running tests.

   Test paths are used to specify the tests in a specific branch of the test tree or to specify a specific test to run. The harness walks the test tree and runs all specified tests (unless otherwise filtered out) that it finds.

   Use the configuration editor to set the test paths listed in the test run configuration.


Test Result Files

   Contains all of the information gathered by the JT harness during a test run.

   The test result files (.jtr) are stored in a cache in the work directory associated with the test suite.

   You can view the test result files in a web browser configured to use the JT harness ResultBrowser servlet.


Test Run Filters

   Include or exclude tests in a test run. Tests are included or excluded from test runs by the following means:

   Test run filters are set using the Configuration Editor or the command-line interface.


Test Script

   A script used by the JT harness, responsible for running the tests and returning the status (pass, fail, error) to the harness. The test script must interpret the test description information returned to it by the test finder. The test script is a plug-in provided by the test suite. In the GUI, the Test Manager Properties dialog box lists the plug-ins that are provided by the test suite.


Test Suite

   A collection of tests, used in conjunction with the JT harness, to verify compliance of the licensee's implementation of the technology specifications.

   A test suite must be associated with a work directory before the harness can run its tests.


Test Tree

   The hierarchical representation of the folders and tests in a test suite.

   The test tree is displayed in the Test Manager window and uses colored status icons to indicate the test status of the folders and tests. Use view filters to specify the folders and tests whose test status are displayed in the test tree.


U

V

View Filters

   Include or exclude the results of tests in views of the test tree.

   View filter settings only change the Test Manager display and do not include or exclude tests from a test run. Use the test run filter settings to include or exclude tests from a test run.


W

Work Directory

   A directory associated with a specific test suite and used by the JT harness to store files containing information about the test suite and its tests.

   Until a test suite is associated with a work directory, the JT harness cannot run tests.


X

Y

Z