Working Group Charter: wsi_testing

/

Working Group Charter:

Web Services Profile Testing Tools and Material

Web Services Profile Testing Tools and Material (wsi_testing)

Revision History
2002.03.05 / Tom Glover / Chris Kurt / Initial version
2002.03.21 / Tom Glover / Modifications resulting from review at board meeting
2002.03.12 / Jacques Durand / Modified to accommodate expansion of the Basic Profile scope to cover Attachments. Also incorporates modification to the dates in the original document to reflect the current status and plan.
2003.07.15 / Jacques Durand / Significant modifications to extend the scope of the working group to support profile 1.1 as well as all future profiles; to become a long standing WG; to deliver a regularly updated plan.
2003.09.11 / Jacques Durand / Abstract further the charter for a long standing group, consolidate comments from Board (July review meeting)
2003.11.12 / Jeff Mischkinsky / Add requirement to document use of extensibility points to scope
2003.11.13 / Tom Glover / Amendments to proposed changes in section 3.
2004.02.18 / Chris Kurt / Chair transition to Narendra Patil

Document Version: 1.5

Document Editor(s):

Tom Glover, IBM ()

Christopher Kurt, Microsoft ()

Jeff Mischkinsky, Oracle ()

Jacques Durand, Fujitsu ()

This Working Group will produce Test Material and Tools for testing conformance to the WS-I Basic Profile 1.0 , as well as of all WS-I future profiles. Support for testing WS-I profiles includes configurable tools that can handle several profiles. It also includes documentation and process for supporting the development of Test Material and tools.

Table of Contents

1. Goals and Mission

2. Working Group Chair, Co-Chair

3. Scope of Effort

4. Duration of Working Group

5. Deliverables

6. Delivery Program

7. Critical Dependencies with Other WS-I Working Groups

1. Goals and Mission

The Test Working Group will develop the supporting documentation and process for WS-I Test Tools development, and will develop or supervise the development of the Test Materials used to test Web service implementations for conformance with Web Services profiles.

2. Working Group Chair

Chair: Narendra Patil, Optimyz Software, appointed February 18, 2004

Previous Chair: Jacques Durand, Fujitsu, appointed July 21, 2003

The Working Group chair will be appointed by the Board on an annual basis, on the anniversary of the charter. Should the chair step down the board will appoint a new chair.

3. Scope of Effort

This Working Group will develop WS-I Test Material and Tools that will facilitate the verification of conformance to WS-I profiles.

The artifacts monitored and analyzed by the tools include message material, Web Service description material and registry material.

For each WS-I profile, the working group will define test assertions as a testable interpretation of the profile definitions, gathered in Test Assertions documents. Use of extensibility points not addressed by Profiles explicitly under test will be identified by the test tools.

The working group will define or supervise the definition of test case material necessary to verify that the tools behave as expected, and that multiple WS-I tool implementations function in a consistent manner.

Tools produced will attempt to implement testing of all assertions within Test Assertion documents in support of the use of these tools in the evaluation of profile compliance.

When the testing target is a Web Services platform or tool that implements a specification that is itself underlying to a profile (such as SOAP, WSDL, HTTP), the working group is not required to handle exhaustive testing of such tools or platforms for conformance to such underlying specifications. It is assumed that this level of conformance is already provided by specific test suites and tools that are out of the scope of this charter. Web Service platform or development tool under test are expected to have passed conformance to the underlying specifications they claim to implement.

This Working Group will not develop WS-I Profiles, Scenarios, Sample Applications, or any material other than that which is either listed in the deliverables section of this Charter, or which is supporting these deliverables.

4. Duration of Working Group

This Working Group replaces the WS-I Basic Profile Testing Tools and Material Working Group. It has no fixed end date. Prior to the annual anniversary of the Working Group’s inception, the Board of Directors will re-confirm this Charter.

5. Deliverables

The Test Tools Development Working Group will produce the following types of deliverable material:

  1. WS-I Testing Methodology White paper.
  2. WS-I Testing Tools Specification for the testing of one or more profiles.
  3. At least one implementation of each Testing Tools specification, packaged in such a way that they can be used by Web Services developers, with supporting user documentation. Whenever a programming language is involved, each tool release will include at least two equivalent implementations; one in C# and one in Java, as required by the by-laws, Article VII, Section 1.
  4. Test Assertions Documents: one or more documents for each profile to be tested, in a format such that they can be processed as input to the Testing Tools.
  5. WS-I Experience Report: Tool Development as a component of WS-I Profile Development.
  6. Test environment and test cases for verifying the conformance of testing tools to their specification, as well as to verify the equivalence of different implementations.

In addition to these deliverables, the working group will also develop and apply processes for:

  1. Collecting feedback and controlling the production and delivery of errata.
  2. Producing and maintaining a list of current errata for each tool and document (specifications and test assertions).
  3. Deciding whether a software deliverable is ready for vote as working group draft or as board approval draft, by using and applying specific release guideline criteria.

6. Delivery Programs

Deliverables will be provided from the Working Group to the Board for board approval on a schedule to be agreed and coordinated by the Technical Coordination Group (TCG). The detailed content and schedule for each deliverable or each group of deliverables – typically covering a one year period - will be described in a document called “Profile Testing Tools Working Group Delivery Program”.

Before being considered an official work target for the working group, a Delivery Program must be agreed upon by the TCG, and submitted to the WS-I board. It must be approved by the board. Any change requested to the Delivery Program (e.g. nature of content, delivery dates) must also be approved by the TCG and by the board.

7. Critical Dependencies with Other WS-I Working Groups

  1. The Testing Tool Working Group will require the timely delivery of the definition of the Web Services Profile under test. Testing tools typically need a minimum of two weeks to adjust to an update of a profile under test..
  2. The Testing Tool Working group will use the Sample Applications produced by the Web Services Basic Sample Application Working Group to verify the quality and usability of Testing Tools and configurations. Conversely, the Sample Application WG needs the Testing Tools to verify conformance of their application material, before release.
  3. The Testing Tools Working Group will require timely review of its Test Assertion Documents by the Profile working groups, for consistency with their profile definitions. Conversely, the testing Tools WG will give feedback to the Profile working groups about their profile definitions.

V1.5 February 18, 2004Page 1 of 4

© Copyright 2002-2004 by the Web Services-Interoperability Organization. All rights reserved.