draft ETSI TS 102 950-1 V0.0.3(2013-08)
Methods for Testing and Specification (MTS);
TTCN-3 Conformance Test Suite;
Part 1: Implementation Conformance Statement (ICS)
Technical Specification
draft ETSI TS 102 950-1 V1.2.1 (2013-08)
2
Reference
RTS/MTS-102950-1ed131 T3Conf
Keywords
conformance, ICS, testing, TTCN
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF). In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status. Information on the current status of this and other ETSI documents is available at http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
Reproduction is only permitted for the purpose of standardization work undertaken within ETSI.
The copyright and the foregoing restrictions extend to reproduction in all media.
© European Telecommunications Standards Institute 2013.
All rights reserved.
DECTTM, PLUGTESTSTM, UMTSTM and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members.
3GPPTM and LTE™ are Trade Marks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
Contents
Intellectual Property Rights 7
Foreword 7
1 Scope 8
2 References 8
2.1 Normative references 8
2.2 Informative references 8
3 Definitions and abbreviations 9
3.1 Definitions 9
3.2 Abbreviations 9
4 Conformance requirement concerning ICS 10
Annex A (normative): TTCN-3 conformance ICS proforma 11
A.1 Instructions for completing the ICS proforma 11
A.1.1 Other information 11
A.1.2 Purposes and structure 11
A.1.3 Conventions 11
A.2 Identification of the implementation 12
A.2.1 Date of the statement 12
A.2.2 Implementation under Test (IUT) identification 12
A.2.3 System under Test (SUT) identification 13
A.2.4 Product supplier 13
A.2.5 Client 13
A.2.6 ICS contact person 13
A.3 ICS proforma tables 13
A.3.1 Global statement of conformance 13
A.3.2 Basic language elements 14
A.3.3 Identifiers and keywords 14
A.3.4 Scope rules 15
A.3.5 Scope of formal parameters 15
A.3.6 Uniqueness of identifiers 16
A.3.7 Ordering of language elements 17
A.3.8 Parameterization 17
A.3.9 Formal parameters of kind value 18
A.3.10 Formal parameters of kind template 18
A.3.11 Formal parameters of kind timer 19
A.3.12 Formal parameters of kind port 19
A.3.13 Actual parameters 19
A.3.14 Cyclic definitions 19
A.3.15 Simple basic types and values 20
A.3.16 Basic string types and values 21
A.3.17 Accessing individual string elements 22
A.3.18 Lists of values 22
A.3.19 Lists of types 23
A.3.20 Ranges 24
A.3.21 String length restrictions 25
A.3.22 Pattern subtyping of character string types 26
A.3.23 Mixing patterns, lists and ranges 26
A.3.24 Using length restriction with other constraints 27
A.3.25 Structured types and values 28
A.3.26 Record type and values 29
A.3.27 Referencing elements of record of and set of types 30
A.3.28 Communication port types 31
A.3.29 Addressing entities inside the SUT 32
A.3.30 Type compatibility of non-structured types 33
A.3.31 Type compatibility of structured types 35
A.3.32 Type compatibility of enumerated types 37
A.3.33 Type compatibility of component types 37
A.3.34 Arithmetic operators 38
A.3.35 List operator 41
A.3.36 Relational operators 42
A.3.37 Logical operators 44
A.3.38 Bitwise operators 44
A.3.39 Shift operators 45
A.3.40 Rotate operators 45
A.3.41 Field references and list elements 45
A.3.42 Definition of a module 46
A.3.43 Module definitions part 46
A.3.44 Module parameters 47
A.3.45 Groups of definitions 47
A.3.46 General format of import 48
A.3.47 Importing single definitions 48
A.3.48 Importing groups 49
A.3.49 Importing definitions of the same kind 50
A.3.50 Importing all definitions of a module 51
A.3.51 Import definitions from other TTCN-3 editions and from non-TTCN-3 modules 52
A.3.52 Importing of import statements from TTCN-3 modules 53
A.3.53 Compatibility of language specifications of imports 53
A.3.54 Definition of friend modules 54
A.3.55 Visibility of definitions 55
A.3.56 Module control part 56
A.3.57 Port types, component types and test configurations 57
A.3.58 Communication ports 58
A.3.59 Declaring constants 58
A.3.60 Value variables 59
A.3.61 Template variables 60
A.3.62 Declaring timers 61
A.3.63 Declaring messages 63
A.3.64 Declaring procedure signatures 65
A.3.65 Declaring templates 65
A.3.66 Declaring message templates 66
A.3.67 Declaring signature templates 67
A.3.68 Global and local templates 68
A.3.69 In-line templates 69
A.3.70 Modified templates 70
A.3.71 Referencing individual string elements 71
A.3.72 Referencing record and set fields 72
A.3.73 Referencing record of and set of elements 73
A.3.74 Template restrictions 75
A.3.75 Match operation 78
A.3.76 Valueof operation 79
A.3.77 Concatenating templates of string and list types 80
A.3.78 Functions 82
A.3.79 Invoking functions 82
A.3.80 Predefined functions 83
A.3.81 External functions 88
A.3.82 Invoking function from specific places 89
A.3.83 Altsteps 90
A.3.84 Invoking altsteps 91
A.3.85 Test cases 91
A.3.86 Assignments 92
A.3.87 The if-else statement 92
A.3.88 The select case statement 93
A.3.89 The for statement 93
A.3.90 The while statement 94
A.3.91 The do-while statement 94
A.3.92 The label statement 95
A.3.93 The goto statement 95
A.3.94 The stop execution statement 96
A.3.95 The return statement 96
A.3.96 The log statement 96
A.3.97 The continue statement 97
A.3.98 Statement and operations for alternative behaviours 97
A.3.99 The alt statement 98
A.3.100 The repeat statement 99
A.3.101 The interleave statement 99
A.3.102 Configuration operations 100
A.3.103 Connection operations 100
A.3.104 Test case operations 100
A.3.105 The create operation 101
A.3.106 The start test component operation 101
A.3.107 The stop test behaviour operation 102
A.3.108 The kill test component operation 102
A.3.109 The alive operation 102
A.3.110 The running operation 103
A.3.111 The done operation 103
A.3.112 The killed operation 103
A.3.113 The send operation 104
A.3.114 The receive operation 105
A.3.115 The trigger operation 105
A.3.116 The call operation 106
A.3.117 The getcall operation 107
A.3.118 The reply operation 107
A.3.119 Timer operations 108
A.3.120 The stop timer operation 109
A.3.121 The running timer operation 110
A.3.122 The timeout operation 111
A.3.123 Test verdict operations 112
A.3.124 The verdict mechanism 114
A.3.125 The getverdict mechanism 115
A.3.126 Module control 116
A.3.127 The execute statement 117
A.3.128 The control part 118
A.3.129 Scope of attributes 120
A.3.130 Optional attributes 121
A.3.131 Matching specific values 122
A.3.132 Value list 123
A.3.133 Complemented value list 123
A.3.134 Any value 124
A.3.135 Any value or none 124
A.3.136 Value range 125
A.3.137 SuperSet 126
A.3.138 SubSet 126
A.3.139 Any element 127
A.3.140 Any number of elements of no element 128
A.3.141 Permutation 129
A.3.142 Length restrictions 130
A.3.143 The ifpresent indicator 130
A.3.144 Matching character pattern 131
A.3.145 Set expression 131
A.3.146 Reference expression 132
A.3.147 Match expression n times 133
A.3.148 Match a referenced character set 134
A.3.149 Type compatibility rules for patterns 135
A.3.150 Preprocessing macros 136
A.4 Additional information for ICS 136
History 137
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found in ETSISR000314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web server (http://ipr.etsi.org).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not referenced in ETSISR000314 (or the updates on the ETSI Web server) which are, or may be, or may become, essential to the present document.
Foreword
This Technical Specification (TS) has been produced by ETSI Technical Committee Methods for Testing and Specification (MTS).
The present document is part 1 of a multi-part deliverable covering a TTCN-3 conformance test suite, as identified below:
Part 1: "Implementation Conformance Statement";
Part 2: "Test Suite Structure and Test Purposes (TSS&TP)";
Part 3: "Abstract Test Suite (ATS) and Implementation eXtra Information for Testing (IXIT)".
1 Scope
The present document provides the Implementation Conformance Statement (ICS) proforma for the conformance test suite for TTCN-3 as defined in ES201873-1[1] in compliance with the relevant guidance given in the proforma for TTCN-3 reference test suite TS 102 995[4]. In the present document only the core language features, specified in ES2018731[1] have been considered but not the tool implementation (see [i.1] and [i.2]), language mapping (see [i.3], [i.4] and [i.5]) and language extension (see e.g. [i.6], [i.7]and [i.8]) aspects.
The supplier of an implementation which is claimed to conform to ES2018731[1] is required to complete a copy of the ICS proforma provided in the annex A of the present document.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or nonspecific. For specific references,only the cited version applies. For non-specific references, the latest version of the referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at http://docbox.etsi.org/Reference.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
[1] ETSI ES 201 873-1: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 1: TTCN-3 Core Language v4.3.1".
[2] ISO/IEC 9646-7 (1994): "Conformance testing methodology and framework -
Part 7: Implementation Conformance Statement".
[3] ISO/IEC 9646-1 (1992): "Information Technology - Open Systems Interconnection - Conformance Testing Methodology and Framework - Part 1: General concepts".
[4] ETSI TS 102 995: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Proforma for TTCN-3 reference test suite".
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the user with regard to a particular subject area.
[i.1] ETSI ES 201 873-5: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 5: TTCN-3 Runtime Interface (TRI)".
[i.2] ETSI ES 201 873-6: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 6: TTCN-3 Control Interface (TCI)".
[i.3] ETSI ES 201 873-7: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 7: Using ASN.1 with TTCN-3".
[i.4] ETSI ES 201 873-8: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 8: The IDL to TTCN-3 Mapping".
[i.5] ETSI ES 201 873-9: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; Part 9: Using XML schema with TTCN-3".
[i.6] ETSI ES 202 781: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language Extensions: Configuration and Deployment Support".
[i.7] ETSI ES 202 784: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language Extensions: Advanced Parameterization".
[i.8] ETSI ES 202 785: "Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Language Extensions: Behaviour Types".
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in ISO/IEC 9646-1 [3], ISO/IEC 9646-7[2], ES 201 873-1[1] (TTCN3) and the following apply:
Abstract Test Suite (ATS): test suite composed of abstract test cases
Implementation Conformance Statement (ICS): statement made by the supplier of an implementation claimed to conform to a given specification, stating which capabilities have been implemented
ICS proforma: document, in the form of a questionnaire, which when completed for an implementation or system becomes an ICS
Implementation eXtra Information for Testing (IXIT): statement made by a supplier or implementor of an IUT which contains or references all of the information related to the IUT and its testing environment, which will enable the test laboratory to run an appropriate test suite against the IUT
IXIT proforma: document, in the form of a questionnaire, which when completed for the IUT becomes the IXIT
Implementation Under Test (IUT): implementation of one or more OSI protocols in an adjacent user/provider relationship, being part of a real open system which is to be studied by testing
3.2 Abbreviations
For the purposes of the present document, the following abbreviations apply:
ATS Abstract Test Suite
BNF Backus Naur Form
ICS Implementation Conformance Statement
IUT Implementation under Test
IXIT Implementation eXtra Information for Testing
SUT System Under Test
TC Test Case
TCI TTCN-3 Control Interface
TP Test Purpose
TRI TTCN-3 Runtime Interface
TS Test System
TSS Test Suite Structure
TSS&TP Test Suite Structure and Test Purposes
TTCN-3 Testing and Test Control Notation edition 3
4 Conformance requirement concerning ICS
If it claims to conform to the present document, the actual ICS proforma to be filled in by a supplier shall be technically equivalent to the text of the ICS proforma given in annexA, and shall preserve the numbering/naming and ordering of the proforma items.
An ICS which conforms to the present document shall be a conforming ICS proforma completed in accordance with the instructions for completion given in clauseA.1.
Annex A (normative):
TTCN-3 conformance ICS proforma