ISO/IEC/IEEE 29119-3:2013

INTERNATIONAL ISO/IEC/
STANDARD IEEE
29119-3
First edition
2013-09-01


Software and systems engineering —
Software testing —
Part 3:
Test documentation
Ingénierie du logiciel et des systèmes — Essais du logiciel —
Partie 3: Documentation des essais





Reference number
ISO/IEC/IEEE 29119-3:2013(E)

©
ISO/IEC 2013
©
IEEE 2013

---------------------- Page: 1 ----------------------
ISO/IEC/IEEE 29119-3:2013(E)

COPYRIGHT PROTECTED DOCUMENT


©  ISO/IEC 2013
©  IEEE 2013
All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means,
electronic or mechanical, including photocopying and microfilm, without permission in writing from ISO, IEC or IEEE at the respective
address below.
ISO copyright office IEC Central Office Institute of Electrical and Electronics Engineers, Inc.
Case postale 56 3, rue de Varembé 3 Park Avenue, New York
CH-1211 Geneva 20 CH-1211 Geneva 20 NY 10016-5997, USA
Tel. + 41 22 749 01 11 Switzerland E-mail stds.ipr@ieee.org
Fax + 41 22 749 09 47 E-mail inmail@iec.ch Web www.ieee.org
E-mail copyright@iso.org Web www.iec.ch
Web www.iso.org
Published in Switzerland

© ISO/IEC 2013 – All rights reserved
ii © IEEE 2013 – All rights reserved

---------------------- Page: 2 ----------------------
ISO/IEC/IEEE 29119-3:2013(E)
Contents Page
Foreword . vii
Introduction . viii
1 Scope . 1
2 Conformance . 3
2.1 Intended Usage . 3
2.2 Types of conformance . 3
2.2.1 Full Conformance . 3
2.2.2 Tailored Conformance . 3
3 Normative References. 4
4 Terms and Definitions . 4
5 Organizational Test Process Documentation . 9
5.1 Overview . 9
5.2 Test Policy . 9
5.2.1 Overview . 9
5.2.2 Document specific information . 9
5.2.3 Introduction . 10
5.2.4 Test policy statements . 10
5.3 Organizational Test Strategy . 11
5.4 Overview . 11
5.4.1 Document specific information . 12
5.4.2 Introduction . 13
5.4.3 Project-wide organizational test strategy statements . 13
5.4.4 Test sub-process-specific organizational test strategy statements . 14
6 Test Management Processes Documentation . 15
6.1 Overview . 15
6.2 Test Plan . 15
6.2.1 Overview . 15
6.2.2 Document specific information . 16
6.2.3 Introduction . 16
6.2.4 Context of the testing . 17
6.2.5 Testing communication . 17
6.2.6 Risk register . 18
6.2.7 Test strategy . 18
6.2.8 Testing activities and estimates . 20
6.2.9 Staffing . 20
6.2.10 Schedule . 20
6.3 Test Status Report . 21
6.3.1 Overview . 21
6.3.2 Document specific information . 21
6.3.3 Introduction . 21
6.3.4 Test status . 22
6.4 Test Completion Report . 23
6.4.1 Overview . 23
6.4.2 Document specific information . 23
6.4.3 Introduction . 23
6.4.4 Testing performed . 24
7 Dynamic Test Processes Documentation . 25
7.1 Overview . 25
7.2 Test Design Specification . 26
© ISO/IEC 2013 – All rights reserved
© IEEE 2013 – All rights reserved iii

---------------------- Page: 3 ----------------------
ISO/IEC/IEEE 29119-3:2013(E)
7.2.1 Overview .26
7.2.2 Document specific information .26
7.2.3 Introduction .26
7.2.4 Feature sets .27
7.2.5 Test conditions .28
7.3 Test Case Specification .29
7.3.1 Overview .29
7.3.2 Document specific information .29
7.3.3 Introduction .29
7.3.4 Test coverage items .30
7.3.5 Test cases .31
7.4 Test Procedure Specification .32
7.4.1 Overview .32
7.4.2 Document specific information .33
7.4.3 Introduction .33
7.4.4 Test sets .34
7.4.5 Test procedures .34
7.5 Test Data Requirements .35
7.5.1 Overview .35
7.5.2 Document specific information .36
7.5.3 Introduction .36
7.5.4 Detailed test data requirements .37
7.6 Test Environment Requirements .38
7.6.1 Overview .38
7.6.2 Document specific information .38
7.6.3 Introduction .38
7.6.4 Detailed test environment requirements .39
7.7 Test Data Readiness Report .40
7.7.1 Overview .40
7.7.2 Document specific information .40
7.7.3 Introduction .41
7.7.4 Test data status .41
7.8 Test Environment Readiness Report .41
7.8.1 Overview .41
7.8.2 Document specific information .42
7.8.3 Introduction .42
7.8.4 Test environment readiness .43
7.9 Actual Results .43
7.10 Test Result .43
7.11 Test Execution Log .44
7.11.1 Overview .44
7.11.2 Document specific information .44
7.11.3 Introduction .44
7.11.4 Events .45
7.12 Test Incident Reporting .45
7.12.1 Overview .45
7.12.2 Incident Report .46
7.12.3 Document specific information .46
7.12.4 Introduction .46
7.12.5 Incident details .47
Annex A (informative) Overview and Outlines of Documents .49
A.1 Overview .49
A.2 Document Outlines .50
A.2.1 Overview .50
A.2.2 Organizational Test Policy .51
A.2.3 Organizational Test Strategy .51
A.2.4 Test Plan .52
A.2.5 Test Status Report .53
A.2.6 Test Completion Report .53
© ISO/IEC 2013 – All rights reserved
iv © IEEE 2013 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC/IEEE 29119-3:2013(E)
A.2.7 Test Design Specification . 54
A.2.8 Test Case Specification . 54
A.2.9 Test Procedure Specification . 55
A.2.10 Test Data Requirements . 55
A.2.11 Test Environment Requirements . 56
A.2.12 Test Data Readiness Report . 56
A.2.13 Test Environment Readiness Report . 56
A.2.14 Test Execution Log . 56
A.2.15 Incident Report . 56
Annex B (informative) ISO/IEC/IEEE 29119-2 Normative Requirements Mapped to
ISO/IEC/IEEE 29119-3 Information Items. 58
B.1 Mapping . 58
B.1.1 Organizational Test Policy . 58
B.1.2 Organizational Test Strategy . 58
B.1.3 Test Plan . 59
B.1.4 Test Status Report . 59
B.1.5 Test Completion Report . 60
B.1.6 Test Design Specification . 60
B.1.7 Test Case Specification . 60
B.1.8 Test Procedure Specification . 60
B.1.9 Test Data Requirements . 61
B.1.10 Test Environment Requirements . 61
B.1.11 Test Data Readiness Report . 61
B.1.12 Test Environment Readiness Report . 61
B.1.13 Test Execution Log . 61
B.1.14 Incident Report . 61
Annex C (informative) Overview of Examples. 63
C.1 Overview . 63
Annex D (informative) Test Policy . 65
D.1 Example 1 – Agile Corporation . 65
D.2 Example 2 – Traditional Ltd . 65
Annex E (informative) Organizational Test Strategy . 67
E.1 Example 1 – Agile Corporation . 67
E.2 Example 2 – Traditional Ltd . 68
Annex F (informative) Test Plan . 72
F.1 Example 1 – Agile Corporation . 72
F.2 Example 2 – Traditional Ltd . 73
F.2.1 Project Test Plan . 74
F.2.2 System Test Plan . 80
Annex G (informative) Test Status Report . 85
G.1 Example 1 – Agile Corporation . 85
G.2 Example 2 – Traditional Ltd . 85
Annex H (informative) Test Completion Report . 88
H.1 Example 1 – Agile Corporation . 88
H.2 Example 2 – Traditional Ltd . 89
Annex I (informative) Test Design Specification . 91
I.1 Example 1 – Agile Corporation . 91
H.2 Example 2 – Traditional Ltd . 91
Annex J (informative) Test Case Specification . 99
J.1 Example 1 – Agile Corporation . 99
J.2 Example 2 – Traditional Ltd . 99
Annex K (informative) Test Procedure Specification . 104
K.1.1 Example 1.1 – Agile Corporation . 104
K.1.2 Example 1.2 – Agile Corporation . 104
K.2 Example 2 – Traditional Ltd . 105
© ISO/IEC 2013 – All rights reserved
© IEEE 2013 – All rights reserved v

---------------------- Page: 5 ----------------------
ISO/IEC/IEEE 29119-3:2013(E)
Annex L (informative) Test Data Requirements . 107
L.1 Example 1 – Agile Corporation . 107
L.2 Example 2 – Traditional Ltd . 107
Annex M (informative) Test Environment Requirements . 109
M.1 Example 1 – Agile Corporation . 109
M.2 Example – Traditional Ltd . 109
Annex N (informative) Test Data Readiness Report . 111
N.1 Example 1 – Agile Corporation . 111
N.2 Example 2 – Traditional Ltd . 111
Annex O (informative) Test Environment Readiness Report . 112
O.1 Example 1 – Agile Corporation . 112
O.2 Example 2 – Traditional Ltd . 112
Annex P (informative) Actual Results . 113
P.1 Example 1 – Agile Corporation . 113
P.2 Example 2 – Traditional . 114
Annex Q (informative) Test Result . 115
Q.1 Example 1 – Agile Corporation . 115
Q.2 Example 2 – Traditional Ltd . 116
Annex R (informative) Test Execution Log . 117
R.1 Example 1 – Agile Corporation . 117
R.2 Example 2 – Traditional Ltd . 117
Annex S (informative) Incident Report . 118
S.1 Example 1 – Agile Corporation .
...