History, status, and recent trends of the testing and test control notation version 3 (TTCN-3)
International Journal on Software Tools for Technology Transfer - Tập 16 Số 3 - Trang 215-225 - 2014
Tóm tắt
This overview article presents the Testing and Test Control Notation (TTCN-3) success story and serves as an introduction to this Special Section that contains five articles selected from the TTCN-3 user conference in 2011. The article sketches the development of TTCN-3 from its very beginning. It summarizes the current status of the language by reviewing its standardization process, available test suites, tools, and services as well as its training program. In addition, the article puts the articles selected for this Special Section into perspective, with regard to the evolution of TTCN-3 and the testing methodology in general. Last but not least, it discusses indicators for possible future developments of TTCN-3.
Tài liệu tham khảo
Adamis, G., Kristoffersen, F., Makedonski, P., Ulrich, A., Wendland, M.: An overview of the ETSI Test Description Language (TDL)—Results from STF 454. Presentation at the first ETSI User Conference on Advanced Automated Testing (UCAAT’13), Paris, 22–24 Oct 2013.
http://ucaat.etsi.org/2013/presentations/Intro%20to%20ETSI%20TDL_Andreas%20Ulrich.pdf
. Accessed 06 Jan 2014
ATML Hompage:
http://grouper.ieee.org/groups/scc20/tii/
. Accessed 06 Jan 2014
citation_title=Model-Driven Testing—Using the UML Testing Profile; citation_publication_date=2007; citation_id=CR3; citation_author=P Baker; citation_author=Z Dai; citation_author=J Grabowski; citation_author=O Haugen; citation_author=I Schieferdecker; citation_author=C Williams; citation_publisher=Springer
CppUnit Hompage:
http://sourceforge.net/projects/cppunit/
. Accessed 06 Jan 2014
ETSI: TTCN-3 Change Request System:
http://t-ort.etsi.org/
. Accessed 06 Jan 2014
ETSI: TTCN-3 Web Site;
http://www.ttcn-3.org/
. Accessed 06 Jan 2014
ETSI ES 201 873–1: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 1: Core Language, v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–10: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 10: TTCN-3 Documentation Comment Specification, v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–2: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 2: Tabular Presentation Format (TFT), v3.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2007)
ETSI ES 201 873–3: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 3: Graphical Presentation Format (GFT), v3.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2007)
ETSI ES 201 873–4: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 4: Operational Semantics, v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–5: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 5: Run-Time Interface (TRI), v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–6: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 6: Control Interface (TCI), v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–7: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 7: Using ASN.1 with TTCN-3, v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–8: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 8: Using IDL with TTCN-3, v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 201 873–9: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3;—Part 9: Using XML with TTCN-3, v4.5.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 202 553: Methods for Testing and Specification (MTS); TPLan: A notation for expressing Test Purposes, v1.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2009)
ETSI ES 202 781: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Extensions: Configuration and Deployment Support, v1.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 202 782: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Extensions: Performance and Real-time Testing, v1.1.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2010)
ETSI ES 202 784: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Extensions: Advanced Parametrization, v1.3.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 202 785: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Extensions: Behaviour Types, v1.3.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI ES 202 786: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Extensions: Support of Interfaces with Continuous Signals, v1.1.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2012)
ETSI ES 202 789: Methods for Testing and Specification (MTS); The Testing and Test Control Notation version 3; TTCN-3 Extensions: Extended TRI, v1.2.1. European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (2013)
ETSI TR 101 666: Information technology — Open Systems Interconnection Conformance Testing Methodology and Framework; The Tree and Tabular Combined Notation (TTCN) (Ed. 2++). European Telecommunications Standards Institute (ETSI), Sophia-Antipolis (1999)
First ETSI User Conference on Advanced Automated Testing (UCAAT’13), Paris, 22–24 October 2013.
http://ucaat.etsi.org/2013/
. Accessed 06 Jan 2014
Fowler, M.: UML Distilled: A Brief Guide to the Standard Object Modeling Language, 3rd edn. Addison-Wesley Professional (2003)
Grabowski, J., Kuliamin, V., Vouffo Feudjio, A., Wu-Hen-Chang, A., Zoric, M.: Towards the Usage of MBT at ETSI. In: MBT 2013: proceedings of the eighth workshop on Model-Based Testing (MBT 2013), Rome, 17th Mar 2013, electronic proceedings in theoretical computer science, vol 111, pp. 30–34.
http://arxiv.org/abs/1303.1007
. Accessed 06 Jan 2014 (2013)
Grossmann, J.: Testing hybrid systems with TTCN-3 embedded. Int. J. Software Tools Technol. Trans. (STTT), ISSN 1433–2779 (2013). doi:
10.1007/s10009-013-0283-0
HtmlUnit Hompage:
http://htmlunit.sourceforge.net/
. Accessed 23 Jan 2014
ISO/IEC: Information processing systems — Open Systems Inter- connection—LOTOS—A formal description technique based on the temporal ordering of observational behaviour. International ISO/IEC standard No. 8807 (1989)
ISO/IEC: Information technology—Open Systems Inter- connection—Basic Reference Model: The Basic Model. International ISO/IEC standard No. 7498–1 (1994)
ISO/IEC: Information technology—Open Systems Inter- connection—Conformance testing methodology and framework. International ISO/IEC multipart standard No. 9646 (1994– 1998)
ISO/IEC: Information technology—Open Systems Inter- connection—Conformance testing methodology and framework—Part 3: The Tree and Tabular Combined Notation (TTCN). International ISO/IEC standard No. 9646–3 (1998)
ITU-T: Information technology—Abstract Syntax Notation One (ASN.1): Specification of basic notation. ITU-T recommendation X.680 (11/2008) (2008)
JUnit Hompage:
http://junit.org/
. Accessed 06 Jan 2014
Kroon, J., Wiles, A.: A Tutorial on TTCN. Tutorial at the 11th International IFIP WG6.1 symposium on Protocol, Specification, Testing and Verification (PSTV) (1991)
Makedonski, P., Grabowski, J., Philipp, F.: Quantifying the evolution of TTCN-3 as a language. Int. J. Software Tools Technol. Trans. (STTT), ISSN 1433–2779 (2013). doi:
10.1007/s10009-013-0282-1
Monkewich, O.: Ten Years of TTCN-3—Past, Present and Future. Presentation at the ETSI TTCN-3 User Conference 2011 (T3UC’11), Bled, Slovenia, 7–9 June 2011.
http://www.ttcn-3.org/TTCN3UC2011/Pres/08_T3UC-Monkewich-TenYearsOfTTCN3-PastAndFuture.ppt
. Accessed 06 Jan 2014
NUnit Hompage:
http://www.nunit.org/
. Accessed 06 Jan 2014
Object Management Group (OMG): UML Testing Profile (UTP), Version 1.2. OMG Document Number: formal/2013-04-03, Standard document
http://www.omg.org/spec/UTP/1.2/
(2013)
Rings, T., Poglitsch, P., Schulz, S., Serazio, L., Vassiliou-Gioles, T.: A generic interoperability testing framework and a systematic development process for automated interoperability testing. Int. J. Software Tools Technol. Trans. (STTT), ISSN 1433–2779 (2013). doi:
10.1007/s10009-013-0281-2
Schneider, M., Grossmann, J., Schieferdecker, I., Pietschker, A.: Online model-based behavioral fuzzing. ICSTW’13: proceedings of the 2013 IEEE sixth International Conference on Software Testing Verification and Validation, Workshops, pp. 469–475. IEEE Computer Society, Washington, DC (2013)
Stepien, B., Peyton, L.: Innovation and evolution in integrated web application testing with TTCN-3. Int. J. Software Tools Technol. Trans. (STTT), ISSN 1433–2779 (2013). doi:
10.1007/s10009-013-0278-x
Wiles, A.: The History and Future of TTCN-3. Presentation at the ETSI TTCN-3 User Conference 2007 (T3UC’07), Stockholm, 29 May–1 June 2007.
http://www.ttcn-3.org/TTCN3UC2007/Presentations/Thu/ETSI%20TTCN-3%20keynote.pdf
. Accessed 06 Jan 2014
Zeiss, B., Kovacs, A., Pakulin, N., Stanca-Kaposta, B.: A conformance test suite for TTCN-3 tools. Int. J. Software Tools Technol. Trans. (STTT), ISSN 1433–2779 (2013) doi:
10.1007/s10009-013-0285-y