NORTH ATLANTIC TREATY RESEARCH AND TECHNOLOGY

ORGANISATION ORGANISATION

AC/323(IST-027)TP/31 www.rta.nato.int

RTO TECHNICAL REPORT TR-IST-027

Validation, Verification and Certification

of Embedded Systems
(Validation, vérification et certification
des systèmes intégrés)

Final Report of the NATO RTO Task Group IST-027/RTG-009.

Published October 2005

Distribution and Availability on Back Cover

NORTH ATLANTIC TREATY RESEARCH AND TECHNOLOGY
ORGANISATION ORGANISATION

AC/323(IST-027)TP/31 www.rta.nato.int

RTO TECHNICAL REPORT TR-IST-027

Validation, Verification and Certification

of Embedded Systems
(Validation, vérification et certification
des systèmes intégrés)

Final Report of the NATO RTO Task Group IST-027/RTG-009.

 The Research and Technology
Organisation (RTO) of NATO
RTO is the single focus in NATO for Defence Research and Technology activities. Its mission is to conduct and promote
co-operative research and information exchange. The objective is to support the development and effective use of
national defence research and technology and to meet the military needs of the Alliance, to maintain a technological
lead, and to provide advice to NATO and national decision makers. The RTO performs its mission with the support of an
extensive network of national experts. It also ensures effective co-ordination with other NATO bodies involved in R&T
activities.
RTO reports both to the Military Committee of NATO and to the Conference of National Armament Directors.
It comprises a Research and Technology Board (RTB) as the highest level of national representation and the Research
and Technology Agency (RTA), a dedicated staff with its headquarters in Neuilly, near Paris, France. In order to
facilitate contacts with the military users and other NATO activities, a small part of the RTA staff is located in NATO
Headquarters in Brussels. The Brussels staff also co-ordinates RTO’s co-operation with nations in Middle and Eastern
Europe, to which RTO attaches particular importance especially as working together in the field of research is one of the
more promising areas of co-operation.
The total spectrum of R&T activities is covered by the following 7 bodies:
• AVT Applied Vehicle Technology Panel
• HFM Human Factors and Medicine Panel
• IST Information Systems Technology Panel
• NMSG NATO Modelling and Simulation Group
• SAS Studies, Analysis and Simulation Panel
• SCI Systems Concepts and Integration Panel
• SET Sensors and Electronics Technology Panel
These bodies are made up of national representatives as well as generally recognised ‘world class’ scientists. They also
provide a communication link to military users and other NATO bodies. RTO’s scientific and technological work is
carried out by Technical Teams, created for specific activities and with a specific duration. Such Technical Teams can
organise workshops, symposia, field trials, lecture series and training courses. An important function of these Technical
Teams is to ensure the continuity of the expert networks.
RTO builds upon earlier co-operation in defence research and technology as set-up under the Advisory Group for
Aerospace Research and Development (AGARD) and the Defence Research Group (DRG). AGARD and the DRG share
common roots in that they were both established at the initiative of Dr Theodore von Kármán, a leading aerospace
scientist, who early on recognised the importance of scientific support for the Allied Armed Forces. RTO is capitalising
on these common roots in order to provide the Alliance and the NATO nations with a strong scientific and technological
basis that will guarantee a solid base for the future.

The content of this publication has been reproduced

directly from material supplied by RTO or the authors.

Published October 2005

Copyright © RTO/NATO 2005

All Rights Reserved

ISBN 92-837-1146-7

Single copies of this publication or of a part of it may be made for individual use only. The approval of the RTA
Information Management Systems Branch is required for more than one copy to be made or an extract included in
another publication. Requests to do so should be sent to the address on the back cover.

ii RTO-TR-IST-027
 Validation, Verification and Certification
of Embedded Systems
(RTO-TR-IST-027)

Executive Summary
This report is the final report resulting from the deliberations of the NATO Research Task Group on the
Validation, Verification and Certification of Embedded Systems (IST-027/RTG-009). The report discusses
the important role of embedded systems in both the civil and military contexts. Given the importance, the
validation, verification and certification (VV&C) of such systems are of increasing concern. The report
discusses the current landscape of VV&C, expected evolution, and also identifies standards of note. The
report concludes with various conclusions and recommendations drawn from the task group’s
deliberations.

In general terms, the Task Group found that their discussions were not specific to embedded systems; the
problems of verification, validation and certification encompass many kinds of systems. The Task Group
observed that trust, in itself, is a sociological-technical matter; it is not attained wholly through technical
means.

The Task Group concluded that certification can be used successfully to increase our confidence in
systems. However, that confidence could be expensive. We have observed that certification is working
with bounded problems and has been particularly successful in the Avionics arena. However, we also note
a couple of cautionary aspects to the use of certification in the military realm. Furthermore, we found that
current technical capabilities are not well developed for the verification, validation and certification of
component reuse, for the rigorous predictability of the behavior of networks and system, nor for
determining the non-interference of multi-level critical processes.

Numerous research trends of VV&C methods were identified including the increasing use of Commercial-
Off-The-Shelf systems, increasing occurrence of systems of systems, an increasing number of
unharmonised standards, ongoing reality of striving for cheaper and faster systems, increasing adoption of
formal modeling and analysis techniques in industrial tools, and increased interest in correlating the threat
space with the VV&C techniques to be used.

Specifically, the Task Group recommends to NATO that it give serious consideration to the use of goal-
based approaches to the certification of systems; that when performing VV&C of “critical components”
the VV&C be performed and/or assessed by an independent third party; consider whether such parties
should be accredited; that objective guidance be provided for required V&V artifacts; that maximum
freedom of IT processes and techniques be provided within the scope of the VV&C framework; and that
the certification effort reflect the criticality of the system. For highly critical systems, it is recommended
that NATO insert formal modeling and reasoning into their development processes, insert advanced static
analysis techniques, and apply extensive testing.

RTO-TR-IST-027 iii
 Validation, vérification et certification
des systèmes intégrés
(RTO-TR-IST-027)

Synthèse
Le présent rapport est le fruit des délibérations du Groupe de travail Recherches de l’OTAN sur la
validation, vérification et certification des systèmes intégrés (IST-027/RTG-009). Le rapport décrit le rôle
important des systèmes intégrés, tant dans la sphère civile que militaire. Compte tenu de leur importance,
la validation, la vérification et la certification (VV&C) de ces systèmes présentent un intérêt croissant. Le
rapport dresse un état des lieux de la VV&C actuelle, évoque l’évolution escomptée,
puis identifie les normes importantes. Le rapport s’achève en présentant diverses conclusions et
recommandations dérivées des délibérations du Groupe de travail.

De façon générale, le Groupe de travail a constaté que les débats ne portaient pas uniquement sur les
systèmes intégrés ; les problèmes de vérification, de validation et de certification affectent de nombreux
types de systèmes. Le Groupe de travail a découvert que, en soi, la confiance est une notion sociologico-
technique ; on ne l’acquiert pas entièrement par des moyens techniques.

Le Groupe de travail a conclu que la certification peut être utilisée avec succès pour optimiser notre
confiance envers les systèmes. Cependant, cette confiance peut s’avérer onéreuse. Nous avons remarqué
que la certification fonctionnait assez bien et qu’elle était particulièrement fructueuse dans le domaine de
l’avionique. Nous avons cependant relevé une certaine circonspection quant au recours à la certification
dans le domaine militaire. Par ailleurs, nous avons constaté que les moyens techniques actuels n’étaient
pas suffisamment matures pour vérifier, valider et certifier la réutilisation des composants, pour prévoir de
façon rigoureuse le comportement des réseaux et systèmes et pour déterminer la non-interférence des
processus critiques à niveaux multiples.

Plusieurs voies de recherche concernant les méthodes VV&C ont été identifiées ; citons notamment
l’utilisation accrue des systèmes disponibles sur étagère, la démultiplication des systèmes de systèmes,
un nombre croissant de normes non harmonisées, la tendance actuelle aux systèmes plus rapides et
meilleur marché, le recours accru aux techniques de modélisation et d’analyse formelles dans les outils
industriels et l’intérêt croissant pour corréler l’espace de la menace avec les techniques de VV&C devant
être utilisées.

Le Groupe de travail recommande plus particulièrement à l’OTAN d’étudier de façon approfondie

l’adoption d’approches basées sur les objectifs concernant la certification des systèmes. Il recommande
également de faire effectuer et/ou de faire évaluer la VV&C par un tiers indépendant lorsqu’on procède à
la VV&C de « composants critiques » et de déterminer si cette partie doit être accréditée ou non ;
de fournir une orientation objective pour les artéfacts de V&V requis ; d’accorder une liberté maximum
aux processus et techniques de TI dans le cadre de la VV&C ; et que l’effort de certification reflète la
criticité du système. S’agissant des systèmes hautement critiques, il est recommandé que l’OTAN
accompagne ses processus de développement d’une modélisation et d’un raisonnement formels, qu’elle
adopte des techniques d’analyse statique évoluées et qu’elle procède à des essais poussés.

iv RTO-TR-IST-027
 Table of Contents

Page

Executive Summary iii

Synthèse iv

Membership of Task Group 027/RTG-009 viii

Chapter 1 – INTRODUCTION 1-1

1.1 Background 1-1
1.2 Meetings 1-2
1.3 Report 1-2
1.4 Acknowledgements 1-3

Chapter 2 – EMBEDDED SYSTEMS 2-1

by Dan Craigen
2.1 What are Embedded Systems? 2-2
2.2 Trends 2-3
2.3 Trends: Conferences/Workshops 2-5

Chapter 3 – VERIFICATION AND VALIDATION: CURRENT AND 3-1

BEST PRACTICE
by Natalia Juristo
3.1 Definitions of Validation and Verification 3-1
3.2 Definitions of Error, Fault and Failure 3-1
3.3 Evaluation vs. Prevention 3-2
3.4 Quality Attributes 3-2
3.5 Fault Detection Techniques (Functionality Validation) 3-4
3.5.1 Testing Techniques 3-4
3.5.1.1 Black Box Testing (Functional Testing) 3-6
3.5.1.2 White (Glass) Box Testing (Structure-Based Testing) 3-7
3.5.2 Other Techniques 3-7
3.6 Static Techniques 3-8
3.6.1 Inspections 3-8
3.6.2 Walkthroughs 3-8
3.6.3 Reviews 3-9
3.6.4 Audits 3-9
3.6.5 Other Techniques 3-9
3.7 Failure Detection Techniques (Reliability Validation) 3-9

RTO-TR-IST-027 v
3.8 Usability Validation 3-10
3.8.1 Expert Reviews 3-10
3.8.2 Usability Tests 3-11
3.8.3 Follow-up Studies of Installed Systems 3-12
3.8.4 Other Techniques 3-13
3.9 Efficiency Validation 3-13
3.9.1 Avalanche/Stress Testing 3-13
3.9.2 Performance Requirements 3-13
3.9.3 Other Techniques 3-13
3.10 Maintainability Validation 3-14
3.10.1 Regression Testing 3-14
3.10.2 Other Techniques 3-14
3.11 Portability Validation 3-14

Chapter 4 – VERIFICATION AND VALIDATION: EVOLUTION AND 4-1

ENHANCEMENT
by Jacques Cazin
4.1 Software Partitioning 4-2
4.2 Model Checking 4-2
4.3 Static Analysis 4-2
4.4 Test Case Generation from High Level Specifications 4-3
4.5 Man Machine Interface 4-3
4.6 Safety Analysis 4-3

Chapter 5 – STANDARDS 5-1

by Ernst Kesseler
5.1 DO-178B/ED12B 5-2
5.2 DO-278/ED109 5-3
5.3 IEC 61508 5-3
5.4 Eurocontrol EATMP Software Task Force 5-4
5.5 Electronic Flight Bag AC 120-76 5-5
5.6 DRD 920 5-5
5.7 IEC 60880-2 5-6
5.8 FDA 1252 5-6
5.9 Software Safety Assurance in ATS UK SW01 5-7
5.10 Security 5-8

Chapter 6 – CERTIFICATION 6-1

by Robin Bloomfield and Jeff Voas
6.1 Different Types of Certification (Who? What? Why?) 6-1
6.2 Assessment of Certification and Relevance to NATO Requirements 6-2
6.3 Certification Conclusions 6-4

vi RTO-TR-IST-027
Chapter 7 – CONCLUSIONS AND RECOMMENDATIONS 7-1
by Dan Craigen
7.1 Assessment of Current Technical Capabilities and Relevance of these Techniques and 7-1
Methods to Embedded Military Systems
7.2 Assessment of Relative Strengths and Limitations of these Methods 7-2
7.3 Assessment of Current Research Trends of these Methods 7-2
7.4 Specific Recommendations for Military Application of these Techniques 7-3
7.5 Recommendation for Future NATO IST Efforts, if relevant, such as Symposium or Workshop 7-4

Annex A – TERMS OF REFERENCE A-1

Annex B – TAP B-1

Annex C – PROGRAMME OF WORK C-1

Annex D – COMBATING TERRORISM RECOMMENDATIONS D-1

Annex E – SOFTWARE CERTIFICATION AGENCIES AND SERVICES E-1

OFFERED

Annex F – MAPPING TECHNIQUES TO PROPERTIES AND ATTRIBUTES F-1

RTO-TR-IST-027 vii
 Membership of Task Group 027/RTG-009
The following table identifies the members of the research task group. The following members were
particularly active and have played a material role in the development of this report: Robin Bloomfield,
Jacques Cazin, Dan Craigen, Natalia Juristo, Ernst Kesseler and Jeff Voas.

Task Group Chairman

Mr. Dan CRAIGEN ∗
ORA Canada
P.O. Box 46005, 2339 Ogilvie Road
Ottawa, Ontario K1J 9M7
CANADA
E-mail: [email protected]
Tel: +1 (613) 241-8692
Fax: +1 (613) 842-5288

Task Group Members

CZECH REPUBLIC POLAND

Dip. Eng. Radek ORSAK Maj. Andrzej STASIAK
Air Force Research Institute Prague Faculty of Cybernetics
VTUL a PVO Praha, tr. kpt. Jarose, 27 Military University of Technology
602 00 Brno Kaliskiego 2
E-mail: [email protected] 00-908 Warsaw
Tel: +420 (5) 41.18.24.50 E-mail: [email protected]
Fax: +420 (5) 45.24.61.80 Tel: +48 (22) 685.70.25
Fax: +48 (22) 685.71.44
FRANCE
Mr. Jacques CAZIN PORTUGAL
ONERA/DTIM Prof. Fernando BRITO E ABREU
2, Av Edouard Belin INESC (Instituto de Engenharia e Sistemas de
B.P. 4025 Toulouse, Cedex 3 Computadores)
E-mail: [email protected] Rua Alves Redol, 9
Tel: +33 (0) 5.62.25.25.90 31055 1000 Lisbon
Fax: +33 (0) 5.62.25.25.93 E-mail: [email protected]
Tel: +351 (21) 310.02.63
GEORGIA Fax: +351 (21) 314.58.43
Vice-Col. Shota GELENIDZE
Deputy Head SLOVAK REPUBLIC
Central Board of Strategy Planning Lt. Col. Dr. Josef TKAC
and Scientific-Technical Researches Military Academy
Moscow avenue, 7/1 Kt-302, PO Box 45
380020 Tbilissi 03101 Liptovsky Mikulas
E-mail: [email protected] E-mail: [email protected]
Tel: +995 (32) 92.37.79 Tel: +421 (849) 552.22.34
Fax: +995 (32) 95.69.49 Fax: +421 (849) 552.22.37

∗ Principal Member

viii RTO-TR-IST-027
SPAIN UNITED KINGDOM
Dr. Natalia JURISTO Mr. Robin BLOOMFIELD
Facultad de Informática Adelard and CSR
Universidad Politecnica de Madrid Drysdale Building, Northampton Square
Campus de Montegancedo London EC1V 0HB
28660 Boadilla del Monte E-mail: [email protected]
Madrid Tel: +44 (20) 7490.9453
E-mail: [email protected] Fax: +44 (20) 7490.9451
Tel: (+34) 91336 6922
Fax: (+34) 91336 6917 UNITED STATES
Dr. Jeffrey VOAS
THE NETHERLANDS Cigital
Dr. Ernst KESSELER 21351 Ridgetop Circle, Suite 400
National Aerospace Laboratory (NLR) Dulles VA 20166
P.O. Box 90502 E-mail: [email protected]
1006 BM Amsterdam Tel: +1 (703) 404-9293
E-mail: [email protected] Fax: +1 (703) 404-9295
Tel: +31 (20) 511.34.62
Fax: +31 (20) 511.32.10

Task Group Liaison Member

CANADA
Dr. Malcolm R. VANT ∗
Director General
Defence R&D Canada – Ottawa
3701 Carling Avenue
Ottawa, Ontario K1A 0Z4
E-mail: [email protected]
Tel: +1 (613) 998-2569
Fax: +1 (613) 998-4560

∗ Principal Member

RTO-TR-IST-027 ix
x RTO-TR-IST-027
 REPORT DOCUMENTATION PAGE
1. Recipient’s Reference 2. Originator’s References 3. Further Reference 4. Security Classification
of Document
RTO-TR-IST-027 ISBN 92-837-1146-7 UNCLASSIFIED/
AC/323(IST-027)TP/31 UNLIMITED
5. Originator
Research and Technology Organisation
North Atlantic Treaty Organisation
BP 25, F-92201 Neuilly-sur-Seine Cedex, France
6. Title
Validation, Verification and Certification of Embedded Systems
7. Presented at/Sponsored by

Final Report of the NATO RTO Task Group IST-027/RTG-009.

8. Author(s)/Editor(s) 9. Date

Multiple October 2005

10. Author’s/Editor’s Address 11. Pages

Multiple 90
12. Distribution Statement
There are no restrictions on the distribution of this document.
Information about the availability of this and other RTO
unclassified publications is given on the back cover.
13. Keywords/Descriptors
Airborne computers Critical systems Software development
Avionics Embedded systems Software engineering
Best practices Information systems Software management
Commercial equipment Integrity SoSI (System of Systems Integration)
Compatibility Integrated systems Standards
Computer program verification Interoperability System of systems
Computer programs Modelling Systems engineering
Computer systems programs Performance standards VV&C (Validation, Verification
Control systems Quality assurance and Certification)
COTS (Commercial Off-The
Shelf)
14. Abstract

This report is the final report resulting from the deliberations of the NATO Research Task Group
on the Validation, Verification and Certification of Embedded Systems (IST-027/RTG-009). The
report discusses the important role of embedded systems in both the civil and military contexts.
Given the importance, the validation, verification and certification (VV&C) of such systems are
of increasing concern. The report discusses the current landscape of VV&C, expected evolution,
and also identifies standards of note. The report concludes with various conclusions and
recommendations drawn from the task group’s deliberations.

RTO-TR-IST-027
RTO-TR-IST-027
 NORTH ATLANTIC TREATY ORGANISATION RESEARCH AND TECHNOLOGY ORGANISATION

BP 25 DIFFUSION DES PUBLICATIONS

F-92201 NEUILLY-SUR-SEINE CEDEX • FRANCE
Télécopie 0(1)55.61.22.99 • E-mail [email protected] RTO NON CLASSIFIEES
Les publications de l’AGARD et de la RTO peuvent parfois être obtenues auprès des centres nationaux de distribution indiqués ci-dessous. Si vous
souhaitez recevoir toutes les publications de la RTO, ou simplement celles qui concernent certains Panels, vous pouvez demander d’être inclus soit à
titre personnel, soit au nom de votre organisation, sur la liste d’envoi.
Les publications de la RTO et de l’AGARD sont également en vente auprès des agences de vente indiquées ci-dessous.
Les demandes de documents RTO ou AGARD doivent comporter la dénomination « RTO » ou « AGARD » selon le cas, suivi du numéro de série.
Des informations analogues, telles que le titre est la date de publication sont souhaitables.
Si vous souhaitez recevoir une notification électronique de la disponibilité des rapports de la RTO au fur et à mesure de leur publication, vous pouvez
consulter notre site Web (www.rta.nato.int) et vous abonner à ce service.

CENTRES DE DIFFUSION NATIONAUX

ALLEMAGNE FRANCE PAYS-BAS
Streitkräfteamt / Abteilung III O.N.E.R.A. (ISP) Royal Netherlands Military
Fachinformationszentrum der 29, Avenue de la Division Leclerc Academy Library
Bundeswehr (FIZBw) BP 72, 92322 Châtillon Cedex P.O. Box 90.002
Friedrich-Ebert-Allee 34, D-53113 Bonn 4800 PA Breda
GRECE (Correspondant)
BELGIQUE Defence Industry & Research POLOGNE
Etat-Major de la Défense General Directorate, Research Directorate Armament Policy Department
Département d’Etat-Major Stratégie Fakinos Base Camp, S.T.G. 1020 218 Niepodleglosci Av.
ACOS-STRAT – Coord. RTO Holargos, Athens 00-911 Warsaw
Quartier Reine Elisabeth
Rue d’Evère, B-1140 Bruxelles HONGRIE PORTUGAL
Department for Scientific Analysis Estado Maior da Força Aérea
CANADA Institute of Military Technology SDFA – Centro de Documentação
DSIGRD2 Ministry of Defence Alfragide
Bibliothécaire des ressources du savoir H-1525 Budapest P O Box 26 P-2720 Amadora
R et D pour la défense Canada
Ministère de la Défense nationale ISLANDE REPUBLIQUE TCHEQUE
305, rue Rideau, 9e étage Director of Aviation LOM PRAHA s. p.
Ottawa, Ontario K1A 0K2 c/o Flugrad o. z. VTÚLaPVO
Reykjavik Mladoboleslavská 944
DANEMARK PO Box 18
Danish Defence Research Establishment ITALIE 197 21 Praha 9
Ryvangs Allé 1, P.O. Box 2715 Centro di Documentazione
DK-2100 Copenhagen Ø Tecnico-Scientifica della Difesa ROYAUME-UNI
Via XX Settembre 123 Dstl Knowledge Services
ESPAGNE 00187 Roma Information Centre, Building 247
SDG TECEN / DGAM Dstl Porton Down
C/ Arturo Soria 289 LUXEMBOURG Salisbury
Madrid 28033 Voir Belgique Wiltshire SP4 0JQ

ETATS-UNIS NORVEGE TURQUIE

NASA Center for AeroSpace Norwegian Defence Research Establishment Milli Savunma Bakanlığı (MSB)
Information (CASI) Attn: Biblioteket ARGE ve Teknoloji Dairesi Başkanlığı
Parkway Center, 7121 Standard Drive P.O. Box 25, NO-2007 Kjeller 06650 Bakanliklar – Ankara
Hanover, MD 21076-1320

AGENCES DE VENTE
NASA Center for AeroSpace The British Library Document Canada Institute for Scientific and
Information (CASI) Supply Centre Technical Information (CISTI)
Parkway Center, 7121 Standard Drive Boston Spa, Wetherby National Research Council
Hanover, MD 21076-1320 West Yorkshire LS23 7BQ Acquisitions, Montreal Road, Building M-55
ETATS-UNIS ROYAUME-UNI Ottawa K1A 0S2, CANADA

Les demandes de documents RTO ou AGARD doivent comporter la dénomination « RTO » ou « AGARD » selon le cas, suivie du numéro de série
(par exemple AGARD-AG-315). Des informations analogues, telles que le titre et la date de publication sont souhaitables. Des références
bibliographiques complètes ainsi que des résumés des publications RTO et AGARD figurent dans les journaux suivants :
Scientific and Technical Aerospace Reports (STAR) Government Reports Announcements & Index (GRA&I)
STAR peut être consulté en ligne au localisateur de publié par le National Technical Information Service
ressources uniformes (URL) suivant: Springfield
http://www.sti.nasa.gov/Pubs/star/Star.html Virginia 2216
STAR est édité par CASI dans le cadre du programme ETATS-UNIS
NASA d’information scientifique et technique (STI) (accessible également en mode interactif dans la base de
STI Program Office, MS 157A données bibliographiques en ligne du NTIS, et sur CD-ROM)
NASA Langley Research Center
Hampton, Virginia 23681-0001
ETATS-UNIS
 NORTH ATLANTIC TREATY ORGANISATION RESEARCH AND TECHNOLOGY ORGANISATION

BP 25 DISTRIBUTION OF UNCLASSIFIED
F-92201 NEUILLY-SUR-SEINE CEDEX • FRANCE
RTO PUBLICATIONS
Télécopie 0(1)55.61.22.99 • E-mail [email protected]
AGARD & RTO publications are sometimes available from the National Distribution Centres listed below. If you wish to receive all RTO reports,
or just those relating to one or more specific RTO Panels, they may be willing to include you (or your Organisation) in their distribution.
RTO and AGARD reports may also be purchased from the Sales Agencies listed below.
Requests for RTO or AGARD documents should include the word ‘RTO’ or ‘AGARD’, as appropriate, followed by the serial number. Collateral
information such as title and publication date is desirable.
If you wish to receive electronic notification of RTO reports as they are published, please visit our website (www.rta.nato.int) from where you can
register for this service.
NATIONAL DISTRIBUTION CENTRES
BELGIUM GERMANY NORWAY
Etat-Major de la Défense Streitkräfteamt / Abteilung III Norwegian Defence Research
Département d’Etat-Major Stratégie Fachinformationszentrum der Establishment
ACOS-STRAT – Coord. RTO Bundeswehr (FIZBw) Attn: Biblioteket
Quartier Reine Elisabeth Friedrich-Ebert-Allee 34 P.O. Box 25, NO-2007 Kjeller
Rue d’Evère D-53113 Bonn
B-1140 Bruxelles POLAND
GREECE (Point of Contact) Armament Policy Department
CANADA Defence Industry & Research 218 Niepodleglosci Av.
DRDKIM2 General Directorate, Research Directorate 00-911 Warsaw
Knowledge Resources Librarian Fakinos Base Camp, S.T.G. 1020
Defence R&D Canada Holargos, Athens PORTUGAL
Department of National Defence Estado Maior da Força Aérea
305 Rideau Street HUNGARY SDFA – Centro de Documentação
9th Floor Department for Scientific Analysis Alfragide, P-2720 Amadora
Ottawa, Ontario K1A 0K2 Institute of Military Technology
Ministry of Defence SPAIN
CZECH REPUBLIC H-1525 Budapest P O Box 26 SDG TECEN / DGAM
LOM PRAHA s. p. C/ Arturo Soria 289
o. z. VTÚLaPVO ICELAND Madrid 28033
Mladoboleslavská 944 Director of Aviation
PO Box 18 c/o Flugrad, Reykjavik TURKEY
197 21 Praha 9 Milli Savunma Bakanlığı (MSB)
ITALY ARGE ve Teknoloji Dairesi Başkanlığı
DENMARK Centro di Documentazione 06650 Bakanliklar – Ankara
Danish Defence Research Tecnico-Scientifica della Difesa
Establishment Via XX Settembre 123 UNITED KINGDOM
Ryvangs Allé 1 00187 Roma Dstl Knowledge Services
P.O. Box 2715 Information Centre, Building 247
DK-2100 Copenhagen Ø LUXEMBOURG Dstl Porton Down
See Belgium Salisbury, Wiltshire SP4 0JQ
FRANCE
O.N.E.R.A. (ISP) NETHERLANDS UNITED STATES
29, Avenue de la Division Leclerc Royal Netherlands Military NASA Center for AeroSpace
BP 72 Academy Library Information (CASI)
92322 Châtillon Cedex P.O. Box 90.002 Parkway Center, 7121 Standard Drive
4800 PA Breda Hanover, MD 21076-1320

SALES AGENCIES
NASA Center for AeroSpace The British Library Document Canada Institute for Scientific and
Information (CASI) Supply Centre Technical Information (CISTI)
Parkway Center Boston Spa, Wetherby National Research Council
7121 Standard Drive West Yorkshire LS23 7BQ Acquisitions
Hanover, MD 21076-1320 UNITED KINGDOM Montreal Road, Building M-55
UNITED STATES Ottawa K1A 0S2, CANADA
Requests for RTO or AGARD documents should include the word ‘RTO’ or ‘AGARD’, as appropriate, followed by the serial number (for example
AGARD-AG-315). Collateral information such as title and publication date is desirable. Full bibliographical references and abstracts of RTO and
AGARD publications are given in the following journals:
Scientific and Technical Aerospace Reports (STAR) Government Reports Announcements & Index (GRA&I)
STAR is available on-line at the following uniform published by the National Technical Information Service
resource locator: Springfield
http://www.sti.nasa.gov/Pubs/star/Star.html Virginia 2216
STAR is published by CASI for the NASA Scientific UNITED STATES
and Technical Information (STI) Program (also available online in the NTIS Bibliographic
STI Program Office, MS 157A Database or on CD-ROM)
NASA Langley Research Center
Hampton, Virginia 23681-0001
UNITED STATES
ISBN 92-837-1146-7