BARS Auditor Guide - V3
BARS Auditor Guide - V3
Auditor Guide
This guide is Copyright ©2017 by Flight Safety Foundation Limited (ABN 41 135 771 345) (“FSF”),
Any copying or reproduction of this Guide is expressly prohibited without the permission of FSF.
Disclaimer
This guide is made available solely to assist persons to participate in the Program around the Basic Aviation
Risk Standard (“Standard”) as issued by FSF. The guide is for the purpose of assistance to BARS Auditors in
the conduct of a BARS Audit.
FSF and FSFI expressly disclaim any and all liability and responsibility to any person in respect of the
consequences of anything done or not done in reliance, whether wholly or in part on the guide. In no
circumstances will either FSF or FSFI be liable for any loss or damage, including incidental or consequential
damages, resulting from use of the Guide.
Table of Contents
Table of Contents ...................................................................................................................................... 2
1. Introduction....................................................................................................................................... 4
1.1 Document Control .......................................................................................................................................................................... 4
1.2 Version Status ................................................................................................................................................................................ 5
1.3 Log of Changes ............................................................................................................................................................................... 6
1.4 Acronyms ....................................................................................................................................................................................... 7
1.5 Definitions ...................................................................................................................................................................................... 8
1.6 BARSoft ........................................................................................................................................................................................ 14
5. SFIAR ............................................................................................................................................... 30
6. Audit Report Contents ..................................................................................................................... 35
6.1 Executive Summary ...................................................................................................................................................................... 35
9. Appendix 1 ...................................................................................................................................... 45
9.1 BARS Audit Preparation Process Flow Chart ................................................................................................................................ 45
9.2 Sample Meeting Attendance Register .......................................................................................................................................... 46
9.3 P2 Variation Handling Flow Chart ................................................................................................................................................ 47
9.4 BARS Audit Codes ......................................................................................................................................................................... 48
The BARS Auditor Guide will be issued as a single whole document and any revisions or
amendments will result in a re-issuance of the whole document. Changes in the content of the
manual from one version to the next will be indicated by change bars at the side of the page
and a summary of changes in section 1. Obsolete versions of the BARS Auditor Guide should be
destroyed upon receipt of the new version. If, for any reason, the old version is retained it
should be clearly marked as obsolete.
The BARS Auditor Guide will be reviewed annually to ensure it is up to date and relevant for
the purpose designed. The BARS Program Operations Manager is responsible for the content
of the BARS Auditor Guide and changes are to be approved by the Flight Safety Foundation’s
BARS Managing Director. The document is only produced in English and hand written
amendments (manuscript amendments) are not endorsed to ensure the document remains
legible at all times.
Changes to policy or procedures on an interim basis will be advised by the BPO using the BARS
Notification (BN) document.
Suggestions for improvements are welcome and should be addressed to the BARS Audit
Manager.
Distribution of the BARS Auditor Guide is in electronic form only and any hardcopy versions
shall be treated as uncontrolled. The Guide will be distributed via the BARSoft program –
Document Management tab and sent via email to each AC and ATO. Distribution within each
of these entities is the responsibility of the BARS contact person listed on BARSoft for that
company.
Aircraft Operator: AO
Geophysical Survey: Fixed or rotary-wing operators who conduct geophysical survey operations.
The BARSoft login page can be found at: https://barsoft.flightsafety.org or at the BARS web
pages at the FSF website: http://flightsafety.org/bars/login
The BARSoft application is for the use of authorized users in carrying out the various functions
within the BARS Program. These users have different roles and permissions as granted by the
BARS Program Office. For information on the use and features of BARSoft, consult the BARSoft
User Guide which is available on the BARSoft Documents tab.
The information supplied in this Guide covers the preparation, onsite and follow-up activities
associated with an Audit.
It is critical that all Auditors are familiar with the contents of Program documentation including
the suite of Basic Aviation Risk Standards, current BARS Notifications, the BARSoft User Guide,
the BARS Implementation Guidelines, the BARS Question Master List and the BARS Procedures
Manual to gain further knowledge and a comprehensive understanding of the Audit criteria
and procedures.
2.2 Audience
When conducting the Audit and during the follow-up stages, the auditor must keep in mind
the purpose of the Audit is to convey an accurate assessment and description of the Operator
to a wider audience. Clear descriptions of the Conforming, Non-Conforming and Not
Applicable assessments must be provided. The final readership of a BARS Audit report are the
BARS Member Organizations who are making risk-based decisions on the information
contained in the report. Vague, inaccurate or incomplete text within the report will devalue
the audit process and cause unnecessary follow-up effort. It should also be noted that some of
the readers are not necessarily aviation professionals. For this reason industry acronyms not
detailed in the BARS Procedures Manual should be spelled out at the first instance of use
within a report. Avoid using local regulatory acronyms or references that would not be
relevant to a readership outside that particular country or region.
The official language of the BARS Program is US English. Where Operators have used local
language to complete information in the checklist, auditors are to ensure that the use of the
term is consistent throughout the report. This is only for the case of abbreviations and or
acronyms (e.g. anexo for the word annex) however, full sentences in non-English are not
acceptable.
2.3 Scope
The scope of the Audit can be considered as the extent and boundaries of the review and is to
be decided by the Aircraft Operator (AO) well before the onsite phase of the Audit. This should
be communicated to the AC well in advance so the AC can take this into account when
developing the Audit plan.
In all cases the Lead Auditor is to describe the scope of the Audit in both the Executive
Summary of the Audit in BARSoft and in the SFIAR document. Ensure that the information in
the description of the scope correlates with the fleet information and operational base
locations uploaded by the Operator in BARSoft.
Note: the disciplines of the sections within the checklist (ORG, FLT, MNT and GRH) are not
the scope of the Audit;
The BARS Program does not have exclusions as Operators can nominate the fleets and aircraft
they wish to have audited. For this reason Lead Auditors must be clear regarding what is, and
what is not within the scope of the Audit.
2.4 Sampling
The audit process by definition is a sampling process whereby the auditor will review a portion
of evidence to assist in the determination of Conformity. The sample size will vary from one
audit to the next however, the auditor(s) must satisfy themselves that the sample size used is
indicative for the general population of the reviewed record. The evidence/records sampled
must be within the scope of the audit. Aircraft not used in BMO operations, or staff who do
not have responsibilities for duties or roles within operations conducted on behalf of BMOs,
would not be valid evidence to support an assessment under a BARS Audit.
Sampling of aircraft and fleets should be determined by the Lead Auditor during the
preparation for the Audit. Only aircraft that are used for BMO operations are to be reviewed
as part of the audit. Questions within the Flight operations (FLT) and Maintenance and
engineering (MNT) sections that relate specifically to aircraft equipment fit should have a
representative sample quoted in the references column. Auditors should select a cross section
of the Operator’s fleet that give a good indication that the Operator’s policies and procedures
are applied consistently throughout the organization. For example: review a turbine engine
fleet and one reciprocating engine fleet, or one helicopter fleet and one fixed wing fleet. The
During the Audit preparation the Lead Auditor should note the aircraft inspected and/or the
fleets reviewed on previous Audits and where possible avoid inspecting/reviewing the same
aircraft on subsequent Audits.
At least 35 days prior the proposed Audit date, the AC delegate or Lead Auditor will establish
initial contact with the AO representative, to confirm that the proposed audit dates are
mutually acceptable.
The AC Administrator should assign the selected Auditors to the Audit in BARSoft. This will
allow the Auditors to view the Audit and AO Profile information for preparation.
Approximately 14 days before the Audit the Lead Auditor will establish contact with the AO
representative again to re-confirm the following:
That all logistical arrangements are in place;
Confirm the AO has the correct checklist from BARSoft and has completed all
references which are required;
The Audit Agreement has been finalized;
The details of the checklist review; and
The final structure of the Audit team.
The completion of the checklist by the AO may flag issues with Operational Categories. These
need to be dealt with immediately. If the AO has selected an Operational Category in error, it
cannot be removed after the audit has begun. All questions in the checklist must be assessed,
and the errant category cannot be declared not applicable. Any change to scope must be made
in advance of the audit.
Some questions in the checklist require a large amount of analysis and it would be beneficial to
conduct a review of the AO published policy and procedures prior to the onsite phase. (e.g.
the AO fuel policy and examples of fuel loads).
The AC/Auditor should review the previous BARS Audit Report, (if conducted), and any listed
Non-Conformities for consideration prior to the Audit.
The AC Audit Planning process must address the scope of the Audit and what aircraft and
operations are to be reviewed as part of the Audit. It is imperative that this is discussed with
the AO prior to the onsite phase and compared to the Operational Categories selected by the
AO in the creation of the Audit checklist.
The AC/Auditor should review the AO effort in referencing the specific BARS Audit checklist
generated from BARSoft for that Audit. This should be completed at least 14 days before the
scheduled onsite phase of the Audit.
AOs with an existing Audit planned and scheduled within the transitional period can remain on
the previous version of the QML/Audit Checklist with no penalty. To move to the new version
of the QML/Audit Checklist, the Operator must create a fresh Audit in BARSoft and advise the
BPO to delete the redundant Audit from the system. In this case the AO and Audit team must
ensure that the correct Audit Checklist is used in the conduct of the Audit.
AOs with an existing Audit planned and scheduled for a date after the transitional period, or
AOs who reschedule an Audit for a date after the transitional period must create a fresh Audit
in BARSoft to use the newly effective QML/Audit Checklist. Once the new Audit has been
created the BPO will coordinate the deletion of the redundant Audit from the system. Both the
AO and the Audit Team must ensure the correct Audit Checklist is used in the conduct of the
Audit.
Cases where the question has Cases where the question has
Audit Status
been deleted in entirety been re-worded/revised.
Case 3: AO to create a fresh Audit in BARSoft and coordinate with the BPO
Audits created prior to the BN to have the redundant Audit deleted. Audit will be conducted on the
but scheduled for a date after new QML/Audit Checklist. – No impact.
the transition period.
Case 4: The BPO will coordinate the As directed by the BPO. In most
The Audit has been conducted question to be re-categorised as cases the assessment can be
but not yet uploaded to BARSoft, a P3 at the time of upload. amended to Conformity prior to
(undergoing AC or BPO QC RCA and CAP are required. upload.
review). Text as per Example 1 (next
The finding can remain Open page) should be added to the
and the CAP as No Further OE.
Action.
Contact the BPO who will The Auditor should describe the
Case 5: coordinate the question to be information that justifies the re-
Audit Checklist completed and re-categorized to a P3. The assessment to Conforming.
uploaded to BARSoft. Corrective Auditor should enter the Enter the standard text as per
Actions underway. standard text in the Auditor Example 3 (next page) in the
Comments field as per Example Auditor Comments field and
2 (next page) then leave the Close the corrective action.
corrective action Open at Cap
Accepted status.
Standard text responses from the Auditor in the corrective action page of BARSoft – Auditor
Comments on CAT field should be as follows:
Example 1:
Based on the revised BARS Question Master List Version X.X becoming effective on
ddMmmYYYY, this question has been assessed as Conforming. The Operator is in Conformity
Example 2:
This question has been deleted from the BARS Question Master List Version X.X effective from
ddMmmYYYY. This question has been re-categorized as a P3 and the Operator is under no
obligation to close the finding.
Example 3:
Based on the revised BARS Question Master List Version X.X effective ddMmmYYYY, the Auditor
has determined the Operator should be re-assessed as Conforming and no further corrective
action is required.
Audit Documents:
1) BAR Standard;
2) BARS Implementation Guidelines; and
3) Question Master List.
Operational Documents:
1) BARS Audit Agreement;
2) BARS Notifications;
3) BARS Program Manual; and
4) BARS Auditor Guide.
Monitoring audits and core stream audits, and are expected to take two auditor days on site
with requisite preparation and post audit activity in addition.
The success of the Audit and the Auditor/s may depend on the manner in which the Auditor/s
communicate with the auditee personnel and how they will react in different conditions
arising from the audit.
The Aircraft Operator when creating the Audit on BARSoft must select from the Operational
Category options, the functions that they desire to be audited. The options for the Operational
Category vary from time to time and are announced via the BARS Notifications (BNs). BARSoft
will create a tailored checklist for the particular Operator based on the date of the Audit and
the Operational Categories selected. Any changes to either the AC or Operational Categories
will require the AO to create a new Audit and delete the obsolete Audit. The checklist created
by the AO must be used in the conduct of the Audit and submitted to the BPO for uploading.
Use of non-tailored, generic or copied checklists may result in the checklist failing the upload
to BARSoft.
Do not allow the Audit checklist to be modified in any way during the course of the Audit. The
‘P’ categories, question text and hidden cells must not be amended after the checklist has
been generated from BARSoft.
Pressing of a bespoke checklist which is defined by the BAR Standard, industry best
practice, and risk based assessment of the Aircraft Operator’s operations and previous
audit performance.
The questions presented will therefore vary from audit to audit in both content and depth.
Certain questions in the BARS Audit checklist use the terms plan, policy, procedure, process or
system in describing the desired outcome of the question. In these cases the Auditor must
seek and verify a manual reference in a company controlled document in order to confirm the
‘documentation’ of the question. Implementation evidence should also be found to support an
assessment of Conformity.
Conditional Questions are those that commence with ‘If the Operator…’ In these cases the
Auditor must satisfy themselves that the question can be applied to the AO under the scope of
the Audit or the functions/services on offer by the AO.
There will be cases where, based on the conditionality of the question, an assessment of Not
Applicable would be appropriate; however the Operator does in fact satisfy the requirements
of the question. The Auditor should weigh up the value of the conforming assessment in order
to demonstrate the Operator meets the requirement even when not strictly necessary, for the
purpose of data analysis and transparency. (E.G. Flight Data monitoring is only required for
long term contracts with specified aircraft however if the Operator has FDM and no long term
contracts, the Audit outcome is benefited by the review and assessment of the FDM data
download process).
Objective Evidence should not be a description of what the auditor did. e.g. “Reviewed pilot
files.” Rather it must describe the evidence at hand and provide traceability.
Where questions call for policy, process, procedure or systems, they must be verified as
implemented. Look for and record in OE markers of effective implementation.
The following points are possible sources for Objective Evidence in order to determine the
assessment of Conformity. This list is not complete, but is presented as a guide to Auditors in
options to review during the Audit:
Personnel training records;
AOC/Operational Specifications/Instruments of Approval;
Weight and balance records;
Operational flight plans;
Passenger and cargo manifests;
Safety or hazard report forms;
Meeting minutes;
Risk assessment/safety case reports;
Internal audit reports and checklists;
Interviews with management;
Interviews with operational personnel;
Inspection of facilities or aircraft; and
Observation of operational practices.
Where interviews are conducted, they should not form the sole bases of determination.
Assessments based on interviews must be supported by traceable evidence of
implementation.
For assessments of Not Applicable, the Auditor should enter a statement in the Objective
Evidence column justifying the N/A. If possible, a supporting documentary reference could be
provided showing AO internal policies to support the N/A assessment. The N/A assessment
shall only be used when the requirements of the question or Standard cannot be applied to
the AO due to the scope of the Audit or the service/function is inactive.
Auditors should use care when making Not Applicable assessments as invalid assessments will
mean an incomplete Audit and the possibility of raising findings post-audit.
For assessments of Non-Conformity the Auditor must make a complete and full description of
the Non-Conformity as it relates to the Operator, the scope of the Audit and the response to
the question. In certain cases it will be useful to describe the evidence for parts of the question
that is in Conformity first and then describe the Non-Conformity in cases where there is partial
Conformity.
Any description of Conformity or Non-Conformity should not contain the Auditor’s opinion nor
should it have any guidance or recommendations on how to correct a Non-Conformity. The
description of the Non-Conformity forms the basis of the effort the Operator will commence
for the corrective action. It is for this reason that the Auditor must carefully craft the
description of the Non-Conformity to ensure that the subsequent Root Cause Analysis,
planned action (CAP) and final Corrective Action Taken (CAT) are appropriate for the Non-
Conformity.
Generic statements, copy and paste of the question or poorly worded descriptions of the Non-
Conformity will lead to extra workload and even inappropriate activity in the corrective action
process. A description of Non-Conformity should not refer to any other question (either
Conforming or Non-Conforming) as the corrective action must be a self-contained description
of the Non-Conformity and the subsequent corrective action.
Specific questions within the QML/Audit Checklist have been designated by the BPO as having
a P2 Variation (P2V) available. Use of the P2V in the assessment of Conformity for the
designated question is not mandatory, but considered as an option. If the P2V is not used to
demonstrate Conformity, then it should not be mentioned in the Objective Evidence column
by the Auditor. However, if the P2V is used by the AO to demonstrate Conformity, the Auditor
must acknowledge it by using the following text at the beginning of the Objective Evidence
description:
The Operator conforms to this question by use of the P2V described in BNXX.
Section 9 Appendix contains a flow chart for the correct handling of P2V Questions.
The BARS Program does not provide facility for Onsite Corrections for Non-Conformities. All
Non-Conformities identified shall be dealt with via the normal corrective action process so that
the root cause is identified, appropriate corrective actions are taken and there is a full review
of evidence by the Auditor in order to determine that the AO is in Conformity.
The priority level of the question does not reflect the severity of finding, nor map to a system
of major/minor/observation.
The Lead Auditor should consider the situation of the AO and the number, significance and
impact of the identified Non-Conformities and allocate a due date for the closure of each
finding respectively. The maximum time is 90 days after the Audit Checklist is uploaded and if
no date is annotated in the checklist the 90 day due date will apply. The 90 day Finding Due
Date (FDD) is displayed in the Audit Details page on BARSoft.
When conducting the aircraft inspection, ensure the aircraft presented is part of the scope of
the Audit and where possible the aircraft should be selected by the auditor rather than the
Operator selecting the aircraft that they wish to be reviewed. Make note of the aircraft
inspection in the Executive Summary of the Audit Report and detail the type and model,
registration and an overview in cases where the inspection was completed. For cases where
there is no time or there are no suitable aircraft to inspect, note this in the Executive Summary
and the reasons why the inspection was not carried out. Refer to Section 6 for contents of the
Executive Summary.
Where available the Maintenance auditor should conduct an inspection of the maintenance
facility including any ground handling facilities.
The BARS Procedures Manual (BPM) Chapter 8 details the minimum requirements that must
be addressed during the Closing Meeting. It is important that the AO clearly understands the
timelines established in the BARS Program for the completion of the corrective actions in order
to close the findings made during the Audit and that this is completed in a timely manner.
At the conclusion of the Closing Meeting, the Lead Auditor should issue the Aircraft Operator’s
nominated representative with copies of draft summary of Non-Conformities. These
documents should have the word “DRAFT” clearly displayed.
The Lead Auditor shall ensure the Aircraft Operator’s nominated representative understands
that findings presented on draft documents:
May be revised or undergo editorial change through the AC and BPO QC process;
Are to be used by the Aircraft Operator’s representatives to begin development of
the Corrective Action Plan(s); and
May not represent the total number of findings; and that additional areas of Non-
Conformity could be identified if further assessment is required to resolve
discrepancies identified during the Audit Company’s and/or BPO’s quality control
review process.
The Lead Auditor shall ensure the Aircraft Operator’s nominated representative understands
that:
The Aircraft Operator is to make every effort to provide and implement acceptable
corrective actions within the nominated Finding Due Date;
In exceptional circumstances a later due date may be allocated but this is subject to
approval by the BPO; and
Final Audit closure shall not be declared until corrective action in accordance with
the accepted corrective action has been implemented by the Aircraft Operator and
suitable Objective Evidence has been verified by the Lead Auditor.
Prior to leaving the Aircraft Operator’s premises, the Lead Auditor should ensure the Aircraft
Operator’s nominated representative understands and is competent with using the BARSoft
website to enter corrective actions and providing supporting Objective Evidence.
The SFIAR document template is available from the BARSoft Document Management tab and
shall be completed by the Lead Auditor for submission to the BPO within four days of the
Closing Meeting. The BPO shall upload the SFIAR to provide visibility to BMOs that the Audit
has been conducted prior to the uploading of the full Audit Report.
A copy of the SFIAR template is provided in the Appendix to Section 5. The document is
provided in MS Word format and only the editable fields should be completed by the Lead
Auditor. The following information is to be completed:
[field: a] Lead Auditors name;
[field: b] Name of the AO followed by a trading name if used;
[field: c] Date of the Opening Meeting and date of the Closing Meeting;
[field: d] Date the SFIAR was drafted;
[field: e] The Audit Code is for AC traceability of the Audit. (See Section 9 for
information on the Audit Codes):
[field: f] Full name of the Audit Company;
[field: g] Name of the AO as per the title page;
[field: h] Dates of the Audit as per the cover page;
[field: i] The Operational Categories selected by the AO and audited, (e.g. Standard
Questions, External Loads or Geophysical), this can be confirmed via BARSoft;
[field: j] The registration stream which the AO has selected. This can be, Initial (for
first audit), core, advanced, or RPAS. This can be confirmed via BARSoft:
[field: k] The Lead Auditor is to describe the scope of the Audit as it was conducted.
See Section 2.3 for information on describing the Audit Scope.
Note: the disciplines of the sections within the checklist (ORG, FLT, MNT and
GRH) are not the scope of the Audit;
[field: l] Out of Scope refers to aircraft or operations not subject to use by BMO or
prospective BMO operations (e.g. a flying school function, aircraft that are not
suitable for BMO operations but on the AOC);
[field: m] Provide a short summary (five lines maximum) on the execution of the
Audit and any relevant points; without mention of the outcome of previous audits or
color designation within the Program. Additional Auditors or Observers participating
in the onsite phase of the Audit should be mentioned. The full Executive Summary
should be reserved for the full Audit Report;
[field: n] Enter the draft numbers of Non-Conformities identified during the course of
the onsite phase of the Audit. Insert a 0 (zero) for discipline/categories where there
were no Non-Conformities;
[field: o] The Audit Company disclaimer tailored for the purpose of the SFIAR should
be added here; and
[field: p] Enter the Lead Auditor and Auditors name along with the FSF BA number.
Each Executive Summary must be an original piece of work written specifically for the benefit of the BARS
Audit Report to which it belongs. It is unacceptable to use generic templates or to reuse previous audit
reports, and to do so is considered a severe breach of Program policy.
The contents of the Executive Summary should not duplicate this template text. As a minimum, each
Executive Summary shall include information on the following points:
Names of the Auditors and their roles: Note the names of the Auditors and which
sections/disciplines and categories of the checklist they completed. If different Auditors were
used in the Audit follow-up phase, (corrective action closing), then this should be described.
BARSoft will automatically enter each and every Auditor assigned to the Audit via BARSoft on
the cover page of the Audit report. The Executive Summary should be used to indicate what
role each auditor participated in for the Audit.
Scope: Provide a description of the scope of the Audit. Include the Operational Categories that
the Operator has requested to be audited. If certain fleets under the control of the Operator
and listed on the AOC were NOT audited then this must be explained. If the Operator has their
operations conducted under more than one AOC this should also be noted. In this section the
AC/Lead Auditor can describe the methodology for the sampling that was used in selecting
evidence and which aircraft were reviewed during the course of the Audit. Refer to para 2.3
for further information on the scope of the BARS Audit.
Company Overview: Provide a brief description of the company, its services, structure and
functions. This may include staffing areas, contracts, overall synopsis or overview of the
company. Differences in the trading name and AOC name or unusual ownership structure
should be explained. The state granting the AOC shall be noted in this section. If the Operator
has long term contracts with a BMO, it would be relevant to mention this here.
Organizational Structure and Management: This should be a summary based on the current
organization structure of the Aircraft Operator outlining any nominated post holder positions
that may be relevant to management or regulatory representation.
Quality and Safety Management: This section should describe the quality and safety systems
and their manuals in place within the AO. A brief summary on their scope and maturity should
be noted.
Department Overview: In this section provide a general overview of each department and the
relationship within the AO. Note if any of the services are outsourced.
P2Variation (P2V) shall be listed for every Executive Summary regardless if the P2V was used
or not. This is for data gathering purposes.
P2Variation (P2V)
The following questions were assessed as conforming by use of the P2V as described in BNXX:
Flt 2.06.02 [BARS Control 5.6].
If the P2V was not used during the Audit enter – Nil.
Aircraft inspections carried out, or in situations where the inspection is not carried out, the
reasons for such.
Other Items: Unusual circumstances in the conduct of the Audit should be described.
Observers from regulatory bodies, Program Office observations, auditor trainees and
observers attending the Audit, audits that are conducted over multiple visits or rescheduling of
Audit dates should be described in this section. The Other Items paragraph can also include
information on repeat findings from previous Audits, and factors such as the local regulatory
authority’s methods/ability for the approval/acceptance of changes to operational
documentation.
This section should also carry a high level synopsis of questions declared NA and the reason for
doing so.
Summary of Audit: This section of the Executive Summary can be completed after all the
findings have been closed or at the end of the corrective action closing phase of the Audit. It
should describe any additional information relative to the closure of the findings with reasons
for delays or non-closure of any findings.
The Corrective Action section of the report is the most important section of the report as it
must clearly show the method and effort applied by the Operator to address the finding. The
section of the corrective action completed by the AC must show the method of verification
applied by the AC to determine that the Operator is now in Conformity with the requirements
of the question and that the Operator has effectively addressed the Non-Conforming items
identified by the auditor.
A Root Cause is required for P3 Non-Conformities even if there is no intention to correct the
Non-Conformity. This information is valuable in the BARS Program data analysis.
The AO can use any number of the above choices for the Root Cause or use their own
description if desired; however it must conform to the requirements outlined in 7.2.1.
Operators who have a Non-Conformity against a question that has been designated by the
BPO as having a P2V available can use the information in the P2V BARS Notification as the
basis for the corrective action.
For P3 Non-Conformities where the AO does not intend to correct the Non-Conformity, the AO
should enter No further corrective action in the CAP field.
The Auditor shall review the CAP in BARSoft and reply with either an Accept or Reject
response. Any rejection should have a clear description as to why the proposed CAP is not
satisfactory. An Acceptance could indicate what evidence is to be provided by the AO for the
Auditor to review to close the finding. The Auditors comments for the CAP are not shown in
the Final Audit Report.
P3 CAPs indicated as No further corrective action should be marked as CAP Accepted and
there is no further activity required by the Auditor on this corrective action.
Each CAP should be independent of any other CAP or CAT and avoid terms of ‘see above’ or
‘see attached’ referring to other documents or other corrective actions.
Where Operators have a regulatory approval process that may exceed the corrective action
closing time available, then an interim action that ensures the Non-Conformity is addressed is
acceptable. In this case the Operator should be able to demonstrate that the
revision/amendment to the company manuals that require regulatory approval have been
drafted and submitted to the authority and are awaiting approval.
Corrective Actions of a temporary or interim nature to be accepted by the Auditor must satisfy
the following points:
Documentation changes must be of a controlled document format and distributed to
all relevant personnel/departments; and
Implementation must be commenced or a plan of implementation showing verifiable
evidence that the plan will be carried out within the registration period.
If the P2V methodology has been used by the AO in completing the corrective action, the
Auditor should note this in the Auditor Comments when closing the corrective action. The
relevant BN for the P2V should be quoted in the closing comments.
Unusual circumstances, delays in Corrective Action closing, extensions granted by the BPO,
and unanswered findings should all be described in the Summary of Audit paragraph within
the Executive Summary section of the Audit Report.
The BARS Audit checklist undergoes thorough quality checking by the Auditors, Audit Company
and the BPO prior to the checklist being uploaded to BARSoft and the initial Audit report
generation. For these reasons a Non-Conformity listed and subsequently found to have been
raised in error will remain in the Audit Report and cannot be deleted. Findings raised in error,
normally as a result of inability to demonstrate the documentation or records at the time of
the Audit, are to have the corrective action closed in the normal manner. The CAP should
describe the plan to present evidence that demonstrates that the AO was in Conformity at the
time of the Audit. The CAT should describe what evidence has been submitted. The Auditor
Comments should describe what evidence was reviewed by the Auditor in order to close the
Non-Conformity. Ensure the revision status of any controlled document is listed in the CAT.
The Quality Control (QC) of a report should be multilayered and starts from the work
completed during the onsite phase of the Audit. Individual checks, peer review and centralized
QC all have a place in the QC process in order to eliminate errors, ambiguity and discrepancies.
When the QC process is completed on the Audit Checklist and Executive Summary the Audit
Report will be uploaded to BARSoft. This Audit report will be visible to BMOs, the AC and
Auditors involved along with the AO audited.
The BPO QC process will be applied in three separate stages in the production of the BARS
Audit report:
A review of the contents of the SFIAR prior to uploading to BARSoft;
A review of the Audit Checklist, Executive Summary and BARSoft data prior to
uploading and production of the Initial Audit Report; and
A review of the corrective actions information and BARSoft data prior to production
of the Final Audit report.
Once the last corrective action has been completed to the satisfaction of the (Lead) Auditor,
the AC Quality Control person or Lead Auditor shall ensure that quality control checks are
conducted on all parts of the Audit. This should include the following:
Spelling and grammar of all corrective actions;
Any additional Auditors assigned to the corrective action process have been
mentioned in the ES;
All corrective actions have a correctly completed RCA, CAP; and
All P1 and P2 Non-Conformities have a correctly completed CAT and Auditors
Comments.
8.4 BPO QC
The BARS Program Office will conduct a QC check of the elements making up the BARS Audit
Report (checklist, Executive Summary, corrective actions and BARSoft data) and any anomalies
identified will be recorded in the QC checklist for action by the AC.
The AC quality representative/Lead Auditor shall make any changes/corrections required and
return the QC checklist to the BPO with a description of the changes in the ‘Corrections’
column of the QC checklist.
The QC checklist should be actioned and returned to the BPO within 7 calendar days of receipt.
If there are delays, the BPO should be informed.
Errors with the Audit checklist and Executive Summary have been classified into the following
categories:
Items that are unclear or may require further clarification or explanation will be classified
under the INQ or Inquiry category. In these cases, a change to the checklist or ES may not be
necessary and the AC should provide a clarification in the ‘Corrections’ column of the QC
checklist.
The QC Checklist from the BPO forms a record of all the Non-Conforming aspects of the
Auditors and AC work in developing the Audit Report. Audit Companies shall regularly review
all the contents of the QC Checklists and the BPO bi-annual QC Report to identify trends and
areas for improvement in the production of the Audit Reports.
Date:
Venue:
Type of Meeting:
Lead Auditor
On-site assessment
by BARS Auditor
Yes Yes
Non-Conformity
Assessment:
Does the AO Finding raised
Conformity
satisfy the P2V No against the basic
Assessment
option? text of the BARS
Audit Checklist
question
Yes
Corrective Action
Conformity work can use the
End assessment: P2V option to
(Note 1) achieve conformity
(Note 2)
Note 1:
Audit Checklist to note: Note 2:
The Operator conforms to the question by use of The Auditor should note the use of the P2V to
P2V as described in BN##. achieve conformity in the Auditor Comment
Record the Objective Evidence in the Audit when closing the finding.
Checklist.
Note the use of P2V in the Audit Report
Executive Summary.
The Long form Audit Code will be made up by seven (7) elements: Region/Country/AO
Code/Audit Year/Audit Company/Audit Sequence/Operational Categories. The long form code
will be used for the purpose of data analysis.
The Normal Audit Code does not require the Region and Country identifier. The Normal Audit
Code will be made of five (5) elements and displayed in BARSoft on the Audit Details page: AO
Code/Audit Year/Audit Company/Audit Sequence/Operational Categories.
In most circumstances a short form of the code will be adequate to identify the particular
Audit in work. The Short Form Audit Code comprises just two (2) elements: AO Code and the
Audit Year.
Audit Type
o BARS Aerial Work A;
o Off-Shore Operations O;
o Initial Questions I;
o Core Questions; C;
o Comprehensive Questions; S; and
o Remotely Piloted Aircraft Systems R.
Operational Categories
o Airdrop D;
o External Loads E;
o Aerial Firefighting F;
o Geophysical Survey G;
o Humanitarian (UN AvStads) H (previously U);
o Medevac M;
o Night Vision Goggles [NVG] N; and
o Transport Hoist/Search and Rescue T.
Example:
An Audit completed by Litson & Associates on Hennerberry Airlines in 2018 as their fifth BARS
Audit with Comprehensive Questions and Geophysical Survey and Humanitarian as the
Operational Categories would be coded as;
ASP-AUlHB3A-2018-LAA05-SGH
For the Short Form version of the Hennerberry 2018 Audit code it would be: HB3A-2018.
Following are examples of Objective Evidence. There are six types of question. Each has
acceptable and unacceptable versions of OE. The examples address findings of conformance
and Non-Conformance. For appropriate questions a determination of not applicable is also
presented.
For the sake of saving space, the document reference and assessment columns have been
removed, and C / NC /NA is used instead. Colour coding reflects acceptability of OE, not
assessment of conformance.
This description of
what the auditor
did doesn’t relate
Maintenance fatigue policy any useful
C
sighted. information about
the system.
BAG 4.8.1
BAG 4.8.10
Operations manager
demonstrated use of a
commercially available crew Provide traceable
management system which evidence and
populates crew flight and confirmation of a
C duty, and recency data working system
upon lodgement of flight being in place.
returns. The system BAG 4.8.1
prevents allocation of pilots BAG 4.8.4
The Operator shall have who do not meet recency
a system which ensures requirements.
that prior to flight, all Demonstrates
flight crew members failure of the
P1 FLT 1.05.03
assigned to flights meet system, though
operational recency doesn’t address the
Two recent hires had been
requirements. system itself. Will
NC allocated without meeting
[CC1.2] have uncertain
requirements.
effect on carrying
out of appropriate
corrective action.
BAG 4.8.8
The Operator’s excel
Addresses the
spreadsheet was configured
system directly, and
to calculate night recency
identifies failings in
from the last night landing,
the development of
not 90 days from the third
NC it. Corrective action
last night landing. No
will result in a more
system requirements
robust system.
document or evidence of
BAG 4.8.8
verification of the excel
BAG 4.8.9
system was available.
This confirms
existence of a
Inspected workshop, sighted shadow board, but
C
shadow board. does not show
suitability.
BAG 4.8.1
Demonstration of the sign This describes a
in/sign out process, and working system and
completed end of task provides traceable
C
checklists (jobs: S825, and evidence.
S276) confirmed BAG 4.8.1
implementation. BAG 4.8.4
This will result in
either removal of
The Maintenance tools to another
facility should have location or more
P2 MNT 1.03.04
suitable tool control shadows drawn on
Shadow board had tools
facilities. NC the board.
without shadows on pegs.
Underlying issues
may go
unaddressed.
BAG 4.8.8
BAG 4.8.9
This explains level
Shadow boards, cut outs, of conformance,
itineraries, and audits are in and goes on to
use for company tools. describe point of
NC Personal tools found mixed failure. Underlying
with company controlled issues will be
tools. Personal tools are addressed in this
allowed and uncontrolled. instance.
BAG 4.8.8
Email: [email protected]
Web: www.flightsafety.org/bars