24
Appendix. Agency Comments
consist of standardized processes and procedures that will be used to conduct ATO assessments.
These standards, procedures, and checklists are scheduled for completion by December 1, 2012.
AJI will determine when to conduct these audits or assessments based on data analyses of
Mandatory Occurrence Reports, Electronic Occurrence Reports, and Voluntary Safety Reports
that identify potential risk within specific Facility, District, Service Area, or National Airspace
System wide. The AJI Audits and Assessments Program may be conducted through various
methods that may include: a review of available data from the Comprehensive Electronic Data
Analysis and Reporting tool, quality control and quality assurance data, Risk Analysis Event
analyses, information from Air Traffic Safety Action Program, direct observations, interviews
with personnel, developing a custom checklist, and other means as appropriate.
Within FAA JO 7210.634, there is a requirement that Field Assessments, referred to as
Compliance Verifications (CV), be conducted. CVs are a means of assessing Air Traffic
Facilities performance and identifying areas for improvement. There are two types of CVs that
can be conducted, Internal Compliance Verification (ICV) and External Compliance Verification
(ECV). ICVs are planned assessments accomplished through the use of a formal checklist and
random sampling methods such as, but not limited to, direct operational observation, discussions
with Service Delivery Point personnel, review of voice or radar data, equipment parameters,
certification parameters, and examination of other documentation. ECVs are assessments of
facilities that are conducted on an as needed basis as determined by the service unit, director of
operations, and/or the Quality Control Group (with the concurrence of the director of
operations). Determinations to conduct ECVs will be based upon data analyses of Mandatory
Occurrence Reports, Electronic Occurrence Reports, and Voluntary Safety Reports which
identifies potential risk within a specific facility. ECVs may be conducted through various
methods that may include: a review of available data; direct observation; interviews with
personnel; developing a custom checklist; and other means, as appropriate. All FAA and FCTs
must conduct a regularly scheduled ICV each Fiscal Year and report their findings.
Additionally, to support oversight efforts, all radar, voice, and other supporting data used to
conduct these assessments must be retained for 12 months following the date of the review.
Information related to the CV process (checklists, reports, facility information, tracking
information, mitigation plans, etc.) are stored in the Compliance Verification Tool (CVT), a
national database developed by AJI. The data in the CVT database supports the analysis of
system trends, the identification of suspected risk trends, and the development of requirements
for safety assessments.
The Audits and Assessment Group will begin their assessments once the standards, procedures,
and checklists are finalized in December 2012. The group will conduct a planned number of
assessments each year that will be determined by data-driven needs and available resources.
They will use the established assessment process and requirements checklists (developed based
on suspected risk trends and other data stored in the CVT) to assess compliance, facility
performance, and the effectiveness of operations in accordance with the ATO safety orders.