What We Looked AtFAA relies on its highly-trained Air Traffic Control Specialists (ATCS) to safely and efficiently manage the flow of air traffic across the National Airspace System. In 2012, FAA undertook a review of the ATCS hiring process that identified the need to update its ATCS pre-employment test. In response, FAA deployed the Air Traffic Skills Assessment (ATSA) test in November 2016. The National Defense Authorization Act for Fiscal Year 2020 mandated that the Office of Inspector General (OIG) assess the assumptions and methodologies used to develop the ATSA. Accordingly, we initiated this audit to assess FAA’s (1) validation of the assumptions and methodologies used to develop the air traffic controller pre-employment test and (2) administration of the test and its plans to evaluate the test’s effectiveness in identifying successful ATCS candidates. What We FoundFAA has taken steps to validate the assumptions and methodologies used to develop the ATSA. FAA worked with a human resource consulting organization, APTMetrics, to identify the critical skills, abilities, and other characteristics (SAO) required to perform important ATCS responsibilities. FAA then worked with APTMetrics, NATCA, and various subject matter experts to ensure that the ATSA evaluates the SAOs required for entry level ATCS. Also, the ATSA identifies sufficient applicants to meet FAA’s trainee hiring goals but the Agency has not established a plan for evaluating the ATSA’s effectiveness. As a result, it is unclear whether the test is effective at helping the Agency identify successful ATCS candidates. Furthermore, FAA’s lengthy hiring process and COVID-19 restrictions have slowed FAA’s onboarding and training activities for newly hired ATCS. As a result, few applicants who have taken the ATSA and were selected as trainees have completed their training and obtained certification. Our RecommendationsFAA concurred with our recommendation that the Agency evaluate the ATSA’s effectiveness in identifying successful ATCS candidates. We consider the recommendation resolved but open pending completion of the planned actions.
| Report Date | Agency Reviewed / Investigated | Report Title | Type | Location | |
|---|---|---|---|---|---|
| Department of Transportation | FAA Has Taken Steps To Validate Its Air Traffic Skills Assessment Test but Lacks a Plan To Evaluate Its Effectiveness | Audit | Agency-Wide | View Report | |
| U.S. Postal Service | The Postal Service in the 21st Century: A Recent History | Inspection / Evaluation | Agency-Wide | View Report | |
| U.S. Agency for International Development | Financial Audit of USAID Resources Managed by African Water Association in West Africa Under Cooperative Agreement AID-624-A-16-00003, January 1 to December 31, 2021 | Other | Agency-Wide | View Report | |
| U.S. Agency for International Development | Financial Audit of USAID Resources Managed by Benjamin William Mkapa Foundation in Tanzania Under Cooperative Agreement 72062120CA00003, July 1, 2021, to June 30, 2022 | Other |
|
View Report | |
| Amtrak (National Railroad Passenger Corporation) | AMTRAK VENDOR FAILED TO PROTECT AND SECURE FUEL CARDS | Investigation |
|
View Report | |
| Election Assistance Commission | Summary of Investigation, Alleged Contract Fraud, EAC, DC | Investigation | Agency-Wide | View Report | |
| General Services Administration | Implementation Review of Corrective Action Plan - Audit of GSA's Controls to Prevent Contracting With Suspended and Debarred Contractors, Report Number A180104/Q/2/P20004 | Other | Agency-Wide | View Report | |
| Defense Intelligence Agency | Announcement of the Audit of DIA's 2023 Financial Statements, Project 2023-1003 | Audit | Agency-Wide | View Report | |
| Department of Justice | Investigative Summary: Findings of Misconduct by a State’s Attorney for Misuse of Federal Grant Funds and False Statements | Investigation | Agency-Wide | View Report | |
| Department of State | Information Brief: Ukraine Supplemental Appropriations Act, 2023 Mandated Assessment | Other | Agency-Wide | View Report | |