Fiscal Year	2023
Division	Research & Sponsored Programs
Department	Naval Research Program
Investigator(s)	Bacolod, Marigee P. Helzer, Erik
Sponsor	NPS Naval Research Program (Navy)
Summary	A credible performance evaluation system is critical for identifying and managing talent in the United States Navy. Performance Evaluation Transformation (PET) is accelerating with multiple efforts. In FY22, the PI's of this study fielded a prototype of trait and value statements (TVS) for use in performance evaluation across Navy commands. This research established the construct, face, and content validity of the TVS using Navy doctrine, CNO guidance, and survey data. In FY23, we expand the aperture of the previous study to ask: 1. Are the draft TVS valid and free from adverse impact over an individual's Naval career? 2. How well can the draft TVS assess current vs. potential job performance? The proposed research will link FY22 survey data with secondary data comprised of historical FITREPs, EVALs, demographics, and other personnel information from Oct 2009-Mar 2022. A data sharing agreement to access these data was put in place by the PIs in FY22. Statistical and machine learning (ML) models using this data will establish how well the prototype predicts talent development over an individual's Naval career. We will estimate how well the TVS predict actual career outcomes like milestones, time to promotion, being above or below the reporting senior's cumulative average (RSCA), and other metrics. To determine the extent to which the TVS are free from adverse impact, we will examine differences by gender, race, and community. The models will also assess the relative validity of the TVS in measuring current vs potential job performance. The FY22 study highlighted the importance of separating the administrative purpose of evaluations (promotion, retention) from their development purpose (feedback, job improvement). Using results from the statistical models, the FY23 study will continue to obtain fleet input to refine two separate instruments: one evaluative, one developmental. The FY23 study could then be a vehicle for fleet input as PET accelerates and the Navy adopts policy improvements.
Keywords	performance evaluation, FITREP, validity, psychometrics
Publications	Publications, theses (not shown) and data repositories will be added to the portal record when information is available in FAIRS and brought back to the portal
Data	Publications, theses (not shown) and data repositories will be added to the portal record when information is available in FAIRS and brought back to the portal