The following are some examples of current HSI research projects. Sleep deprivation and fatigue in the military: - Assessing Cadet Sleep at the USMA, West Point
- Experimental Watchstanding Schedules for US Navy Submariners
Effects of vehicle motion on human performance: - Underway assessment of the effects of ship motion on Sailors aboard HSV-2 “SWIFT”
- Assessing effects of vehicle motion on US Army Future Combat Vehicles
- Effects of motion vs. fixed-base simulators in training US Army helicopter pilots
Command and Control decision support: - UAV Operator Workload Assessment
- Ease-of-use of hand-held tactical computers for US Army Rangers
Applied Warfighter Ergonomics Lab Lang, Jeanine A. “Analysis of the integrated defense acquisition, technology, and logistics life cycle management framework for human systems integration documentation”
The objective of this thesis is to conduct a thorough analysis of the documentation and policy that currently exists within the Department of Defense (DoD) framework. There are numerous gaps within this documentation pertaining to Human Systems Integration (HSI) in the Integrated Defense Acquisition, Technology, and Logistics (IDAT&L) Life Cycle. The U.S. Navy currently implements HSI at different stages throughout the Life Cycle, but it lacks continuity throughout the entire process. A detailed analysis of the IDAT&L framework can potentially aid in redefining how the Navy should address HSI, by identifying areas where HSI policies and guidelines should exist, but currently do not (i.e., gaps), and then proposing ways to close those gaps and streamline the HSI process as a whole throughout the Navy. This thesis suggests a potential, strengthened framework for HSI in the Navy, based on the information and findings gathered from not only the current framework, but also current Navy policies. The outcome of this thesis is to improve the entire HSI process throughout the Navy and help ensure that HSI is used effectively throughout the acquisition process.
Thesis Advisor(s): Shattuck, Lawrence G. Second Reader: Miller, Nita Lewis. December 2009. Cowan, Shawn R. A human systems integration perspective to evaluating Naval Aviation mishaps and developing intervention strategies
This thesis analyzed both the human factors involved in Naval Aviation mishaps and the results of a survey of the safety concerns of Naval aircrews. Naval Aviation mishap data between 2000-2008 revealed skill-based errors and coordination/communication/planning factors to be the leading causes of mishaps. In contrast, the Naval aircrews surveyed in 2008 believed ops tempo/workload, proficiency, complacency, and motivational exhaustion (burnout) to be the most likely causes of future mishaps. To address these concerns, a mishap intervention generation and evaluation methodology recently created by Shappell and Wiegmann (2006, 2009, in press) called the Human Factors Intervention Matrix (HFIX) was examined. Drawing upon the domains of human systems integration (HSI) and the Joint Capabilities Integration Development System's (JCIDS) doctrine, organization, training, material, leadership, personnel, and facilities (DOTMLPF) analysis, the HFIX methodology was revised and expanded. It is suggested that this revised framework will be useful to both the developers of future Naval aircraft systems and safety professionals in reducing the occurrence of human error-related mishaps.
Thesis Advisor(s): O'Connor, Paul E. Second Reader: Miller, Nita Lewis. December 2009. Lazzaretti, Patrick C. HSI in the USN frigate community: operational readiness and safety as a function of manning levels
Human Systems Integration (HSI) is a process designed to reduce life-cycle costs and improve system performance by considering human-related domains. Acquisition specialists lack objective, quantitative research findings on which to base trade-off analyses. This thesis used eight fiscal years of historical safety (mishaps), manpower (manning levels) and system performance (SORTS) data on the U.S. Navy's Frigates, collected from computer databases of routine reports, to explore relationships in an existing notional model of HSI. Three hypotheses were tested: there is a negative relationship between manning and SORTS levels; there is a negative relationship between manning and mishaps; and there is a positive relationship between mishaps and SORTS levels. No significant relationships were found between SORTS levels and manning or mishaps. When all of the ships were ranked for each month based on percent of total manning and number of reportable mishaps, a positive correlation (Spearman's rho = 0.4194, p-value = 0.0294) was found corresponding to a negative relationship between manning levels and mishap rates. More detailed research is needed to isolate the relationship between manning levels and mishap rates from numerous other influences and any noise that may be present in the data set.
Thesis Advisor: Miller, Nita Lewis. General note: December 2008. Maynard, Pamelyn L. Marine Aviation Weapons and Tactics Squadron One (MAWTS-1): sleep, fatigue, and aviator performance study
The Weapons and Tactics Instructor (WTI) course conducted at the Marine Aviation Weapons and Tactics Squadron One (MAWTS-1) command in Yuma, Arizona is considered the capstone of Marine aviation training. Concerned about its high aviation incident rate, MAWTS-1 leadership asked the Naval Postgraduate School (NPS) to assess whether student sleep is a contributing factor. In a baseline study at MAWTS-1, the students were found to be chronically sleep deprived. Six months later, this thesis effort gathered sleep data on 20 WTI 1-06 student pilots using wrist activity monitors and activity logs. Results showed the mean nightly sleep to be significantly higher than the baseline study, possibly caused by the implementation of a Tactical Risk Management course. Unlike their predecessors, the students in WTI 1-06 were not sleep deprived. As a result, no significant correlations were seen between sleep quantity and quality and student performance, as measured by exam and flight scores, or between predicted effectiveness and performance, as generated with the Fatigue Avoidance Scheduling Tool (FAST) program. While other variables were found to be slightly correlated with performance, several issues were identified that may have affected these results, along with recommendations for improving future studies.
Thesis Advisor: Miller, Nita Lewis. December 2008. Kratz, Elizabeth A. A qualitative analysis of the Navy's HSI billet structure
This research was conducted in response to a request by Chief of Naval Personnel and examined the Navy's Human Systems Integration billet structure, the work requirements of the 4600 (Human Systems Integration) coded billets and the work done by officers who had a 4600 subspecialty code. The research results support the hypothesis that the work requirements of the July 2007 data set of 4600P-coded billets (billets requiring graduate education in Human Systems Integration) was not properly representative of the Human Systems Integration competencies as developed through the Educational Skill Requirements; not all Navy Human Systems Integration work was identified by a 4600 subspecialty; and the 4600 billet structure did not allow sufficient career progression opportunities. Despite the focus on the defense acquisition process in the Human Systems Integration curriculum at Naval Postgraduate School, the billets did not reflect this priority. In order for Human Systems Integration to be a viable subspecialty requiring graduate education, relevant billets need to be identified in the Navy. The research recommends conducting an in-depth needs analysis to better identify the Human Systems Integration work of the Navy by organization and subsequently leading to a better "fit" of officer category, designator, grade, education, and work experience.
Thesis Advisor: Hatch, William D. June 2008. Hannen, Timothy W. The effect of personality style and team organization on team performance
The continual advancement of technology and the increasing complexity of the operational environments for the military have necessitated the proliferation of teambased operations. The use of personality styles is one possible way to go beyond normal demographics when attempting to predict team performance. This study provides an analysis of two personality styles and their potential for predicting team performance. The tenets of Human Systems Integration (HSI) state that it is critical to view the human as a component of any system. This study examined the effect of team personality style on team performance. Additionally, the effect of team command and control organization was examined by building upon the Office of Naval Research's Adaptive Architecture for Command and Control (A2C2) project. The results of the study were inconclusive. There was no significant difference between the performance of teams high in conscientiousness and high in agreeableness (A+C+) and the performance of teams low in conscientiousness and low in agreeableness (A-C-). Furthermore, there was no difference between teams utilizing different command and control organizations. The results of the study reveal that, currently, A+C+ and AC- personality styles are not viable as selection tools Further research concerning the many possible personality styles is required.
Thesis Advisor(s): Shattuck, Lawrence G. December 2007. Desmond, Matthew S. Implementation of the quantified judgement model to examine the impact of human factors on Marine Corps Distributed Operations
The Distributed Operations (DO) concept is designed to answer the challenge of covert, highly adaptable, enemies operating with a dispersed command structure. The human variance that is part of military combat presents a critical challenge to the United States Marine Corps in the implementation of the DO concept. In addition to all current capabilities a DO Marine unit would have the additional capability of operating in smaller, more autonomous units, and would have greater authority to take actions in a given situation. The domains of Doctrine, Organization, Training, Materiel, Leadership and education, Personnel, Facilities (DOTMLPF) and Human Systems Integration (HSI) are areas where augmentation of current Marine Corps policy could enable Distributed Operations as a capability. This thesis presents a modified form of Dupuy's Quantified Judgment Model (QJM) (1987) called the Predictive Force Ratio Model. It is programmed in Microsoft Excel and first develops a score for a given unit based on physical characteristics pertaining to fire power, then adjusts that score through the use of factor weightings. The model is intended for use by a subject matter expert in estimating the gains that can be achieved in combat power through improvement of a force's human capabilities.
Thesis Advisor: Miller, Nita Lewis. September 2007. Higgins, Leon A. A module for employing human systems integration into the Rapid Equipping Force (REF)
The rapidly changing complexity of the Global War on Terrorism has changed the approach to equipping forward deployed military forces. Combatant Commanders conducting operations now require timely materiel solutions to enhance mission capabilities and reduce risk for individual Soldiers. To address this challenge the U.S. Army established the Rapid Equipping Force (REF) to assess emerging requirements, to propose solutions to those requirements, and to implement those solutions in an expedient time frame. Unfortunately, the REF lacks a consistent analytical methodology for developing alternative materiel solutions. To address the need for a Human Systems Integration analysis method, the authors developed an Assessment Based Rapid Acquisition HSI Analysis Tool (ABRAHAM) capable of generating tailored surveys and evaluating these surveys for unacceptable risks to Soldiers. To validate ABRAHAM's concept and content, ABRAHAM was showcased in three Department of Defense settings, the Human Factors Engineering Technical Advisory Group, the REF, and the United States Marine Corps' Operational Test and Evaluation Activity. The ABRAHAM appears to fill a gap in the current library of HSI tools. Based on the feedback provided during the product showcases, there is sufficient interest and technological maturity to further develop ABRAHAM to serve both the traditional and rapid acquisition processes.
Thesis Advisor: Shattuck, Lawrence G. December 2006. Simpson, Matthew A. Toward an improved method of HSI evaluation in Defense Acquisition
Each of the domains of HSI is of itself a discipline with vast amounts of research, analytic techniques, educational programs, and methods for evaluating the effectiveness of the system with respect to the specific domain. Relatively recently, domains with a logical similarity have been the focus of interest for researchers studying the plausibility of creating evaluative tools which take into account the constraints of multiple domains. This interest has led to the creation of various tools with which acquisition professionals can more accurately determine the impact of design decisions on the system as a whole. However, no single tool has yet been created which takes into consideration the constraints of all the domains which HSI encompasses. The development of such a tool would give decision-makers the ability to quickly and accurately determine the system-wide trade-offs associated with changes in a single domain. In order for this to occur, an in-depth study of the current tools associated with each of the HSI domains must be conducted. The most accurate tools from each domain must be integrated with a single interface. However, this step will only be realized after a common language has been identified which can speak to the effectiveness of the system in each of the domains. Finally, the interface must be intuitive, and designed with the end-user in mind. This study identified the various resources currently available for evaluating each of the HSI domains. These resources were compiled in a searchable database for use by the HSI professional in the planning of HSI evaluations. Following a description of how HSI relates to the Department of Defense acquisition process, the design effort to produce an overarching interface was presented. This interface would allow the acquisition professional to evaluate the trade-offs between all relevant domains and make well-informed decisions with respect to the overall effectiveness of the human in the system. Next, a plan for insertion of the process and software into the acquisition community, making the tool available to all acquisition professionals, was discussed. Finally, as with all research, the limitations of the present study were discussed, as well as recommendations for future research.
Thesis Advisor: Miller, Nita Lewis. December 2006. Thomas, Jeffrey Alexander. Evaluating the claims of network centric warfare
In response to technological advances, Network Centric Warfare (NCW) emerged as a theory to leverage the technology available in today’s world. Advocates of NCW claim that technology will improve information sharing by “robustly networking a force”, thereby improving mission effectiveness. This study proposes a methodology with which to test the first tenet of NCW: a robustly networked force improves information sharing. Lessons learned from Human Systems Integration (HSI) demonstrate that in order to improve mission effectiveness, characteristics of both the human and the technology must be considered. As such, the impact of human characteristics and traits on mission effectiveness, as measured by individual and team performance, are assessed using a computer simulation, C3Fire. Results at the individual level suggest that persons scoring high on extraversion and low on pessimism perform better than those scoring low on extraversion and high on pessimism. In contrast, at the team level, homogenous teams as measured by optimism-pessimism perform worse than diverse teams. Results of this thesis provide a methodology with which to examine NCW’s claims in a laboratory setting. Preliminary evidence demonstrates the need to consider human characteristics and traits in the design and composition of network teams.
Thesis Advisor: Miller, Nita Lewis. December 2005. Belcher, Michael F. Comparative analysis of United States Army and Marine Corps human systems integration methodologies
This thesis analyzes how the United States Army and Marine Corps comply with Department of Defense Directive 5000.2, Defense Acquisition Management Policies and Procedures,' which mandates the effective integration of human considerations into the acquisition process. Despite a common purpose, the Army and Marine Corps human systems integration (HSI) programs have evolved distinctive policies, procedures, and methodologies, tailored to the Services' unique operational and organizational environments. To evaluate program effectiveness, this thesis performs a comparative analysis of the HSI procedures employed by each Service in the acquisition of major and non- major ground combat weapon systems. Specifically, the thesis constructs an HSI Attributes Matrix, contrasting the Advanced Amphibious Assault Vehicle (AAAV) with the Armored Gun System (AGS), and the Short Range Anti-tank Weapon (SRAW/Predator) with the Advanced Anti-tank Weapon System- Medium (AAWS-M/Javelin). Extrapolating generalizations from case analyses, this thesis identifies the policies, procedures, and methodologies which are most effectual in integrating human considerations into system acquisition. Finally, the thesis recommends modifications to the Marine Corps' HSI program to improve the acquisition process and thereby, better satisfy the operational requirements of the Fleet Marine Force.
Thesis advisor(s): Thomas H. Hoivik, Frank C. Petho. |
