Research Summaries

Back Reinforcement Learning for Modeling Large Scale Cognitive Reasoning (Phase II)

Fiscal Year 2018
Division Research & Sponsored Programs
Department Naval Research Program
Investigator(s) Kendall, Walter A.
Zhao, Ying
Sponsor NPS Naval Research Program (Navy)
Summary The proposal is a continuation of the project NPS-17-N279-A. Soar is cognitive architecture and software system to model complex reasoning, cognitive functions and decision making. Soar is continually being updated and has recently added reinforcement learning. Soar is especially suitable for DoD applications because it can accept and use knowledge systems including English-language based rules as well as Deep Analytics or Smart Data. Therefore, it has the potential to learn and discover the optimal combinations of existing knowledge models and generate better ML/AI that can automate and speed up complex decision making. In the past, we showed the feasibility of using Soar for the combat identification (CID) application. The model for cognitive reasoning is under development to rigorously assess the effectiveness of decision makers in a cyber warfare kill chain. The methodology is sound and will scale.
This continuation of the cognitive modeling will build on the prior effort that introduced reinforcement learning. Future work will expand on the sensory and data analytics input and experience of the cognitive model. A prototype will be refined that uses the Soar cognitive Architecture. The Soar model will be added to the simulations to be informed by war games at NWDC and CPF mission planners. The simulations will use vetted scenarios and provide assessment based on measures of effectiveness. The cognitive model prototype is based on a robust combat ID concept that is fundamentally representative for cyber warfare simulation. This prototype model will be modified and reused at NCWDG for tactical analysis and will be reused in simulations for decision work flow assessment. The simulations will ultimately be adapted for strategic assessment.
Specifically, the goal of is to investigate the feasibility of the Soar into the Naval Simulation System (NSS) which can accept cognitive models to capture perception and reasoning of the decision maker in the kill chain.
Keywords
Publications Publications, theses (not shown) and data repositories will be added to the portal record when information is available in FAIRS and brought back to the portal
Data Publications, theses (not shown) and data repositories will be added to the portal record when information is available in FAIRS and brought back to the portal