Team Orlando panel discusses VR, XR and AR’s role in military training and readiness at TSIS

By Cassidy Mills, Staff Writer

 

Team Orlando experts explored how immersive technologies might impact cognitive training, task proficiency and technical integration in the panel discussion “Can VR/AR/XR Advancements in Military Training Improve Readiness?” during the Training & Simulation Industry Symposium (TSIS), June 17.

 

TSIS is one of the key gatherings for the modeling, simulation and training (MS&T) community. The symposium serves as an annual forum for representatives from industry and the U.S. military to discuss training and simulation requirements. Officials from the Army, Navy, Marine Corps and Air Force presented updates on current and future procurement needs. Topics included acquisition strategies, timelines and funding priorities. Within Florida, it is second in scale only to the Interservice/Industry Training, Simulation and Education Conference (I/ITSEC).

 

Moderated by Jim Pharmer, Ph.D., chief scientist at the Naval Air Warfare Center Training Systems Division (NAWCTSD), the panel featured Derrick Barton, chief growth officer of Vertex Solutions; Niall Campion, managing director of VRAI Simulation; Jim Cooper, business development representative at Design Interactive; and Darin Hughes, Ph.D., lead software engineer at SIMETRI.

 

Pharmer emphasized the need to distinguish between the different technologies encompassed by the XR umbrella, noting that virtual reality (VR), augmented reality (AR) and mixed reality (MR) each offer distinct capabilities relevant to various training scenarios.

 

“We say ‘XR’ as an umbrella, but it’s not the same,” Pharmer said. “What you do in AR is different than VR, and mixed reality is different still. Each technology has unique strengths, and knowing those differences helps us target the right solutions for specific training needs.”

 

Hardware remains a key barrier to operational adoption of XR systems. Devices tend to be bulky and uncomfortable for soldiers operating in austere environments, limiting training duration and scalability.

 

The industry is actively researching smaller, lighter headsets that balance durability with performance, while also prioritizing battery life and wireless capability. The goal is to develop gear that feels natural and unobtrusive, allowing soldiers to focus on the mission.

 

“We’re still wearing a brick on our face,” Barton said. “For XR to be operationally useful, we need something wearable, ruggedized and closer in form factor to glasses. Comfort, durability and battery life matter as much as capability.”

 

Panelists noted that XR technologies currently offer greater benefits for cognitive and procedural training than for replicating physical tasks. They emphasized the use of XR for mental rehearsal and decision-making over direct physical skill practice.

 

“It’s great for cognition and procedural memory, but it’s not the same as being in a cockpit or putting a tourniquet on a real limb,” Campion said. “XR supports mental preparation better than physical skill replication. We need to use it for what it does best.”

 

Careful planning is necessary to integrate XR technologies into existing military training ecosystems. Infrastructure constraints, network security concerns and compatibility with legacy systems all shape deployment strategies.

 

In addition to infrastructure issues, acquisition hurdles and system interoperability remain persistent challenges. Campion highlighted potential risks related to insufficient haptic feedback, warning that such limitations could lead to ineffective or even counterproductive training.

 

“You run the risk of negative training without realistic haptics or resistance,” Campion said. “Trainees need real-world interaction while immersed virtually. Hybrid solutions are essential for effective skill transfer.”

 

Decentralizing content creation to empower warfighters was another recurring theme. Cooper said generative AI could enable soldiers to rapidly build and customize scenarios, reducing dependence on contractors and accelerating innovation.

 

“How do we enable warfighters to create their own content quickly, using generative AI? They should handle the scenarios they understand best,” Cooper said. “Contractors can then support the more complex elements.”

 

The Authority to Operate (ATO) process was identified as a significant hurdle. Limitations on network access and data sharing further complicate deployment and hinder innovation, leading to frustration among developers and users.

 

Panelists also pointed to inconsistent standards and protocols across the Department of Defense as a key challenge. They suggested that unified policies and clearer guidance could improve interoperability and streamline contractor adaptation.

 

“Tell us what standards you want and we’ll adapt,” Hughes said. “Without unified infrastructure, it’s hard to build solutions that work across services. Standardization is key.”

 

Concerns were raised about the vulnerability of cloud-dependent systems to outages or electronic attack, particularly in contested environments. Panelists emphasized the importance of building resilience into XR platforms used in near-peer conflict scenarios.

 

“We’re fooling ourselves if we think XR works at the edge without connectivity,” Hughes said. “One electromagnetic pulse and we’re left with sticks and rocks. Resilience is a must.”

 

Field exercises continue to offer important insights into the performance and limitations of XR technologies. These environments often reveal usability issues that are not apparent in laboratory settings, helping to inform further development and refinement.

 

Campion said artificial intelligence may support more adaptive and resilient XR training. He noted that AI could adjust scenarios in real time based on user performance or stress, while voice AI has the potential to facilitate more natural team interactions.

 

“AI makes XR adaptive, tailoring training to the user’s state and actions. It personalizes learning dynamically, improving outcomes,” Campion said. “Contextual voice AI that reacts mission-relevantly will transform team training. This brings realism and responsiveness to group exercises.”

 

Campion also noted that XR can make better use of downtime during training cycles. By filling waiting periods with cognitive exercises, immersive technology can improve mission rehearsal and overall productivity.

 

The panel concluded by emphasizing the importance of aligning XR implementation with operational needs. Panelists suggested that success will depend on thoughtful integration, human-centered design and continuous feedback loops to guide development and application.

 

“It’s not about what’s cool, but what works. What improves retention and accelerates mastery?” Pharmer said. “XR isn’t a silver bullet, but it’s part of the solution when designed well.”