Virtual, augmented, and mixed reality for defence and the public sector - 11 July 2019 - Deloitte
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Virtual, augmented, and mixed reality for defence and the public sector 11 July 2019
Virtual, augmented, and mixed reality for defence and the public sector
Contents
Messages from PHD Chamber of Commerce and Industry 4
Foreword by Deloitte 7
Introduction and overview 9
The world of digital reality, market adoptions, and global applications 11
Virtual reality 11
Augmented reality 11
Mixed reality 11
360° videos 11
Immersive technologies 12
Digital reality ecosystem enabling success stories 15
Global players in the digital reality space 15
Indian players in the digital reality space 15
Digital reality applications in defence 19
AR applications in defence 19
VR applications in defence 19
Digital reality use cases applicable to defence 20
Comparison of digital reality headsets 23
Mobile-based VR headsets 23
Desktop/PC-based VR headsets 23
Standalone VR headsets 23
AR headsets 23
MR headsets 23
Potential barriers to adoption in defence applications 25
Overcoming challenges to create a digital reality for defence 25
Flying high in a digital sky 29
About Deloitte 30
About PHD Chamber of Commerce and Industry 31
Endnotes 32
References 33
Acknowledgements 34
3
Virtual, augmented, and mixed reality for defence and the public sector
From the President’s Desk,
PHD Chamber of Commerce
and Industry
PHD Chamber of Commerce and The Innovations for Defence Excellence
Industry’s ‘VR AR for Defence and Public (iDEX) focuses on creating an ecosystem
Sector Summit’, to be organised on 11 July to foster innovation and technology
2019 at PHD House, New Delhi, plans to development in the defence and
showcase the significance of Industry 4.0 aerospace sectors, and provides immense
technologies as a harbinger for growth of opportunities for micro, small, and
the Indian industry. medium enterprises, start-ups, individual
innovators, and R&D institutes to imbibe
India’s transformative journey of Industry AR and VR technologies into their
4.0 is evolving fast to tackle the disruptive operations to enable the military to use
changes that industries may encounter in these technologies in the future. Defence-
Rajeev Talwar the next decade. As opined by our prime tech start-ups are being engaged to work
minister, this fusion of physical, digital, and on several high-end technologies, including
biological spheres towards technological new materials in armour, electronic
transformation of global production warfare solutions, anti-drone technologies,
systems using tools of Artificial Intelligence and armour piercing incendiary rounds.
(AI), Robotics, Machine Learning (ML),
Internet of Things, Blockchain, and Big With the adoption of Industry 4.0, an
Data hold the potential to take India to incremental rise in hi-tech manufacturing
greater heights. can be visualised, thus increasing the share
of digitised manufacturing to 25 percent
The huge potential of augmented reality by 2022. With the help of AI and Robotics,
(AR)/virtual reality (VR) can be tapped new ideas will be used to build model
to create large volume simulation patterns that can be quickly converted
environments for military and paramilitary into mass products. With new hardware
domains by simultaneously embracing and technologies, AR and VR can bring
technologies such as AI and Industry 4.0 value to enterprises in multiple domains
across functions (such as manufacturing, by revolutionising manufacturing and
supply chain, logistics, and procurement) providing manufacturers an opportunity
and providing an immersive way for to use advanced manufacturing
training and optimising operations. With capabilities and information technology
more than a hundred AR/VR start-ups throughout the product lifecycle.
set up in the past two years, the AR/VR
market in India is expected to register a I am sure that this knowledge report
compounded annual growth rate of more would serve as a useful reference guide
than 50 percent in the next five years. for stakeholders of public and private
companies and provide them information
That said, AR will be used to equip military about the incorporation of new
officials with “computer vision technology” technologies in the industry that would
to help with equipment maintenance and help contribute towards the progress of
repair. The VR technology could enable new India
military officials to digitally capture
landscapes during times of crisis such as
war, devastation, or in the aftermath of
bombing — and share those environments
virtually with remote personnel to better
plan personnel deployment and crisis Rajeev Talwar
management strategies.
4
Virtual, augmented, and mixed reality for defence and the public sector
From the Secretary General’s
Desk, PHD Chamber of
Commerce and Industry
Being a proactive National Apex police forces, DRDO labs, CSIR labs,
Chamber, PHD Chamber of Commerce PSUs, and Indian Railways will benefit
and Industry is at the forefront immensely from the day-long summit
of encouraging adoption of new and will go back with a fair idea about
technologies and innovations in the the potential of VR and AR and how
public and private sectors to become to begin implementing these in their
more efficient and competitive. VR and respective organisations.
AR technologies have revolutionised the
design of new computing platforms to I wish the summit success and am
replicate the real environment by pushing thankful to the Ministry of Defence, and
the limits of technologies in processing, the Ministry of Electronics and IT for
Dr Mahesh Y Reddy
sensing, and displays. VR and AR their support. PHD Chamber intends to
technologies are ideal for defence sector encourage innovations and start-ups.
applications, public-sector units (PSUs) It also supports building capacity for
and central police forces, and research various new and emerging technologies
in science and technology to gain for a better economic growth
experience of high-risk environments of the country.
from the convenience of research labs.
This summit aims to sensitise
stakeholders on applications of VR, AR,
and mixed reality (MR). Representatives
from the Indian Army, paramilitary, Dr Mahesh Y Reddy
5
Virtual, augmented, and mixed reality for defence and the public sector 6
Virtual, augmented, and mixed reality for defence and the public sector
Foreword by Deloitte
India is the hotspot of digital innovation increased significantly. In fact, the size
across sectors and stands on the cusp of of the AR market and the VR market is
the fourth industrial revolution (Industry expected to reach US$ 70-75 billion and
4.0) with new-age technologies, which US$ 10-15 billion by 2023, respectively.1
are disruptive and poised to have a deep We, at Deloitte, are engaged in being
impact on the way we live and work. part of this journey and actively using
From AI and Industry 4.0 to digital reality, the experience of our member firms
digital forces continue to disrupt business globally to tailor solutions to suit the
operations. Wearing a computer screen Indian context.
on your face is something only a gamer
or tech enthusiast could love. However, This report primarily focuses on myriad
Rakesh Barik
headsets and other devices that create applications of digital reality in the
Partner, Consulting
mobile, virtual, or AI experiences, are defence sector where we have tried to
Deloitte India
being seen in places other than labs and understand how start-ups are influencing
gaming centres. this development. The report also
explores different elements of technology
There are multiple use cases where and how they are being adopted
the deployment of digital reality by the industry.
solutions help organisations introduce
productivity-enhancing features, such as We are thankful to the PHD Chamber of
remote guidance through telepresence Commerce and Industry, India for giving
and immersive interactions for us an opportunity to be the Knowledge
collaboration in a virtual sandbox. These Partner for this summit. We are confident
enhance safety and reduce training costs. that the summit and this report will help
Disaster response teams are also seen generate more awareness on digital
to have benefited from digital reality reality, and express our best wishes for
technologies; the police, firefighting, stimulating discussions between the
and engineering teams have used these government, and the industry and start-
technologies to create disaster maps and up ecosystem as an outcome of the event.
locate hotspots for quick response.
Further, the number of players
(organisations and start-ups) working in
the digital space and their revenue have Rakesh Barik
7Virtual, augmented, and mixed reality for defence and the public sector 8
Virtual, augmented, and mixed reality for defence and the public sector
Introduction and overview
Digital reality has moved from being a As expected, the digital reality market also led by big players, such as Apple with
futuristic concept, residing only in video is soaring given the ground-breaking ARKit, which was launched in competition
games and sci-fi movies, to a collection opportunities offered by the field. In fact, with Google’s ARCore. Alongside these
of engaging, immersive, multisensory by 2023, the global revenue for mobile prominent names, a booming ecosystem
technologies that replace aspects of the AR and smart glasses is projected to be of start-ups is eager to make a mark in
real world with digital elements. From between US$ 70 billion and US$ 75 billion, the digital reality space.
the use of AR-enabled filters on social while that of VR (mobile, standalone,
media to VR video game headsets, digital console, and PC) is projected to be However, much of what we see today
reality is becoming entrenched in the way between US$ 10 billion and US$ 15 billion. of digital reality has its commercial
people interact with the world. roots in investments and developments
Industry experts posit that unlike other the military made in exploring this
Digital reality as a concept has been exponential technologies AR and VR technology’s different facets. Therefore,
around for a long time. It has picked up have travelled across the frame of it is important to study the current
only recently, with a slew of investments experimentation and are moving towards applications of digital reality in the
made in both hardware and software higher adoption (highlighted in Figure 1). defence sector and what the future holds.
applications. Consequently, various This paper tries to assess the existing
digital reality applications are available The hardware and software capabilities landscape of digital reality, examine the
for organisations to adopt − in the of certain key players are driving range of start-ups operating in this space,
form of immersive learning, enhanced growth of the digital reality market. The and take a deep dive into its scope in the
consumer experience, design and hardware market is relatively captured arena of defence in the future.
analysis, guidance and collaboration, by larger organisations, such as Facebook
equipment maintenance, media, or with Oculus (a range of headsets) and
other applications. HTC with Vive. The software market is
Figure 1: The hype maybe waning, but real opportunity is growing
Deep neural nets
(deep learning)
Digital twin
Biochips Carbon nanotube
Smart workspace IoT platform
Brain-computer interface Virtual assistants
Autonomous mobile robots Silicon anode batteries
Smart robots Blockchain
Deep neural
network ASICs Connected home
Expectations
AI PaaS
Quantum Autonomous driving level 4
5G computing
Self-healing system Volumetric displays Mixed reality
technology Conversational
Autonomous driving level 5 AI platform
Edge AI
Exoskeleton
Blockchain for
Neuromorphic hardware data security
Knowledge graphs Smart fabrics
4D printing Virtual reality
Artificial general intelligence
Flying autonomous
vehicles Augmented reality
Smart dust
Biotech – cultured or artificial tissue Time
Innovation Peak of inflated Trough of Slope of Plateau of
trigger expectations disillusionment enlightenment productivity
Plateau will be reached in: 2 to 5 years 5 to 10 years More than 10 years As of August 2018
Source: https://www.gartner.com/en/newsroom/press-releases/2018-08-20-gartner-identifies-five-emerging-technology-trends-that-will-blur-the-lines-
between-human-and-machine2
9Virtual, augmented, and mixed reality for defence and the public sector 10
Virtual, augmented, and mixed reality for defence and the public sector
The world of digital reality,
market adoptions, and global
applications
Digital reality has many facets, including Augmented reality (AR) operators.4 The technology improved
VR, AR, mixed reality, 360° video, and AR refers to the overlaying of virtual the process of providing feedback and
now even extended reality. However, content onto elements from the real increased workers’ speed. The findings
what they mean and what differentiates world. In this scenario, the real world of both the Boeing and GE studies are
them determine how they bring digital is central, while digital details are summarised in Figure 2.
information to people. layered in to supplement reality. A
typical AR experience involves features Mixed reality (MR)
Virtual reality (VR) such as transparent optics and a MR is a technology that marries both
VR involves creating an entirely digitally viewable environment. AR and VR, creating a seamless blend
rendered, immersive environment between real-world elements and virtual
in lieu of stimuli from the real world. AR has numerous business applications. content. Advanced sensors for spatial
Body-tracking and motion-tracking For instance, Boeing improved its awareness and gesture recognition are
capabilities are core features, allowing productivity considerably using AR core components of MR applications.
a user to manipulate and move objects glasses in its wiring harness assembly MR applications have mostly been
using haptic controllers, head-mounted procedures.3 Looking into glasses, restricted to enterprise users, especially
displays, and headsets. In 2016, one of technicians on the project were able in the domains of manufacturing and
the world’s leading retailers launched a to view real-time, hands-free, and education.
VR app for its store to improve in-store interactive 3D wiring diagrams that
design and product placement, allowing guided them through the process 360° videos
customers to make more informed in a way that minimises errors. These videos are captured with omni-
product decisions. The organisation directional cameras or a collection of
claims that the test app has helped Similarly, GE deployed an Xbox console cameras, such that they allow viewers to
generate 1,200 articles across the world and connected Kinect motion tracker look in all directions. A social media major
since its launch. in a factory that projected work launched a commonly used application
instructions onto assembly parts, and that allowed users to view a photograph
relayed visual and sensory feedback to as a video.
Figure 2: Findings from Boeing and GE experiments using AR
The industry says it works
A study conducted by And at GE Healthcare, a warehouse worker Additionally, several other
Boeing showed that AR receiving a new picklist order through AR firms show an average
productivity improvement
improved productivity in completed the task 46% faster than when using
wiring harness assembly the standard process, which relies on a paper list of approximate 30%.
by 25%. and item searches on a workstation.
Source: National Training Laboratories, USA
11Virtual, augmented, and mixed reality for defence and the public sector
Immersive technologies content, and MR blends virtual content
These consist of multisensory digital into the real world so that the two can
experiences involving AR, VR, MR, and interact. Further, 360° video adds a
360° videos. different perspective to a video and
immersive technologies create an
To summarise, VR creates a digital entirely multisensory digital experience
environment, AR modifies existing for a viewer.5
environment with digitally created
Figure 3: Industrial applications for AR and VR
Enterprise category What Where Potential results
Guidance and Provide workers with visual cues to Aerospace and defence, Improved productivity,
collaboration help them perform tasks such as automotive, construction, streamlined work progress,
maintenance, repair, or assembly health care providers, reduced risk, and cross-
industrial products, oil and gas, geographic collaboration
power and utilities, technology
Immersive learning Immerse the personnel in realistic Consumer products, health Stronger retention of material,
training environments that are either care providers, higher reduced risk, cost savings,
high-cost or high risk; variations education, and industrial and improved therapeutic
include addressing PTSD, phobias, products outcomes
and their medical issues
Enhanced consumer Enhance customers’ experience by Automotive, banking and Better customer engagement,
experience providing customised or unique securities, consumer products, increased marketing
methods to interact with the health care providers, opportunities, increased
company, brand, or its products industrial products, media sales, and enhanced brand
and entertainment, travel, positioning
hospitality, and other services
Design and analysis Enable knowledge workers to assess Aerospace and defence, Cost savings, increased
design ideas virtually and/or analyse automotive, construction, efficiency, earlier detection of
data in new formats higher education, industrial design flaws, new methods
products, real estate, and to analyse data, and generate
technology insights
Source: Deloitte Analysis on Applications of AR and VR Technologies6
These technologies have found operations, these industries have seen
resonance with a variety of industries tangible business outcomes, such as
ranging from aerospace, automotive, enhanced productivity and collaboration,
healthcare, and education, to real estate improved sales, better customer
and energy resources. By integrating engagement, improved data analysis,
these technologies into their business insights generation, and low risks and
functions and service offerings and operational costs.
12Virtual, augmented, and mixed reality for defence and the public sector
13Virtual, augmented, and mixed reality for defence and the public sector 14
Virtual, augmented, and mixed reality for defence and the public sector
Digital reality ecosystem
enabling success stories
From modernising tactical training for Figure 4: Deloitte analysis on Tracxn.com data based on their sector report on AR
soldiers and worker training in industries (April 2019)
for optimising internal business functions Investments ($M) and number of rounds in AR; 2012−2019
to disrupting the way people engage 1400 80
with social media, gaming, and brands, $1.2 B 70
1200
the scope of digital reality is extensive.
60
1000
Both global and local players are actively $931 M
$ Funding
# Rounds
$799 M 50
involved in developing relevant solutions 800 $715 M
40
for the industry. 600
30
400 $348 M
Global players in the digital 20
reality space 200
$79 M
10
$44 M $83 M
Some of the larger global players, such 0 0
2012 2013 2014 2015 2016 2017 2018 2019*
as Google, Facebook, Microsoft, and HTC,
are widely known for providing hardware 3 year CAGR 39% $ Funding
and software elements to accelerate the 6 year CAGR 66% $ Funding 4% # Funding
development of digital reality. However,
24% # Funding
a plethora of start-ups also provide
revolutionary solutions in sectors such as $ Funding # Rounds Predicted $ Funding Predicted # Rounds * Until April’2019
police and administration, surveillance, Note: Funding excludes grant, debt, and post-IPO rounds. Excludes funding information of Chinese
entertainment, and real estate. companies
The industry has seen significant Figure 5: Deloitte analysis on Tracxn.com data based on their sector report on AR
investment in start-ups operating in the (April 2019)
digital reality space across the globe. It Investments ($M) and number of rounds in AR
has received high investments over the
past three years. Interestingly, some of Total funding # Rounds
these start-ups are backed by Google US $3.5 B 242
Ventures and Samsung, underscoring the
interconnected nature of this ecosystem. Europe $415 M 96
In 2018 alone, start-ups raised
US$ 931 million, up from US$ 799 million Israel $286 M 34
in the preceding year (an increase of ~17
percent), as presented in Figure 4. Canada $48.9 M 12
Indian players in the digital Taiwan $27.2 M 2
reality space
India too has seen a strong interest in Japan $10.6 M 7
developing digital reality applications.
The country is among the top eight India $10 M 24
regions in terms of total funding received
by AR start-ups across the globe, with South Korea $6.6 M 4
Israel and the US featuring at the top of
the list (depicted in Figure 5). Source: Deloitte analysis on Tracxn.com data based on their sector report on AR
(April 2019)
Note: Excludes funding information of Chinese companies
15Virtual, augmented, and mixed reality for defence and the public sector
AR has consistently seen higher revenues equipped with zoom features, facial
over the past few quarters, and future recognition, and calibration with rifles,
projections too seem bent towards to combat terror situations in crowded
AR, with reports projecting the global settings. He also delineates another
revenue for AR to hit US$ 70-75 billion use case: creating ground zero training
by 2023.7 scenarios to enhance the field experience
for police and army officials. According to
Despite uptake in the adoption of VR- him, “This is similar to modern day chess
based products, such as head-mounted players, who train themselves by playing
display among end-users (manufacturing, various games against AI-powered
automotive, and consumer electronics), software.”
the VR market in India is seeing a tepid
response. Organisations are only in the However, the journey of digital reality
early stages of AR and VR adoption, start-ups has not been smooth,
with many in the initial stage of proof of with a lack of resources and right
concept and ROI justification. skill sets posing a challenge. With
limited universities offering courses
The majority of start-ups are working in this domain, there are not enough
on vertical-focused solutions for professionals who can take up these
specific industries, such as real estate, roles. Low rates of adoption by clients is
hospitality, gaming, and retail, but the also seen to be a stumbling block.
uptake is slow. Organisations struggle
to measure ROI, and determine the right According to Munish Dhiman, founder
model for partnerships, pricing, and and CEO at Gesture Research, while
content. Consequently, to know what digital reality as a field is picking up,
will benefit them in the long run, Indian people do not always perceive it as being
establishments have been exploring ready for operational use at a mass
solutions in this domain with the scale. It is still considered experimental.
help of start-ups. Nonetheless, he proposes a solution
to address this issue: “This gap can be
One such start-up is Digital Agents fulfilled by knowledge sharing sessions
Interactive Private Limited, which has and expert discussions to precisely
been involved in collaborating with the define the use cases and expectation
defence forces of the country. Founder from digital reality. Having digital
Mohit Ramani, while speaking to Deloitte, transformation labs with an intent to
articulated how he had a clear view of mature the technology in-house to make
the problem statement he was looking it more useful can be a good idea to
to solve, and developed defence-specific get started.” He also suggests several
solutions that have been successfully potential applications of digital reality
deployed by various departments. in military operations, such as plastic
models for terrain visualisation and
Atul Rai, founder of Staqu Technologies, planning, centralised simulated facilities,
highlighted that India loses US$1 trillion digital planning tables linked to satellite
of its GDP annually to violence and data for real-time terrain visualisation,
criminal activities.8 He explained that's and doctors performing virtual surgeries.
why he set his mind to address this
problem with the help of technology. Fortunately, over the past few years, the
Through his AI-and AR-based solutions, pace of technological development has
he has been instrumental in aiding started to match that of the application
government authorities to address development in the market. This points
issues of homeland security and to a brighter future for the stakeholders
defence over the past two years. Rai lists involved in the digital reality ecosystem.
various applications for digital reality in
homeland security, such as smart glasses
16Virtual, augmented, and mixed reality for defence and the public sector
17Virtual, augmented, and mixed reality for defence and the public sector 18
Virtual, augmented, and mixed reality for defence and the public sector
Digital reality
applications in defence
The US Department of Defence spends to ground forces, and lead to significantly situation (without stopping to look at
about US$ 14 billion annually on synthetic faster problem-solving and lower error screens and coordinates).
digital training for personnel.9 Moreover, rates. The medium of information is
the AR market in the military domain is more secure and now considered the A 2019 Deloitte study (Refer to Figure 6)
estimated to reach US$ 1,797.5 million preferred mode for soldiers who can found that police officers trained for
by the end of 2025.10 The focus on continue to act according to the on-ground helicopter operations in a 3D virtual
improving skills faster and at lower costs
is seen to have led to a rise in the
Figure 6: Virtual training for collaborative tasks
deployment of digital reality in defence
departments globally. In accordance with
commercial applications, defence too
has its preference for various themes of
digital reality.
AR applications in defence
47 police officers trained in operations where they
AR is often used to solve challenges
had to interact with a helicopter crew
such as the paucity of information and
resources, and compromised effectiveness Three training conditions
and safety due to unrealistic or high-
risk training situations. Often used
for training purposes, AR is effective VS VS
for warfare simulations, military sand
tables, battlefield visualisations, and Control training condition Standard training Virtual training condition
other applications that place a high (handout material) condition (helicopter) (3D virtual environment)
premium on the realistic representation of
defence activities.
Knowledge transfer Learning outcomes
Mean and standard deviation Mean and standard deviation 7.13
The use of AR in defence can also take 5.17
(1.21) 6.94 (2.47)
the form of smart glasses and displays
3.85 3.98 (1.73)
that present information regarding (1.33) 3.07
(0.94)
spatial orientation, situational awareness, (2.15)
weapons targeting, digital terrain, and
other critical data, to mitigate lapses in
safety, speed, and coordination. Devices
Control Standard Virtual Control Standard Virtual
can also allow soldiers to familiarise condition condition condition condition condition condition
themselves with features such as night
vision, thermal sensing, and applications Knowledge transfer. This shows the Learning outcomes: Difference between
knowledge transfer score: A test composed pre-and post-training test results that
that measure vital signs during training.
by 11 short videos of the real world showing consisted of 20 multiple choice questions
ground forces that interacted with a helicopter about the defined learning goals
VR applications in defence
crew in a variety of different situations. The
The applications of VR in defence are videos stopped at certain points of critical
also noteworthy. Smart helmets are an situations and the participants were asked to
example of VR applications in the field. describe how they would behave.
These helmets allow the transmission
Source: https://www2.deloitte.com/content/dam/Deloitte/dk/Documents/Grabngo/Digital%20
of crucial information (e.g., maps and
Reality%20GrabNGo_2019_030419.pdf
environmental factors) from commanders
19Virtual, augmented, and mixed reality for defence and the public sector
environment had the highest rates –– How it will benefit defence forces •• Digital twin of navy ships and
of knowledge transfer and learning The application is expected to reduce engines
outcomes following their training, response time and mobilisation costs –– What it is
compared with other officers who for experts while providing on-the-job VR and IoT are used to create digital
followed a standard training procedure in training to personnel. twin ship models with digitalised
a helicopter and control conditions with components and a real-time
•• Tele-robotic and tele-presence
informative handouts.11 simulation platform is deployed to
–– What it is
integrate engine and ship models.
Robots are remotely controlled and
Digital reality use cases applicable to –– How it will benefit defence forces
operated by people to perform tasks.
defence A virtual, real-time copy of engine
–– How it will benefit defence forces
The adoption of digital reality is growing equipment is expected to help
The Navy can use this technology to
across the defence forces and the better monitor, analyse, and predict
remotely operate equipment during
industry. Digital reality technologies performance, leading to safer and
deep-sea activities.
across the globe are used to develop more efficient operations in the Navy.
applications to train soldiers and •• Vehicular repair and maintenance in
•• Tactical augmented reality (TAR) to
medical professionals, as well as for the battlefield
improve situational awareness with
teleoperation. Some of the applications –– What it is
night vision for soldiers
where AR, VR, and MR can add value to It involves using AR over a two-
–– What it is
the defence sector are discussed below. dimensional printed manual or
It allows soldiers to locate their own
schematics.
and fellow soldiers’ positions, as well
Defence operations and maintenance –– How it will benefit defence forces
as enemy combatants.
The user sees instructions as an
•• Remote collaboration through –– How it will benefit defence forces
overlay onto the actual object in
experts The device is equipped with night
three dimensions, including specific
–– What it is vision capabilities. This means that
symbology indicating which part to
A head-up display enables the expert soldiers will be able to ditch their GPS
adjust or replace. This is expected
to view what on-ground personnel are and night vision goggles, and will rely
to reduce time and cost of repair for
viewing and provide real-time inputs on TAR instead.
army trucks and weapons.
to help them take corrective actions.
20Virtual, augmented, and mixed reality for defence and the public sector
Defence training •• Multi-user war planning systems to collaborate with experts in
–– What it is different geographies.
•• Immersive training for military
Training involves real-time –– How it will benefit defence forces
forces
collaboration among different soldiers With the ability to remotely view a
–– What it is
in a virtual environment. patient, doctors could be able to
VR-based training is provided to
–– How it will benefit defence forces supply a level of expertise that might
ground, air, and navy forces for flight
It allows leadership to develop be missing in the field. This could
and battlefield simulations, vehicle
strategies for tactical missions in be used across the Army, Navy, and
simulation, and virtual boot camps.
extreme circumstances. Air Force.
–– How it will benefit defence forces
It is an immersive training that •• VR-enabled process assessment •• VR-based training for doctors and
helps participants experience –– What it is paramedics
the stress of a parachute jump, This training helps understand the –– What it is
fighter jets, submarines, and tanks effect of undertaking processes, The training provides a virtual
(claustrophobia). such as firing of weapons, in a real- environment for running simulation
world scenario. programmes for doctors.
•• Situational awareness based training
–– How it will benefit defence forces –– How it will benefit defence forces
for armed forces
It allows soldiers to understand what The training will teach army medics
–– What it is
to expect while firing a weapon and how to carry out lifesaving operations
It is the training for extreme
learn the nuances of forces acting on in the stressful surroundings of
conditions (e.g., weather and terrain).
human body during missions. a real warzone.
–– How it will benefit defence forces
This involves navigation and fostering
Medical training and on-ground
teambuilding activities to train
emergency support
ground, air, and navy forces on how
to survive in extreme environments •• Medical support in the battlefield
(jungle, Arctic, and desert missions) –– What it is
and difficult times. On-field doctors can use MR devices
21Virtual, augmented, and mixed reality for defence and the public sector 22
Virtual, augmented, and mixed reality for defence and the public sector
Comparison of digital
reality headsets
Similar to all cases related to digital Facebook’s Oculus Rift series or HTC’s MR headsets
reality, the headset market is also Vive series of headsets that provide Microsoft’s Hololens is the most
trifurcated into the realm of VR, AR, in-depth experience of the virtual commonly used headset for running
and MR. Additionally, the market is environment to soldiers. MR applications at present. Due to
peppered by global tech majors keen the high cost of the device, its usage is
on establishing their presence in the Standalone VR headsets so far restricted to mostly enterprise
minds of consumers. From a US$ 15 As desktop/PC-based VR headsets are applications. Therefore, military
Google Cardboard VR headset to US$ permanently connected to hardware, and other defence forces present an
5000 MR-based Microsoft Hololens, they restrict the fully immersive affable avenue for developing newer
the industry has it all. A detailed look feature of VR headsets. Accordingly, applications. Imagine a situation where
would further highlight that these organisations have begun to launch soldiers can train under a digital sand
headsets are currently being used for standalone VR headsets with in-built modelling environment, and develop
various applications by individuals and rechargeable batteries and a storage skills related to unknown terrain and
enterprises alike. capacity capable of providing a circumstances to apply in real-world
complete VR environment without being scenarios. This can potentially reduce
Mobile-based VR headsets connected to a PC. HTC’s Vive Focus the time to train and help reduce costs
The likes of Google Cardboard and and Oculus Go are trying to cater to this for mobilising training programmes
Samsung Gear VR headset allow users to market. These headsets allow defence for soldiers.
immerse themselves in a virtual world personnel to immerse themselves in alien
and totally cut-off from their real-world environments, such as jungles and desert The applications range from the
surroundings. All that is required is a missions, and allow for interactions education and retail sectors to the
smartphone with a 3D-immersive video similar to real-world scenarios. With medical and of course defence sector.
or app. These technologies are agnostic advanced VR haptic feedback suits and These sectors are currently using one or
to the smartphone’s model and operating gloves, multiple units of soldiers can feel the other form of digital reality to develop
system. They are highly useful in the the effects of combats and at the same an immersive experience for users.
education sector, where the need is time conduct multiple sessions to iron
to educate and introduce concepts to out the details that otherwise would be
students without having to interact with too costly to undertake.
video content.
AR headsets
Desktop/PC-based VR headsets AR headsets have the ability to run
A VR environment built on 3D models content in the heads-up display of the
allows users to engage and manipulate soldier without him/her needing to
the environment they are in. Providing lose focus and look for coordinates or
an immersive experience requires a other information. This application has
longer time to develop apps and high-end a long-standing use in the Air Force,
hardware to support them. These apps where pilots view the heading and other
are best suited for military grade training flight information superimposed onto
and simulations where soldiers train to their visor. Organisations such as Vuzix
know more about either a weapon or its and Meta-2 are working in this domain
functioning and operations in the real to provide the requisite hardware to
world. This market is primarily led by support AR applications.
23Virtual, augmented, and mixed reality for defence and the public sector 24
Virtual, augmented, and mixed reality for defence and the public sector
Potential barriers to adoption
in defence applications
Defence agencies, in particular, have that can mean integrating with a compared with traditional training, the
been using a combination of digital multitude of legacy systems. Getting costs of implementing such a solution
reality technologies to train soldiers legacy platforms and applications to may rest with a training department
and medical professionals across the communicate with each other is already while benefits may accrue to an
world. However, the experiences of challenging. The addition of digital operational department.
early adopters in government appear reality intensifies this challenge.
to point to some key challenges for Overcoming challenges to create a
•• Conflicting requirements: For
agencies. In particular, these initial digital reality for defence
emerging technologies such as AR and
explorations have highlighted four Overcoming the potential barriers could
VR, achieving buy-in from stakeholders
primary considerations for government be key for defence to successfully tap into
can be a challenge. The reasons can
organisations adopting digital reality: digital reality technologies, and increase
range from lack of understanding of
a) cybersecurity and privacy, b) legacy productivity and efficiency of operations.
the benefits to conflicting priorities.
systems, c) conflicting requirements, and
A survey of the US Department of
d) financial sustainability. Cybersecurity: Balance security
Defence personnel on virtual training
with cost
•• Cybersecurity and privacy: Digital ranks lack of understanding as the
Cloud solutions can help address the
reality can lead to privacy challenges in second biggest barrier to the adoption
trade-off between data security and
how technologies interact with users. of virtual training.12 Stakeholders
cost of data privacy. From hardware to
The digital reality technologies assess may misunderstand the technology’s
user-identity verification, the most critical
humans’ reactions to new experiences functions. However, disagreement can
aspect is the large volumes of data that
(e.g., eye movement) to generate data also come from misunderstanding
needs to be stored and processed on
points for system improvement. This the operational goals of digital
servers. Hence, cloud solutions can help
data needs effective controls to protect reality projects.
mitigate this challenge. However, some
soldiers’ privacy. Balancing these
•• Financial sustainability: The ultimate organisations also prefer an alternative
cybersecurity and privacy concerns
issue that can sink efforts to update “on-premises” solution, which is a
against costs is often the underlying
government technology solutions is the hardened local solution that stays within
driver in decisions on where and how to
challenge of ensuring consistent project the organisation’s firewalls and never
host digital reality solutions.
funding, from start-up costs to ongoing traverse the larger net to connect to a
•• Legacy systems: Digital reality can operations. Once implemented, cloud server. Organisations may want
help defence agencies process large digital reality technologies can often to assess their operational needs, risk
amounts of data through intuitive, save money, although difficulties profiles, and cybersecurity strategies, to
interactive experiences. However, in budgeting can cause even the determine whether cloud or on-premises
processing such data typically means best use cases to go unfunded. For installations will be the way forward.
being integrated with other types example, while VR training can often
of software. In the defence sector save money or improve outcomes
25Virtual, augmented, and mixed reality for defence and the public sector
Legacy systems: Modernise with the shareable, and usable compared with
help of API-based architecture direct integration with legacy systems.
Application programming interfaces Using API-based solutions, systems can
(APIs) provide an answer to extracting be upgraded and integrated to enable
key data across legacy systems. API- digital reality applications for defence.
based systems are a more discoverable,
Figure 7: Deloitte Centre for Government Insights
There are barriers to adopting digital reality; there are also solutions for overcoming these barriers
Cybersecurity Legacy Conflicting Financial
and privacy systems requirements sustainability
Solution: Solution: Solution: Solution:
Balance security with costs Modernise systems using Run a pilot programme Try small-scale projects
API-based architecture to get buy-in from supported by strong
stakeholders leadership, and track
expected ROI
Source: Deloitte Centre for Government Insights
Conflicting requirements: Run a pilot Financial sustainability: Run small-
programme to get stakeholders’ buy-in scale projects supported by strong
Pilot programmes can help organisations leaders and track the expected ROI
achieve their goals and demonstrate Digital reality solutions require consistent
the value digital reality adds. A carefully project funding but can drive real
developed pilot programme (with a returns, through improved workforce
clear goal) under the supervision of a performance delivered on a reduced
project champion, can address system overall training budget. Hence, it is
integration and user acceptance important to start small, scale-fast, and
challenges that will enable digital reality rigorously track programme metrics,
to succeed.13 Organisations should begin including a relevant ROI metric that
by finding a high-value use case, starting compares both costs and effects of
small, iterating to solve problems, and digital reality solutions with those of
scaling fast. traditional programmes.
26Virtual, augmented, and mixed reality for defence and the public sector
27Virtual, augmented, and mixed reality for defence and the public sector 28
Virtual, augmented, and mixed reality for defence and the public sector
Flying high in a digital sky
Various applications for digital reality are newer surroundings, and c) understand Organisations that have undergone the
generating a lot of interest in different the environment they might experience processes of identifying and developing
spheres of the industry. Established during real-world missions. digital reality-enabled use cases propose
organisations and start-ups alike are adopting a sprint-based approach to
looking for ways to address different The second part of the above-mentioned encourage the constant flow of new
challenges that the industry faces. The training is highly crucial in addressing solutions. Typically, they first identify
digital reality field has seen strong post-war trauma that is afflicting war the opportunity and then conduct a
growth in the past five years. This trend veterans. Studies are being conducted to proof-of-concept before scaling up
is expected to continue, driven by the ascertain the benefits of deploying digital the solution to a wider deployment.
development of newer use cases for reality in this space. Similarly, another Keeping end-users involved and making
organisations. An area of development area that defence establishments can incremental changes remain paramount
is medical training that can significantly explore is telemedicine where MR for a successful delivery.
improve a) response times, b) efficiency applications assist medical professionals
of response, and c) effectiveness of in real-world scenarios using remote The scope of development of such
response for both medical professionals collaborations. This significantly reduces threads is quite huge. With a continued
and patients. response time to undertake critical focus and investment by different
medical procedures, thus saving lives. stakeholders, some of these might see
Military training sessions are expensive light of the day soon, thus saving time,
and time consuming, and require specific A third important area that can be money, and human lives.
grounds for soldiers to familiarise explored is the field of developing
themselves on what is in store for them applications by combining AI, Industry
in a mission. Furthermore, the militarised 4.0, and digital reality. Inside a critical
world has a long history of war veterans facility, such as a vessel carrier or
who failed to adjust back into normal submarine, monitoring the performance
life in a post-war scenario. At present, of different equipment and taking
digital reality can help solve both these necessary actions is critical. These
dilemmas by developing applications technologies can be used together to
that can a) familiarise soldiers to expect raise alerts to the right personnel in the
wartime scenarios, b) learn from the right areas to take corrective actions in
past and gain insights on how to adapt to case of equipment malfunction.
29Virtual, augmented, and mixed reality for defence and the public sector About Deloitte All the facts and figures that talk to our size underpin all that we do. Deloitte Globally and diversity and years of experiences, as has grown in scale and diversity—more notable and important as they may be, are than 286,000 people in 150 countries, secondary to the truest measure of providing multidisciplinary services yet our Deloitte: the impact we make in the world. shared culture remains the same. So, when people ask, “what’s different about Deloitte?” the answer resides in the ©2019 Deloitte Touché Tohmatsu India LLP many specific examples of where we have helped Deloitte member firm clients, our Deloitte Touche Tohmatsu India LLP people, and sections of society to achieve 7th Floor, Building 10, Tower B, remarkable goals, solve complex problems DLF Cyber City Complex, DLF Phase II, or make meaningful progress. Deeper still, Gurgaon, Haryana 122002 it’s in the beliefs, behaviors and Tel: +91-124-679 2000 fundamental sense of purpose that Email: inideas-tmt@deloitte.com 30
Virtual, augmented, and mixed reality for defence and the public sector
About PHD Chamber of
Commerce and Industry
PHD Chamber of Commerce and and High Commissions to bring in the
Industry, a leading Industry Chamber of International Best Practices and
India, ever since its inception in 1905, has Business Opportunities.
been an active participant in the India
Growth Story through its Advocacy Role PHD Chamber has special focus on the
for the Policy Makers and Regulators of following thrust areas:
the Country. Regular interactions,
•• Economic & Business Policy Advocacy
Seminars, Conference and Conclaves
allow healthy and constructive •• Industry
discussions between the Government,
•• Infrastructure
Industry and International Agencies
bringing out the Vitals for Growth. As a •• Housing
true representative of the Industry with a
•• Health
large membership base of 1,30,000 direct
and indirect members, PHD Chamber has •• Education & Skill Development
forged ahead leveraging its legacy with
•• Agriculture & Agri-business
the Industry knowledge across sectors
(58 Industry verticals being covered •• ICT
through Expert Committees), a deep
•• International Trade
understanding of the Economy at large
and the populace at the micro level.
PHD Chamber of Commerce
and Industry
At the National level, the PHD Chamber is
PHD House, 4/2 Siri Institutional Area,
well represented in 16 States with its own
August Kranti Marg, New Delhi 110016
offices and MOUs with 11 Partner
Tel: 91-11-26863801-04, 49545454
Chambers in different States.
Fax: 91-11-26855450, 49545451
Website: www.phdcci.in
At the Global level we have been working
E-mail: phdcci@phdcci.in
with the Concerned Ministries, Embassies
31Virtual, augmented, and mixed reality for defence and the public sector
Endnotes
1
https://www.digi-capital.com/news/2019/01/for-ar-vr-2-0-to-live-ar-vr-1-0-must-die/
2
https://www.gartner.com/en/newsroom/press-releases/2018-08-20-gartner-identifies-five-emerging-technology-trends-that-will-
blur-the-lines-between-human-and-machine
3
https://www.boeing.com/features/2018/01/augmented-reality-01-18.page
4
https://www.ge.com/reports/game-augmented-reality-helping-factory-workers-become-productive/
5
https://www2.deloitte.com/insights/us/en/industry/public-sector/augmented-virtual-reality-government-services.html
6
https://www2.deloitte.com/insights/us/en/focus/signals-for-strategists/augmented-and-virtual-reality-enterprise-applications.html
7
https://www.digi-capital.com/news/2019/01/for-ar-vr-2-0-to-live-ar-vr-1-0-must-die/
8
https://www.thehindubusinessline.com/economy/violence-cost-indias-gdp-over-1-trn-on-ppp-basis/article24128123.ece"
9
https://www.usnews.com/news/best-countries/articles/2018-03-20/the-us-military-wants-to-lead-the-innovation-game-in-vr
10
https://www.researchandmarkets.com/research/qlsfbk/global_military?w=12
11
https://www2.deloitte.com/content/dam/Deloitte/dk/Documents/Grabngo/Digital%20Reality%20GrabNGo_2019_030419.pdf"
12
Government Business Council, “Going virtual to prepare for a new era of defense,” accessed July 9, 2017. View in article
13
https://www2.deloitte.com/insights/us/en/industry/public-sector/augmented-virtual-reality-government-services.
html#endnote-32
32Virtual, augmented, and mixed reality for defence and the public sector
References
Deloitte Insights, “Digital reality: The focus shifts from technology to opportunity”, 2017, https://www2.deloitte.com/insights/us/en/
focus/tech-trends/2018/immersive-technologies-digital-reality.html
Deloitte Digital, “Digital Reality changes everything”, 2019, https://www2.deloitte.com/content/dam/Deloitte/dk/Documents/
Grabngo/Digital%20Reality%20GrabNGo_2019_030419.pdf
Deloitte Insights, “The adoption of disruptive technologies in the consumer products industry”, 2019, https://www2.deloitte.com/
insights/us/en/industry/retail-distribution/potential-of-digital-reality-consumer-products.html
Deloitte Insights, “Digital reality in government”, 2018, https://www2.deloitte.com/insights/us/en/industry/public-sector/
augmented-virtual-reality-government-services.html
Deloitte Insights, “For more companies, new ways of seeing”, 2017, https://www2.deloitte.com/insights/us/en/focus/
signals-for-strategists/augmented-and-virtual-reality-enterprise-applications.html
Gartner, “Top Trends in the Gartner Hype Cycle for Emerging Technologies, 2017”, 2017, https://www.gartner.com/
smarterwithgartner/top-trends-in-the-gartner-hype-cycle-for-emerging-technologies-2017/
Tracxn.com, “Tracxn Sector Report: Augmented Reality”, 2019
33Virtual, augmented, and mixed reality for defence and the public sector
Acknowledgements
Nitin Sawant
Technology: Digital
Partner, Consulting, Deloitte India
nitinsawant@deloitte.com
Authors
Binaifer Karanjia Sudeepta Veerapaneni
Director, Consulting Senior Manager, Consulting
bikaranjia@deloitte.com sveerapaneni@deloitte.com
Saurabh Gupta Saurajit Goswami Saumya Sudhir
Manager, Consulting Manager, Consulting Analyst, Consulting
guptasaurabh@deloitte.com gsaurajit@@deloitte.com sasudhir@deloitte.com
Partnership Coordinators
Deloitte PHDCCI
Mohan Doifode Dr. Jatinder Singh
Technology: Digital Director, PHD Chamber
Director, Consulting, Deloitte India jatinder@phdcci.in
mdoifode@deloitte.com
Punit Chaudhry
Joint Secretary
punit@phdcci.in
34Deloitte refers to one or more of Deloitte Touche Tohmatsu Limited, a UK private company limited by guarantee (“DTTL”), its network of member firms, and their related entities. DTTL and each of its member firms are legally separate and independent entities. DTTL (also referred to as “Deloitte Global”) does not provide services to clients. Please see www.deloitte.com/about for a more detailed description of DTTL and its member firms. This material is prepared by Deloitte Touche Tohmatsu India LLP (DTTILLP). This material (including any information contained in it) is intended to provide general information on a particular subject(s) and is not an exhaustive treatment of such subject(s) or a substitute to obtaining professional services or advice. This material may contain information sourced from publicly available information or other third party sources. DTTILLP does not independently verify any such sources and is not responsible for any loss whatsoever caused due to reliance placed on information sourced from such sources. None of DTTILLP, Deloitte Touche Tohmatsu Limited, its member firms, or their related entities (collectively, the “Deloitte Network”) is, by means of this material, rendering any kind of investment, legal or other professional advice or services. You should seek specific advice of the relevant professional(s) for these kind of services. This material or information is not intended to be relied upon as the sole basis for any decision which may affect you or your business. Before making any decision or taking any action that might affect your personal finances or business, you should consult a qualified professional adviser. No entity in the Deloitte Network shall be responsible for any loss whatsoever sustained by any person or entity by reason of access to, use of or reliance on, this material. By using this material or any information contained in it, the user accepts this entire notice and terms of use. ©2019 Deloitte Touche Tohmatsu India LLP. Member of Deloitte Touche Tohmatsu Limited
You can also read
