Building the Metaverse One Standard at a Time - Neil Trevett President, Khronos Vice President Developer Ecosystems, NVIDIA - Khronos Group
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Building the Metaverse
One Standard at a Time
Neil Trevett
President, Khronos
Vice President Developer Ecosystems, NVIDIA
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 1
Topics
1. Just what do we mean by ‘the metaverse’?
2. How will it come into existence?
3. What role will standards play – and NOT play!
4. Which Khronos standards can help build the metaverse?
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 2
Microsoft Flight
Simulator GE, Siemens,
Bentley, NVIDIA
VR environments where users can
import their own authored assets Digital twins eventually encompassing the world
Roblox, Minecraft, Manticore What is
the Metaverse?
Virtual spaces where gamers create their own content
NVIDIA
Omniverse
3D application interoperability for real-time
immersive collaborative simulation and design
1992
PTC, Open AR Cloud, Niantic
Humans, as avatars, interacting with
each other and software agents, in a
Augmenting Reality with persistent geo-locking, three-dimensional space that uses the
linking, occlusion and realistic scene illumination metaphor of the real world
Fortnight, PUBG, Valheim
OGC, Cesium
Discussions on connecting ecosystems with interoperable
Spatially indexing and streaming the digitized world A spatial evolution of the Web runtimes and economies for portable assets and avatars
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 3
How Will the Metaverse Evolve?
Evolution will be organic
Darwinian mix of ideas, innovations,
commercial successes and failures
Overlapping, messy, synergistic,
awesome experimentation
Not as a single platform
No one design or roadmap can serve all
needs and solve all problems …
Synthetic visual reality, practical XR optics,
effective remote social interactions, server scaling Proven solutions
to millions of users, online personas and social
connections, realistic avatars, security, privacy,
will emerge and be
sharable assets, interoperable run-times, online widely adopted
economies and currencies, real-world XR geo-
anchoring with persistence, universal digital twins,
Providing the foundation for
IOT sensor networks, pervasive low-latency the next round of innovation
wireless connectivity, pervasive 3D commerce,
real-time environment scanning and semantic
understanding… and many more …
Significant opportunities for all companies
contributing to metaverse solutions!
What role can Open Standards
play in this process?
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 4
What is an Open Standard?
INTEROPERABILITY standards define precise COMMUNICATION
Through a specification that enables multiple conformant implementations
E.g., Software Hardware Communication through an
Application Programming Interface (API)
Growing Markets Reducing Costs
By reducing consumer confusion and increasing By sharing development between many
capabilities and usability companies and driving volume
Successful Open Standards Share Core Goals
Speeding Time to Market Enabling Innovation
With well-proven functionality, testing Companies compete on implementation
and interoperability quality, performance, power etc. etc.
True OPEN standards are not controlled by any single company
Standards Developing Organizations (SDOs) enable industry cooperation
Inclusive participation, well-defined governance and intellectual property frameworks
Stronger industry consensus and participation increases potential Adoption
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 5
Don’t Need Standards?
Making the metaverse
Standards are the basis for Widely adopted platforms ubiquitous will involve a
ubiquitous infrastructure require multiple standards constellation of standards!
IEC 60038 Standard voltages
IEC 60228 Conductors of insulated cables
IEC 60269 Low-voltage power fuses
IEC 60320 C13 Connectors and C14 Inlets
IEC 60884 Household Plugs And Socket-Outlets
IEC 61970 APIs for energy management systems
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 6
Proprietary Technology and Open Standards
Technology becomes Proven
Business interests are better served
by cooperation than competition
Areas of Emerging Consensus
Beachhead standardization opportunities
Proprietary Products Multi-company Governance
and Technologies Complex and Open Standards
Rapid Innovation Interdependent Do not R&D!!
Darwinian testing ground Satisfy wider need for technologies
Smart Innovators can retain Relationship Thread of continuity for
long-term advantage industry forward progress
Standards Move the Industry Forward
Frees competitive energy to find new ways
to innovate value
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 7
Open Standards and Open Source
Not the same thing! Both are powerful tools in the right situation
Choose the right tool to make best forward progress
Often positive synergy between the two e.g.,
Open-source sample implementations of open standards
Tools, samples, conformance tests for open standards in open source
Contributor
Open Standard =
Contributor Contributor
Shared Specification
Contributor Contributor
Implementation Implementation
Implementation Implementation Open Source =
Implementation Shared Implementation
Best When … Best When …
Competitive advantage in implementation innovation No competitive advantage in implementation
Industry needs multiple implementations Industry consensus to share implementation resourcing
Need a stable design target Need rapid updates
But.. But..
Can take time to generate consensus on a new version Can fork and fragment
Conformance testing is vital Need governance model clarity
Many open-source projects have concentrated control – not multi-company governance
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 8
Khronos Standards as Metaverse Components
Pervasive, universal 3D assets
Enabling reliable deployment of 3D
in e-commerce at industrial scale
Vision and sensor processing
Accelerated machine
learning and inferencing
High-performance,
low-latency 3D Graphics
Portable interaction with
VR/AR sensor, haptic and
display devices
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 9
XR Portability
XR App/ XR App/ XR App/ Virtual Reality
Experience Experience Experience
V
Game
WebXR
Engine A
Augmented Reality
Application Interface
And
More!
OpenXR provides cross-platform, high-performance access
directly into XR device runtimes across multiple platforms
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 10Advanced UI Cross-Vendor OpenXR Extensions
Developers can build cross-platform applications that use
advanced UI solutions from different technology vendors
OpenXR API layers can be used implement extensions
Hand Tracking Eye Tracking
26 unique joints per hand for fully Eye gaze interaction for intuitive interfaces
articulated hands visible to the user 2-Step Interaction
Shipping on HoloLens 2 Hand-eye coordination
and Microsoft Hand Mesh Extension Natural aiming
for HoloLens 2 layers over it
Shipping on HoloLens 2
Ultraleap developer preview available
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 11OpenXR Widespread Industry Adoption
Conformant Implementations
Microsoft HoloLens 2 Oculus Rift S
HTC Vive Cosmos
Windows Mixed Reality Headsets Quest and Quest 2
Developer Preview Implementations
Valve SteamVR Varjo Collabora
Transitioning from OpenVR to OpenXR Preliminary support shipping now Open-source Implementation
Engine Support
Unreal Engine Unity Engine Chromium 81 for Chrome and Edge Browsers
Support in 4.24. Optimizations in 4.25 OpenXR Plugin Preview in 2020.2+ OpenXR default backend for WebXR
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 12The Web Will be Part of the Metaverse
https://xkcd.com/1367/
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 13Bringing XR to the Web
Native XR Apps Web XR Apps
Lifting OpenXR
functionality into
the Web stack
Native 3D Web 3D
Engines Close cooperation Engines
between WebXR
and OpenXR
Khronos provides the
foundation for native
and Web-based 3D/XR
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 14glTF – The JPEG of 3D!
glTF spec development
Audio Video Images 3D on open GitHub – get involved!
https://github.com/KhronosGroup/glTF
MP3 H.264 JPEG
New market opportunities
for 3D content creation
and deployment!
Compact to Transmit
Simple and Fast to Load
Describes Full Scenes
Runtime Neutral
Open and Extensible
glTF 2.0 – June 2017
Efficient, reliable glTF 1.0 – December 2015 Native AND Web APIs
transmission Primarily for WebGL Physically Based Rendering
Bring 3D assets into 100s of Uses GLSL for materials Metallic-Roughness and Specular-Glossiness
apps and engines
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 15https://github.khronos.org/glTF-Project-Explorer/ This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 16
glTF Universal GPU Textures & PBR Roadmap
Future Waves of
glTF PBR glTF PBR Extensions
Extensions Subsurface Scattering,
Attenuation,
December 2020 Index of Refraction (IOR),
Transmission Thickness, Specular Color,
Clearcoat Anisotropy, Translucency,
Sheen Thin Film (iridescence)
and more…
KTX 2.0 textures support
Basis Universal supercompression
20th April 2021
glTF assets with compact, high-quality textures
that can be efficiently converted to GPU
compressed textures on-the-fly on diverse
target platforms to reduce both asset file
download sizes AND GPU memory usage
https://www.khronos.org/ktx/
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 17Using Open Standards to Build the Metaverse
• Seek friction points in your industry caused by lack of agreed communication protocols
- Between people, companies, products, subsystems, components
- Is the potential solution to better communication well understood?
• Find or create a safe space for industry cooperation to define interoperability standards
- With well defined, consensus-based governance model and effective IP framework
- Standardize when the need is wide – not when doing R&D
• Neil Trevett
- ntrevett@nvidia.com | @neilt3d
Gain early insights Influence the design and direction Accelerate your time-to-
into industry trends of key open standards that will market with early access to
and directions drive your business specification drafts
Gather industry Draft Specifications Publicly Release
requirements for future Confidential to Khronos Specifications and
open standards members Conformance Tests
Network with domain experts State-of-the-art IP Framework Enhance your company reputation
from diverse companies in your protects your Intellectual as an industry leader through
industry Property Khronos participation
Benefits of Khronos membership www.khronos.org
This work is licensed under a Creative Commons Attribution 4.0 International License © The Khronos® Group Inc. 2021 - Page 18You can also read
