FUSING BLOCKCHAIN AND AI WITH METAVERSE: A SURVEY - arXiv
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
F USING B LOCKCHAIN AND AI WITH M ETAVERSE : A S URVEY ∗
Qinglin Yang Yetong Zhao, Huawei Huang * , Zibin Zheng
School of Intelligent Systems Engineering School of Computer Science and Engineering,
Sun Yat-sen University, Shenzhen Sun Yat-sen University, Guangzhou
arXiv:2201.03201v3 [cs.CY] 12 Jan 2022
yangqlin6@mail.sysu.edu.cn huanghw28@mail.sysu.edu.cn
A BSTRACT
Metaverse as the latest buzzword has attracted great attention from both industry and academia.
Metaverse seamlessly integrates the real world with the virtual world and allows avatars to carry
out rich activities including creation, display, entertainment, social networking, and trading. Thus,
it is promising to build an exciting digital world and to transform a better physical world through
the exploration of the metaverse. In this survey, we dive into the metaverse by discussing how
Blockchain and Artificial Intelligence (AI) fuse with it through investigating the state-of-the-art
studies across the metaverse components, digital currencies, AI applications in virtual world, and
blockchain-empowered technologies. Further exploitation and interdisciplinary research on the fusion
of AI and Blockchain towards metaverse will definitely require collaboration from both academia
and industries. We wish to see that our survey can help researchers, engineers, and educators build an
open, fair, and rational future metaverse.
Keywords Metaverse, Blockchain, Artificial Intelligence, Economy System, Digital Currency
1 Introduction Currently, researchers cannot accurately judge the shape
and boundary of the future metaverse. They could only
The concept of metaverse was proposed almost 30 years envision some of its possible characteristics, such as open
ago in the science fiction named Snow Crash, written by space, decentralization, human-computer interaction ex-
Neal Stephenson [1]. Metaverse has been one of the hottest perience, digital assets, and digital economy. The avatars
buzzwords to attract the tech industry’s attention due to of human player, their creations and consumption in meta-
the breakthroughs of Blockchain, Internet of Things (IoT), verse truly affect the physical world and even change the
Network, Artificial Intelligence (AI), and etc. The Sandbox behaviors of people in the physical world, through the
game platform Rolbox is the company that firstly incorpo- influence of people’s thoughts (e.g., choosing the entertain-
rates the term ‘metaverse’ into their prospectus and pro- ment method). This change has a profound social signifi-
poses the key characteristics (e.g., identity, friends, immer- cance [8, 9], and thus forms the life-style of post-human
sive experience, low friction, civility, economy, anywhere, society while reconstructing the digital economic system.
variety) of metaverse. The social company, Facebook, is re- Metaverse can be viewed as a complete and self-consistent
named as Meta [2] to help bring metaverse to life and make economic system, a complete chain of the production and
people meet each other, learn, collaborate and play in ways consumption of digital items. The economy of metaverse
that go beyond what they can imagine. The video game refers to the digital production-based economic behaviors,
Fortnite that is released by Epic games puts the players e.g., creation, exchange, and consumption in the digital
into a virtual world, such as a post-apocalyptic, zombie- world, is the fundamental components of the digital econ-
infested world, experiencing new levels of photorealistic omy. The development of the economic system can be
interaction [3, 4, 5, 6] and watching virtual concert [7]. regarded as one of the most challenging tasks of meta-
Metaverse seamlessly integrates the physical world with verse. This is because the production and consumption of
the virtual world and allows avatars to carry out rich activi- digital assets that can be traded in the virtual world is a phe-
ties including creation, display, entertainment, social, and nomenon that traditional economists have not encountered
trading. [10]. Moreover, in a public, fair, and self-organized virtual
world, the centralized economic system of the physical
world cannot operate efficiently due to the high transac-
Huawei Huang is the corresponding author.
Q. Yang, Y. Zhao, H. Huang et al
Figure 1: The fusion of AI and Blockchain with metaverse. Animated picture is from https://store.steampower
ed.com/app/1313290/Let_Them_Trade/
tion volumes involved. Therefore, the economic system Jiang et al. [17] introduce a kind of collaborative comput-
of metaverse must be constructed in a decentralized man- ing paradigm based on Coded Distributed Computing to
ner such that the virtual assets of avatars could be traded support the computation requirement of metaverse services
efficiently in metaverse. [18]. The up-to-date survey [8] mainly reviews the state-of-
the-art technologies as enablers to implement metaverse,
Blockchain as a decentralized ledger without a central-
such as high-speed networks (e.g., 5G) and edge comput-
ized authority has drawn enormous attention in diverse
ing, Blockchain, and AI. The authors’ findings demon-
application fields in recent years. Blockchain is highly
strate the gap between the up-to-date technologies and
expected to bring a variety of opportunities to metaverse,
the demands of implementing metaverse. The other sur-
and to trigger a new round of technological innovation
vey [19] focuses on metaverse analytics, the search traffic,
and industrial transformation. On the other hand, recent
news frequency, and the topic with respect to the sustain-
advances in AI have brought promising solutions to over-
able growth. Duan et al. [20] highlight the representative
coming the challenges of metaverse’s development, such
applications for social goods and propose a three-layer
as big data analytics, AI-empowered content generation,
metaverse architecture from a macro perspective, which
and intelligence deployment. Consequently, the integration
contains infrastructure, interaction, and ecosystem. In con-
of AI and metaverse technologies becomes a promising
trast, our survey discusses how to fuse blockchian and AI
trend to promote the benign evolution of the blockchain/AI-
technologies with metaverse. As depicted in Fig. 1, AI
empowered metaverse ecosystem. Although the advent of
technologies are applied into the digital creation and digi-
blockchain and AI has spawned a large number of new
tal market. Meanwhile, blockchain can guarantee digital
technologies and applications, the fusion of blockchain
assets, digital currencies, and the digital market. In this
and AI with metaverse also poses several emerging re-
survey, we emphasize the fusion of AI and blockchain tech-
search challenges. For example, transaction volumes in
nologies to establish an intelligent, open, fair, promising
metaverse system are much higher than those in the physi-
future metaverse.
cal world due to the features of digital products and mar-
kets. Blockchain-based Non-Fungible Tokens (NFT) en- The contributions of the paper include the following three
able avatars to generate the content that can be traded with points.
their digital certificates [11, 12].
We then review several representative survey articles here, • We first present the preliminaries of the economic
to highlight the difference of our survey. Lim et al. [13] system in metaverse.
focus on the network demands [14] of metaverse from the
perspective of edge intelligence [15] since metaverse is • We then discuss how blockchain and AI technolo-
viewed as ‘the successor to the mobile Internet’. Du et gies fuse with metaverse, and review the state-of-
al. [16] propose a privacy-preserving targeted advertising the-art studies.
strategy for the wireless edge metaverse to enable meta-
verse service providers to allocate network bandwidth to • Finally, we envision typical challenges and open
users so that the users can access metaverse from edge sites. issues to shape the future metaverse in the next
decades.
2
Q. Yang, Y. Zhao, H. Huang et al
The rest of this paper is organized as follows. Section 2 encryption algorithms can capitalize on data, and
mainly describes the characteristic of the ecosystem of consensus mechanisms help people verify and
metaverse by comparing it with the conventional economy. confirm transactions.
Section 3 discusses the artificial intelligence technologies • Digital Market is the fundamental place in
and the challenges of applications in metaverse. In Section which avatars can trade to have income like in
4, the fundamental Blockchain technologies and applica- the physical world. The mature market of meta-
tions are introduced in metaverse by comparing with the verse that should ensure the creation of products
current breakthroughs. Section 5 mainly discusses the and real trade completed in metaverse must be dif-
challenges and open issues of shaping the future metaverse. ferent from the existing digital market. Bourlakis
Finally, Section 6 concludes this paper. et al. [25] examine the evolution of retailing,
i.e., from traditional to electronic to metaverse
2 Preliminaries of Economic System in retailing, and sheds light on the ways metaverse
influence that evolution. Cliff et al. [26] mainly
Metaverse discuss the research that applies computational in-
telligence, i.e., the methods from AI and machine
The economy is the fundamental component of metaverse. learning to automatically discover, implement,
From the more idealistic perspective, metaverse should be and fine-tune strategies for adaptive automated-
interoperable such that users can trade virtual items like trading in financial markets. Decentraland mar-
clothes or cars from one platform to another. Firstly, as ketplace [27] allows users to trade all their De-
depicted in Fig. 2, we shall describe metaverse economic centraland on-chain assets like what they could
system according to the mainstream games and existing behave in the physical world.
research works. Metaverse economic system is composed
of four parts: digital creation, digital asset, digital mar- • Digital Currency is the media in metaverse with
ket, and digital currency, whose exploitation will lead the which the avatars can finish the trade and ex-
transformation of the conventional economy. change. While in metaverse, fiat currency cannot
satisfy the demands of the development of meta-
• Digital Creation is the foundation of metaverse. verse due to the high cost of the legal currency
The creation progress is similar to the material system. In addition, fiat currency is converted
production in the physical world. The develop- from physical currency (e.g., gold, silver) that
ment of the economy of metaverse is decided by is different from the digital-based currency of
the number of creators. Thus, the digital creation metaverse. Roblox enables players to buy vari-
activities urgently need a basic authoring tool that ous items by purchase with real currency, from
can make the creation easily and personalized a recurring stipend given to members with the
[21, 22]. The Decentraland [23] is a game plat- premium membership, or from other players by
form that provides two kinds of authoring tools producing and selling virtual content in Roblox
for creating interactive Decentraland applications, [28]. The Diem payment system [29] supports
i.e., the Builder and the Decentraland SDK. Play- single-currency stablecoins (e.g., USD, EUR, and
ers can execute a simple drag and drop editor by GBP) and a multi-currency coin (XDX). We shall
the Builder without coding required, while the talk about the fusion of blockchain in metaverse
Decentraland SDK enables players to have suffi- in section 4.
cient freedom to create their applications. Lee et
al. [24] summarize the research works on com- As demonstrated in The Wealth of Nations, the traditional
putational arts that are relevant to metaverse, de- economics in real world are based on some basic premises
scribing novel art works (e.g., immersive arts, such as the scarcity of resources, and selfish individuals
robotic arts.) in blended virtual-physical realities. [30]. In contrast, the individuals in metaverse are self-
less and illogical. These individuals prefer to emphasize
• Digital Asset has the hidden property, which is their personal feeling such as happiness and the sense of
the precondition of trade. For instance, in the FPS accomplishment. This is because there is no farming so-
game Counter-Strike: Global Offensive, players ciety and industrial society experienced by human beings,
can equip their weapons with all kinds of ‘skins’ and no traditional industrial structure in the virtual world.
that shows the asset attributes the ‘skins’ since In metaverse, the conceptual economy will be the basic
the ‘skins’ can be exchanged, traded, or bought at form of economic activities. The natural form of financial
the platforms (e.g., BUFF, Steam). While these currency can no longer be precious metals, but the virtual
trade platforms need to make the users’ accounts social currency. Hence, the difference between the econ-
known to the public, which might incur privacy omy of metaverse and the conventional economy can be
issues since there is no reliable mechanism to summarised as following:
guarantee the digital asset and platform. Hence,
people’s confirmation of digital assets is insepara- • In metaverse, identity determines value instead of
ble from the value provided by the blockchain and the undifferentiated labor in conventional econ-
the encryption system of the blockchain. Because omy.
3
Q. Yang, Y. Zhao, H. Huang et al
following object function:
X
max 0, 1 − yi ω T xi + b ] +λkωk22 . (1)
L(ω) =
i=1
| {z } | {z }
Loss function regularization
where ω denotes a weight vector, b denotes the threshold,
and λ denotes a Lagrangian factor that determines the
trade-off between margin maximization and regularization
in the loss function. However, machine learning algorithms
usually require to select features manually, which limits
its wide applications since a large amount labeled data are
Figure 2: Conventional economy and metaverse economy. needed.
icons are from https://www.flaticon.com/ The convolutional neural networks (CNNs, or ConvNets
(Fig. 3(b))) is a kind of representative deep neural network
inspired by biological neural network. The normal CNNs is
• The marginal benefits will increase in metaverse based on the shared-weight architecture of the convolution
instead of diminishing marginal benefits of pro- kernels or filters that slide along input features and provide
duction in the physical world. translation equivariant responses known as feature maps.
CNNs are always composed of convolution layers, pooling
• The marginal costs of products will decrease, layers and fully connected layers [36]. The great amount
comparing with the physical world. of reduction in CNN was achieved by a technique called
• Transaction costs in metaverse tend to zero, which weight sharing between neurons. Given an image X ∈
will incur frequent transactions. RM ×N and a filter W ∈ Rm×n , where mQ. Yang, Y. Zhao, H. Huang et al
(a) Support-Vector Machine (b) Convolutional Neural Network (c) Reinforcement Learning
Figure 3: Illustration of artificial intelligence technologies
DRL algorithms can be applied to achieve over-human with objects, which provides large-scale diversified indoor
performance in some fields [40]. In next section, we shall and outdoor scenes. Augmented reality (AR) devices could
argue the works on AI technologies that are related to provide people with immersive and interactive experiences
metaverse when it comes to the establishment of metaverse while their applications are latency-sensitive. Hence, in
environment and object creation in metaverse. the work [48], Chen et al. exploit to address solve the
computation efficiency, low-latency objects recognition,
3.2 Establishment of Metaverse Environment and classification issues of AR applications by integrating
mobile edge computing paradigm with federated learning.
Not only metaverse users, but the objects or things in the A city DT system depends on long-term and high quality
physical world also interact with metaverse, evolving over data to bring to perfection. Pang et al. [59] propose a
time to persistently represent the structure, behaviors, and federated learning-based DT framework to enable multiple
context of a unique physical asset (such as a component, city DTs to share the local strategy and status quickly
a human, or a process) [41] in the virtual world. With the with accumulating the insights from multiple data sources
breakthroughs of digital transformation, the latest trend in efficiently, and enhance privacy protection settings.
every industry is to build digital twins with the ultimate Lee et al. [60] demonstrate a serious game for self-training
goal of using them throughout the whole asset life-cycle us- fire evacuation drills, in which the avatar is synchronized
ing real-time data [42]. Digital twins are instrumental not with multiple trainees and can be placed in different remote
only during the conceptualization, prototyping, testing, and physical locations with the option of real-time supervision.
design optimization phase but also during the operational The proposed system architecture includes a wearable mo-
phase. Virtual world of metaverse generates a huge amount, tion sensor and a head-mounted display to synchronize
variety, and velocity of data, such as structured data, un- each user’s expected motion with her/his avatar activity in
structured data, which makes deep learning-based digital the cyberspace in metaverse environment which provides
twin (DT) essential [43]. It can provide a better understand- an immersive and inexpensive environment for the easy-
ing of the underlying mechanics to all the stakeholders by to-use user interface of a fire evacuation training system
the fusion of the virtual world with data sciences [44]. Ham based on network experience. The model [50] explicitly
et al. [45] propose a new participatory-sensing-to-digital deals with occluded body parts by hallucinating plausible
twin city framework for community functioning in cities. solutions of not visible joint. Fabbri et al. propose a new
The work fuses crowdsourced and unstructured visual data- end-to-end architecture that is a three-branch multi-stage
based reality information with a three-dimensional (3D) CNN with four branches (visible heat-maps, occluded heat-
virtual city to update the 3D city model that is fed into a maps, part affinity fields, and temporal affinity fields) fed
computer-aided virtual environment (CAVE) for interact- by a time linker feature extractor.
ing and immersive visualization. To address the challenge
of processing unstructured point clouds, epitomized by To overcome the lack of surveillance data with tracking,
high cost, movable objects, limited object classes, and body part, and occlusion annotations they created the
high information inadequacy/redundancy. Xue et al. [46] vastest Computer Graphics dataset for people tracking
present a novel unsupervised method, called Clustering Ofin urban scenarios by exploiting a photorealistic video
Symmetric Cross-sections of Objects (COSCO), to pro- game. During the initial stage of metaverse, it still requires
cess urban LiDAR point clouds to a hierarchy of objects technological companies or countries to collaboratively
based on their characteristic cross-sections. COSCO fol- establish the AI-based infrastructure when it comes to the
lows the Gestalt design principles, including proximity, computational capacities, data, technologies, etc. While
connectivity, symmetry, and similarity. scattered ownership of data is another barrier since com-
panies often don’t want to share commercially sensitive
Lai et al. [47] propose a novel virtual environment for information, nor do countries [61]. To address this issue,
visual deep learning since the existing works remain the federated learning (FL) has emerged as a kind of collabo-
drawbacks, such as small scenes or limited interactions
5Q. Yang, Y. Zhao, H. Huang et al
Table 1: A Summary of the Application of AI in Metaverse
Types Description Machine Leaning Models Use cases
3D computer vision [47] DRL Learning indoor navigation, action
recognition, event detection, etc.
Federated learning [48] Parameter server-based Augmented Reality Applications
Virtual
Environments To reduce the executing latency Centralized FL in mobile edge Collaborative learning
and the drawbacks of AR [48] computing
Recognizing Avatar Faces [49] Markov random field Face Recognition
Detection and track [50] three-branch multi-stage CNN Multi-People Tracking
AI-based NPCs (Fig. 3(b))
NPC training [51] RL (Fig. 3(c)) RL-DOT
OpenAI Five [52] Distributed learning framework Dota2
and LSTM
Intelligent behavior avatar [53] RL-based bayesian networks Play game tracking
AI-based Avatar graph
Learning-based interactive State-action Animate and control avatars
avatar control [54]
Human-computer interaction RL (Fig. 3(c)) Avatar moving
[55]
Virtuality-Reality The trained controller in virtual LSTM and Mixture Density Net- Robots training, Digital twin for human-
Interaction environment can be transferred work machine interaction
to the physical world [56, 57,
58]
rative learning paradigm, allowing participants to train the Chen et al. [53] propose a novel method for personal
shared model locally by transferring the training parame- intelligent behavior avatar to make the optimal strategic
ters instead of raw data. FL paradigm can protect the data decision for the user through the interactions between the
privacy and reduce the communication overhead [62], es- user and smart objects by integrating Bayesian Networks
pecially for the large-scale scenarios with large model and and reinforcement learning in the virtual environment. To
massive data. With respect to the data privacy, there have create a controllable and responsive avatar with large mo-
been many research on applying FL in medical institutions tion sets in computer games and virtual environments, Lee
[63], industries [61], banks [64], etc. et al. [54] presents a novel method of precomputing avatar
behavior from unlabeled motion data in order to animate
and control avatars at minimal runtime cost.
3.3 Object Creation in Metaverse
Meanwhile, a reinforcement learning method [55] is ap-
plied to train a virtual character to move participants to
After the descriptions of AI-based establishment of virtual a specified location. The virtual environment depicted
world, we shall argue the authoring tools in metaverse an alleyway displayed through a wide field-of-view head-
since AI-based authoring tools provide technical support tracked stereo head-mounted display. This method opens
for all systems and roles to reach or exceed the level of up the door for many such applications where the virtual
human learning. Authoring tools will greatly affect the environment adapts to the responses of the human partici-
operational efficiency and intelligence of metaverse. pants with the aim of achieving particular goals.
Apart from the above-mentioned contents, AI-driven non-
3.3.1 Avatar and Non-player Characters player characters (NPCs) are computer-operated characters
who act as enemies, partners, and support characters to
The notion ‘avatar’ can be derived from the Sanskrit word provide challenges, offer assistance, and support the sto-
and identifies the god Vishnu’s manifestations on earth. ryline. While from the game perspective, most of the
However, it was the first to be used for player representa- human-looking NPCs are not intelligent enough to interact
tions in virtual worlds [65]. Avatars are not only used in with players in certain game genres (e.g., real-time strat-
games, but also as users’ representations in e-commerce egy, some modes of first-person shooting) which requires
applications, social virtual environments, and in geograph- strong tactical decision-making abilities. Wang et al. [51]
ically separated workplace meetings [66]. propose a reinforcement learning-based domination team
6Q. Yang, Y. Zhao, H. Huang et al
for playing Unreal Tournament (UT) Domination games so that interactive narrative can feature the physical envi-
that consists of a commander NPC and several solider ronment inhabited by the player character as an ‘actor’.
NPCs. During each decision cycle in the running process, The prototype-based on the top of the Unreal Tournament
the commander NPC makes a decision of troop distribu- game engine relies on a ‘causal engine’, which essentially
tion and, according to that decision, sends action orders to bypasses the native Physics engine to generate alterna-
other soldier NPCs. Each soldier NPC tries to accomplish tive consequences to player interventions. The evaluation
its task in a goal-directed way, i.e., decomposing the final method [73] can be applied to the human-centered evalua-
ultimate task (attacking or defending a domination point) tion of AI-based games, grounded in the analysis of player
into basic actions (such as running and shooting) that are retellings of their play experiences in Civilization VI, Stel-
directly supported by UT application programming inter- laris, and two distinct versions of the research game Prom
faces (APIs). The RL agents as means of creating NPCs Week. Because it is difficult to understand through existing
that could both progressively evolve behavioral patterns evaluation methods, such as the typical narrative struc-
and adapt to the dynamic world by exploring their envi- ture that players tend to have in their minds when playing
ronment and learning optimal behaviors from interesting a specific game. The diversity of subjective experience
experiences [67, 68]. narratives that might occur in a specific game.
Berner et al. [52] develop a distributed training system Puder et al. [74] demonstrate that open distributed envi-
and tools for continual training which allowed us to train ronment can be viewed as a service market where services
OpenAI Five for 10 months. By defeating the Dota 2 [69] are freely offered and requested. Any infrastructure which
world champion (Team OG), OpenAI Five demonstrates pursues appropriate mechanisms for such an environment
that self-play reinforcement learning can achieve superhu- should contain mediator functionality (i.e., a trader) that
man performance on a difficult task. Rahmatizadeh et al. matches service demands and service offers.
[56] exploits to address the challenging problem of behav-
In the open and decentralized metaverse, deep reinforce-
ior transfer from virtual demonstration to a physical robot
ment learning is expected as a promising alternative for
through training a Long Short Term Memory (LSTM) re-
automate trading in metaverse ecosystem since DRL can
current neural network to generate trajectories. During the
enable the well trained agent to make decision automati-
training process, a Mixture Density Network (MDN) is
cally. Liu et al. [75, 76] believes that proper usages of AI
applied to calculate an error signal suitable for the multi-
will initiate a paradigm shift from the conventional trad-
modal nature of demonstrations. The learned controller
ing routine to an automated machine learning approach.
in the virtual environment can be transferred to a physical
Therefore, Liu et al. [75] propose a deep reinforcement
robot (a Rethink Robotics Baxter) and successfully per-
learning-based system to achieve efficiently automate trad-
form the manipulation tasks on a physical robot, which
ing in ecosystem, named FinRL, which can solve dynamic
motivates the avatar to create AI objects that can impact
decision making problems and build a multi-factor model.
the physical world. So do the works [57, 58] exploit the
In addition, Liu et al. [76] exploit to reduce the simulation-
interaction between the virtual environment and physical
to-reality gap and data processing burden through an open-
world by CNNs.
source library that includes hundreds of market environ-
ment for financial reinforcement learning.
3.3.2 AI-based Activities in Metaverse
In games (e.g., [4], [28], [70]), the basic characteristics of
metaverse can be perfectly explained and displayed, but 4 Blockchain in Metaverse
there is no game that fully achieves the ideal metaverse
state. We can exploit metaverse from the perspective of
game, and extend it to the fields of manufacturing, educa- Blockchain is widely believed as one of the foundamental
tion, work and so on. infrastructures of metaverse. Because blockchain bridges
isolated small sectors together and provides a stable eco-
Ando et al. [71] presents a way how to infer the observed nomic system, which helps offer transparent, open, effi-
exhibits in a metaverse museum from a movement log cient, and reliable rules for metaverse. For example, Hash
based on Second Life. To use recommendation systems in algorithms and timestamp technologies provide metaverse
metaverse museums, they need some pieces of information users the traceability and confidentiality of underlying data.
to infer which exhibits the user is visiting via perform- As illustrated in Fig. 4, the convcentional Blockchain ar-
ing this task efficiently and precisely by focusing on the chitecture includes data layer, network layer, consensus
avatar’s states in the museum. In the virtual world, it be- layer, incentive layer, contract layer, and application layer.
comes interested in forensic investigators to accurately and The correlations between those layers and metaverse are
automatically track people since the high crime rate, to explained as following.
detect the criminal in the virtual world.
Yampolskiy et al. [49] proposes a set of algorithms ca- • Data transmission and verification mechanism
pable of verification and recognition of avatar faces with provide network support for various data trans-
a high degree of accuracy. Lugrin et al. [72] propose a mission and verification of metaverse economic
method for the AI-based simulation of object behaviour system.
7Q. Yang, Y. Zhao, H. Huang et al
writing, the exchange rate of US dollar to Bitcoin hits
50000:1 (USD/BTC) recently.
Like the real word builds upon fiat currencies, the future
metaverse inevitably needs cryptocurrencies, which deliver
value during their circulation, payment and currency of set-
tlement. In detail, blockchain systems have implemented a
series of operations of cryptocurrencies, such as creation,
recording, and trading. All these fundamental operations
are necessary for metaverse.
Traditionally, Bitcoin [77] adopts UTXO (Unspent Trans-
action Outputs) transaction model to trace the usages of
this cryptocurrency, while Ethereum [78] records the bal-
Figure 4: Layered Architecture of Blockchain. ance of each account address, which can be queried di-
rectly through Ethereum dataset tools (e.g. Etherscan).
Both UTXO and Ethereum adopt Proof of Work (PoW)
• Consensus mechanisms solve the credit problem consensus. Miners mint coins by generating new blocks.
of metaverse transactions. However, there is cost for them to generate blocks. In such
PoW consensus, miners mine blocks by calculating a hash
• Distributed storage of blockchain ensures the se- puzzle, which consumes a giant amount of electricity. For
curity of virtual assets and the identities of meta- Ethereum 2.0, miners under PoS (Proof of Stake) consen-
verse users. sus mechanism mine blocks by electing, which depends
• Smart contract technology offers a trustworthy on the coin age of miners [79].
environment for all participating entities in meta- Using blockchain technologies, there are multiple ways to
verse. It realizes the value exchange in metaverse deal with cryptocurrency exchanges. The vast majority of
and ensures the transparent execution of system cryptocurrency exchanges occur in centralized exchanges
rules described in contract codes. Once deployed, such as OKEx and AOFEX. The advantages of the central-
the code of smart contracts cannot be modified ized exchanges include low-latency transactions, simple
any more. All clauses depicted in those smart interfaces and a certain level of security. However, the cen-
contracts must be completely executed. tralized exchanges also experience scandals such as price
manipulation by insiders taking advantage of information
Without the support of blockchain technology, it will be dif- asymmetries. Other cryptocurrency exchanges occur in
ficult to identify the value of the resources and goods trad- decentralized exchanges, where smart contracts or other
ing in metaverse, especially when those virtual elements peer-to-peer network execute transactions automatically
have economic interactions with the real-world economy. [80]. In some cases, the smart contracts, e.g., IDex and Pa-
Thus, it is undoubtedly worth exploring the blockchain radex, maintain continuous-limited order books offchain, a
technology in metaverse. counterparty of the order or the exchange itself performs or-
In this section, we introduce the blockchain-empowered der matching and submits order pairs to the smart contract
applications in metaverse considering four perspectives, for processing. In other cases, such as Uniswap and Ban-
i.e., Cryptocurrency, Transaction characteristics, Authen- cor, the smart contract performs as a counterparty and trade
tication, and Market & Business. with its user directly. It is easy to foresee that metaverse
built by different corporations will coexist in the near fu-
ture. Thus, various cryptocurrencies used in those smaller
4.1 Cryptocurrency for Metaverse metaverses need to be exchanged like fiat currencies using
in the physical world. We thus envision that multiple cryp-
What is the functionality of cryptocurrency in metaverse?
tocurrencies will also coexist in future metaverse. Users
How to issue and use cryptocurrency in metaverse? Fac-
of metaverse have the natural need to exchange different
ing these questions, we discuss whether the conventional
cryptocurrencies, just like the manner described above.
cryptocurrency-issuing rule is applicable to metaverse in
this subsection.
Cryptocurrency is one of the main applications under spot-
light empowered by blockchain. It also makes blockchain 4.2 Transaction Characteristics in Metaverse
more popular. The trust of a wide range of users supports
the value system of cryptocurrencies, and drives both the Metaverse is expected to have various types of financial
circulation and trading of cryptocurrencies. To date, more issues such as estate purchases, item rentals and service
than 12,000 virtual currencies have been issued world- acquisitions, which include but are not limited to almost
wide, and new virtual currencies are still being created everything people do in the physical world. Therefore,
every single day. The price of mainstream cryptocurren- transactions in metaverse are not merely related to intra-
cies keeps hitting their record highs. At the time of the metaverse scenario, and not only for token transferring.
8Q. Yang, Y. Zhao, H. Huang et al
Once a user launches a transaction on the conventional all cryptocurrencies, aiming to reduce the confirmation
blockchain, the transaction will be first broadcast to miners latency in the context of many transactions waiting to be
and be stored in their local transaction pools. The miner processed. To accelerate transaction relay in blockchain
picks up a certain number of transactions and next performs networks, Zhang et al. [85] propose a Repulay protocol
the hash-based consensus. The block generated by the first where nodes select neighbors based on a reputation mech-
miner to find an output to the puzzle that fits the specified anism and verify transactions only with certain probability.
difficulty will be uploaded to the chain and broadcast to all Overall, the proposed RepuLay also helps nodes save their
the other miners. bandwidth while guaranteeing the quality of transaction
relay.
In metaverse, it is not hard to predict that those blockchain
nodes will generate a giant volume of transactions since
metaverse has a significant number of users, who trade in 4.3 Blockchain-empowered Market in Metaverse
the virtual world every second while using various intra-
or inter-metaverse applications. As conventional, the full Blockchains prior to Ethereum, such as Bitcoin, only sup-
blockchain nodes working in metaverse need to store all port token transferring. Until the emergence of Ethereum
the historical transactions locally, which brings a great platform, smart contracts begin to support Turing-complete
burden for the full nodes. programming. Complicated businesses could be exe-
cuted in a virtual machine through smart contract codes.
Another issue associated to metaverse transactions is the
Ethereum realizes the upgrade of blockchain applica-
requirement of low confirmation latency. Internet appli-
tion from cryptocurrency to crypto-business. Various
cations that satisfy human habits often have end-to-end
blockchain reconfiguration of market and business could
latency between tens of milliseconds and hundreds of mil-
be implemented.
liseconds. Even further, metaverse applications based on
three-dimensional display and interaction require an la- Empowering by the advanced blockchain technologies,
tency within 10 milliseconds in order to avoid dizziness. decentralized finance (DeFi) is able to boost the decentral-
All those low-latency applications enforce metaverse trans- ized market and business in metaverse. We review several
actions to have low-confirmation latency. representative studies related to DeFi market and business
here. In [80], the authors analyze the behavior of arbitrage
The existing blockchain consensus protocols have several
bots in the context of cryptocurrency market. They find
constraints that prevent them from being directly applied
that arbitrage robots could observe the transactions in the
to metaverse. For instance, the PoW mechanism relies
transaction pool and perform arbitrage without risks. They
on miner’s hash power to achieve consensus on a certain
also present a cooperative strategy to maximize the profit
transaction data. Considering the huge data volume of
of arbitrage robots and point out that miners could act as
metaverse, PoW consensus will consume a large amount of
arbitrage robots under certain circumstances. However,
mining resources. The PoS mechanism, on the other hand,
the MEV (miner extractable value) could incentivize the
relies on the number and age of coins held by miner nodes
emergence of forking attacks. The authors propose a coop-
for reaching consensus towards a group of proposed trans-
erative bidding strategy for them to strive for more profit.
actions. Since the Matthew effect is more pronounced on
They also find that the current amount of MEV in a month
metaverse, the PoS mechanism cannot ensure the fairness
is more than 25× the cost of 51% attack on Ethereum.
of the miners participating in the consensus in metaverse.
Therefore, metaverse needs new consensus protocols and DeFi, based on smart contracts and Fungible Tokens (FT),
new blockchain mechanisms to meet the rigorous require- offers a new approach to innovate economic models in
ments of transactions. metaverse. Existing successful solutions, such as Uniswap
[86], a decentralized exchange (DEX) implemented on
We then review some state-of-the-art studies to find some
Ethereum, automatically provides users with liquidity for
clues to address the transaction issues aforementioned. In
their tokens. DEXs is a new kind of marketplace that
[81], the authors merge blockchain with IIoT architecture
can offer secure peer-to-peer exchange of crypto asset to-
and propose a hierarchical storage structure where his-
kens for trading [87]. Because the core of a DEX, named
torical information is stored on the cloud and the latest
atomic swap, enables two parties to exchange tokens or
block is stored on IIoT devices. The new architecture
crypto-assets without involving an intermediary party. Cy-
could offer immutable and verifiable services. To reduce
bex [88] as a DEXs-based DApp, provides a peer-to-peer
the cost of block validation during forwarding, Frauen-
marketplace for tokens to be exchanged. Cybex also is-
thaler et al. [82] propose to validate the block header only
sues its own token called CYB. It is worth noting that
when needed, making interoperation between Ethereum-
CYB is only allowed to use in the Cybex market when
based blockchains feasible. Yang et al. [83] change the
paying for the exchange of new tokens, staking to borrow
traditional linear structure of blockchains using Directed
crypto asset tokens, and paying transaction fees, etc. The
Acyclic Graph (DAG) structure where blocks are organized
Diem Blockchain [29] is the technological backbone of
into a compacted DAG structure. This new structure can
the payment system, operated by a network of validator
improve the security and decrease the transaction verifi-
nodes. The software that implements the blockchain is
cation time. Aumayr et al. [84] present a virtual channel
open-sourced so that anyone can build upon it and scale
protocol based on UTXO that is compatible with almost
their financial needs.
9Q. Yang, Y. Zhao, H. Huang et al
4.4 Blockchain-empowered Authentication in between metaverse and the physical world still remains an
Metaverse open issue.
Currently, the main economic activities in metaverse In addition, the transaction volume and frequency occurred
mainly include the auction of virtual assets, including land, in metaverse will become extremely much higher than that
scarce items, precious real estate, the development and happened in physically world. Thus, how to support such
leasing of land, the rewards of game tasks, and the profits high-volume and high-frequency transactions remains a
from investing cryptocurrency. Thus, metaverse invokes a challenging problem in future metaverse. Another issue
new form of funding that draws inspiration from both the related to future metaverse might be the inflation caused
real and virtual world. by massive cryptocurrency supplements in a decentralized
economy system built upon blockchain and AI technolo-
NFT has been mainly used to commemorate special mo- gies.
ments or to collect digital assets, and recently it is creating
a new digital content business by combining it with meta-
5.2 Artificial Intelligence Issues
verse [89, 90]. Because NFT can guarantee the unique-
ness of the digital assets by keeping encrypted transaction
The breakthroughs of artificial intelligence technologies,
history permanently on the blockchain. Each token has
especially deep learning, enables the academia and indus-
a unique recognizable value, which enables to authenti-
tries to make great progress for the automatically operation
cate the ownership of digital assets. For example, the
and design in metaverse, and performs better than con-
blockchain-empowered NFT has been applied to prove the
ventional approaches. For example, the study [4] applies
uniqueness of the avatar and the created things that scan-
AI to generate vivid digital characters quickly that might
ning themselves in 3D or transforming them into avatar
be deployed by virtual service providers as conversational
characters in metaverse [91].
virtual assistants to populate metaverse. However, existing
deep learning models are usually very deep and have mas-
5 Challenges and Open Issues sive amount of parameters, which incurs high burden for
resource-constrained mobile devices to deploy learning-
based applications. While current AI technologies are just
Through the previous review, we found that AI and at the stage where people tell the machine to do specific
blockchain are fundamental technologies for metaverse. tasks instead of enabling the machine to learn to learn
Although those technologies are promising to building a automatically. Most learning tasks are only suitable for
scalable, reliable, and efficient metaverse, we are clearly the closed static environment and have poor robustness,
aware that metaverse is still in its infant stage. Thus, this poor interpretability that can not satisfy the requirement of
section discusses the challenges, open issues, and sugges- availability, robustness, interpretability, and adaptability in
tions for the fusion of AI and blockchain in metaverse. an open and dynamic environment.
Meta-learning [96] as a promising learning paradigm can
observe how different machine learning approaches per-
5.1 Open Issues on Digital Economy in Metaverse form on a wide range of learning tasks. Learning from
this experience, meta-data can learn new tasks much faster
Different from the physical world, the digital creation in than others possible. Not only does this dramatically speed
virtual world might be unlimited. The identity of digital ob- up and improve the design of machine learning pipelines
jects determines value instead of the undifferentiated labor or neural architectures, it also allows us to replace hand-
in conventional economy. In the field of digital creation, engineered algorithms with novel approaches learned in a
it is necessary to develop authoring tools to enable the data-driven way. Therefore, meta-learning remains chal-
users to produce original content easily and gain rewards lenging to achieve auto-machine learning in future years.
efficiently with low cost. Those tools could improve the en-
thusiasm of content producers of metaverse. The marginal
benefits will increase in metaverse instead of diminishing 5.3 Blockchain-related Issues
marginal benefits of production in the physical world. The
difference of marginal benefits between the physical world Although blockchain technologies have achieved a lot of
and virtual world demands a value conversion mechanism improvements, there are still challenges and open issues
to bridge their gap. while fusing blockchain in metaverse. We pose several
questions in the following to inspire readers to deeply dive
In future metaverse, people prefer to turn to their virtual into the related technical studies.
cabinet to select digital outfit, while companies begin to
hype the virtual skins, virtual clothing, even virtual estates • Can the existing real-world NFT ecosystem adapt
with high price which will block a large portion of players to the high transaction volumes in metaverse?
to join in metaverse. Hence, it is necessary to propose
particular governance mechanisms under the cooperation • What rules does metaverse require to achieve
of worldwide companies. Furthermore, how to establish a a healthy digital blockchain-empowered market
digital currency system that enables the currency exchange and business?
10Q. Yang, Y. Zhao, H. Huang et al
Table 2: A Summary of the Blockchain Technologies in Metaverse
Types Description Representative Works Use cases
Blockchain Smart contracts [80] Executing transactions
Architecture Consensus mechanisms [79] Pow, PoS
Cryptocurrency [77, 78] Bitcoins, Ethereum
Repulay protocol based on reputation [85] Accelerate transaction relay
mechanism
Applications of Incorporate probabilistic blockchain [92] Blockchain and AI
Blockchain with reputation
Alliance chain with reputation [93] Supply chain
Blockchain Meets IoT [94] Use Blockchain to manage IoTs
Fast certificate verification [95] Certificate verification
• Is the application model of the real-world on Ronin, and send it to their address due to the legal-
blockchain able to be directly transplanted to ity of cryptocurrency in some countries. Although this
metaverse? blockchain-empowered game finance doesn’t not work in
• Does metaverse need new blockchain platforms some countries, we believe that the future metaverse will
and consensus mechanisms? embrace a much more open, fair, and rational physical
world.
5.4 Governance in Metaverse
5.6 Security and Privacy for Metaverse
Currently, the concept of metaverse is mainly used and
propagated by companies such as Roblox and Meta (Face- From the perspective of metaverse users, a natural question
book previously). It is predictable that the most popular is how to guarantee their security & privacy in metaverse?
ecosystems in the near future are built and operated by For example, a lot of private properties in metaverse, in-
these giant corporations. Tiny metaverse has only a few cluding the digital assets, the identity of virtual items, cryp-
application scenarios. In contrast, the macro metaverse tocurrency spending records, and other private user data,
would include all scenarios required by users. To real- are required to be protected. Thus, metaverse-oriented
ize such a vision, large companies need to cooperate to cryptography mechanisms are open to propose for the pri-
create a huge unified metaverse. The problems is how to vacy preservation in metaverse.
incentivize those giant companies to cooperate? Once the
unified metaverse is set up, how to make uniform rules that
govern the whole unified metaverse? 6 Conclusion
On the other hand, the threats of market manipulation
Artificial intelligence and blockchain technologies are ex-
and money laundering will definitely exist in future meta-
pected to play an essential role in the ever-expanding meta-
verse. Thus, the market governance will be viewed as more
verse. For example, metaverse uses artificial intelligence
significant in the perspective of regional management of
and blockchain to create a digital virtual world where any-
metaverse.
one can safely and freely engage in social and economic
activities that transcend the limits of the real world. Ex-
5.5 Blockchain-empowered Applications for ploiting metaverse, the application of these latest AI and
Metaverse blockchain technologies will be accelerated as well.
Various applications will boost the virtual economy in By surveying the most related works across metaverse
metaverse, such as blockchain-empowered Apps for office components, digital currencies, AI technologies and ap-
work, social networks, NFT markets, game finance, and plications in virtual world, and blockchain-empowered
etc. For instance, the blockchain-based game Axie Infin- technologies, we wish to offer a thoughtful review to the
ity [97] establishes a digital pet universe in which players experts from both the academia and industries. We also
can battle, raise, and trade fantasy creatures called Ax- envisioned critical challenges and open issues on construct-
ies. The game allows players to deposit from an Ethereum ing the fundamental elements of metaverse with the fusion
wallet to Ronin wallet via the Ronin Bridge. In short, of AI and blockchain. Further exploitation and interdisci-
the game allows the currency exchange between fiat and plinary research on metaverse entail the collaboration from
cryptocurrency since the players can buy ETH on a cryp- both academia and industries to strive for an open, fair and
tocurrency exchange like Binance or Coinbase or with fiat rational future metaverse.
11Q. Yang, Y. Zhao, H. Huang et al
References [16] H. Du, D. Niyato, J. Kang, D. I. Kim, and
C. Miao, “Optimal targeted advertising strategy
[1] J. Joshua, “Information bodies: Computational anx- for secure wireless edge metaverse,” CoRR, vol.
iety in neal stephenson’s snow crash,” Interdisci- abs/2111.00511, 2021. [Online]. Available: https:
plinary Literary Studies, vol. 19, no. 1, pp. 17–47, //arxiv.org/abs/2111.00511
2017. [17] Y. Jiang, J. Kang, D. Niyato, X. Ge, Z. Xiong,
[2] Meta, “Introducing meta: A social technology com- and C. Miao, “Reliable coded distributed com-
pany,” https://about.fb.com/news/2021/10/facebook puting for metaverse services: Coalition forma-
-company-is-now-meta/, accessed: 2021-11-11. tion and incentive mechanism design,” CoRR,
vol. abs/2111.10548, 2021. [Online]. Available:
[3] P. Ambrasaitė and A. Smagurauskaitė, “Epic games
https://arxiv.org/abs/2111.10548
v. apple: Fortnite battle that can change the industry,”
Vilnius University Open Series, pp. 6–25, 2021. [18] Y. Han, D. Niyato, C. Leung, C. Miao, and D. I.
Kim, “A dynamic resource allocation framework for
[4] E. Games, “The world’s most open and advanced
synchronizing metaverse with iot service and data,”
real-time 3d creation tool,” https://www.unrealengi
arXiv preprint arXiv:2111.00431, 2021.
ne.com/en-US/, accessed: 2021-11-11.
[19] J. Y. Lee, “A study on metaverse hype for sustainable
[5] M. Seymour, C. Evans, and K. Libreri, “Meet mike:
growth,” International journal of advanced smart
epic avatars,” in ACM SIGGRAPH 2017 VR Village,
convergence, vol. 10, no. 3, pp. 72–80, 2021.
2017, pp. 1–2.
[20] H. Duan, J. Li, S. Fan, Z. Lin, X. Wu, and W. Cai,
[6] E. Games, “Fortnite,” Epic Games, 2017.
“Metaverse for social good: A university campus pro-
[7] E. Kain, “Epic games pulls travis scott emote from totype,” in Proceedings of the 29th ACM Interna-
‘fortnite’ item shop,” https://www.forbes.com/sites tional Conference on Multimedia, 2021, pp. 153–161.
/erikkain/2021/11/09/epic-games-pulls-travis-scott
[21] M. Rymaszewski, W. J. Au, M. Wallace, C. Winters,
-emote-from-fortnite-item-shop/?sh=7f5cbabe4708,
C. Ondrejka, and B. Batstone-Cunningham, Second
accessed: 2021-11-13.
life: The official guide. John Wiley & Sons, 2007.
[8] L. Lik-Hang, T. Braud, P. Zhou, L. Wang, D. Xu,
[22] R. Arnaud and M. C. Barnes, COLLADA: sailing
Z. Lin, A. Kumar, C. Bermejo, and P. Hui, “All one
the gulf of 3D digital content creation. CRC Press,
needs to know about metaverse: A complete survey
2006.
on technological singularity, virtual ecosystem, and
research agenda.” [23] Decentraland, “Builder,” https://builder.decentraland
[9] J. D. N. Dionisio, W. G. B. III, and R. Gilbert, “3d vir- .org/, accessed: 2021-12-15.
tual worlds and the metaverse: Current status and fu- [24] L.-H. Lee, Z. Lin, R. Hu, Z. Gong, A. Kumar, T. Li,
ture possibilities,” ACM Computing Surveys (CSUR), S. Li, and P. Hui, “When creators meet the metaverse:
vol. 45, no. 3, pp. 1–38, 2013. A survey on computational arts,” arXiv preprint
[10] W. LaDuke, “Traditional ecological knowledge and arXiv:2111.13486, 2021.
enviromental futures,” Colo. J. Int’l Envtl. L. & Pol’y, [25] M. Bourlakis, S. Papagiannidis, and F. Li, “Retail
vol. 5, p. 127, 1994. spatial evolution: paving the way from traditional to
[11] M. Nadini, L. Alessandretti, F. Di Giacinto, M. Mar- metaverse retailing,” Electronic Commerce Research,
tino, L. M. Aiello, and A. Baronchelli, “Mapping vol. 9, no. 1, pp. 135–148, 2009.
the nft revolution: market trends, trade networks and [26] D. Cliff and M. Rollins, “Methods matter: A trading
visual features,” arXiv preprint arXiv:2106.00647, agent with no intelligence routinely outperforms ai-
2021. based traders,” in 2020 IEEE Symposium Series on
[12] N. Lambert, “Beyond nfts: A possible future for Computational Intelligence (SSCI), 2020, pp. 392–
digital art,” ITNOW, vol. 63, no. 3, pp. 8–10, 2021. 399.
[13] W. Y. B. Lim, Z. Xiong, D. Niyato, X. Cao, C. Miao, [27] Decentraland, “Marketplace,” https://market.decentr
S. Sun, and Q. Yang, “Realizing the metaverse with aland.org/, accessed: 2021-12-15.
edge intelligence: A match made in heaven,” 2022. [28] J. Fennimore, “Roblox: 5 fast facts you need to
[14] M. Xu, D. Niyato, J. Kang, Z. Xiong, C. Miao, and know,” https://heavy.com/games/2017/07/roblox-y
D. I. Kim, “Wireless edge-empowered metaverse: outube-free-download-corporation-baszucki-cassel
A learning-based incentive mechanism for virtual -nerfmodder/, accessed: 2021-11-12.
reality,” arXiv preprint arXiv:2111.03776, 2021. [29] Diem, “How the diem payment system works,” https:
[15] W. C. Ng, W. Y. B. Lim, J. S. Ng, Z. Xiong, D. Niyato, //www.diem.com/en-us/vision/#how_it_works, ac-
and C. Miao, “Unified resource allocation framework cessed: 2021-11-22.
for the edge intelligence-enabled metaverse,” arXiv [30] A. Smith, The wealth of nations [1776]. na, 1937,
preprint arXiv:2110.14325, 2021. vol. 11937.
12Q. Yang, Y. Zhao, H. Huang et al
[31] S. Dick, “Artificial intelligence,” 2019. [47] K.-T. Lai, C.-C. Lin, C.-Y. Kang, M.-E. Liao, and
M.-S. Chen, “Vivid: Virtual environment for visual
[32] S. R. Jammalamadaka, “Introduction to linear regres-
deep learning,” in Proceedings of the 26th ACM inter-
sion analysis,” 2003.
national conference on Multimedia, 2018, pp. 1356–
[33] T. M. Oshiro, P. S. Perez, and J. A. Baranauskas, 1359.
“How many trees in a random forest?” in Interna- [48] D. Chen, L. J. Xie, B. Kim, L. Wang, C. S. Hong,
tional workshop on machine learning and data min- L.-C. Wang, and Z. Han, “Federated learning based
ing in pattern recognition. Springer, 2012, pp. 154– mobile edge computing for augmented reality appli-
168. cations,” in 2020 International Conference on Com-
[34] C. C. Paige and M. A. Saunders, “Towards a gener- puting, Networking and Communications (ICNC),
alized singular value decomposition,” SIAM Journal 2020, pp. 767–773.
on Numerical Analysis, vol. 18, no. 3, pp. 398–405, [49] R. V. Yampolskiy, B. Klare, and A. K. Jain, “Face
1981. recognition in the virtual world: Recognizing avatar
[35] V. Vapnik, The nature of statistical learning theory. faces,” in 2012 11th International Conference on
Springer science & business media, 1999. Machine Learning and Applications, vol. 1, 2012, pp.
40–45.
[36] N. Ketkar, “Convolutional neural networks,” in Deep
Learning with Python. Springer, 2017, pp. 63–78. [50] M. Fabbri, F. Lanzi, S. Calderara, A. Palazzi, R. Vez-
zani, and R. Cucchiara, “Learning to detect and track
[37] L. P. Kaelbling, M. L. Littman, and A. W. Moore, visible and occluded body joints in a virtual world,”
“Reinforcement learning: A survey,” Journal of artifi- in Proceedings of the European conference on com-
cial intelligence research, vol. 4, pp. 237–285, 1996. puter vision (ECCV), 2018, pp. 430–446.
[38] J. Van Der Wal, “Stochastic dynamic programming,” [51] H. Wang, Y. Gao, and X. Chen, “Rl-dot: A rein-
Ph.D. dissertation, Methematisch Centrum Amster- forcement learning npc team for playing domination
dam, The Netherlands, 1980. games,” IEEE Transactions on Computational intel-
[39] K. Arulkumaran, M. P. Deisenroth, M. Brundage, and ligence and AI in Games, vol. 2, no. 1, pp. 17–26,
A. A. Bharath, “Deep reinforcement learning: A brief 2009.
survey,” IEEE Signal Processing Magazine, vol. 34, [52] C. Berner, G. Brockman, B. Chan, V. Cheung,
no. 6, pp. 26–38, 2017. P. D˛ebiak, C. Dennison, D. Farhi, Q. Fischer,
[40] ——, “Deep reinforcement learning: A brief survey,” S. Hashme, C. Hesse et al., “Dota 2 with large
IEEE Signal Processing Magazine, vol. 34, no. 6, pp. scale deep reinforcement learning,” arXiv preprint
26–38, 2017. arXiv:1912.06680, 2019.
[53] J.-F. Chen, W.-C. Lin, H.-S. Bai, C.-C. Yang, and
[41] M. G. Kapteyn, J. V. Pretorius, and K. E. Willcox, “A H.-C. Chao, “Constructing an intelligent behavior
probabilistic graphical model foundation for enabling avatar in a virtual world: a self-learning model based
predictive digital twins at scale,” Nature Computa- on reinforcement,” in IRI -2005 IEEE International
tional Science, vol. 1, no. 5, pp. 337–347, 2021. Conference on Information Reuse and Integration,
[42] O. San, “The digital twin revolution,” Nature Com- Conf, 2005., 2005, pp. 421–426.
putational Science, vol. 1, no. 5, pp. 307–308, 2021. [54] J. Lee and K. H. Lee, “Precomputing avatar behavior
[43] Q. Qi and F. Tao, “Digital twin and big data towards from human motion data,” Graphical models, vol. 68,
smart manufacturing and industry 4.0: 360 degree no. 2, pp. 158–174, 2006.
comparison,” Ieee Access, vol. 6, pp. 3585–3593, [55] I. Kastanis and M. Slater, “Reinforcement learning
2018. utilizes proxemics: An avatar learns to manipulate the
[44] K. Malik and M. Farhan, “Merging virtual world with position of people in immersive virtual reality,” ACM
data sciences,” Int Rob Auto J, vol. 2, no. 1, p. 00012, Transactions on Applied Perception (TAP), vol. 9,
2017. no. 1, pp. 1–15, 2012.
[45] Y. Ham and J. Kim, “Participatory sensing and digital [56] R. Rahmatizadeh, P. Abolghasemi, A. Behal, and
twin city: updating virtual city models for enhanced L. Bölöni, “From virtual demonstration to real-world
risk-informed decision-making,” Journal of Manage- manipulation using lstm and mdn,” in Thirty-Second
ment in Engineering, vol. 36, no. 3, p. 04020005, AAAI Conference on Artificial Intelligence, 2018.
2020. [57] ——, “Learning real manipulation tasks from vir-
[46] F. Xue, W. Lu, Z. Chen, and C. J. Webster, “From tual demonstrations using lstm,” arXiv preprint
lidar point cloud towards digital twin city: Cluster- arXiv:1603.03833, 2016.
ing city objects based on gestalt principles,” ISPRS [58] T. Wang, J. Li, Y. Deng, C. Wang, H. Snoussi, and
Journal of Photogrammetry and Remote Sensing, vol. F. Tao, “Digital twin for human-machine interaction
167, pp. 418–431, 2020. with convolutional neural network,” International
13You can also read
