Augmented Reality Approach to Domestic Maintenance Tasks
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
Augmented Reality Approach to Domestic
Maintenance Tasks
Jorge Martín-Gutiérrez and Irene Inés Santos Pérez
Universidad de La Laguna, Dpto. Expresión Gráfica en Arquitectura e Ingeniería,
Avda. Astrofísico Francisco Sánchez s/n 38206 La Laguna, Spain
jmargu@ull.es, ireneines85@gmail.com
Abstract. Augmented reality technology is becoming more familiar and
utilized at user level thanks to new generation of smartphones provided of
webcam, big format tactile screens and internet connection. This allows
creating applications which make certain human tasks nicer and more
comfortable. AR technology has been applied to mechanical engineering field,
concretely for assistance on repairing and maintenance tasks of complex and
specific systems using expensive systems which are not very useful nor
accessible for performing simple or domestic tasks. In this work we intend
making this technology approachable for applications and tasks which are more
common to everybody. For example, two AR technology based tools, one
belonging to a smartphone platform and another using a head mounted display
(HMD) glasses connected to a PC. Both allow helping user while performing
installation, maintenance and adjustment of a mountain bike brakes system.
1 Introduction
In next decade we will access real world through augmented reality; this process will
reach global audience in 2021 according to the “Realidad Aumentada: una nueva
lente para ver el mundo”- report [1].
Augmented reality (AR) is a technology which allows real-time superimposition of
virtually generated images and information over real world images meaning adding a
synthetic virtual part to the real one. AR is a technology helping enrichment of our
perception of reality making possible real world information is complemented by
digital one.
AR experiences have become easy to use and especially mobile. Progress made in
mobile devices, particularly smartphones with cameras but also in different
technologies which combine real world with virtual information allowing the chance
to enjoy this applications making possible AR accessing broad consumer sector
through actual devices such as smartphones, game consoles and computers with
webcams.
Gartner1 consultant states AR will achieve broad public reach gradually in a 5 to 10
years horizon. Although AR has already begun to introduce in the market, its use is
not quite extended yet but a great growth is expected within the next few years thanks
1
http://www.gartner.com/it/page.jsp?id=1447613
C. Stephanidis (Ed.): Posters, Part II, HCII 2011, CCIS 174, pp. 125–129, 2011.
© Springer-Verlag Berlin Heidelberg 2011126 J. Martín-Gutiérrez and I.I. Santos Pérez
to mobile devices (especially smartphones). Trend in virtual reality systems is
becoming more transportable, comfortable and user friendly each time. Actually,
computers and smartphones are both devices chosen although is expected that
development of display technologies will allow creation of glasses or lens allowing
showing virtual information right in front of human eye.
2 Augmented Reality in Maintenance Tasks Industrials
There are few contributions where augmented reality technology is applied to
machines’ mounting and maintenance and most of them are developed through
research work. In less accessible fields like aerospace, applications have been
developed for supporting maintenance staff performing their tasks [2, 3, 4]. In the
same application field Schwald [5], introduces an AR system for training & assistance
in maintenance of complex industrial equipment using an optical see-through head
mounted display.
ARMAR project, has developed, designed, implemented and tested on users a beta
version of an AR application for support of army mechanics during routine
maintenance tasks inside an armored vehicle turret [6, 7]. Actually, mechanics from
the army and manufacturers like Boeing use AR glasses when staff works on vehicles,
glasses show repairs step by step, target necessary tools including textual instructions.
This kind of experience supports learning as well training of specific tasks. I+D
department of automotive giant BMW2 (through BMW research project), include
among their working lines development of an AR application supporting mechanics
while performing maintenance, diagnose and repair of any fault. A recently published
study has also applied AR technology for maintaining photovoltaic solar installations
equipment [8].
According to these references, it could be thought that use of AR technology in
repair and maintenance fields is subject to complex systems although that’s not the
case because it’s actually available to anyone. A few years ago, AR apps demanded
specialized equipment which wasn’t portable. Nowadays applications for laptops and
smartphones merge digital information into the real world quick and easily. Design of
easy apps makes communication between people and computers more natural each
time allowing those who are not used to computers can interact with the system. So,
the use of augmented reality may be extrapolated to nearer and common
environments for everybody.
3 Project Target
In this work we have developed an application based on AR use for support, repair
and maintenance of a standard mountain bike brakes system. Also, it focuses on
making the AR system useful as training for all bicycle users targeting substitution of
the troublesome maintenance manuals and assembly instructions. Augmented manual
(AR_Brakes-V manual) is developed to visualize in two platforms: smartphone or
computer (through HMD). The first of both has been developed for being accessible
2
http://www.bmw.com/com/en/owners/service/augmented_reality_workshop_1.htmlAugmented Reality Approach to Domestic Maintenance Tasks 127 to everybody meanwhile the second is the most suitable platform from machines requiring more complex maintenance tasks. It’s intended performing a usability study in the very near future for comparing both platforms. This work is a pilot study, which may be extensible to all electronic devices, vehicles, home appliances, etc, as they are all provided of user manuals for configuration or installation and usually understanding their instructions becomes a tough task. The possibility of creating those manuals in augmented reality as assistance during training, configuration and installation of those equipment could make learning how to use them much easier. 4 Generic AR-Manual for Devices Project consisted in developing an augmented manual with instructions of steps for installing the brake lever, V-brakes and replacement of the cartridge shoe providing also assistance for adjusting the cable’s tension. Augmented manual is presented in spiral binding so it can be leant over the mountain bike’s handlebar. Each page has a marker that belongs in AR to every task that must be accomplished. The application requires accurate position and orientation tracking in order to register virtual elements in the real world and so we have used a marker-based method. Therefore, the system requires a webcam for capturing the real world. The captured image recognizes virtual objects on the visible markers. Program used for developing scenes in PC has been Build_AR [9] while AndAR [10] software was used for creating mobile devices scenes both being GNU software – General Public license). 3D modeling of the parts manipulated during tasks was performed using Autodesk Inventor 3D software. Besides, textual information is added about tools used in every step. 3D graphics are animated so user can understand gestures that should be carried out. User provided with a mobile phone including camera will lean the augmented book over the bike’s handlebar where an included adapter should be set. Through the phone’s screen he can see virtual parts superimposed over the real ones (displaced respecting marker) (see Fig.1). Besides seeing animated components on the real environment, user will also be able to listen to a recorded voice which will guide him through every task following instructions accordingly. Fig. 1. Augmented scenes with HMD and PC Fig. 2. Augmented scenes with platform Smartphone
128 J. Martín-Gutiérrez and I.I. Santos Pérez
Most accessible and common device suggested is mobile phone although an AR
glasses with earphones included could also be used (Fig.2). Traditional user manual
will be substituted by several markers and AR application would be available for
download from the product’s website.
5 Conclusion
This study introduces a simple augmented reality system seeking incorporation of this
technology to home appliances and usual vehicles for providing help in their
configuration or maintenance. An application is introduced allowing user visualizing
in a smartphone the augmented scenes for performing installation, substitution and
maintenance tasks on a mountain bike brakes system. The AR system can
substantially improve quality of maintenance services while saving costs as the same
AR system can be used for different versions of several products (for example, V-
brakes is standard for many bikes models).
This kind of apps can be extended for setup and installation of electrical appliances
(TV recorder and programmer, Hi-fi systems, home cinemas, game consoles, etc.).
We propose substitution of the usual user manual for setup and maintenance of home
appliances or devices for AR based portable applications. User may access product’s
website from his mobile device (iPhone, smartphone) for download and installation of
the AR application.
As a future work we propose performing a usability study for knowing the
efficacy, efficiency and satisfaction of created AR apps drawing conclusions about
viability of introducing these apps for user’s performance of common tasks.
Acknowledgements. The Spanish Ministry of Innovation and Science, through the
“Not oriented Fundamental Investigation Projects” (“Improvement for spatial
reasoning and visualization through technologically developed tools” Project ref.
TIN2010-21296-C02-02) partially supported this work.
References
1. Ariel, Fundación Telefónica: Realidad Aumentada: Una nueva lente para ver el mundo,
Planeta edn. Madrid, Spain (2011)
2. Rahardja, S., Wu, E., Thalmann, D., Huang, Z.: Visualization of intelligent maintenance
systems through mixed reality. In: Proceedings of the 7th International Conference on
Virtual Reality Continuum and its Applications in Industry, VRCAI 2008 (2008)
3. Haritos, T., Macchiarella, N.D.: Augmented Reality (AR) for Aircraft Maintenance
Technician’s Training. In: Proceedings of Society of Applied Learning Technologies: New
Technologies (2007)
4. Macchiarella, N.D.: Augmenting Reality as a Medium for Job Task Training. Journal of
Instruction Delivery Systems 19(1), 21–24 (2005)
5. Schwald, B., Laval, B.: An augmented reality system for training and assistance to
maintenance in the industrial context. In: 11th International Conference in Central Europe
on Computer Graphics, Visualization and Computer Vision, pp. 425–432 (2003)Augmented Reality Approach to Domestic Maintenance Tasks 129
6. Henderson, S., Feiner, S.: Augmented Reality for Maintenance and Repair (ARMAR).
Technical Report AFRL-RH-WP-TR-2007-0112, United States Air Force Research Lab
(2007)
7. Henderson, S., Feiner, S.: Evaluating the Benefits of Augmented Reality Documentation
for Maintenance and Repair. IEEE Transactions on Visualization and Computer Graphics
(2011)
8. Benbelkacem, S., Zenati-Henda, N., Belhocine, M., Bellarbi, A., Tadjine, M.: Augmented
Reality Platform for Solar Systems Maintenance Assistance. In: Proceeding of the
International Symposium on Environment Friendly Energies in Electrical Applications. In:
EFEEA 2010 (2010)
9. Build_AR. Human Interface Technology Laboratory New Zealand (HIT Lab NZ)
(2010.03.07), http://www.buildar.co.nz/
10. AndAR project. Android Augmented Reality (2010.03.07),
http://code.google.com/p/andar/You can also read
