We push the envelope in Human Computer Interaction with wearables and other forms of pervasive computing. New modalities require new aesthetics and ergonomics. For example, hands-free navigation through the tangible reality using smart glasses needs new forms of interaction.
Dr Fridolin Wild, director of PAL, was invited to attend a Showcase and Networking meeting at the Microsoft Hololens Lounge in London – as one of twelve universities invited, on May 10, 2018. Microsoft shared some details about the Mixed Reality strategy and observations on the importance of academia as enable to industry, including an announcement for two new mixed reality apps (remote assist and layout, both now in the store). The universities shared their research. The building and demos took place in the stylish Hololens Lounge.
While presenting at the Future Tech Now Show in London on April 5, Dr Fridolin Wild was able to sneak into the new Tesla suit, experiencing the effects of electro-muscular stimulation (EMS) on his own body. The suit embeds muscle-stimulation pads and motion sensors – to be applied in anything from rehabilitation to gaming. “When you activate the six pack pads, you literally can make people feel a subtle kick in the guts”, so Dr Wild. “You still feel a strange electric tingling on your skin, but once immersed in a simulation or game, this quickly fades to the background”, he continues. With the technology, it is also possible to make people move, see here for an earlier reflection on how people feel about their bodies being remote controlled. The latest version of the suit also holds sensors for galvanic skin resistence and heat pads, promising new approaches to personalisation and adaptation.
Also exhibited at the show: electronic cocktails, using the same principle of electric stimulation – of the taste-buds on the tongue, to turn soda water – combined with fragrances – into a virtual cocktail.
Dr. Fridolin Wild gave a TEDx talk on ‘reality as a medium’, speaking about truth, reality, and perception, and how we can hack into perception to actually ‘make’ reality. The talk will be available online soon.
Last week in Tallinn Alla Vovk presented a paper at the 12th European Conference on Technology Enhanced Learning (EC-TEL 2017) “Affordances for Capturing and Re-enacting Expert Performance with Wearables” written by Will Guest, Fridolin Wild, Alla Vovk, Mikhail Fominykh, Bibeg Limbu , Roland Klemke, Puneet Sharma, Carl H Smith, Jazz Rasool, Soyeb Aswat, Kaj Helin, Daniele Di Mitri, and Jan Schneider. You can watch the presentation in 360 with a Q&A session.
The WEKIT.one prototype is a platform for immersive procedural training with wearable sensors and Augmented Reality. Focusing on capture and re-enactment of human expertise, this work looks at the unique affordances of suitable hard- and software technologies. The practical challenges of interpreting expertise, using suitable sensors for its capture and specifying the means to describe and display to the novice are of central significance here. We link affordances with hardware devices, discussing their alternatives, including Microsoft Hololens, Thalmic Labs MYO, Alex Posture sensor, MyndPlay EEG headband, and a heart rate sensor. Following the selection of sensors, we describe integration and communication requirements for the prototype. We close with thoughts on the wider possibilities for implementation and next steps.
Interactive designer, motion-designer, musical composer. After studying the history of cinema in La Sorbonne (Paris) and studying editing and audio-visual post-production in Cannes, he settled in Brussels in 2006 where he developed his activities as motion-designer and VFX artist. He works for the film industry (Mood Indigo by Michel Gondry, The Brand New Testament by Jaco Van Dormael), music-videos (Puggy, Sacha Toorop), documentaries for Arte, tv-shows for France Television). He occasionally trains professionals and students at digital creation workshops (School Arts2 Mons, EMMD Motion Design Brussels). Between 2012 and 2017, he co-directed the virtual reality performance IMMERSIO. This performance was a mix between live music and digital arts, played in a rich set of venues (SAT Montreal, ADAF Athens, SignalOFF Prague, Wisp Festival Leipzig, Bozar and Halles de Schaerbeek Brussels).
Scenographer, visual art designer. She studied scenography at La Cambre / Brussels and visual arts at ISPG Brussels. She develops an activity around the topics of scenography, visual installations and the organisation of workshops with kids and adults.
Industry 4.0 is on the rise and this coordinated push for automation, big data, and internet-of-things in the smart factory is already causing (and will continue to) disruption in the job market. New skills for ‘new collar’ jobs are needed and intelligent assistance systems with Augmented Reality, Smart Glasses, and other forms of wearable computing may help to deliver them.
In this talk, Dr. Wild introduced to the concept of Performance Augmentation and illustrated how challenges for the future can be met at the hand of several examples of intelligent training and live guidance applications in aircraft maintenance, space assembly, and medical diagnostics.
In this master project, Sophie Kirkham is developing a proof of concept prototype for providing real-time auditory feedback to end-users on their arm movement during simple motor tasks, an application that could be used, for example, in rehabilitation of stroke patients who have to regain motor control of their limbs. This is how she explains the work:
Research using augmented reality and virtual reality as a source of visual feedback in rehabilitation and motor learning has been receiving positive outcomes across the computing and medical fields. AR and VR can provide a method of increasing motivation and stimulation whilst performing the repetitive tasks required for motor development. Little research, however, has been done so far on integrating auditory feedback within these systems despite it’s capabilities at representing spatio-temporal information and to motivate, encourage and reduce stress in people. In this project, I am designing, developing and evaluating a proof of concept real-time auditory biofeedback system that maps EMG and IMU data from arm movements during simple motor tasks to auditory parameters.” (Sophie Kirkham)
Dr Fridolin Wild won the best paper award for his first authored paper entitled “Technology Acceptance of Augmented Reality and Wearable Technologies” at the Immersive Learning Research Network annual conference that this year took place in Combra, Portugal, from June 26 to 29:
Wild F., Klemke R., Lefrere P., Fominykh M., Kuula T. (2017): Technology Acceptance of Augmented Reality and Wearable Technologies, In: Beck D. et al. (eds): Immersive Learning Research Network (iLRN 2017), Communications in Computer and Information Science, Vol 725. Springer, Cham
The paper develops a new method to measure technology acceptance for AR/wearable tech in a workplace context (see abstract below). This is what the paper covers:
“Augmented Reality and Wearables are the recent media and computing technologies, similar, but different from established technologies, even mobile computing and virtual reality. Numerous proposals for measuring technology acceptance exist, but have not been applied, nor fine-tuned to such new technology so far. Within this contribution, we enhance these existing instruments with the special needs required for measuring technology acceptance of Augmented Reality and Wearable Technologies and we validate the new instrument with participants from three pilot areas in industry, namely aviation, medicine, and space. Findings of such baseline indicate that respondents in these pilot areas generally enjoy and look forward to using these technologies, for being intuitive and easy to learn to use. The respondents currently do not receive much support, but like working with them without feeling addicted. The technologies are still seen as forerunner tools, with some fear of problems of integration with existing systems or vendor-lock. Privacy and security aspects surprisingly seem not to matter, possibly overshadowed by expected productivity increase, increase in precision, and better feedback on task completion. More participants have experience with AR than not, but only few on a regular basis.”
In the picture: co-author Mikhail Fomynikh receiving the award from conference chair Jonathan Richter.
A trans-European team of researchers is transforming industrial learning and training with the use of innovative Augmented Reality and Wearable Technology (AR/WT).
Wearable Experience for Knowledge Intensive Training (WEKIT) is a 2.7 million EURO research and innovation project funded by Horizon 2020, to develop and test a novel way of training using smart wearable technology within three years.
Dr Fridolin Wild, Senior Research Fellow at Oxford Brookes University and Principal Investigator and Scientific Director of the WEKIT Project said: “In the modern world, there tends to be a concern that technology is developing so rapidly that it will replace humans in the workplace.”
“WEKIT demonstrates that cutting-edge technology can actually help humans become better at work, quicker, less error-prone, more engaged and healthier.”
Using AR, WEKIT effectively brings textbooks to life using digital visual and audial information that overlay on the physical environment, for example in the form of animations. The WEKIT.one soft- and hardware system shows the trainee what to do through the eyes of the expert, allowing the trainee to learn by experience rather than simply reading about it or watching a video tutorial. It also allows an expert to create instructions easily – by capturing performance using WT.
Dr Wild continued: “Using augmented reality as a medium for learning and work is a powerful tool, particularly in high-skill settings which require the teaching or re-teaching, of complex manufacturing and engineering tasks after ‘Industry 4.0’.”
“Crucially, it also has the potential to have a positive impact on the time and costs of training large numbers of people.”
The new WEKIT.one AR system, involving the Hololens and other wearable devices, was recently put into action for the first time when it was tested with 142 experts and trainees at three separate organisations; in Tromsø, halfway to the North Pole in the Arctic circle, and in Turin and Genoa, Italy.
Throughout the trials, specially developed applications for both the experts and novices were used and feedback was collected to assess the suitability and acceptance of the system in three distinct scenarios:
- Medics and engineers at the Arctic town of Tromsø performed equipment checks on the aircraft used as emergency responders in the region. More than 50 students donned the Hololens and used the WEKIT training application to carry out the checks. The system walked them through the air ambulance with the aid of holograms and audio instructions and gave them real-time feedback on their progress.
- At ALTEC (a service provider for the Italian Space Agency) WEKIT tested a procedure for setting up stowage racks for use by astronauts on the International Space Station. Trainees were tracked as they installed the equipment, monitoring their efficiency on every step as well as their heart-rate variability.
- With the help of radiologists in Genoa and EBIT, a medical software company, a number of medical students were trained to assess the blood flow in the carotid artery on an unfamiliar ultrasound machine. This tricky procedure involves following instructions (laid out in 3D) whilst maintaining control of both an ultrasound probe and a patient (in our case: an actor). A holographic tutor delivers the recorded think-aloud explanation of the expert, while instructional holograms, floating videos and to-be snapshots guide step by step through the procedure. Tested by medical and engineering students, this trial provided in-depth feedback on the subtleties of using AR for complicated, interactive procedures.
The trainees and experts involved in the trial evaluated specific features of the prototype and the training approach, technology acceptance, system usability, user satisfaction of training with AR glasses and human-computer interface, and simulation sickness.
More information about WEKIT: http://www.wekit.eu
For more information, please contact: Natalie Gidley, Communications Officer (Media Relations) at Oxford Brookes University on 01865 484452 or firstname.lastname@example.org.
Notes to Editors
- Images and video footage taken during the WEKIT trails are available. Please contact the Oxford Brookes University press office.
- The scientific coordination of WEKIT is at Oxford Brookes University in the UK, the administrative coordination with the Italian IT company GFT. WEKIT brings together four further academic partners including Ravensbourne (UK), University of Tromsø (Norway), Open University (The Netherlands), and RWTH (Germany).
- The research centres at Oxford Brookes University (UK), Open University of the Netherlands (NL), VTT (Finland), and the high-tech SME MyndPlay (UK) are leading the development of the key components of the platform.
- Three industry partners – Norway-based Lufttransport as well as EBIT and ALTEC from Italy – are leading evaluation cases to test the WEKIT training methodology and technological platform in real practical settings.
- Set in a historic student city, Oxford Brookes is one of the UK’s leading universities and enjoys an international reputation for teaching excellence and innovation as well as strong links with business and industry. More information is available on the Oxford Brookes website at www.brookes.ac.uk
Perspectives on Wearable Enhanced Learning: Current Trends, Research and Practice
An edited volume by Ilona Buchem, Ralf Klamma, Fridolin Wild
to be published by Springer, New York
Springer website: http://www.springer.com
Dedicated website: http://ea-tel.eu/special-interest-groups/well
EasyChair submission: https://easychair.org/conferences/?conf=wellspringer2018
Wearable technologies – such as smart glasses, smart watches, smart objects, or smart garments – are potential game-changers, breaking ground, and offering new opportunities for learning. These devices are body-worn, equipped with sensors, and integrate ergonomically into everyday activities. With wearable technologies forging new human-computer relations, it is essential to look beyond the current perspective of how technologies may be used to enhance learning.
This edited volume “Perspectives on Wearable Enhanced Learning” aims to take a multidisciplinary view on wearable enhanced learning and provide a comprehensive overview of current trends, research, and practice in diverse learning contexts including school and work-based learning, higher education, professional development, vocational training, health and healthy aging programs, smart and open learning, and work. This volume will feature current state of the art in wearable enhanced learning and explore how wearable technologies begin to mark the transition from the desktop through the mobile to the age of wearable, ubiquitous technology-enhanced learning.
The edited volume is divided into seven parts:
Part I The Evolution and Ecology of Wearable Enhanced Learning
This part includes chapters describing an evolution of technology-enhanced learning from the desktop to wearable era, the different phases in the evolution of technologies for learning, introducing in the technological and conceptual shifts from e-learning through m-learning to ubiquitous learning. This part introduces the reader to the topic and provides both a historical perspective and a conceptual framework for a socio-cultural ecology of learning with wearables.
Part II The Topography of Wearable Enhanced Learning
This part includes chapters giving an overview of current trends and uses of wearable enhanced learning including examples of projects, use cases, case studies. This part provides an overview of real-life examples and aims at illustrating the breadth of uses of wearable technologies for learning in different application contexts such as education, work, health and open learning.
Part III Technological Frameworks, Development and Implementation
This part includes chapters providing insight into different technological aspects of wearable enhanced learning focusing both on the hardware and the software. This part also gives an overview of different development and implementation methodologies applied in wearable enhanced learning.
Part IV Pedagogical Frameworks and Didactic Considerations
This part includes chapters providing insight into different pedagogical frameworks and didactic/instructional design approaches applied in wearable enhanced learning. This part also discusses pedagogical affordances of wearables as technologies for learning and the consequences for a didactically sound design and integration of wearables in learning settings/environments.
Part V Design of User Experience
This part includes chapters providing insight into different aspects of user experience design including approaches for enhancing user engagement such as gamification and information visualisation as well as human-computer interaction and interface design. This part also discusses how current insights from research and development in wearable computing, which represents the forefront of HCI innovation, may be applied to designing user experience in learning settings.
Part VI Research and Data
This part includes chapters providing overview of current empirical research results in wearable enhanced learning touching upon the different dimensions of learning including cognitive, social and embodied dimensions. This part also discusses how data can be gathered and exploited in wearable enhanced learning which includes such topics as wearable learning analytics, turning data into information and data-driven approaches to enhancing learning in wearable enhanced learning.
Part VII Synopsis and Prognosis
The final part includes a chapter providing a synopsis and a prognosis for the future development in the field of wearable enhanced learning.
Call for Chapters
Prospective authors (co-authors are welcome) are invited to submit a chapter proposal (via EasyChair: https://easychair.org/conferences/?conf=wellspringer2018) in form of an abstract (max. 300 words) with the title, names of authors, five keywords and the part of the book for the contribution not later than 30 September 2017. The proposals for chapters should be a previously unpublished work.
Upon acceptance of the chapter proposal and notification of authors by 20 October 2017, the final chapter should be completed not later than 01 February 2018.
Contributions will be double blind reviewed and returned with comments by 31 March 2018. Finalised chapters are due no later than 30 April 2018. The final contributions should not exceed 20 manuscript pages. Guidelines for preparing your chapter will be sent to you upon acceptance of your proposal.
The following represents a timeline for completing this volume:
- 20 June 2017: Call for Chapters open
- 30 September 2017: Abstracts due (title, authors, abstract, keywords & book part)
- 20 October 2017: Notification and additional information for authors and templates
- 01 February 2018: Chapters due (according to the template)
- 31 March 2018: Chapters returned with reviewers’ comments
- 30 April 2018: Final chapters due (ready for publication)
- 31 May 2018: Book manuscript delivered to Springer
Inquires and Submissions
Please forward your inquiries to:
The Editors: Ilona Buchem, Ralf Klamma and Fridolin Wild
Twitter: @mediendidaktik @klamma @fwild
Please submit your proposal to: