ModGrasp
A Wave Simulator and Active Heave Compensation Framework
JOpenShowVar, a communication interface to Kuka robots

Blog

Mixed reality (MR) Enabled Proprio and Teleoperation of a Humanoid Robot for Paraplegic Patients

A new paper has been presented in the Proc. of the 5th International Conference on Information and Computer Technologies (ICICT), New York City (virtual), United States, March 4-6, 2022. The selected article is:

Filippo Sanfilippo, Jesper Smith, Sylvain Bertrand and Tor Halvard Skarberg Svendsen. Mixed reality (MR) Enabled Proprio and Teleoperation of a Humanoid Robot for Paraplegic Patients. In Proc. of the 5th International Conference on Information and Computer Technologies (ICICT), New York City (virtual), United States, March 4-6, 2022.

The work received good feedback and triggered an interesting discussion. I thank my co-authors, and congratulate them for their contribution.

This work is supported by the Top Research Centre Mechatronics (TRCM), University of Agder (UiA), and by Halodi. Principal investigator: Filippo Sanfilippo. The pilot project is facilitated by Inger Holen at I4Helse as a collaboration between the TRCM, the student consulting company Young Industrial Innovators (Yi2) at UiA, the Assistive Technology Center at the Norwegian Labour and Welfare Administration (NAV), Dahlske High School, and MENY Krøgenes. The pilot project is supported by Digin, the largest Norwegian information and communications technology (ICT) cluster. The authors acknowledge the contribution of Andreas Eikin, who took part into the considered human subject study. The authors also acknowledge the contribution of Kristoffer Sand, Arminas Gronskis, Henning Blomfeldt Thorsen, and Emil Evnum.

PROTV News, a popular Romanian TV channel showcased our research project titled European network for 3D printing of biomimetic mechatronic systems (EMERALD)

PROTV News, a popular Romanian TV channel showcased our research project titled European network for 3D printing of biomimetic mechatronic systems (EMERALD).

This is a cooperation project that includes the following partners:

  • Technical University of Cluj-Napoca (Universitatea Tehnică din Cluj-Napoca), Romania
  • Politehnica University of Bucharest, Romania
  • University of Agder (UiA), Norway
  • Bizzcom s.r.o., Slovakia
  • Poznań University of Technology, Poland

The entire team is very grateful to the brilliant reporter Teodora Suciu and to PROTV News for the great opportunity

European network for 3D printing of biomimetic mechatronic systems

I am very glad to announce that our research project titled "European network for 3D printing of biomimetic mechatronic systems" (EMERALD) has received funding under the EEA Grants and Norway Grants.

This is a cooperation project that includes the following partners:

  • Technical University of Cluj-Napoca (Universitatea Tehnică din Cluj-Napoca), Romania
  • Politehnica University of Bucharest, Romania
  • University of Agder (UiA), Norway
  • Bizzcom s.r.o., Slovakia
  • Poznań University of Technology, Poland

The official link of the results communicated by the Romanian Agency today can be found here: https://www.eea4edu.ro/rez-coop/.

The official date for starting of the EMERALD project is 15 February 2022.

Approved budget 198,810 (EUR).

Congratulations to all members of the EMERALD project team for 1st place in EEA competition!

The project is complementary and builds up upon ongoing/previous related research works at the University of Agder (UiA). In a previous work [1, 2], a strategy that consists of adopting low-cost commercial off-the-shelf (COTS) components for engineering learning purposes was presented at UiA. This combined both industry standard automation controllers, such as Programmable Logic Controller (PLC) technology, as well as novel microcontrollers designed for use in embedded systems education. Specifically, the micro:bit microcontroller based on the nRF51822 system-on-chip (SoC) and designed by the British Broadcasting Corporation (BBC) was adopted. This work proposed a novel organisation of the embedded systems module for the engineering cybernetics education curriculum. With this approach, students were engaged in both a series of theoretical lectures as well as practical and highly-involving laboratory group projects. The course organisation and main topics as well as result analysis of student surveys were discussed. The survey results indicated that the course organisation and topics are effective for the students. A similar approach was also adopted and presented in a recent project. In particular, a strategy that consists of recycling electronic and robot disposals was adopted. Students were engaged in a real reverse engineering process and then challenged to find new possible applications and uses. The proposed approach enables students to gain practical knowledge of the integration of different engineering fields. However, these previous works do not consider the possibility of adopting virtual reality or augmented reality in the learning process. The potential benefit of considering this possibility was preliminary explored in a new recent work [3, 4, 5]. This work investigates the use of the virtual world to create experiential based learning experiences in a 3D immersive world for teaching computer hardware and electronic systems. In particular, the paper presents a number of approaches to capturing, displaying and visualising real world data in such 3D virtual environments. This approach shows the potential of adopting immersive learning environments. However, no VR/AR wearable devices were adopted in this preliminary work. To address some of these challenges, UiA is currently involved in an ongoing Erasmus+ project, titled AugmentedWearEdu, to identify potential VR application scenarios and current VR practices in higher education. Moreover, UiA is also exploring the development of low-cost wearable haptics. To give researchers and students a haptic feedback system that is economical, customisable, and fast to fabricate, our group developed a low-cost immersive haptic, audio, and visual experience built by using off-the-shelf (COTS) components. It is composed of a vibrotactile glove, a Leap Motion sensor, and an head-mounted display, integrated together to provide compelling immersive sensations. This technology will be adopted as a starting point for the project.

 

References

[1] Filippo Sanfilippo and Kolbjørn Austreng. Sustainable Approach to Teaching Embedded Systems with Hands-On Project-Based Visible Learning. International Journal of Engineering Education 37(3):814–829, 2021.

[2] Filippo Sanfilippo and Kolbjørn Austreng. Enhancing Teaching Methods on Embedded Systems with Project-Based Learning. In Proceeding of the IEEE International Conference on Engineering, Technology and Education (TALE), Wollongong, Australia. 2018, 335–342.

[3] Filippo Sanfilippo and Claudio Pacchierotti. A Low-Cost Multi-Modal Auditory-Visual-Tactile Framework for Remote Touch. In Proceeding of the 3rd IEEE International Conference on Information and Computer Technologies (ICICT), Silicon Valley, San Jose, United States. 2020, 213–218.

[4] Filippo Sanfilippo, Tomas Blažauskas, Gionata Salvietti, Isabel Ramos, Silviu Vert, Jaziar Radianti, and Tim A. Majchrzak. Integrating VR/AR with Haptics into STEM Education. In Proceeding of the 4th International Conference on Intelligent Technologies and Applications (INTAP 2021), Grimstad, Norway. 2021.

[5] Filippo Sanfilippo, Tomas Blažauskas, Martynas Girdžiūna, Airidas Janonis, Eligijus Kiudys and Gionata Salvietti. A Multi-Modal Auditory-Visual-Tactile e-Learning Framework. In Proceeding of the 4th International Conference on Intelligent Technologies and Applications (INTAP 2021), Grimstad, Norway. 2021. (Best Conference Paper).

Filippo Sanfilippo