Digital Dexterity (2024)

Digital Dexterity – Tailored 3D Printing for Hand Posture Sensing (2024)

Svenya Duffy

In our daily lives, hands are indispensable tools for carrying out a wide array of tasks, from the mundane to the highly specialized. Their function goes beyond the physical realm, increasingly becoming essential for interaction in the virtual world. In these digital environments, hands often serve as controllers, acting as the primary interface between users and virtual experiences. The ability to accurately detect finger and hand movements—referred to as hand posture sensing—has become a crucial aspect of translating physical gestures into corresponding digital actions. This is especially important for applications like virtual reality (VR), augmented reality (AR), and gaming, where immersion and user control depend heavily on precision.

Currently, the most common approach to hand posture sensing involves the use of sensors integrated into wearable devices such as gloves. These sensor-laden gloves track hand and finger movements and translate them into digital signals. However, there are several limitations with these systems that hinder their broader adoption and effective use. One of the primary challenges is the durability of the sensors. Over time, wear and tear from constant use can degrade the sensors’ functionality, leading to inaccurate readings or complete failure. Additionally, the precision of these gloves is often called into question, as small inaccuracies in sensor placement or calibration can lead to a mismatch between the user’s physical movement and the digital response. Furthermore, positioning the sensors in a way that accounts for all the fine motor skills of the hand can be difficult, limiting the accuracy and naturalness of the interaction.

This research explores whether 3D printing can offer solutions to the existing challenges in hand posture sensing. With advancements in additive manufacturing – particularly the ability to print directly onto flexible materials like fabric – 3D printing presents a unique opportunity to design customised, precise, and durable sensor layouts. One key advantage of 3D printing is its accessibility: individuals and small businesses can rapidly iterate designs at a lower cost than traditional manufacturing processes. In this context, 3D printing allows for the creation of bespoke components, such as structural reinforcements for sensors, which are based on a 3D scan of the user’s hand. This ensures a precise fit, which enables accurate data collection and could prolong the sensor’s lifespan.

One of the primary innovations of this research is the integration of 3D-printed structural modifications. These additions serve several functions, such as improving the placement of sensors to ensure more accurate readings and providing protection to prevent damage from wear and tear. The combination of these enhancements not only addresses the immediate challenges of sensor durability and accuracy but also opens the door to the creation of bespoke, market-ready products tailored to specific user needs.

The practical application of this research lies in its potential to revolutionize augmented reality experiences, particularly in areas like playing musical instruments in a virtual environment. By offering a more accurate and responsive interface, users can engage with immersive virtual worlds in ways that were previously impossible, creating new opportunities for interaction, creativity, and performance. This project not only contributes to the field of hand posture sensing but also sets the stage for more advanced, immersive applications in virtual and augmented reality spaces.

This research was supported by the NZ Product Accelerator

Materials and Processes

Software

GrabCAD Print

Hardware

Stratasys J850 printer

Project Level:

Master of Design Innovation (MDI) thesis, supervisor Ross Stevens