Abstract
In this paper we report the results of a series of experiments conducted as part of a participatory Research through Design (RtD) project [1] which aims to develop interactive jewels for deaf women. The project moved from the idea of bringing mindful attention to aesthetics in designing for disability, exploring cross-modal sensory associations. Our jewels detect ambient sound and represent them with light patterns, vibration patterns, and shape change. Preferences can be set through an app that allows to record sounds of interest (e.g. doorbell, a household appliance) and to notify them through visual or tactile feedback of the jewel.
In order to design meaningful cross-modal sensory associations between sounds in input and behaviours of the jewels in output, we engaged hearing and deaf people in an experiment on the association of light patterns to sound types. Preliminary results show the difficulty in associating light patterns to sound types without listening to the sound during the task. On the contrary, when the sound was preliminary heard, there was a higher possibility to associate it with the correct light pattern. Even if the results of the experiment are preliminary due to the small sample size of participants and the limited number of sounds used in the study, nevertheless they gave us insights about the design of the jewelry system and for follow up studies.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Wilde D, Marti P (2018) Exploring aesthetic enhancement of wearable technologies for deaf women. In: 13th ACM SIGCHI conference proceedings designing interactive system. ACM, Hong Kong
Quietude. www.quietude.it. Accessed 4 June 2018
WEAR (Wearable technologists Engage with Artists for Responsible innovation). https://wearsustain.eu/. Accessed 4 June 2018
Zimmerman J, Forlizzi J (2014) Research through design in HCI. In: Olson JS, Kellogg WA (eds) Ways of knowing in HCI, pp 167–189. Springer
Zimmerman J, Forlizzi J, Evenson S (2007) Research through design as a method for interaction design research in HCI. In: SIGCHI conference on human factors in computing systems proceedings, CHI 2007, pp 493–502. ACM, San Jose, California, USA
Löwgren J (2016) On the significance of making in interaction design research. Interactions 23:27–33
Gaver, W.: What should we expect from research through design? In: SIGCHI conference on human factors in computing systems proceedings, CHI 2012, pp 937–946. ACM, Austin, Texas, USA
Gaver W, Blythe M, Boucher A, Jarvis N, Bowers J, Wright P (2010) The prayer companion: openness and specificity, materiality and spirituality. In: SIGCHI conference on human factors in computing systems proceedings, CHI 2010, pp 2055–2064. ACM, Atlanta, Georgia, USA
Odom W (2015) Understanding long-term interactions with slow technology: an investigation of experiences with FutureMe. In: SIGCHI conference on human factors in computing systems proceedings, CHI 2015, pp 575–584. ACM, Seoul, Republic of Korea
Vibeat. http://www.designindaba.com/articles/creative-work/wearables-helping-deaf-feel-beat. Accessed 4 June 2018
Gorman BM, VisAural: a wearable sound localisation device for people with impaired hearing. In: 16th international ACM SIGACCESS conference proceedings on computers & accessibility, pp 337–338. ACM, Rochester, New York, USA
Vest. https://www.redbull.com/us-en/neosensory-vest-interview. Accessed 4 June 2018
Cute Circuit’s Sound-Shirt. http://cutecircuit.com/soundshirt/. Accessed 4 June 2018
VibroHear. http://www.abledata.com/product/vibrohear. Accessed 4 June 2018
Music for Deaf People. https://www.fastcompany.com/1653578/how-collar-could-help-deaf-people-hear-music. Accessed 4 June 2018
Harrison C, Horstman J, Hsieh G, Hudson S (2012) Unlocking the expressivity of point lights. In: SIGCHI conference on human factors in computing systems proceedings, Austin, Texas, USA
Kamlesh Sridhar P, Petry B, Pakianathan PVS, Kartolo AS, Nanayakkara S (2016) Towards one-pixel-displays for sound information visualization. In: 28th australian conference on computer-human interaction, pp 91–95, Launceston, Australia
Shinohara K, Tenenberg J (2009) A blind person’s interactions with technology. Commun ACM 52(8):58–66
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Marti, P., Iacono, I., Tittarelli, M. (2019). Experiencing Sound Through Interactive Jewellery and Fashion Accessories. In: Bagnara, S., Tartaglia, R., Albolino, S., Alexander, T., Fujita, Y. (eds) Proceedings of the 20th Congress of the International Ergonomics Association (IEA 2018). IEA 2018. Advances in Intelligent Systems and Computing, vol 824. Springer, Cham. https://doi.org/10.1007/978-3-319-96071-5_140
Download citation
DOI: https://doi.org/10.1007/978-3-319-96071-5_140
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-96070-8
Online ISBN: 978-3-319-96071-5
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)