Google Glass app for colorblind individuals and people with impaired vision

50 %
50 %
Information about Google Glass app for colorblind individuals and people with impaired vision

Published on December 16, 2016

Author: sociallearning_tugraz

Source: slideshare.net

1. www.tugraz.at Institute of Information Systems and Computer Media OmniColor Google Glass app for colorblind individuals and people with impaired vision December 15th, 2016 Georg Lausegger, BSc.

2. 2 Agenda 1. Motivation 2. Colorblindness 3. Smartglasses 4. OmniColor Prototype 5. Evaluation and Results 6. Outlook Georg Lausegger, BSc., December 15th, 2016 2/16

3. 3 Motivation Motivation Fig. 1: Raw meat Fig. 2: Clothes Fig. 3: Traffic Lights, taken from wikipedia.org1 Fig. 4: Bananas, taken from banabay.com2 (1) https://de.wikipedia.org/wiki/Ampel , (2) http://www.banabay.com/press-room/going-green/ Georg Lausegger, BSc., December 15th, 2016 3/16

4. 4 Colorblindness Colorblindness Human Eye Consists of rods and cones Cones classified in three different types L (long-) wavelength (Red) M (middle-) wavelength (Green) S (short-) wavelength (Blue) Colorblindness = lack or disfunction of one or more cone type(s) Georg Lausegger, BSc., December 15th, 2016 4/16

5. 5 Colorblindness Colorblindness types Anomalous trichromacy Protanomaly Deuteranomaly Tritanomaly Dichromatism Protanopia Deuteranopia Tritanopia Monochromacy Fig. 5: The three colorblindness types, taken from Johaness Ahlmann3 (3) https://www.flickr.com/photos/entirelysubjective/6146852926 Georg Lausegger, BSc., December 15th, 2016 5/16

6. 6 Colorblindness Colorblindness Testing Methods Color arrangement test Ishihara color plate test Fig. 6: Color arrangement test, taken from color-blindness.com4 Fig. 7: Ishihara color plate test, taken from color-blindness.com4 (4) http://www.color-blindness.com/ Georg Lausegger, BSc., December 15th, 2016 6/16

7. 7 Colorblindness Daltonization Doesn’t affect each pixel Color shifting algorithm Algorithm consisting of 4 steps: RGB to LMS color space Simulation of the specific color blindness type Calculate compensation Convert LMS values back to RGB Georg Lausegger, BSc., December 15th, 2016 7/16

8. 8 Smartglasses Devices Smartphones + computation power + distribution + costs - handfree navigation - availability Smartglasses + handfree navigation + availability - computation power - distribution - costs Georg Lausegger, BSc., December 15th, 2016 8/16

9. 9 Smartglasses Google Glass Optical Head-mounted display Released in February 2013 Upgraded Model(2GB RAM) costs ∼1500$ Input via voice commands, touchpad or head gestures Fig. 8: Sergey Brin wearing Google Glass, taken from Andrew Kelly/Reuters5 (5) http://www.computerworld.com/article/2495675/personal-technology/google-s-sergey-brin-rips-smartphones– shows-off-glass.html Georg Lausegger, BSc., December 15th, 2016 9/16

10. 10 OmniColor Prototype OmniColor Prototype Non-real time All computations performed on Glass No network connection required Uses OpenCV library OmniColor Flow Design Georg Lausegger, BSc., December 15th, 2016 10/16

11. 11 Evaluation and Results Evaluation Ishihara color plate test without OmniColor with OmniColor Individual appointments 14 Participants Five colorblind people Nine people with normal color vision Fig. 9: Ishihara color plate test performed with by participant with OmniColor Georg Lausegger, BSc., December 15th, 2016 11/16

12. 12 Evaluation and Results Results (Colorblinds) Participant age CVD* Without OmniColor With OmniColor 36 protanomaly 7/17 12/17 48 protanomaly 2/17 11/17 37 protanomaly 3/17 12/17 28 protanomaly 7/17 13/17 41 protanomaly 8/17 14/17 Tab. 1: Results of the Ishihara color plate test performed by colorblind participants *Color Vision Deficiency Georg Lausegger, BSc., December 15th, 2016 12/16

13. 13 Outlook Outlook Hardware issues with Google Glass Google Glass discontinued in January 2015 Great potential of smartglasses Further work Other approaches and algorithms Performance optimization (offloading) Support for other Android Smartglasses Georg Lausegger, BSc., December 15th, 2016 13/16

14. 14 Thank you for your attention! Georg Lausegger, BSc., December 15th, 2016 14/16

15. 15 References I [1] David Flatla and Carl Gutwin. “SSMRecolor: Improving Recoloring Tools with Situation-specific Models of Color Differentiation”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’12. Austin, Texas, USA: ACM, 2012, pp. 2297–2306. ISBN: 978-1-4503-1015-4. DOI: 10.1145/2207676.2208388. URL: http://doi.acm.org/10.1145/2207676.2208388. [2] Jia-Bin Huang et al. “IEEE Int’l Conf on Acoustics, Speech and Signal Processing, (ICASSP 2009)”. In: Image Recolorization For The Colorblind. Apr. 2009. [3] Luke Jefferson and Richard Harvey. “An Interface to Support Color Blind Computer Users”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI ’07. San Jose, California, USA: ACM, 2007, pp. 1535–1538. ISBN: 978-1-59593-593-9. DOI: 10.1145/1240624.1240855. URL: http://doi.acm.org/10.1145/1240624.1240855. [4] D. S. Khurge and B. Peshwani. “Modifying Image Appearance to Improve Information Content for Color Blind Viewers”. In: Computing Communication Control and Automation (ICCUBEA), 2015 International Conference on. Feb. 2015, pp. 611–614. DOI: 10.1109/ICCUBEA.2015.125. [5] Viet Nguyen and Marco Gruteser. “First Experiences with GOOGLE GLASS in Mobile Research”. In: GetMobile: Mobile Comp. and Comm. 18.4 (Jan. 2015), pp. 44–47. ISSN: 2375-0529. DOI: 10.1145/2721914.2721931. URL: http://doi.acm.org/10.1145/2721914.2721931. [6] H´elio M. de Oliveira, J. Ranhel, and R. B. A. Alves. “Simulation of Color Blindness and a Proposal for Using Google Glass as Color-correcting Tool”. In: CoRR abs/1502.03723 (2015). URL: http://arxiv.org/abs/1502.03723. Georg Lausegger, BSc., December 15th, 2016 15/16

16. 16 References II [7] Brooke E. Schefrin. “Diagnosis of Defective Colour Vision, by Jennifer Birch, Oxford University Press, New York, 1993, Paperback, 187 pp., $35.00.” In: Color Research & Application 19.6 (1994), pp. 484–484. ISSN: 1520-6378. DOI: 10.1002/col.5080190608. URL: http://dx.doi.org/10.1002/col.5080190608. [8] N. A. Semary and H. M. Marey. “An evaluation of computer based color vision deficiency test: Egypt as a study case”. In: Engineering and Technology (ICET), 2014 International Conference on. Apr. 2014, pp. 1–7. DOI: 10.1109/ICEngTechnol.2014.7016817. Georg Lausegger, BSc., December 15th, 2016 16/16

Add a comment