Published on February 20, 2014
MWF 2014 Wearable Technology for Museums
who we are? user experience and technology
Rokivo & Vidiemme Rokivo Inc. is an American company based in New York and Turin, specialized in user experience, or the design of the experience on different types of screens (computer, smartphone, tablet, etc..) www.rokivo.com #werok Vidiemme Consulting Srl is an Italian company based in Milan, key player in the digital context and focused on technology innovation for web, mobile and wearables www.vidiemme.it #weroll Rokivo and Vidiemme have brought to Italy one of the Google Glass Explorer Edition prototypes, the program opened so far only to US residents with the objective to develop new apps for this revolutionary device.
the speaker Giulio Caperdoni COO Vidiemme Consulting
the speaker Valerio Saffirio Founder Rokivo
what does it mean to develop for Google Glass?
two options to develop on Glass March 2013 November 2013 Mirror API GDK The Google Mirror API allows you to build webbased services, called Glassware, that interact with Google Glass, but do not run on it. The Glass Development Kit (GDK) is an add-on to the Android SDK that lets you build Glassware that runs directly on Glass. Platform independence Common infrastructure Built-in functionality Real-time User Interaction Source: https://developers.google.com/glass/develop Offline Functionality Access to Hardware
focus on GDK Android SDK Layouts, view and other UI widgets GPS, Sensors and other hardware Activities, services and other building block GDK add-on The GDK is an Android SDK add-on that contains APIs for Glass-specific features. By using the Android SDK and GDK, you can leverage the vast array of Android APIs and also design an optimal user experience for Glass. Voice Cards Gesture Detector Source: https://developers.google.com/glass/develop/gdk
why GDK is so important? because it opens up endless possibilities to leverage all the “senses” of the device because it allows to add functionalities, voice commands and gestures because it allows a better integration with external services
designing for Glass UI elements allow 3 pattern types: Glass has its own rules and guideline for design and use, that are fundamentally different from existing mobile and desktop platforms and that need to be taken into consideration when creating the user experience. While computers and smartphones may store a medium to large quantity of data, Glass works best with information that is simple, relevant, and current. forever last year last month now Source: https://developers.google.com/glass/design/principles • Static card - Displays text, HTML, images, and video. Static cards can invoke live cards or immersions • Live card – Show content that is important at the current time and constantly update to keep information fresh and relevant • Immersion - Customized UI experiences that take over a user's focus and display outside of the timeline experience
GOOGLEGLASS4LIS - museum for deaf
what the LIS language is? The LIS is the Italian Sign Language used by those deaf people that cannot speak or write Italian. Every community may have its own sign language; the Italian one is different from the one used in America for example and even in Italy there are different “dialects”. LIS is based on “signs”. Signs are the results of different parameters: Manual Hand movements Hands orientation Place Configuration Non manual Facial expression Oral behavior Posture Each sign is obtained combining basic units of meaning, called cheremes in Italian. Cheremes are ordered in accordance to LIS specific syntactic rules. “Mom’s car” becomes “Mom + Car + Hers” Combining cheremes in new ways it is possible to create new signs.
GoogleGlass4LIS GoogleGlass4LIS is the first experimental project to develop an App intended to deaf people to provide a full and accessible museum experience a project by in collaboration with sponsored by
the concept PLAY
how does it work? 1 Within the museum the deaf person wears Google Glass and looks at the statue of interest 4 2 3 Google Glass displays the avatar on its display GoogleGlass4LIS App recognizes the statue based on its position Information on the statue are linked with the corresponding translation produced by the ATLAS platform and rendered through an avatar signing the LIS
Statue of king Ramses II … Final User Experience
the ATLAS platform GoogleGlass4LIS is based on the ATLAS (Automatic Translation into Sign Languages) platform, a huge project started in 2009 funded by Regione Piemonte and the EU. The platform is able to translate any Italian text or audio to LIS. The platform creates in real time an avatar that can then be displayed on any digital device (smartphone, tablet and – of course – Google Glass). SET of VOCABULARY Input: Subtitles Audio Audio/Video Text* Intermediate Format Weather forecast Train station Museum (to be created for the project) … “Signs” for the virtual avatar *ATLAS core
(r)evolutions Build an App useful for many types of deafness, disabilities or educational needs: Subtitles for non-LIS speaking, Children, Foreigners , … Making the entire museum interactive with indoor positioning systems
press release DOWNLOAD THE FULL PRESS RELEASE HERE
indoor positioning systems
indoor location and positioning • Bringing the power of GPS and maps indoor • Tying digital information to physical places • Instead of punching a 3 digit number into a handheld tour guide, you could walk up to a painting, pull out your smartphone, and find additional info right there waiting for you • No single technology is ubiquitous • There are trade-offs to each of the technologies. WiFi is low cost and ubiquitous, but not very accurate*; high precision location usually requires higher cost and infrastructure work *High accuracy is considered to be 1 to 5 meters, medium accuracy is 6 to 10 meters, and low accuracy is over 11 meters
WiFi fingerprinting • The localization technique is based on measuring the intensity of the received WiFi signal and generating a “fingerprint” for every different position Accuracy • medium Availability • ubiquitous • • Glass compares its current WiFi fingerprint to Fingerprint/Location database in order to find its position The accuracy depends on the number of positions that have been previously entered into the database Glass issue • WiFi signal sampling frequency is much slower than usual in order to safeguard battery life o localization takes longer than with a smartphone
beacons • They are low-cost gizmos that continually beam out a Bluetooth signal, running for up to a year on a small watch battery and located at defined positions within a building Accuracy • high Availability • iOS7 – Android 4.3 • • Beacons come in different formats - including small coin cell powered devices and USB sticks - and software versions A beacon could pinpoint an item’s location in a room Glass issue • Not compatible with current Android version (4.0.4) • Temporary workaround: 1. Beacon is discovered by the smartphone paired with the Glass 2. Beacon Id is sent to Glass by the smartphone
contacts Rokivo Inc. email@example.com - www.rokivo.com 244 Fifth Avenue Suite F263, New York, NY 10001 Rokivo Srl - Via Giolitti, 41 - 10123 Turin (TO) Vidiemme Consulting Srl firstname.lastname@example.org - www.vidiemme.it Via Natale Battaglia, 8 - 20127 Milan (MI) contacts Valerio Saffirio +email@example.com contacts Giulio Caperdoni +firstname.lastname@example.org
Post-web technology: ... Beyond mobile lies the rapidly evolving territory of wearable technology. Museums might have their reservations about the social ...
The future of museums is changing. Gone are the days of a static and internal cerebral experience and instead, a simple visit to a museum is becoming a ...
The Role of Wearable Technology in the Museum Experience. Posted by Elizabeth Alton on Thursday, January 15th, 2015
How can technology improve the museum experience? Published: October 2, 2014 Author: Kati Price Section: Digital Media at the V&A Tags: digital, innovation
Wearable technology refers to devices that can be worn by users, taking the form of an accessory such as jewelry, sunglasses, a backpack, or even actual ...
Wearable Technology ... Our products are sold around the world in retailers such as Halfords and the Science Museum ... Wearable Technologies Limited ...
Fashion and technology are having a moment, and we're not the only ones who've noticed. Museums, those vaults of history and society, are clearly paying ...
This post offers a closer look at how the Internet of Things and wearable technology is impacting the theme park and museum environment.