Published on March 5, 2014
BIG Data + Open Data - BIG Opportunities Ahead Institute of Public Administration of Canada Jury Konga, Principal eGovFutures Group @jkonga Ontario Investment & Trade Centre Toronto, Ontario. March 4, 2014
Overview Context … Big , Open Some challenges … The Road ahead - Opportunities of Big & Open Data Title graphics from City 2.0 Jury Konga Open by Design TM 2
Context – Yesteryear and Today Jury Konga Open by Design TM Source: Don Tapscott 2012 TED Global 3
Context – (Big) Data Landscape Add Data Visualization Key: Data Management, IM, RM Jury Konga Open by Design TM 4
“A Colloquial Definition of Big, Open, and Personal Data” Context – B-O-P Data Big Data is (i) data that you cannot handle with conventional tools or (ii) a term used as a vague metaphor for solving problems with data. Open Data is data that anyone can use; without legal, technical or financial barriers. More formal Open Knowledge Foundation writes: A piece of data or content is open if anyone is free to use, reuse, and redistribute it — subject only, at most, to the requirement to attribute and/or share-alike. Personal Data is data derived from people, where you can distinguish a person from other people in the group. Source: The Open Data Institute (UK) github.com/theodi/data-definitions Jury Konga Open by Design TM More formal: personally identifiable information (PII) from the ISO 29100 standard (privacy framework). 5
Context – Personal Data Source: Open Data Institute github.com/theodi/data-definitions Jury Konga Open by Design TM 6
Context – Privacy Source: Ontario IPC www.privacybydesign.ca/ “One of the most important ways to address the privacy issues associated with big data is to routinely de-identify health information prior to its use or disclosure for research purposes” Also related to Open Data: www.ipc.on.ca/english/access-to-information/Introduction-to-AbD/ Jury Konga Open by Design TM Dr. Ann Cavoukian, Information & Privacy Commissioner 7
Context – How Big is Big Data 3,500 Petabytes in N. Am. Growing 35 Zetta bytes per year 1000 Megabytes = 1 Gigabyte, 1000 Gigabytes = 1 Terabyte , 1000 Terabytes = 1 Petabyte , 1000 Petabytes = 1 Exabyte … Zetta, Yotta Jury Konga Open by Design TM 8
1.3M YouTube views; 2+M Google searches Context – an Internet Minute Jury Konga Open by Design TM … it continues to grow – in size and services 9
Context - Internet of Everything Source: http://blogs.cisco.com/ioe/answering-the-two-most-asked-questions-about-the-internet-of-everything/ Jury Konga Open by Design TM 10
Context - Our “Connected Planet” Source: Don Tapscott - 2013 talk, the Tapscott Group Jury Konga Open by Design TM 11
Context – How Big is Big Data LOTS of Players! Source: Jury Konga Open by Design TM 12
Context – How Open is Open Data Currently 63 countries Jury Konga Open by Design TM Currently …. Federal BC, AB, ON, QC 40 municipalities 13
Context – How Open is Open Data Metrics on open data vary as per definition and/or methodology Jury Konga Open by Design TM 14
Open – not just Government Data In Stunning Win For Open Science, Johnson & Johnson Decides To Release Its Clinical Trial Data To Researchers … Forbes, Jan. 30, 2014. “Open Science” has 2 focal points Open scientific software Open access to scientific data Jury Konga Open by Design TM 15
Open – not just Government Data Jury Konga Open by Design TM 16
Lots of BIG and Open Data - No value without use … recognize some challenges Jury Konga Open by Design TM 17
Challenges … Technology Jury Konga Open by Design TM Source: 18
Challenges … Corporate IM Look familiar? Often we don’t know what we have! DATA DATA DATA DATA Jury Konga Open by Design TM DATA DATA DATA DATA DATA DATA DATA DATA Life in Silo land DATA DATA DATA DATA 19
Challenges … Corporate Culture Outdated Policies Jury Konga Open by Design TM Resistance to Change Risk Aversion Leadership 20
TED 2012 Winner - Not to an individual, but to an idea Opportunities -Big Data & City 2.0 Stats on urbanization Urban challenges & opportunities include “The City 2.0 is a place of beauty, wonder, excitement, inclusion, diversity, life.” Jury Konga Open by Design TM • • • • • • Transportation Housing Energy Environment Education Community Wellbeing 21
Big Data Opportunities - Smart Cities /Intelligent Communities City of the Future Source: IDC Whitepaper on “Delivering Next Generation Citizen Services” Smart + Connected Communities Jury Konga Open by Design TM 22
Big Data Opportunities - Smart Cities Process is simple, Execution is complex Jury Konga Open by Design TM 23
Big Data Opportunities - Smart Geographic Area or Theme Not just at city level … it’s a continuum Themes include: • • • • • • • … sensor city Jury Konga Open by Design TM Health Environment Transportation Energy Natural Resources Education Economic Development 24
Big Data Opportunities - real time Mobile World Algorithm Assessment Global “Solutions “ Hub Time Series Analytics Global Sensor Feeds Source: NASA Jury Konga Open by Design TM Source: Shore-Designs.com Source: AutoGuide.com 25
Opportunity - Integrated Service Delivery Service Requests Requests from MyGovID 1 (Facebook, Linkedin, Twitter) Service One (2.0) 2 - The Service Coordinator Integrated Service Delivery “Engine” 3 •Products & Services Standardized Processes, Protocols and Knowledge Base •Products & Services Provincial Municipal Process A 3 Private & NonProfits •Products & Services Process B Process C Federal •Products & Services Business Knowledge Database Source: From a Social to a Service Web, 2009. www.slideshare.net/jkonga Jury Konga Open by Design TM 26
Opportunities - Open Data fuels the Digital Economy Government Data Corporate Data OPEN DATA Community Data & A D V O C A C Y Needs & Feeds Science Data Source: www.slideshare.net/JuryKonga/open-government-intelligent-community-in-the-digital-economy , 2012 Jury Konga Open by Design TM 27
Opportunities - Open Data Economics Source: McKinsey Global Institute; Open data: Unlocking innovation and performance with liquid information Jury Konga Open by Design TM 28
Opportunities - One Stop Open Data Integrate & Scale Public Provincial External Data Linkages (e.g. World Bank) Jury Konga Open by Design TM Share the data Federal OpenData.CA Evolved from Data Infrastructure model circa 1994 Find the data Municipal Service OpenStreetMap Community Updates Academia, NonProfits, Community Groups OpenData. EARTH USE the data Source: Municipal Open Government Framework, 2010 www.slideshare.net/jurykonga 29
Opportunities - Local2Global view Wellbeing Ontario RGIS Real-time Global Information Sensors network Wellbeing Jury Konga Open by Design TM Earth Wellbeing Canada 30
Environmental Wellbeing - A COMPLEX ecosystem AIR Global National Opportunities - Big & Open Data WATER Global National Provincial Provincial Local Local Real-time Open Environmental Network Global National Jury Konga Open by Design TM National Provincial BIODIVERSITY Global Provincial Local LAND Local 31
Opportunities - Open & Crowdsourced Data Feeding Infrastructure Planning Government Decision Making … both asset & liability Public Sector Data Sharing Jury Konga Open by Design TM Open 311 Open Data Feeds Boston Street Bump App 32
Improve Outcomes Jury Konga Open by Design TM Opportunities – Open Data Analytics … discover & share best practices 33
Opportunity - Big Data, Open Data, Personal Data ETA & Patient Data U.S. Blue Button service Digital Health Records 4 511 Road & Traffic Updates 3 Family 4 Responders Transport Info Medical Emergency Auto 911 ETA Data 2 Heart Attack Sensed 1 … what’s stopping us from having this Jury Konga Open by Design TM (Concept) AED(efib) Data 3 Social Media (with Subject location) 34
BIG opportunities … just the beginning. Jury Konga Open by Design TM 35
BIG & OPEN Data Opportunities … making the world a better place Jury Konga, Principal eGovFutures Group Affiliations Open Knowledge Foundation, Canada Ambassador Canadian Open Data Institute – Co-Founder Ontario IPC “Access by Design” Ambassador email@example.com @jkonga www.slideshare.net/jurykonga
103 3 Big Data: Challenges and Opportunities Roberto V. Zicari CONTENTS Introduction ...
challenges raised by “Big Data for Development” as ... See “Open Data Sites.” < http://www ... Big Data offers the opportunity for an ...
Challenges and Opportunities with Big Data 1. Introduction ... enabling interactive response times is a major open research problem today.
Companies are using this data in powerful analytical tools to operate and market more efficiently and to identify and exploit new market opportunities.
Big data, big value … huge opportunity ... Big data will also drive innovations with an estimated value of GBP 24 billion while new opportunities for ...
Open and big data in Europe: potential growth drivers, or a massively squandered opportunity?
Five big data challenges ... for big data. Instead, ... hurdles, the opportunity for success with a data visualization strategy
Big Data A New World of Opportunities . ... the ^Big Data concerns have moved from big ... One of the most open Big Data technical ...
19 See PCAST report, Big Data and Privacy; ... the potential to dramatically improve learning outcomes and open new opportunities for children, ...