advertisement

Dave Harris

60 %
40 %
advertisement
Information about Dave Harris
Education

Published on March 19, 2008

Author: Demetrio

Source: authorstream.com

advertisement

Toward Improved Visualization of Unstructured Information:  Toward Improved Visualization of Unstructured Information March 4, 2005 National Academy of Sciences Context 2 J. David Harris National Security Agency Context 2:  Context 2 The definition: Visualization in the context of large, unstructured, changing data sets where the relevance, significance, and conceptual links among the data have yet to be discovered Preliminary thoughts Effective visualization of structured data is challenging Unstructured data requires some type of structural mapping . The data discovery and analysis will be imperfect . The mapping will be imperfect, and task dependent An Example of Real Data:  An Example of Real Data A real-world story of intrigue… About a cell of conspiring individuals… Who set forth on a project… Constrained by time and money… Characterized by deception… To advance their own cause. The plot is ultimately discovered… But not before the mission is accomplished. The Players and Their Motivation:  The Players and Their Motivation The Strategy:  The Strategy Discovering “Project X” Exploratory analysis… is there some data that conforms to some pattern? END PROJECT Acquire Land for Florida Property START PROJECT Walt Disney World Company ORGANIZE EXECUTE The Investigation:  The Investigation Purchase Land Disguise Travel Patterns Acquire Mineral Rights Define Operation Establish Schedule Secure Finances Identify Purchase Agents Disguise Travel Patterns Establish Aliases for Agents Obfuscate Communications Establish Dummy Corporations Discovering “Project X” Refining the pattern…but only some of the pattern is observable in the unstructured, varied, uncertain and continuously updated data END PROJECT Acquire Land for Florida Property START PROJECT Walt Disney World Company ORGANIZE EXECUTE Retrospective analysis? Or prospective analysis? The Observables:  The Observables Establish aliases for purchase agents, and incorporate Important information is dominated by irrelevant data There’s very little evidence on which to base decisions… Relevant observations, (semi-)notional: COMPANY NAME POC STATE DATE ( Compass East Group, Roy Davis, Delaware, 7 December 1964 ) ( Tomahawk Properties, Inc., Bob Price, Florida, January 1965 ) (Latin-American Dev and Mgmt Corp, Roy Davis, Florida, February 1965 ) ( Ayefour Corporation, Bob Foster, Florida, February 1965 ) ( Bay Lake Properties, Inc., Bob Price, Florida, March 1965 ) ( Reedy Creek Ranch, Inc., M. T. Lott, Florida, June 1965 ) Incorporations More Observables:  More Observables Purchase land The plot begins to unfold… Correlated events emerge (both within and across streams) Incorporations Land Acquisition Relevant observations: PURCHASING AGENT TRANSACTION DATE LONGITUDE LATITUDE ACRES The Discovery:  The Discovery Orlando Sentinel Dateline—May 4, 1965 Reported that two real estate transactions totaling over $1.5 million had been made…for nearly 9,000 acres of land near the small Florida farming town of Orlando Dateline—October 20, 1965 Reported that Walt Disney was secretly behind the purchase of land LOGICAL “COMMUNITY OF INTEREST” PHYSICAL and TEMPORAL PROXIMITY OF TRANSACTIONS Vagueness (Dynamism) of Hypotheses Unknown Sources of Data and Information Relevant Data Concealed by “Noise” Uncertain and Erroneous Observations (Causally) Incomplete Context…Missing Data Logical and Physical Structures But It Was Too Late:  But It Was Too Late Disney’s “Project X” Began in the early 1960’s The Florida site was selected on November 22, 1963 Ayefour Corporation buys the first parcel of land on October 23, 1964 An official announcement was made by Disney on November 15, 1965 They had acquired 27,443 acres of land SW of Orlando… And they had “big plans” The first acre: $80 The final acre: $80,000 What did it cost? About $185/acre, on average Why is This Context Interesting?:  Why is This Context Interesting? The definition: Visualization in the context of large, unstructured, changing data sets where the relevance, significance, and conceptual links among the data have yet to be discovered To enable understanding! Retrospective Forensics Prospective Investigative Reporting Business Intelligence Security The “Context 2” Agenda:  The “Context 2” Agenda Ronald Coifman Yale University Diffusion/Inference Geometries of Data Features, Situational Awareness and Visualization Andre Skupin University of New Orleans A Different Kind of Map Stephen Eick University of Illinois at Chicago; SSS Research DECIDETM Hypothesis Visualization Tool Dave Harris National Security Agency Reactions and discussion Reactions and Discussion…:  Reactions and Discussion… Context 2…the definition: Visualization in the context of large, unstructured, changing data sets where the relevance, significance, and conceptual links among the data have yet to be discovered Perception and cognition of visualization Reasoning under uncertainty Perception and Cognition of Visualization:  Perception and Cognition of Visualization Map-making Simplification What’s important? Who’s the intended audience? How might we measure interpretability? Classification Symbolization Induction Visualize… Existence Notation on a map that a point or area exists Associative existence Added absolute or relative quantity to the identified points and areas Spatially associated existence Spatial relationships between points and areas This representation of the Orlando metropolitan area is targeted at tourists… Maps are a specific type of diagram with which most people have experience Perception and Cognition of Visualization:  Perception and Cognition of Visualization How can we capture the dynamic nature of data? Maps are snapshots…but they require little additional training Can we place thematic overlays on top of term-document landscapes? as a means of creating different views of the same data... How do we encourage interactivity? What can’t be represented using topography only? For unstructured data… What kind of mappings can we impose? Some structure may be due to contact or context (not content)… What might roads represent? What about rest areas? National Parks? Hospitals? How is uncertainty represented? Reasoning Under Uncertainty:  Reasoning Under Uncertainty A critical aspect of Context 2 Visualization of the hypotheses… Capture the intent of the task and subject matter expertise Guide the exploration and analysis Customize the visualization Reasoning Under Uncertainty:  Reasoning Under Uncertainty Multiple (competing) hypotheses Alternative models, at the onset… or after improved/diminished understanding Machine-learning can (should?) offer data as... Supporting evidence Contradictory evidence Change in the actual plan Changing world events What to Visualize?:  What to Visualize? How do we decide what’s important? We (probably) don’t need all of these observations? Incorporations Land Acquisition Final Thoughts:  Final Thoughts So… Visualization influences hypothesis generation Hypothesis generation influences analysis Analysis influences visualization Reactions and Discussion…:  Reactions and Discussion… Select relevant information from assembled data Impose some kind of structure… Apply graphic techniques To enable understanding…

Add a comment

Related presentations

Related pages

Dave Harris - Wikipedia, the free encyclopedia

The topic of this article may not meet Wikipedia's notability guideline for biographies. Please help to establish notability by citing reliable secondary ...
Read more

Dave Harris Profiles | Facebook

View the profiles of people named Dave Harris on Facebook. Join Facebook to connect with Dave Harris and others you may know. Facebook gives people the...
Read more

Dave Harris — Free listening, videos, concerts, stats and ...

Watch videos & listen free to Dave Harris: Dinner Music for a Pack of Hungry Cannibals, The Penguin & more. Up in Victoria on Vancouver Island in ...
Read more

Dave Harris One Man Band - Facebook

Dave Harris One Man Band. 781 likes · 28 talking about this. Head, Hands & Feet available for order here!...
Read more

Dave Harris « The Country Blues

Up in Victoria on Vancouver Island in British Columbia, Canada, there is a wily busker keeping the old traditional folk blues flames burning. Busking, as ...
Read more

Dave Harris (@davidjayharris) | Twitter

The latest Tweets from Dave Harris (@davidjayharris). Postdoctoral researcher in the @weecology lab at @UF. I design statistical methods for community ecology
Read more

Retro Rewind - with DAVE HARRIS

Retro Rewind with Dave Harris is a weekly broadcast that plays the hits and rare classics from the late 70's, 80's and 90's. Also included are exclusive ...
Read more

Top 10 Dave Harris profiles | LinkedIn

View the profiles of professionals named Dave Harris on LinkedIn. There are 4,232 professionals named Dave Harris, who use LinkedIn to exchange information ...
Read more

Dave Harris - Head of SAP Competence - Allied Domecq Plc ...

Head of SAP Competence ... Anmelden und ganzes Profil ansehen Anmelden und Profil ansehen
Read more

Councillor Dave Harris - Dave's blog (scroll down to view)

Borough Councillor Dave Harris, Working for Colchester and Berechurch residents. (Also County Councillor for Shrub End and Berechurch )
Read more