advertisement

MediaEval 2011 SED Opening

50 %
50 %
advertisement
Information about MediaEval 2011 SED Opening
Technology

Published on September 3, 2011

Author: troncy

Source: slideshare.net

Description

Opening presentation of the Social Event Detection (SED) task at MediaEval 2011 and EURECOM's participation, September 2011, Pisa, Italia
advertisement

Social Event Detection (SED): Challenges, Dataset and Evaluation RaphaëlTroncy<raphael.troncy@eurecom.fr> VasileiosMezaris<bmezaris@iti.gr>Symeon Papadopoulos <papadop@iti.gr>Benoit Huet<benoit.huet@eurecom.fr> IoannisKompatsiaris<ikom@iti.gr>

What are Events? Events are observable occurrences grouping 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 2 People Places Time Experiences documented by Media

Two challenges (type and venue) Find all soccer events taking place in Barcelona (Spain) and Rome (Italy) in the collection. For each event provide all photos associated with it Find all events that took place in May 2009 in the venue named Paradiso (in Amsterdam, NL) and in the Parc del Forum (in Barcelona, Spain). For each event provide all photosassociated with it 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 3

Dataset Construction Collect 73,645 Flickr Photos (May 2009) 98,3% geo-tagged in 5 cities (Amsterdam, Barcelona, London, Paris and Rome) 1,7% (1294) non geo-tagged from EventMedia Altered metadata: geo-tags removed for 80% of the photos (random) 14,465 photos still geo-tagged Provide only metadata … but real media were available to participants if they asked (2,43 GB) 1% (697) photos disappeared in June-July 2011 Who studied the volatility of Flickr photos? 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 4

Ground Truth and Evaluation Measures Ground Truth Use EventMedia and machine tags (lastfm:event=xxx) Manual lookup at photos from Amsterdam and Barcelona Discussion for the corner cases 14 photos discussed for challenge 1 No time for discussion for challenge 2 (single assessor) Evaluation Measures: Harmonic mean (F-score of Precision and Recall) Normalized Mutual Information (NMI): jointly consider the goodness of the photos retrieved and their correct assignment to different events 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 5

Who Has Participated ? 18 Teams registered 7 Teams cross the lines Everybody is present at the workshop! 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 6

Quick Summary of Approaches Up to 5 non-constrained runs per challenge All participants use background knowledge Last.fm (all), Fbleague (EURECOM), PlayerHistory (QMUL) DBpedia, Freebase, Geonames, WordNet Classification vs Information Retrieval approach: City classifier, topic/venue classifier (CERTH) Linear SVM (QMUL) Latent Dirichelet Allocation (LIA) Hybrid (ANU) Image processing: ITI, EURECOM and ANU 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 7

Results (sent to participants) 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 8 Challenge 1 Challenge 2

Results (updated, real?) 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 9 Challenge 1 (ground truth contained photos not present in the dataset) Challenge 2

Challenge 1 (all runs) – F-measure 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 10

01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 11 Challenge 2 (all runs) – F-measure

Conclusion It was an easy task  … BUT people had fun Looking at next year SED Dataset: bigger, more diverse, training vs test sets Media: photos and videos Metadata: include some social network relationships, participation at events Challenges: detect personal events Evaluation measures: event granularity? Time/CPU? … 01/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 12

EURECOM @Social Event Detection (SED) Xueliang Liu <xueliang.liu@eurecom.fr>RaphaëlTroncy<raphael.troncy@eurecom.fr> Benoit Huet<benoit.huet@eurecom.fr>

What are Events? Events are observable occurrences grouping … and announced on the WEB ! 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 14 People Places Time Experiences documented by Media

Approach Get background knowledge about occurrences of past events Information retrieval approach Event information model // metadata + photo query 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 15 Query Event Occurrences Matching

Which Prior Knowledge? Challenge 1 6 past football games in Barcelona and Roma Challenge 2 68 past events recorded in Paradiso and Parc del Forum 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 16

Event Model and Photo Query 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 17 E = {title, geo, time} Event P = {text, geo, time}

Matching Process Given a photo P and an event Ewhere δisthe Dirac delta function N is used for scaling (vary depending on the run) 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 18 p(P|E) = p(P.text|E.title) p(P.geo|E.geo)p(P.time|E.time)

Visual Pruning and Owner Refinement Are photos taken at the event visually similar? Low-level features used: Color moments, Gabor texture, Edge histogram L1 distance on the K-nearest neighbors Photos sorted according to the distance Experimentally, we remove the 5% photos that are far away from the center in the visual feature space Confidence that a media sharer attended an event Effective way to deal with photos without any textual description 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 19

Challenge 1 Run 1: basic Event Identification Model (N=3) Run 2: run 1 + Owner Refinement Photos for 2 games while we had knowledge for 6 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 20

Challenge 2 Run 1 / 3: basic Event Identification Model (N=1) / (N=3) Run 2 / 4: run 1 / run 3 + Owner Refinement Run 5: run 3 + Visual Pruning + Owner Refinement 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 21

Challenge 2 Results – Paradiso 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 22

Challenge 2 Results – Parc del Forum 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 23

Conclusion Event information model using background knowledge: Dedicated resources for Sport Events General event directories for Popular Venues Querying photos with occurrences of past events Importance of time for structuring media collection The way we used visual analysis didn’t add any value 02/09/2011 - Social Event Detection (SED) Task - MediaEval 2011, Pisa, Italy - 24

Add a comment

Related presentations

Presentación que realice en el Evento Nacional de Gobierno Abierto, realizado los ...

In this presentation we will describe our experience developing with a highly dyna...

Presentation to the LITA Forum 7th November 2014 Albuquerque, NM

Un recorrido por los cambios que nos generará el wearabletech en el futuro

Um paralelo entre as novidades & mercado em Wearable Computing e Tecnologias Assis...

Microsoft finally joins the smartwatch and fitness tracker game by introducing the...

Related pages

MediaEval 2012 SED Opening - Technology - documents.mx

Opening presentation of the Social Event Detection (SED) task at MediaEval 2012 October 2012, Pisa, Italia
Read more

MediaEval 2011 Workshop - Home - Aanmelder.nl

MediaEval 2011 Workshop. MediaEval Workshop 2011 The ... Agenda Thursday 1 September 2011 8:30-9:00 Registration 9:00 Opening of ... (SED ) session (Chairs ...
Read more

Thursday 1 September 2011 - Multimedia Eval

Program the MediaEval 2011 Workshop ... Friday 2 September 2011 8:45 Opening of Day 2 ... 10:40 - 13:00 Social Event Detection (SED) session ...
Read more

MediaEval 2012

MediaEval 2011; MediaEval 2010; ... "SED at MediaEval 2012: Challenges, Dataset and Evaluation" ... 9:00 Opening of Day 2
Read more

“Anselm of Laon Unveiled: the Glosae super Iohannem and ...

“Anselm of Laon Unveiled: the Glosae super Iohannem and the Origins of the Glossa ordinaria on the Bible”, Mediaeval Studies, 73 (2011), 217-40
Read more

Mediaeval thought-experiments - Documents

Download Mediaeval thought-experiments. Transcript. X. Recommended. Mediaeval 1. 2.
Read more

Mediaeval - Documents

Mediaeval. by guest7058351. on Jun 24, 2015. Report Category: Documents. Download: 0 Comment: 0. 119. views. Comments. Description. Download Mediaeval.
Read more