SWIP at QALD-3 : results, criticisms and lesson learned - Méthodes et Ingénierie des Langues, des Ontologies et du Discours Access content directly
Conference Papers Year : 2013

SWIP at QALD-3 : results, criticisms and lesson learned


This paper presents the results obtained by the SWIP system while participating in the QALD-3 (Question Answering over Linked Data) challenge, co-located with CLEF 2013 (Conference and Labs of the Evaluation Forum). We tackled task 1, multilingual question answering, whose purpose is to interpret natural language questions in order to return the answers contained in a graph knowledge base. We answered queries of both proposed datasets (one concerning DBpedia, the other Musicbrainz) and took into consideration only questions in English. The system SWIP (Semantic Web Interface using Patterns) aims at automatically generating formal queries from user queries expressed in natural language. For this, it relies on the use of query patterns which enable the complex task of interpreting natural language queries. The results obtained on the Musicbrainz dataset (precision = 0,51, recall = 0,51, F-measure = 0,51) are very satisfactory and encouraging. The results on DBpedia (precision = 0,16, recall = 0,15, F-measure = 0,16) are more disappointing. In this paper, we present both the SWIP approach and its implementation. We then present the results of the challenge in more detail and their analysis. Finally we draw some conclusions on the strengths and weaknesses of our approach, and suggest ways to improve its performance.
Fichier principal
Vignette du fichier
pradel_12892.pdf (176.08 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01193095 , version 1 (04-09-2015)


  • HAL Id : hal-01193095 , version 1
  • OATAO : 12892


Camille Pradel, Guillaume Peyet, Ollivier Haemmerlé, Nathalie Jane Hernandez. SWIP at QALD-3 : results, criticisms and lesson learned. 3rd open challenge on Question Answering over Linked Data (QALD 2013), Sep 2013, Valencia, Spain. pp. 1-13. ⟨hal-01193095⟩
126 View
151 Download


Gmail Facebook X LinkedIn More