Instructions for CLEF 2013 Working Notes

For each of the tasks in which they participated, groups are requested to submit a report describing their experiments (in pdf form).

In addition to the paper in pdf form, an extended Abstract must also be submitted (in .doc form) which summarizes the main details and results of the experiments.
This abstract is M A N D A T O R Y and will be used to produce the CLEF 2013 Book of Abstracts. We may not be able to include your paper in the Book of Abstracts if you do not provide the text of the abstract as requested.

Both electronic Working Notes and printed Abstracts will be organized according to the Labs. If one group participates in more than one Lab, separate reports are to be submitted. Moreover, for those Labs which are subdivided in several tasks, separate reports for different task(s) are to be provided.

The publications will be divided into the following main sections (and sub-sections):

  • 1. Cultural Heritage in CLEF - CHiC (Multilingual Task, Polish Task, Interactive Task)
  • 2. CLEFeHealth 2013 (Disorder Identification and Normalization, Acronym/Abbreviation Normalization, Information Retrieval for Medical Disorders)
  • 3. CLEF-IP - Retrieval in the Intellectual Property Domain (Passage Retrieval starting from Claims, Image to Text, Text to Image, Image to Structure Task)
  • 4. ImageCLEF - Cross Language Image Annotation and Retrieval (Photo Annotation and Retrieval, Plant identification, Robot Vision)
  • 5.INEX - INitiative for the Evaluation of XML retrieval (Searching Structured or Semantic Data, Searching Professional and User Generated Data, Focused retrieval)
  • 6. PAN - Uncovering Plagiarism, Authorship, and Social Software Misuse (Plagiarism Detection, Author Identification, Author Profiling)
  • 7. QA4MRE - Question Answering for Machine Reading Evaluation (Main task, Machine Reading of Biomedical Texts about Alzheimer's Disease, Entrance Exams)
  • 8. QALD-3 - Question Answering over Linked Data (Question Answering, Ontology Lexicalization)
  • 9. RepLab (Monitoring task, Polarity for Reputation, Name Ambiguity Resolution)
  • 10. CLEF-ER Entity Recognition @ CLEF Workshop
  • 11. Joint Tasks with Other Evaluation Initiatives (AMIA: Medical task)

Paper Submission

Submission of papers and abstracts is to be done electronically through the Easychair system.


Please remember that the strict deadline for receiving the final electronic versions of all papers is June 15 2013, 11:59 pm - midnight - Central European Summer Time.

Using EasyChair for Paper Submission

  • 1. Authors must log in using their own username and password. If you don't already have an Easychair account, you will find the instructions to obtain one on the same page.
  • 2. Once you have logged in, click on "New Submission", select the correct Lab and sub-task and then follow the instructions to submit your paper.

Please remember that we just request the pdf version of your paper (we do NOT need source files and copyright forms), and a .doc file for the extended abstract uploaded as an attachment.


Technical reports describing the participating systems will appear in the electronic Working Notes.

Guidelines for Extended Abstracts

Language: English

Format: documents must be formatted according to the following template

Max. length: the abstract should be no longer than 400 words and should be as complete as possible.

Content: It should provide the main details of your experiments including at least the following information:

  • Title
  • Authors
  • Affiliations
  • Email addresses of all authors
  • Body of text. This should contain information on:
    • - tasks performed
    • - main objectives of experiments
    • - approach(es) used
    • - resources employed
    • - results obtained

Guidelines for Working Notes Full Papers

Language: English

Format: technical reports must be formatted according to Springer Instructions for Authors, the style sheets are available as Word and Latex files.

Max. length: the paper should not exceed 12 pages (but as they are published only electronically, the length is not too important)

Content: The full paper should contain the information requested in the extended abstract but with more detail and discussion. These papers are meant to describe experiments but obviously cannot contain a full analysis of the results.