Competition on Legal Information Extraction/Entailment (COLIEE) 2020, in association with the Fourteenth International Workshop on Juris-informatics (JURISIN) 2020

http://www.ualberta.ca/~rabelo/COLIEE2020/
http://research.nii.ac.jp/~ksatoh/jurisin2020
November 16th & 17th, Yokohama, Japan
(There might be a possibility of having JURISIN 2020 on line)

As an associated event of JURISIN 2020, we are happy to announce the 7th Competition on Legal Information Extraction and Entailment (COLIEE-2020), which will include tasks on both statute law and case law.

Four tasks are included in the 2020 competition: Tasks 1 and 2 are about case law, and tasks 3 and 4 are on statute law. Task 1 is a legal case retrieval task, and it involves reading a new case Q, and extracting supporting cases S1 , S2 …, Sn from the provided case law corpus, to support the decision for Q. Task 2 is the legal case entailment task, which involves the identification of one or more paragraphs from an existing case that entail a fragment of a new case. As in previous COLIEE competitions, Task 3 is to consider a yes/no legal question Q and retrieve relevant statutes from a database of Japanese civil code statutes; Task 4 is to confirm entailment of a yes/no answer from the retrieved civil code statutes.

Further details can be found at the following URL: http://www.ualberta.ca/~rabelo/COLIEE2020/

The datasets for Task 1 and Task 2 are in English, and the datasets for Task 3 and Task 4 are available both in Japanese and English (translation from Japanese bar exams and civil code). You can choose any (or both) language datasets and any task for participation.

The intention is to build a community of practice regarding legal information processing and textual entailment, so that the adoption and adaptation of general methods from a variety of fields is considered, and that participants share their approaches, problems, and results.

Participants are required to submit a paper on their method and experimental results. At least one of the authors of an accepted paper has to register for JURISIN 2020 and present the paper on site at the special COLIEE 2020 session or on line if he/she cannot attend the session on site. The papers by the winners of each task in the competition will be further reviewed and considered for inclusion in the LNAI 2020 post-proceedings, so please write your papers with that in mind. In addition, we expect to raise some kind of cash prize for the winners in each category.

These papers will be reviewed in the same way of usual submission to JURISIN 2020 and selected papers will be published in the LNAI post-proceedings.
======================================================================
Important dates:

Jun 15, 2020: Dry run data release.
Jun 26, 2020: Formal run data release.
July 3, 2020: Task Registration Due (extended).
Aug 19, 2020: Submission of competition test runs (Case Law tasks - tasks 1 and 2)
Aug 26, 2020: Return of competition test run rankings/assessments (Case Law tasks - tasks 1 and 2)
Aug 19, 2020: Submission of competition test runs for task 3 (the task of retrieval of relevant article(s) given a bar exam question).
Aug 24, 2020: Return of competition test run rankings/assessments for task 3 and announcements of answers (relevant article(s) for each question) for task 3.
Aug 31, 2020: Submission of competition test runs for task 4 using the above answers for the same test test of bar exam questions.
Sep 7, 2020: Return of competition test run rankings/assessments for task 4.
Sep 11, 2020: Papers submission for the COLIEE workshop.
Oct 1, 2020: Notification of acceptance.
Oct 8, 2020: Camera ready papers due.
Nov 16 & 17, 2020: COLIEE-2020 Workshop in JURISIN 2020.

Application Details:
Potential participants to COLLIE-2020 should respond to this call for participation by submitting an application. To apply, submit the application and memorandums available on the URLs below to rabelo(at)ualberta.ca .

Application
http://www.ualberta.ca/~rabelo/COLIEE2020/application.pdf

Memorandum for Tasks 1 and/or 2 (Case law competition)
http://www.ualberta.ca/~rabelo/COLIEE2020/CL_memorandum.pdf

Memorandum for Tasks 3 and/or 4 (Statute law competition, English Data)
http://www.ualberta.ca/~rabelo/COLIEE2020/SL_EN_memorandum.pdf

Memorandum for Tasks 3 and/or 4 (Statute law competition, Japanese Data)
http://www.ualberta.ca/~rabelo/COLIEE2020/SL_JA_memorandum.pdf

An acknowledgement note will be sent to the email address supplied in the form once the form has been processed.

Task coordinators:
Mi-Young Kim, University of Alberta, Canada
Randy Goebel, University of Alberta, Canada
Juliano Rabelo, University of Alberta, Canada
Ken Satoh, National Institute of Informatics, Japan
Yoshinobu Kano, Shizuoka University, Japan
Masaharu Yoshioka, Hokkaido University, Japan

Questions and further information:
rabelo(at)ualberta.ca