CoNLL Shared Task Organization
This page serves as platform for organizing the CoNLL Shared Task in 2007.
Work Plan
January 10 - January 20
- Prepare data sets (with documentation and licenses) (Deniz, Jens, Johan, Ryan, Sandra)
- Collect registrations (Sandra)
- Third and ultimate call (with extended deadline because of e-mail problems) (Joakim)
January 20 - January 29
- Deliver validated data sets to website and (in some cases) LDC (Deniz, Jens, Johan, Ryan, Sandra)
- Finalize web site with procedure and download pages (Sebastian)
- Produce data overview page (Sandra and all)
- Send release message to participants (Sandra, Sebastian)
January 29 - March 26
- Negotiate format and number of pages for proceedings with CoNLL-EMNLP chairs (Joakim)
-
Prepare PaperSubmission (covering both tracks) (Joakim, Ryan)
- Prepare evaluation of test runs, including significance testing and publication of results (Deniz)
- Prepare web page for upload of test runs and evaluation (Deniz, Sebastian)
- Deliver validated test sets to website and (in some cases) LDC (Deniz, Jens, Johan, Ryan, Sandra)
- Recruit reviewers for paper submissions (Joakim)
March 26 - March 30
-
Wait and see.
March 30 - April 14
- Evaluation of test runs, significance testing and publication of results (Deniz, Sebastian)
- Prepare for paper submissions (in START) (Joakim, Ryan?)
- Write introductory paper(s) (Joakim, Ryan, All?)
April 14 - April 25
- Coordinate reviewing of papers, notify authors (Joakim, Ryan?)
April 29 - May 9
-
Relax?
May 9 - June 28
- Prepare shared task session (Joakim, Ryan)
Tracks
-
MultiDomainTrack (English)
Language Reports
Other
-
TreebankNegotiations on how to negotiate licenses (based on Sabine's experience last year)
-
SharedTaskSubpageTemplate a template for pages of the official website. Has the right access rights.
-
ParticipationProcedure the page explaining the procedure
-
DataUpload on how to upload the datasets (for Organizers)