The Rules

Who was allowed to enter?

Researchers working at academic institutions, not-for-profit institutes, and for-profit companies are all eligible to participate. Individuals and teams, including teams of

The following were not able to compete:

  • Judges and members of their research groups
  • The data providers and members of their research groups
  • The organizers and members of their research groups

All participants formally declared that had not had access to the test data sets and their reconstructions. All judges, data providers, and organizers declared that they had not shared the test data sets and the manual reconstructions.

Official Rules for the DIADEM Software Competition

Certification Form for Finalists

How were solutions judged?

Solutions were judged along three general lines: scores produced via an algorithmic metric (the DIADEM metric), qualitatively by judges who use reconstructions in research, and in terms of time saved for editing automated reconstructions up to gold standard quality versus manually reconstructing those same gold standards from scratch.

The judges were:

Germán Barrionuevo
Professor, Department of Neuroscience
University of Pittsburgh

Hollis Cline
Professor, Department of Cell Biology and Chemical Physiology
The Scripps Research Institute

Vincenzo de Paola
Group Leader
Imperial College London

Judith Hirsch
Associate Professor, Department of Biological Sciences
University of Southern California

Greg Jefferis
Welcome Trust Fellow
MRC Laboratory of Molecular Biology

Jeff Lichtman
Professor of Molecular and Cellular Biology
Harvard University

Ju Lu
Postdoctoral Scholar, Schnitzer Lab
Stanford University

Kevan Martin
Professor, Institute of Neuroinformatics
Harvard University

Richard Masland
Professor, Department of Neuroscience
Harvard University

Darren Myatt
Technical Consultant
Formerly of the University of Reading

Stephen Senft
Visiting Scientist
Marine Biological Laboratory (MBL)

Izumi Sugihara
Professor, Department of Systems Neurophysiology
Tokyo Medical and Dental University