CAGI and CASP – surprises and lessons–
Community science is now widely recognized as a key part of computational biology, and many different approaches have been developed. In this talk, I will describe experience in two areas. CASP (Critical Assessment of Structure Prediction) is the first and longest running community experiment in computational biology. Since its inception the field of protein structure modeling has been transformed from an arcane academic pursuit into a widely accepted tool for obtaining structure. How did this come about, and what role did CASP play? CAGI (Critical Assessment of Genome Interpretation) is a newer community experiment that aims to assess and advance the state of the art in relating genetic variation to phenotype, particularly for human disease. Here, the acute pressure to develop reliable tools that can be used in the clinic meets the limitations of computational methods. How do the community results aid in resolving this confrontation? One general observation is that whatever happens in these experiments, its seldom what one expects.