The Computing Research Association

April 22, 2011
The NRC has released "revised" rankings for Ph.D. programs. However, this "revision" does not address any of the substantive issues with both the data collection and the ranking methodology that have been raised by CRA and other organizations. This is regrettable. Accordingly our view must still stand: CRA does not consider the purported rankings that have been released by the NRC to be an accurate reflection of computing program strengths, will not use them in any of our activities and urges others interested in the field of computing to ignore them as well.

September 28, 2010
The Computing Research Association today released the following statement regarding the National Research Council's (NRC) assessment of U.S. doctoral programs:
As an organization representing more than 200 academic departments of computer science, computer engineering, and related fields, CRA commends the National Research Council for undertaking its extensive and statistically novel evaluation of doctoral programs at U.S. universities and colleges nationwide.

However, CRA has serious concerns about the accuracy and consistency of the data being used in the evaluation of the Computer Science discipline.

• CRA has identified a number of instances in which data were reported under different assumptions by institutions, leading to inconsistent interpretation of the associated statistical factors.
• CRA has further identified a number of instances where the data is demonstrably incorrect - sometimes very substantially - or incorrectly measures the intended component.
• CRA is pleased that the NRC acknowledges there are errors in the data used to evaluate computer science departments and that, in the words of NRC Study Director Charlotte Kuh, “There’s lots more we need to look at for computer science before we really get it right.”
• CRA will continue to work closely with its member departments and the NRC to help correct these errors and determine more suitable data sources for the evaluation.

About CRA: The Computing Research Association (CRA) seeks to strengthen research and advanced education in computing and allied fields. It does this by working to influence policy that impacts computing research, encouraging the development of human resources, contributing to the cohesiveness of the professional community and collecting and disseminating information about the importance and the state of computing research.