Monday, March 13, 2017

Law Schools Unfairly Ranked by U.S. News


I've occasionally commented in the past about particular schools that clearly had artificially low overall ranks in U.S. News, and readers e-mail me periodically asking about various schools in this regard.   Since the overall rank in U.S. News is a meaningless nonsense number, permit me to make one very general comment:   it seems to me that all the law schools dumped into what U.S. News calls the "second" tier--indeed, all the law schools ranked ordinally beyond the top 25 or 30  based on irrelevant and trivial differences-- are unfairly ranked and represented.  This isn't because all these schools have as good faculties or as successful graduates as schools ranked higher--though many of them, in fact, do--but because the metric which puts them into these lower ranks is a self-reinforcing one, and one that assumes, falsely and perniciously, that the mission of all law schools is the same.  Some missions, to be sure, are the same at some generic level:  e.g., pretty much all law schools look to train lawyers and produce legal scholarship.  U.S. News has no meaningful measure of the latter, so that part of the shared mission isn't even part of the exercise.  The only "measures" of the former are the fictional employment statistics that schools self-report and bar exam results.  The latter may be only slightly more probative, except that the way U.S. News incorporates them into the ranking penalizes schools in states with relatively easy bar exams.  So with respect to the way in which the missions of law schools are the same, U.S. News employs no pertinent measures. 

But schools differ quite a bit in how they discharge the two generic missions, namely, producing scholarship and training lawyers.  Some schools focus much of their scholasrhip on the needs of the local or state bar.  Some schools produce lots of DAs, and not many "big firm" lawyers.    Some schools emphasize skills training and state law.  Some schools emphasize theory and national and transnational legal issues.   Some schools value only interdisciplinary scholarship.  And so on.  U.S. News conveys no information at all about how well or poorly different schools discharge these functions.  But by ordinally ranking some 150 schools based on incompetently done surveys, irrelevant differences and fictional data, and dumping the remainder into a "second tier", U.S. News conveys no actual information, it simply rewards fraud in data reporting and gratuitously insults hard-working legal educators and scholars and their students and graduates.

Rankings | Permalink