April 30, 2016

Should professors give more feedback before the final exam? (Michael Simkovic)

New research from Dan Schwarcz and Dion Farganis at Minnesota argues that providing students with practice problems and exercises that are similar to final exams and giving individual feedback prior to the final examination can help improve grades for first year law students.

Schwarcz and Farganis tracked the performance of first year students who were randomly assigned to sections, and as a result took courses with professors who either provided exercises and individual feedback prior to the final examination, or who did not provide feedback.

When the students who studied under feedback professors and the students who studied under no-feedback professors took a separate required class together, the feedback students received higher grades after controlling for several factors that predict grades, such as LSAT scores, undergraduate GPA, gender, race, and country of birth. The increase in grades appears to be larger for students toward the bottom half of the distribution. The paper also attempts to control for variation in instructor ability using student evaluations of teacher clarity.

It’s an interesting paper, and part of a welcome trend toward assessing proposed pedagogical reform through quasi-experimental methods.

The interpretation of these results raises a number of questions which I hope the authors will address more thoroughly as they revise the paper and in future research.

For example, are the differences due to instructor effects rather than feedback effects? Students are randomly assigned to instructors who happen to voluntarily give pre-final exam feedback. These might be instructors who are more conscientious, dedicated, or skilled and who also happen to give pre-exam feedback. Requiring other instructors to give pre-exam feedback—or having the same instructors provide no pre-exam feedback—might not affect student performance.

Controlling for instructor ability based on teaching evaluations is not entirely convincing, even if students are ostensibly evaluating teacher clarity. There is not very strong evidence that teaching evaluations reflect how much students learn. An easier instructor who covers less substance might receive higher teaching evaluations across the board than a rigorous instructor who does more to prepare students for practice. Teaching evaluations might reflect friendliness or liveliness or attractiveness or factors that do not actually affect student learning outcomes but that have consumption value for students.  Indeed, high feedback professors might receive lower teaching evaluations for the same quality of teaching because they might make students work harder and because they might provide negative feedback to some students, leading students to retaliate on teaching evaluations.

These issues could be addressed in future research by asking the same instructor to teach two sections of the same class in different ways and measuring both long term student outcomes and teaching evaluations.

Another question is: are students simply learning how to take law school exams? Or are they actually learning the material better in a way that will provide long-term benefits, either in bar passage rates or in job performance? At the moment, the data is not sufficient to know one way or the other.

A final question is how much providing individualized feedback will cost in faculty time, and whether the putative benefits justify the costs.

It’s a great start, and I look forward to more work from these authors, and from others, using quasi-experimental designs to investigate pedagogical variations.


April 30, 2016 in Guest Blogger: Michael Simkovic, Legal Profession, Of Academic Interest, Professional Advice, Science | Permalink

April 22, 2016

Book encouraging law students to be happy is latest target for scambloggers (Michael Simkovic)

Professor Paula Franzese of Seton Hall law school is something of a patron saint of law students. Widely known for her upbeat energy, kindness, and tendency to break into song for the sake of helping students remember a particularly challenging point of law, Paula has literally helped hundreds of thousands of lawyers pass the bar exam through her video taped Property lectures for BarBri.

Paula is such a gifted teacher that she won teacher of the year almost ever year until Seton Hall implemented a rule to give others a chance: no professor can win teacher of the year more than two years in a row. Since the rule was implemented, Paula wins every other year. She’s also incredibly generous, leading seminars and workshops to help her colleagues improve their teaching.

Paula recently wrote a book encouraging law students to have a productive, upbeat happy, and grateful outlook on life (A short & happy guide to being a law school student).

Paula’s well-intentioned book has rather bizarrely been attacked by scambloggers as “dehumanizing”, “vain”, “untrustworthy” and “insidious.” The scambloggers are not happy people, and reacted as if burned by Paula’s sunshine. They worry that Paula’s thesis implies that “their failure must be due to their unwillingness to think happy and thankful thoughts.”  

Happiness and success tend to go together. Some people assume that success leads to happiness. But an increasing number of psychological studies suggest that happiness causes success. (here  and here) Happiness often precedes and predicts success, and happiness appears to be strongly influenced by genetic factors.

Leaving aside the question of how much people can change their baseline level of happiness, being happier—or at least outwardly appearing to be happier—probably does contribute to success, and being unhappy probably is a professional and personal liability.

People like working with happy people. They don’t like working with people who are unhappy or unpleasant. This does not mean that people who are unhappy are to blame for their unhappiness, any more than people who are born with disabilities are to blame for being deaf or blind.

But it does raise serious questions about whether studies of law graduates’ levels of happiness are measuring causation or selection. We would not assume that differences between the height of law graduates and the rest of the population were caused by law school attendance, and we probably should not assume that law school affects happiness very much either.

 


April 22, 2016 in Faculty News, Guest Blogger: Michael Simkovic, Law in Cyberspace, Legal Profession, Of Academic Interest, Professional Advice, Science, Student Advice, Weblogs | Permalink

April 20, 2016

Harvard Law students demand free tuition as a matter of "financial justice"

Story here.  These students, I fear, do not understand justice.


April 20, 2016 in Legal Profession, Of Academic Interest | Permalink

Partially on-line JD proposed by Syracuse

April 11, 2016

Journalists with an agenda

You would never know from this article  about the Choudhry case at Berkeley that I spent most of the time talking to this reporter about tenure and the due process rights of faculty--indeed, she had called me because of this.


April 11, 2016 in Faculty News, Legal Profession | Permalink

April 07, 2016

President Obama is at the University of Chicago Law School today discussing the Supreme Court and the nomination of Judge Garland...

...which you can watch here.  And if you'd like to know the truth about what's really going on with Supreme Court nomination battles, read this.  (I'm not there, I'm at home working, since the faculty have been thrown out of their offices for the day!)


April 7, 2016 in Jurisprudence, Legal Profession, Of Academic Interest | Permalink

April 01, 2016

In law firms, lawyers and paralegals prosper while secretarial jobs disappear (Michael Simkovic)

This post contains figures illustrating data reported by the author in a New York Times Dealbook post.  Lawyers v Secretaries

 

Educated v Unskilled


April 1, 2016 in Guest Blogger: Michael Simkovic, Legal Profession, Of Academic Interest, Professional Advice, Science, Student Advice, Weblogs | Permalink

March 31, 2016

George Mason's law school to be named in honor of Justice Scalia...

...in recognition of 20 million dollars from an anonymous donor and 10 million dollars from the Koch Foundation.  WSJ story here.


March 31, 2016 in Legal Profession, Of Academic Interest | Permalink

March 30, 2016

Lawyer salaries rising according to the latest from BLS

Stephen Diamond (Santa Cara) has the details.


March 30, 2016 in Legal Profession | Permalink

March 28, 2016

Professor Choudhry's lawyers challenge University of California President's treatment of the former Berkeley Dean

They have shared the letter sent to President Napolitano:  Download 2016-03-18 Letter to President Napolitano

The letter makes a number of very good points.  President Napolitano has handled this very badly and unfairly.


March 28, 2016 in Faculty News, Legal Profession, Of Academic Interest | Permalink