Published on:

by James S. Wilber, Esq., Altman Weil, Inc.

As companies continue to pay careful attention to controlling costs, law departments remain under scrutiny. Accordingly, in-house lawyers regularly look for ways to demonstrate value to their clients. One of the easiest and most cost effective ways of doing this is to seek regular feedback from clients.

Some companies require support functions, such as law, to conduct annual satisfaction surveys, often in connection with performance evaluations of law department lawyers and staff. In many companies, however, law departments rarely, if ever, seek formal feedback from their clients about whether they are meeting client needs.

Published on:

Having completed a client satisfaction survey, you can sort your participants all kinds of ways. Let’s give an example by sorting the participants by level and then also identifying them by their office location. Assume that all we do is code them by US office or international office.

US based and Foreign basedThe plot above shows the total number of participants by the light grey bar for each level. Within the bar there are two colored squares. The ones with a “T” on top indicate the number of participants who are US-based when you look straight down to the horizontal axis; those with an “F” indicate the number of foreign-based participants at that level.

Posted in:
Published on:
Updated:
Published on:

by James S. Wilber, Esq., Altman Weil, Inc.

Most law departments periodically use written or online surveys to gauge the satisfaction of clients with the services they (and outside counsel) provide. A question that often arises is whether (and if so, how) to protect the confidentiality of the responses that come from the executives and other key users of legal services served by the law department?

The responses of clients to survey questions, and most especially the narrative comments that they provide, are of immense value to the general counsel and the law department in determining how to improve services and ensure the complete satisfaction of their clients. Although the tabulated results of the survey and the narrative comments are very helpful for these purposes even when the client responses are confidential and the law department cannot tell from whence they came, many general counsel prefer being able to follow up directly with individual clients to discuss their ideas and concerns. That of course isn’t possible if the names of the respondents are confidential. The competing factor is getting clients to be candid, something that is much more likely if the survey is confidential.

Published on:

When you survey your clients to assess how satisfied they are with your law department, you want confidence that you have tapped a representative group by their levels. One way to visualize the responses you get from your survey by a distribution of levels is shown below. For this example, six ranks of clients are stacked from the lowest at the bottom, “Directors,” to the highest-level at the top, the “EVPs or above”.

Twenty-eight of the respondents were at the highest level of the company, followed by 74 Mgt Principals.

Yes, we could present the same information in a table (with the titles abbreviated):

Published on:

by James S. Wilber, Altman Weil, Inc.

Law departments that appreciate the value of client satisfaction understand the importance of obtaining systematic feedback from their clients. The methodological choice typically is between a written or online survey, on the one hand, or in-person meetings and interviews of clients on the other. The former method is easier, quicker, less expensive (in terms of opportunity cost) and provides a broader base of feedback. The latter method allows for a dynamic, iterative discussion where one answer or statement can lead to other important areas of inquiry, and of course, it can help improve relationships since it is done face-to-face. Our experience points to a hybrid approach being best – a survey of a large cross-section of key users of legal services, followed by in-person interviews of executives and top managers.

One advantage of doing an online survey is the ease with which metrics that will help you analyze the results can be generated. There are of course many, many metrics, slices of the data, etc., that can be produced. Set out below is one such example (specifically, a plot done from a metric), which shows a hypothetical company and its divisions and operating units.

Posted in:
Published on:
Updated:
Published on:

Let’s look at the Fortune 500 companies broken into equal-sized revenue categories and see if there is any pattern about the law school of their top lawyers.

The plot below shows 20 revenue categories increasing from $4.8 billion for the smallest company on the left to $89 billion and up in the farthest-right category. There are 25 companies in each category, plus or minus one.

Revbins and F500 GCs Aug 4          The blue dots above a revenue category each represent one general counsel and the US News & World Report ranking of that person’s law school, which can be read from the vertical Y-axis. As noted before, when two schools have the same rank, this plot combines their graduate numbers. Unranked schools are not included and the law schools of a few general counsel are unknown.

Posted in:
Published on:
Updated:
Published on:

A Shepard’s diagram typically describes the composition of soil in terms of three materials: clay, silt, and sand. The pyramid labels each portion according to the respective proportions of those materials in a particular clump of soil. Naturally, seeing such a diagram led me to think about law departments.

My notion was that a company has three basic sources of legal guidance: its internal law department (if there is one), the law firms or private lawyers it hires, and the clients, consultants, outsource services and others who help identify, prevent, or deal with legal issues. In the diagram I call that third group, collectively, “resources”.

So, here is the Shepard’s diagram of the three legal services. Each side ranges from a low percentage of reliance on that service to a high percentage. So, for example, the top component represents a company where the law department does everything, there are no outside counsel, and the “resources” are mid-way. I tried to label the components that result in a short way, but realize that the labels can be improved.

Published on:

July 28 F500 GCs and LS RankSetting aside the number of students in each class of the ranked law schools, is there any pattern in the number of graduates who are Fortune 500 general counsel according to the law school’s rank? The plot above shows the number of graduates by the height of the blue dots and the left axis; the ranking of the schools ranges from number 1 on the left to 150 on the right. Bear in mind that when two schools have the same rank, this plot combines their graduate numbers. Unranked schools are not included.

The evident pattern appears to be that higher ranked schools have more F500 GCs, and the number of GCs per school declines as rankings go lower – until a third of the way across the numbers plateau. Your eye can fill in a line that starts high left, and drops down to about 30, at which point it levels off to the right side of the plot. From about a ranking of 30 on, the numbers bounce around randomly and fairly consistently. One might conclude from this specialized sample that if you didn’t graduate from a very elite law school, it doesn’t matter much if your goal is to reach the top rung of a Fortune 500 legal department.

A better way to depict the line would be with a trend line and confidence levels. But, that treat we hold for another post.

Posted in:
Published on:
Updated:
Published on:

My hypothesis was that the larger the law school, in terms of students enrolled, the more graduates it would have who are the general counsel of a Fortune 500 company. To keep the data tractable and the plot below legible, I took the 150 top-ranked schools from US News & World Report and kept only the 34 schools that have at least three such graduates (some of the GCs do not have a law school associated with them).

Next, I divided that graduate number for each law school by the school’s enrollment (it is unclear as I write this whether enrollment includes LLM candidates, JSD candidates and other students aside from the standard three-year LLB or JD students). So that the numbers on the graph are not miniscule, I first divided the enrollment by 100.

Accordingly, the chart below presents the law schools on the bottom axis in alphabetical order and their Fortune 500 GC graduates per 100 enrollees above with a blue dot. Chicago and Harvard stand highest at two or more graduates per 100. Note that the former is a very large school; the other modest. At the other end, Brooklyn and Miami are lowest at about 0.3 (meaning for every three hundred enrolled students they have produced one Fortune 500 GC graduate).

Posted in:
Published on:
Updated:
Published on:

An article in the Harvard Business Review, June 2014, at 67, by Clayton Christensen and another author, includes a sidebar that criticizes overuse of spreadsheets. When strategic decisions are based on spreadsheet analysis, the authors believe managers are often misguided.

Without a doubt, spreadsheets can mislead or can create a false sense of certainty. Nevertheless, efforts to gather data and look at what that data suggest help combat the well-known shortcomings of intuition, selectively-remembered experience, and less-than-rational gut instinct.

More than that point, spreadsheets require data, and the discussions that should result from deciding which data to collect and how to collect it and then how to weight the various pieces of data should help planners think through future scenarios. Data has value in its own right, that is to say, as well as value in stimulating thinking.