In this article, we will talk about things to consider when reading a Chambers & Partners Insight Report, as knowing more about its methodology and limitations can help you better understand what Research is trying to say and draw added insights into the ranking decisions.

Understanding Your Insight Report

Analysis Tips

Insight reports have historically been constrained by strict word limits, meaning that analyses have not always been able to fully and clearly discuss all aspects and nuances around a firm’s performance and ranking decision.

This can lead to an analysis sounding positive while the firm’s or individual’s ranking remains the same. To help explain this, here are a few reasons why a promotion might not have occurred despite an apparently strong performance.

• Lacking similar performances. Chambers aims to avoid kneejerk reactions to performances, so Research might be waiting for evidence that this year’s showing is part of a trend rather than a one-off. Consistently demonstrating strong performances can therefore be beneficial.

• Promoted last year. A strong performance after a promotion is encouraging, as it helps justify the decision to move up. However, Chambers typically looks for evidence that the promoted party can succeed at this level before it is considered for a further promotion. As above, one data point is usually not enough.

• Lacking something compared with higher ranked competitors. The thing lacking might not be clearly stated but only mentioned in passing, for example: “although client feedback is limited“, it is highly effusive. Keeping an eye out for structures like this can alert you to potential shortcomings which could be differentiating you or your lawyer from those in the tiers above.
  
  Note that CMI purchasers can also cross-reference such phrases with the comparative analyses, to further see how they compare with higher ranked competitors.

It is worth noting that Chambers has recently removed the word limits from Insight reports. It remains to be seen how this affects the analyses, but it could potentially mean that reports are clearer and better able to explain the research.

Submission & Rankings Page Tips

What is it? The page that explains your team’s ranking, gives tips for improvement, and provides information about scores, rankings, and referee response rates.

Tip for reading 1: The analysis will generally only touch upon the most important or interesting aspects of your performance. Therefore, if an aspect is not mentioned, this might actually indicate that you’re already on the right track there.

Tip for reading 2: An Insight report will always provide a tip for improving your submission, but you might not always get a referee tip if your referee response rate was above average. In these cases, continuing to put forward a full complement of referees who would be willing to discuss your team and individuals could be beneficial, as it might show consistent satisfaction with the group’s performance.

Individuals Page Tips

What is it? A page containing feedback, analysis, and data about all of your ranked and Potential lawyers and those who have lost their ranking or Potential status this year.

Tip for reading: This is perhaps obvious, but worth reiterating nonetheless: things that might be detrimental to one lawyer might not necessarily be detrimental to another – a lack of work, for instance. There are various reasons for this, such as:

• Trends: Consistently minimal evidence of activity or feedback will likely be more of a concern than a blip in an otherwise strong track record.
  
• Ranking: Although Chambers generally looks for convincing evidence of market involvement for ranked lawyers, there can be more leeway for Senior Statespeople and Associates to Watch (given where they are in their careers) and Eminent Practitioners (given their management responsibilities). Chambers understands that such individuals are usually less heavily involved in frontline practice and might therefore have less evidence of lead roles on work and consequently recent feedback.

Recognising that Chambers prioritises long-term evidence over potential one-off anomalies can help you plan your submission strategy, while being clear on the band definitions can help explain certain ranking decisions.

Competitors page tips

What is it? The page that analyses the performance of up to three other firms, usually in higher tiers.

Tip for reading 1: The Insight team tends to pick competitors based on their ranking relative to your firm’s. This might result in you being compared with groups that you might not consider natural competitors; however, these choices are designed to aid you on your journey up the table by highlighting comparisons with firms in the bands immediately above you.

Firms typically move up one band at a time, making these insights potentially more valuable than comparisons between, say, an unranked group and the market’s most famous teams which all happen to be at the top of the table.

Tip for reading 2: The comparatives should correlate with what was raised on the Submission & Rankings page, giving you concrete examples of good practice that might shed light on how to address the issues raised in Submission & Rankings.

The comparatives might also touch upon issues not previously mentioned, thereby providing extra insight into Chambers’ thought processes around what constitutes standout activity or feedback for that band in that area. This in turn could influence your future submissions and lead to greater similarities with higher placed competitors.

Client Feedback and Market Feedback pages tips

What is it? These pages contain feedback on the department, grouped into themes.

Tip for reading 1: The number of client and third-party comments here might not necessarily align with the data on the Submission & Rankings page. Feedback might be received from non-referee sources (e.g. clients put forward by other firms), or perhaps some of your referees were contacted but didn’t provide usable feedback on this practice area.

Tip for reading 2: Rankings should not be decided on the contents of peer feedback alone, but your standing in the market might be taken into consideration. This could well happen in a competitive section in which all firms are well regarded by clients but not all have comparable peer recognition. The latter might therefore act as another possible differentiating factor between firms.

Modest peer recognition could be symptomatic of poor brand visibility, so approaching your market feedback objectively and understanding the themes within might help spark discussions around how to increase your team’s exposure in the field. Nishlis Legal Marketing works extensively with firms on professional development to help them grow their brands and become recognised as leading experts in their fields.

Other Individuals Page Tips

What is it? The page containing the unranked individuals who garnered feedback in this practice area this year and their comments.

Tip for reading 1: Remember that any individual who is designated internally as a Potential for a ranking or who has lost this designation or a ranking this year will not appear on this page. They will be in the Individuals screen, as they will have an analysis of their performance.

Tip for reading 2: Unfortunately, Chambers does not provide analysis about all unranked lawyers – only those who lost their rankings or are considered internally as Potentials for a listing.

Final Tips and Tricks

• Chambers no longer emails PDF Insight reports; instead, they have to be accessed through the Digital Insight web portal.
• Reports can be downloaded as PDFs and other formats from Digital Insight.
• Digital Insight lets you download your entire report or just certain chapters, enabling you to send only the relevant parts to the relevant people without having to manually divide a PDF.
• Chambers assigns access to Digital Insight to a nominated contact within your firm, so knowing who that is and promptly informing Chambers if you need to change this contact can be useful for maintaining access to your report or
  distributing it internally.

As always, we remain available if you have any questions!