JICL-6(2)-7.Quantitative Legal Comparisons.indd - Journal of ...

20
[(2019) 6:2 JICL 287–306] QUANTITATIVE LEGAL COMPARISONS: NARRATIVES, SELF-REPRESENTATIONS AND SUNSET BOULEVARDS Marta Infantino* Abstract: Quantitative legal comparisons embedded in global indicators comparing performance of states are probably the most outstanding comparative law product of the recent decades. Yet, these initiatives do not usually qualify as exercises in comparative law. Up to now, comparativists have either heavily criticised them or wholly ignored their existence. The argument developed in this paper is that, by refusing to recognise global indicators as a new technology for comparing laws, comparativists have failed to notice the elephant in the room and have missed a good opportunity to learn from them. Through analysis of three global indicators — the “Freedom in the World” Index, the “Corruption Perceptions” Index, and the “Doing Business” reports — the paper aims to show that global quantitative legal comparisons, perhaps unintendedly, provide an answer to a number of criticisms that have been aimed at comparative law and offer an alternative paradigm for “doing things with comparative law” that deserves further attention. Keywords: quantitative comparisons; numerical comparative law; global indicators; Freedom in the World Index; Corruption Perceptions Index; Doing Business reports; comparative law methodology; statolatry; perceptions of law; legal functionalism; functions of comparative law I. Introduction The editors asked contributors of this issue to “deal with new trends within the context of comparative legal studies”. This paper deals with what is currently considered a non-trend in the eld of comparative law: the growth and success of quantitative comparisons embedded in global indicators comparing states’ legal performances. * Associate Professor of Comparative Law, University of Trieste, IUSLIT. [email protected]. JICL-6(2)-7.Quantitative Legal Comparisons.indd 287 JICL-6(2)-7.Quantitative Legal Comparisons.indd 287 23/10/19 1:45 PM 23/10/19 1:45 PM

Transcript of JICL-6(2)-7.Quantitative Legal Comparisons.indd - Journal of ...

[(2019) 6:2 JICL 287–306]

QUANTITATIVE LEGAL COMPARISONS: NARRATIVES, SELF-REPRESENTATIONS AND

SUNSET BOULEVARDS

Marta Infantino*

Abstract: Quantitative legal comparisons embedded in global indicators comparing performance of states are probably the most outstanding comparative law product of the recent decades. Yet, these initiatives do not usually qualify as exercises in comparative law. Up to now, comparativists have either heavily criticised them or wholly ignored their existence.

The argument developed in this paper is that, by refusing to recognise global indicators as a new technology for comparing laws, comparativists have failed to notice the elephant in the room and have missed a good opportunity to learn from them. Through analysis of three global indicators — the “Freedom in the World” Index, the “Corruption Perceptions” Index, and the “Doing Business” reports — the paper aims to show that global quantitative legal comparisons, perhaps unintendedly, provide an answer to a number of criticisms that have been aimed at comparative law and offer an alternative paradigm for “doing things with comparative law” that deserves further attention.

Keywords: quantitative comparisons; numerical comparative law; global indicators; Freedom in the World Index; Corruption Perceptions Index; Doing Business reports; comparative law methodology; statolatry; perceptions of law; legal functionalism; functions of comparative law

I. Introduction

The editors asked contributors of this issue to “deal with new trends within the context of comparative legal studies”. This paper deals with what is currently considered a non-trend in the fi eld of comparative law: the growth and success of quantitative comparisons embedded in global indicators comparing states’ legal performances.

* Associate Professor of Comparative Law, University of Trieste, IUSLIT. [email protected].

JICL-6(2)-7.Quantitative Legal Comparisons.indd 287JICL-6(2)-7.Quantitative Legal Comparisons.indd 287 23/10/19 1:45 PM23/10/19 1:45 PM

288 Journal of International and Comparative Law

Global legal indicators 1 are probably the most successful comparative law product of recent decades , 2 at least if success is defi ned in terms of media coverage, scientifi c citations and real-world legal reforms’ effects.3

These initiatives do not claim to be in comparative law, nor could they, according to the very few comparativists who have been prepared to acknowledge their existence . 4 Most comparative lawyers have simply preferred to ignore them . 5

The argument developed here is that comparativists’ denial of this new technology for comparing laws closely resembles that of the triumph of “talking” pictures expressed by silent fi lm star Norma Desmond in Billy Wilder’s movie “Sunset Boulevard”.6 While, as a self-proclaimed comparativist, I cannot fully share my colleagues’ frustration, criticism and hostility at global quantitative legal comparisons and I also think that, by refusing to include them within our contested vision of what “comparative law” is,7 we as comparativists are missing many opportunities to learn something from, and perhaps give something to, this

1 There is no clear defi nition of what a (global) legal indicator is. We may tentatively defi ne them as “measures, standards and rankings of the quality of law and legal institutions across the entire world, particular regions, or selected jurisdictions” (David Restrepo Amariles, “Supping with the Devil? Indicators and the Rise of Managerial Rationality in Law” (2017) 13 Int’l J L in Context 465, 466) or as quantitative initiatives that “collect variables that purport to measure a range of aspects of a country’s legal institutions or even specifi c aspects of a jurisdiction’s legislative and regulatory environment” (Tor Krever, “Quantifying Law: Legal Indicator Projects and the Reproduction of Neoliberal Common Sense” (2013) 34 Third World Q 131, 132).

2 Ralf Michaels, “Comparative Law by Numbers? Legal Origins Thesis, Doing Business Reports, and the Silence of Traditional Comparative Law” (2009) 57 AJCL 765, 766 (“What is the most important development in comparative law you have never heard of? If you are a traditional comparative lawyer, chances are the answer is: the legal origins thesis and the Doing Business reports”) and Matthias M Siems, “The End of Comparative Law” (2007) 2 J Comp L 133, 144 (“The importance of these studies, and that of the World Bank’s Doing Business report, cannot be underestimated. This line of research is one of the most important trends in contemporary comparative legal and economic scholarship”).

3 For some evidence of the success of global quantitative legal comparisons, see Section III.4 See, for example, Mauro Bussani and Ugo Mattei, “Diapositives Versus Movies — the Inner Dynamics of

the Law and Its Comparative Account” in Mauro Bussani and Ugo Mattei (eds.), Cambridge Companion to Comparative Law (Cambridge: Cambridge University Press, 2012) pp.3, 5, who, referring to the World Bank’s Doing Business (DB) reports, note that “in our discipline no one would have dared (perhaps since Wigmore’s Panorama) to venture a comparison of so many legal systems in so little space knowing so little about any one of them”. See also Association Henri Capitant des Amis de la Culture Juridique Française, Les droits de la tradition civiliste en question. À propos des Rapports Doing Business de la Banque Mondiale (Paris: Société de législation comparée, 2006) pp.17, 31–32.

5 This is noted, among others, by Mathias M Siems, “Comparative Law: Who is the Elephant in the Room? Book Review of Comparative Law: A Handbook (Örücü and Nelken, eds.)” (2008) 12 Edinburgh L Rev 334–336; Michaels (n.2) 766 and Holger Spamann, “Large-Sample, Quantitative Research Designs for Comparative Law” (2009) 57 AJCL 797, 798.

6 Sunset Boulevard (Paramount Pictures, 1950). As is well known, the movie centres on the delusional aging silent-fi lm queen Norma Desmond, who plans a doomed comeback which culminates in murder. See britannica.com/topic/Sunset-Boulevard-fi lm-1950 (visited September 13, 2019).

7 Speaking of “comparative law” as a monolithic discipline is quite naïve. Suffi ce it to recall the ongoing debates on methodology (and functionalism), systemology, micro versus macro, diachronic versus synchronic, contrastive versus integrative comparisons, opportunity of combining comparative law with historical and anthropological insights, to mention but a few. Yet, for the purpose of this paper, “comparative law” will stand for any form of non-quantitative and small comparative legal research.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 288JICL-6(2)-7.Quantitative Legal Comparisons.indd 288 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 289

new rapidly developing fi eld. As this paper will hopefully show, global quantitative legal comparisons, perhaps unintentionally, cut through many of the Gordian knots that have animated debates and doubts about comparative law, and offer an alternative paradigm for “doing things with comparative law” that deserves further attention. While there might be many reasons for comparative law scholarship not to embrace the enthusiasm for global quantitative legal comparisons, there is all the reason to treat them as presenting a good opportunity to learn. Global quantitative legal comparisons, despite being highly problematic from many points of view, answer a number of critiques that have been brought through time to comparative law as we know it.

In the following sections, the paper therefore explores what global quantitative legal comparisons are and what they tell us about the state of art of comparative law, however defi ned. After locating global quantitative legal comparisons in the wider context of what has been called the “audit explosion”8 and providing some selective illustrations of what they are, the paper delves into their outstanding features, focussing on those that are of major interest for comparative law scholarship. Section V analyses who makes, and what competences are needed for making, global quantitative legal comparisons. Sections VI and VII investigate the focus of global quantitative legal comparisons — namely, states and their (written and perceived) rules. Sections VIII and IX examine global quantitative legal comparisons’ methodologies of inquiry and styles of presentation, as well as their understanding of what law and legal comparison are for. Finally, section X sums up what positions, beyond contempt and denial, are left to comparativists and what role comparativists might play in the emerging world of global quantitative legal comparisons.

II. The Quantitative Revolution

Global quantitative legal comparisons have not stemmed from developments within legal science. They are rather an offspring of a general paradigm shift towards quantifi cation in social sciences and management practices that have occurred throughout the twentieth century. This paradigm shift, fuelled by the globalisation of American business-oriented and ranking-prone culture and by technological advancements in the standardisation, collection and treatment of mass data, has provided global élites with a robust faith in numerical control, besides the well-settled confi dence in economic and fi nancial data. A number of quantitative measurements of human-related activities — from population size to

8 Michael Power, The Audit Explosion (London: Demos, 1994).

JICL-6(2)-7.Quantitative Legal Comparisons.indd 289JICL-6(2)-7.Quantitative Legal Comparisons.indd 289 23/10/19 1:45 PM23/10/19 1:45 PM

290 Journal of International and Comparative Law

average wealth level, and from productivity to violence and to happiness — are increasingly relied upon and used as a technology for knowledge and governance.9

Until the 1970s, law was mostly untouched by these changes. At the beginning of the 1970s, legal scholars involved in the Stanford-based Studies in Law and Development (SLADE) project collected a massive amount of empirical data on a small sample of countries in order to investigate the relationship between law and development.10 As is well known, the project was swiftly discontinued: the information gathered was too much and too hard to manage. The lack of immediate results rapidly cooled down the enthusiasm of the scholars involved and, most importantly, of the development agencies that were funding the program.11 But in parallel, individuals and non-governmental organisations (NGOs) with an interest in global affairs began experimenting with global legal indicators, that is, with collection of data purporting to represent (often in numerical form), compare and rank performance of states with regard to an array of legal issues. 12 These experiments have persisted.

In 1973, the New York-based NGO Freedom House (FH) published its fi rst “Freedom in the World” report, assessing the condition of political rights and civil liberties around the world.13 In 1983, the British Amnesty International Campaigner Charles Humana distributed the fi rst edition of his “World Human Rights Guide”, providing a survey of countries’ compliance with the standards set out in the 1948 UN Universal Declaration of Human Rights.14 In 1995, the Berlin-based NGO Transparency International (TI) launched its “Corruption Perceptions Index” (CPI), measuring perceived levels of corruption.15 In 1996, two World Bank (WB) economists inaugurated the “Worldwide Governance Indicators” series, exploring six dimensions of governance in every country of the world.16 Still at the WB, a team of economists of its Rapid Response Unit built upon the “legal origins” theory developed by the so-called LLSV group (from the initials of the proponents of the theory),17 and launched, in 2003, the “DB” reports to compare states’ investment

9 Chris Shore and Susan Wright, Audit Culture and the New World Order: Indicators, Rankings and Governing by Numbers (London: Pluto Press, forthcoming 2019); Marilyn Strathern (ed.), Audit Cultures: Anthropological Studies in Accountability, Ethics, and the Academy (Hove: Psychology Press, 2000); Alain Desrosiè res, La politique des grands nombres. Histoire de la raison statistique (Paris: La Dé couverte, 2nd ed., 2000) pp.26–59; Mary Poovey, A History of the Modern Fact: Problems of Knowledge in the Sciences of Wealth and Society (Chicago: University of Chicago Press, 1998) and Michael Power, The Audit Society: Rituals of Verifi cation (New York: Oxford University Press, 1997).

10 John H Merryman, “Law and Development Memoirs II: SLADE” (2000) 48 AJCL 713–727.11 David M Trubek, “Law and Development: 40 Years after Scholars in Self- Estrangement — A Preliminary

Review” (2016) 66 U Toronto L J 301–329.12 For this defi nition, see Krever (n.1) 132.13 See http://freedomhouse.org/content/our-history (visited 15 May 2019).14 Charles Humana, World Human Rights Guide (London: Hutchinson, 1st ed., 1983).15 See https://www.transparency.org (visited 15 May 2019).16 See http://info.worldbank.org/governance/wgi/#home (visited 15 May 2019).17 La Porta, Lopez, Shleifer and Vishny. The “legal origins” theory purported to examine how a country’s

legal origin is a determinant of that country’s economic performance: for the fi rst studies in this direction, see Rafael La Porta et al., “Legal Determinants of External Finance” (1997) 52 J Fin 1131–150 and Rafael La Porta et al., “Law and Finance” (1998) 106 J Pol Econ 1113–1155.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 290JICL-6(2)-7.Quantitative Legal Comparisons.indd 290 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 291

climate.18 In 2008 “World Justice Project,” an NGO sponsored by the American Bar Association, published the fi rst edition of the “Rule of Law Index”,19 while in 2009, a University of Connecticut research team, led by development economist Sakiko Fukuda Parr, set up the “Social and Economic Rights Fulfi llment” (SERF) Index for measuring economic, cultural, and social rights.20 All these projects and indexes are alive, and many of them have undergone a signifi cant transformation.

The above are just some illustrations of global legal indicators; there are many others.21 It remains an open question whether these indicators could be classifi ed as a source of law. Some authors emphasise that indicators are “not legal instruments as such”.22 Others claim that indicators “hold an intrinsic normative quality”.23 Still others even qualify indicators as “unconventional transnational norms”.24 While this is not the place to engage in that debate, what is worth stressing here is that, whatever their legal status, all these instruments have given rise to a substantial secondary literature. Secondary literature includes volumes and booklets complementing the indicators themselves and reporting original data and methodological caveats, as well as the thousands of works (mostly from statisticians, political scientists and economists) proposing refi nements to an indicator or reworking the data provided .25 But this literature also includes critical scholarship, mostly represented by political science, international relations and anthropology studies, analysing the effects and drawbacks of relying upon indicators. 26 Legal scholars have contributed to this critical strand of research: among them, many experts of law and development, 27

18 See http://doingbusiness.org/about-us (visited 15 May 2019).19 See https://worldjusticeproject.org (visited 15 May 2019).20 See https://serfi ndex.uconn.edu/overview/ (visited 15 May 2019).21 Suffi ce it to mention, for instance, the Traffi cking in Persons Reports published since 2001 by the US

Department of State, available at https://www.state.gov/j/tip/rls/tiprpt/ (visited 15 May 2019), and the Global Rights Index launched in 2014 by the International Trade Union Confederation, available at https://www.ituc-csi.org/ituc-global-rights-index-2018?lang=en (visited 15 May 2019).

22 Michael Riegner, “Towards an International Institutional Law of Information” (2015) 12 Int’l Org L Rev 50, 60.

23 Debora Valentina Malito, Nehal Bhuta, Gaby Umbach, “Conclusions: Knowing and Governing” in Debora V Malito et al. (eds.), The Palgrave Handbook of Indicators in Global Governance (New York: Palgrave, 2018) pp.503, 507.

24 David Restrepo Amariles, “Legal Indicators, Global Law and Legal Pluralism: An Introduction” (2015) 47 J Leg Pluralism Unoff Law 9, 17.

25 Jack Snyder and Alexander Cooley, “Rating the Ratings Craze: From Consumer Choice to Public Policy Outcomes” in Alexander Cooley and Jack Snyder (eds.), Ranking the World. Grading States As a Tool of Global Governance (Cambridge: Cambridge University Press, 2015) pp.178, 179–180.

26 Cf. Malito et al. (n.23); André Broome and Joel Quirk, “The Politics of Numbers: The Normative Agenda of Global Benchmarking” (2015) 41(special issue 5) Rev Int’l Stud 813–838; Cooley and Snyder (n.25) (political science); Judith Kelley, Scorecard Diplomacy. Grading States to Infl uence Their Reputation and Behavior (Cambridge: Cambridge University Press, 2017) (international relations) and Sally E Merry, The Seductions of Quantifi cation. Measuring Human Rights, Gender Violence, and Sex Traffi cking (Chicago and London: University of Chicago Press, 2015) (anthropology).

27 See for instance María A Prada Uribe, “The Quest for Measuring Development. The Role of the Indicator Bank” in Sally E Merry et al. (eds.), The Quiet Power of Indicators. Measuring Governance, Corruption, and Rule of Law (Cambridge: Cambridge University Press, 2015) pp.133–155 and Katharina Pistor, “Re-Construction of Private Indicators for Public Purposes” in Kevin E Davis et al. (eds.), Governance by

JICL-6(2)-7.Quantitative Legal Comparisons.indd 291JICL-6(2)-7.Quantitative Legal Comparisons.indd 291 23/10/19 1:45 PM23/10/19 1:45 PM

292 Journal of International and Comparative Law

public international lawyers28 and a small number of comparativists. 29 Yet, unlike their colleagues, comparativists have not discussed indicators in general. They have mainly focussed on the “legal origins” theory underlying the “DB” reports, perhaps because it came with an academic format and more clearly concerned their fi eld of studies, devoting substantial efforts to demonstrating how deeply simplistic, biased and untenable were the theory’s methodology, assumptions and conclusions.30

By concentrating on one global legal indicator and disregarding the phenomenon as a whole, comparativists have failed to notice the elephant in the room. Many reasons might explain comparativists’ neglect of global legal indicators as such: from the non-evident legal character of many indicators to the little interest traditionally paid by comparativists to the “global” sphere and to their distrust of large comparative exercises. But the fact remains that such large comparative exercises have enjoyed a success in academic and political circles so far unrivalled by any comparative law study.

III. Some Illustrative Indicators

To fully understand what global quantitative legal comparisons have in common with (and might be educational for) comparative legal scholarship, it is useful to see in more detail some examples of how they are made and what they do. The paper offers three illustrations, scrutinising the already mentioned “Freedom in the World” Index (FWI), the “CPI” and the “DB” reports, always referring to the

Indicators. Global Power through Quantifi cation and Rankings (New York: Oxford University Press, 2012) pp.165–179.

28 Cf., among many such contributions, René Urueña, “Indicators as Political Spaces. Law, International Organizations, and the Quantitative Challenge in Global Governance” (2015) 12 Int’l Org L Rev 1–18 and Riegner (n.22) 50–80.

29 Cf. the contributions to special issues on the legal origins theory in (2009) 57(4) AJCL 765–876; (2009) 59(2) U Toronto LJ 179–235; (2009) 6 BYU L Rev 1413–906; (2010) 166 JITE 1–202 and (2012) 11 Annuario di diritto comparato 7–353. See also Nuno Garoupa, Carlos Gómez Ligüerre, Lela Mélon, Legal Origins and the Effi ciency Dilemma (Oxford: Routledge, 2016); Ralf Michaels, “‘One Size Can Fit All’ — Some Heretical Thoughts on the Mass Production of Legal Transplants” in Günther Frankenberg (ed.), Order from Transfer. Comparative Constitutional Design and Legal Culture (Cheltenham: Elgar, 2013) pp.56–78; Nuno Garoupa and Carlos Gomez Liguerre, “The Syndrome of the Effi ciency of the Common Law” (2011) 29 BU Int’l LJ 287–335; Holger Spamann, “The ‘Antidirector Rights Index’ Revisited” (2010) 23 Rev Fin Stud 467–86; Mathias M Siems, “Legal Origins: Reconciling Law & Finance and Comparative Law” (2007) 52 McGill L J 55–81 and Association Henri Capitant des Amis de la Culture Juridique Française (n.4).

30 See works referred to in note 29. There are few exceptions, such as Mathias M Siems, Comparative Law (Cambridge: Cambridge University Press, 2nd ed., 2018) pp.180–228; Ran Hirschl, Comparative Matters. The Renaissance of Comparative Constitutional Law (Oxford: Oxford University Press, 2014) pp.16, 192–193, 288 and Anne Meuwese and Mila Versteeg, “Quantitative Methods for Comparative Constitutional Law” in Maurice Adams and Jacco Bomhoff (eds.), Practice and Theory in Comparative Law (Cambridge: Cambridge University Press, 2012) pp.230–257.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 292JICL-6(2)-7.Quantitative Legal Comparisons.indd 292 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 293

latest available editions. All these indicators have seen signifi cant changes, often responding to criticisms and comments. 31

The earliest of the three selected indicators is FWI, which evaluates states’ performances annually as far as rule of law and protection of political rights and civil liberties are concerned. States are given a score ranging from 0 to 100, with 0 being “least free” and 100 being “most free”. The fi nal results are shown in a map with green–yellow–purple colours, in which green is good and purple is bad.32

Diagram 1: Freedom in the World Map

Note: Freedom in the World, FH_FITW_Report_2019_WorldMap.jpg, available at https://freedomhouse.org/report/freedom-world/freedom-world-2019/map (© 2019

Freedom House) (visited 15 May 2019).

31 For instance, as a response to the claim that countries’ ratings were not transparent, in 2006 FH started publishing the disaggregated results for each country: Nikhil K Dutta, “Accountability in the Generation of Governance Indicators” (2010) 22 Fla J Int’l L 401, 429. To respond to French critique of the fi rst edition of the report, the DB team incorporated in the second edition some of the proposed suggestions for improvement: see Bénédicte Fauvarque-Cosson and Anne-Julie Kerhuel, “Is Law an Economic Contest? French Reactions to the Doing Business World Bank Reports and Economic Analysis of the Law” (2009) 57 AJCL 811, 814–815. After being subjected to an internal review in 2008 by the WB’s Independent Evaluation Group, in 2013, the DB team voluntarily undertook a process of external review: see Trevor Manuel et al., “Independent Panel Review of the Doing Business report” (2013), available at http://pubdocs.worldbank.org/en/237121516384849082/doing-business-review-panel-report-June-2013.pdf (visited 15 May 2019).

32 See https://freedomhouse.org/report/freedom-world/freedom-world-2019/map (visited 15 May 2019).

JICL-6(2)-7.Quantitative Legal Comparisons.indd 293JICL-6(2)-7.Quantitative Legal Comparisons.indd 293 23/10/19 1:45 PM23/10/19 1:45 PM

294 Journal of International and Comparative Law

Country scores are determined for FH by its in-house and external consultants with nearly 130 people assisting in the preparation of the 2019 edition.33 FH consultants use a publicly available questionnaire to fi nd out how each country deals with electoral and political processes, free speech, labour rights, civil justice, protection of property and freedom of business.34 Consultants answer the questionnaire relying upon their personal knowledge and contacts, news media, offi cial government statements, NGO reports, scientifi c articles and local visits. Answers are then translated into points, which are aggregated to assign a fi nal score to each country.35 Unsurprisingly, the FWI has been subjected to much criticism, mostly focussed on its limited emphasis on civil and political rights, fi nancial and ideological alignment with the views of the US government and obscure and heavily subjective methodology.36 Notwithstanding all such limitations, the FWI is often cited in academic writings to support arguments and test theories about democracy, development and economic growth.37 Most importantly, international organisations, such as the WB, and international donors, such as the US Millennium Challenge Corporation, use the FWI as one of the criteria to determine and evaluate aid distribution.38

In 1995, a few years after the launch of the FWI, the Berlin-based NGO TI, founded by a German lawyer who had previously worked at the WB, published the fi rst edition of its CPI. The CPI ranks 180 countries and territories by their perceived levels of public sector corruption according to experts and businesspeople, and uses a scale of 0 to 100, where 0 is highly corrupt and 100 is very clean.39 CPI’s results too are presented in a coloured map, with dark red meaning “highly corrupt” and light yellow meaning “highly clean”; a ranking of countries, from the least to the most corrupt, is also available.

33 See freedomhouse.org/report/freedom-world/freedom-world-2019/acknowledgements (visited 15 May 2019).

34 The full questionnaire underlying the 2019 edition is available at freedomhouse.org/report/methodology-freedom-world-2019 (visited 15 May 2019).

35 See the website mentioned ibid.36 Sarah Sunn Bush, “The Politics of Rating Freedom. Ideological Affi nity, Private Authority, and

the Freedom in the World Ratings” (2017) 15 Perspectives on Pol 711, 722; Christopher G Bradley, “International Organizations and the Production of Indicators. The Case of Freedom House” in Merry et al. (n.27) pp.27, 60; Stefan Voigt, “How (Not) to Measure Institutions” (2013) 9 J Inst Econ 1, 20; Wolfgang Merkel, “Measuring the Quality of Rule of Law. Virtues, Perils, Results” in Michael Zürn et al. (eds.), Rule of Law Dynamics in an Era of International and Transnational Governance (Cambridge: Cambridge University Press, 2013) pp.21, 24 and Dutta (n.31) 442.

37 Cf. Dutta (n.31) 429; Voigt (n.36) 20; Christiane Arndt and Charles Oman, Uses and Abuses of Governance Indicators (Paris: OECD, 2007) p.23 and Pistor (n.27) p.168.

38 Bush (n.36) 718–722 and Dutta (n.31) 430.39 See https://www.transparency.org/cpi2018 (visited 15 May 2019).

JICL-6(2)-7.Quantitative Legal Comparisons.indd 294JICL-6(2)-7.Quantitative Legal Comparisons.indd 294 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 295

Diagram 2: Corruption Perception Map

Note: Corruption Perception Index 2018, CPI 2018 World Map, available at https://www.transparency.org/cpi2018 (CC-BY-4.0-DE 2018 Transparency

International. Some rights reserved) (visited 15 May 2019).

Scores are determined by the TI’s team by aggregating the results of many expert opinion-based indicators on levels of corruption in the public sector and the quality of the institutional and legal framework to fi ght corruption.40 I n other words, CPI is a composite indicator, which collates data from different sources to come up with a score representing how corrupt a country is perceived to be. Needless to say, the CPI has not gone unchecked. Critical scholarship has highlighted a number of fl aws underlying CPI’s conception and structure. Criticisms have mainly been as regards with issues such as the unreliability of experts’ opinions, the general weakness of perception-based surveys, the narrow conception of “corruption” the CPI embraces and chastising petty corruption by offi cials while turning a blind eye to corrupt activities of private businesses.41 Y et, CPI has proved to be a great success. It is

40 CPI_2018_SourceDescription Document_EN.pdf, available at https://www.transparency.org/cpi2018 (visited 15 May 2019).

41 Robert J Beschel Jr, “Measuring Governance: Revisiting the Uses of Corruption and Transparency Indicators” in Malito et al. (n.23) pp.161, 166–168; Alexander Cooley, “How International Rankings Constitute and Limit Our Understanding of Global Governance Challenges: The Case of Corruption” in Malito et al. (n.23) pp.49, 51; Mlada Bukovansky, “Corruption Rankings” in Cooley and Snyder (n.25) pp.60, 73; Voigt (n.36) 20 and Tom Ginsburg, “Pitfalls of Measuring the Rule of Law” (2011) 3 Hague J Rule L 269, 273.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 295JICL-6(2)-7.Quantitative Legal Comparisons.indd 295 23/10/19 1:45 PM23/10/19 1:45 PM

296 Journal of International and Comparative Law

credited with having solidifi ed in the global agenda the idea that corruption is an obstacle to economic growth42 a nd having cemented the international consensus in the fi ght against corruption, paving the way for the adoption of the OECD Convention on Combating Bribery of Foreign Public Offi cials in International Business Transactions in 1997 and the UN Convention Against Corruption in 2003.43 While it is hard to establish a direct causal link between the CPI and specifi c legal reforms, legislative efforts against corruption (conceived à la CPI) have multiplied since 1995.44

Stemming out from the WB’s long experimentation with assessing countries’ political and economic situation, the DB is the global legal indicator comparativists know best, although they tend to confl ate it with the “legal origins” theory that inspired it. Since its fi rst report in 2003, the DB ranks countries according to the business-friendliness quality of their regulatory environment, on the assumption that “good” laws are conducive to economic growth.

Diagram 3: Doing Business Table

Note: Excerpt from World Bank Group, Doing Business 2019, Table 1.1, 5, available at http://www.doingbusiness.org/en/reports/global-reports/doing-

business-2019 (© 2019 International Bank for Reconstruction and Development/The World Bank) (visited 15 May 2019).

Thanks to the impressive resources available to the WB, the DB’s reports are based upon the answers to a questionnaire drafted by the DB team. The team is made up of roughly 60 people, mostly economists, working at the WB’s Washington DC headquarters. Every year, the team sends the DB questionnaire to approximately 13,000 lawyers and government offi cials around the world.45 The DB questionnaire investigates what would happen to a middle-size local enterprise based in the country’s largest business city in a series of circumstances articulated along

42 Bukovansky (n.41) p.73 and Katharina Pistor, “Advancing the Rule of Law: Report on the International Rule of Law Symposium” (2007) 25 Berkeley J Int’l L 7, 25–26.

43 Bukovansky (n.41) 72 and Pistor (n.42) 31.44 Cooley (n.41) p.49; Urueña (n.28) 7; Arndt and Oman (n.37) p.48 and Pistor (n.42) 31.45 WB, Doing Business 2019: Training for Reforms (WB, 2018) p.73, available at http://www.doingbusiness.

org/en/reports/global-reports/doing-business-2019 (visited 15 May 2019).

JICL-6(2)-7.Quantitative Legal Comparisons.indd 296JICL-6(2)-7.Quantitative Legal Comparisons.indd 296 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 297

11 dimensions: from obtaining a construction permit to getting electricity and from paying taxes to enforcing contracts. Questions range from purely factual, such as “how many days are needed to get electricity?”, to purely legal, such as “is there a specialized commercial court?”.46 Responses are evaluated, assembled, weighted and transformed into numbers by the DB team, producing a country’s ranking for each of the 11 dimensions. Ten of these scores47 are then aggregated to create the fi nal “Ease of DB” score. In addition to ranking countries from the most business friendly to the least business friendly, each edition of the DB also identifi es the top 10 reformers of the year, celebrating the countries that have reformed the most.48 The limits of DB are well known: the DB has been criticised for its weaknesses such as the fragility of the “legal origins” theory and the US-centred bias of the DB’s questionnaire,49 the emphasis the latter puts on offi cial and formal law only50 and the unreliability and unrepresentativeness of expert opinions.51 Further, many have questioned the validity of simplifi ed assumptions the entire project is based on, such as that less regulation is always good, rules can be easily transplanted and there is one ‘right’ solution to every business legal problem.52 Not w ithstanding such criticisms, the DB team estimates that, since the fi rst edition of the DB, more than 10,000 articles using the DB’s data have been published online and in peer-reviewed journals;53 more than 60 countries have established teams, offi ces and even ministries devoted to improving their performances in the DB54 and more than 3,500 legal reforms have been carried out worldwide along DB’s lines.55

46 Ibid., pp.73–124.47 The dimension that is left out from the aggregate score is the one on labour market regulations. The

DB team stopped using this sub-index as a component of the fi nal score in 2009, following the harsh criticism by the International Trade Union Confederation and the International Labour Organization of the slippery slope towards deregulation that the sub-index favoured. On this story, cf. Debbie Collier and Paul Benjamin, “Measuring Labor Market Effi ciency. Indicators that Fuel an Ideological War and Undermine Social Concern and Trust in the South African Regulatory Process” in Merry et al. (n.27) pp.284–316; Krever (n.1) 140–141 and Paul Benjamin et al., “The Cost of ‘Doing Business’ and Labour Regulation. The Case of South Africa” (2010) 149 Int’l Lab Rev 73–91.

48 See WB (n.45) pp.8–14.49 See, among others, Timothy Besley, “Law, Regulation, and the Business Climate: The Nature and

Infl uence of the World Bank Doing Business Project” (2015) 29 J Ec Perspec 99–120; Garoupa and Liguerre (n.29) 304–331; Michaels (n.2) 778, 786–787; Fauvarque-Cosson and Kerhuel (n.31) 821–823 and Association Henri Capitant des Amis de la Culture Juridique Française (n.4).

50 Cf. Besley (n.49) 102, 107; Fauvarque-Cosson and Kerhuel (n.31) 814–815; Alvaro Santos, “The World Bank’s Uses of the ‘Rule of Law’ Promise in Economic Development” in David Trubek and Alvaro Santos (eds.), The New Law and Economic Development: A Critical Appraisal (Cambridge: Cambridge University Press, 2006) pp.253, 295 and Pistor (n.42) 26–28.

51 See for instance Voigt (n.36) 19–20 and Michaels (n.2) 778.52 André Broome, Alexandra Homolar and Matthias Kranke, “Bad Science: International Organizations

and the Indirect Power of Global Benchmarking” (2018) 24 Eur J Int’l Rel 514, 523; Krever (n.1) 132; Garoupa and Liguerre (n.29) 304–305; Fauvarque-Cosson and Kerhuel (n.31) 823; Michaels (n.2) 788–789 and Santos (n.50) p.294.

53 WB (n.45) p.2.54 WB, Doing Business 2018: Reforming to Create Jobs (WB, 2017) v, available at https://openknowledge.

worldbank.org/handle/10986/28608a (visited 15 May 2019).55 WB (n.45) p.7.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 297JICL-6(2)-7.Quantitative Legal Comparisons.indd 297 23/10/19 1:45 PM23/10/19 1:45 PM

298 Journal of International and Comparative Law

Well-known are the cases of Georgia, Azerbaijan, and Rwanda, where the setting up of a national team focussed on the DB and the adoption of many DB-driven legal reforms have produced a corresponding ascent in the ranking.56 Comp eting in the DB’s “law reform Olympics”57 has become a popular sport.

IV. Global Quantitative Legal Comparisons: Features and Lessons

Social scientists have engaged in much debate on the soundness of the methodology and of the assumptions underlying global legal indicators, legitimacy of the institutions promoting them and their goals and their (intended and unforeseen) uses.58

In view of limitation of space what this paper can do is to emphasise that comparativists might view global legal indicators as fl awed, clumsy and simplistic: yet, they can be considered to be genuine comparative law exercises. After all, what global legal indicators do is not much different to what comparative law scholarship does: investigating legal rules, institutions and infrastructures in different settings.

Obviously, there remain some signifi cant differences between global indicators and comparative law projects. Global legal indicators are made by research groups whose members are not trained comparativists, and usually are not even lawyers. They focus on a large number of states rather than on a limited set of legal systems, and on laws-in-the-books rather than on laws-in-action. They put substantial emphasis on the way in which rules are written and perceived, rather than applied. They embrace a strictly functionalist methodology and go to great lengths to package their results in a user-friendly format and to freely disseminate them on the web. Moreover, they always mix description with prescription. On the one hand, they purport to depict the state-of-the-art of legal affairs in all the countries in the world, but, on the other hand, they implicitly or explicitly embrace one model as the best possible one, pushing for worldwide harmonisation in that direction.

Only some or none of these features might be useful. Yet, the claim of this paper is that many of these features could provide comparativists with a source for refl ection and even inspiration.

56 Sam Schueth, “Assembling International Competitiveness: The Republic of Georgia, USAID, and the Doing Business Project” (2010) 87 Ec Geo 51, 63–64 (on Georgia); Alexander Cooley, “The Emerging Politics of International Rankings and Ratings” in Cooley and Snyder (n.25) pp.34–35 (on Azerbaijan) and Besley (n.49) 117 (on Rwanda).

57 Verontay L Taylor, “The Law Reform Olympics: Measuring the Effects of Law Reform in Transition Economies” in Tim Linsey (ed.), Law Reform in Developing and Transitional States (Oxford: Routledge, 2007) pp.83–105.

58 See the authors cited in n.26–n.28.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 298JICL-6(2)-7.Quantitative Legal Comparisons.indd 298 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 299

V. New Actors

One of the most striking features of global quantitative legal comparisons is that they are not made by lawyers, let alone by comparativists. While lawyers might participate as experts and reporters, they do not have a signifi cant presence in the production teams engaged in the publication of global indicators and do not play a signifi cant part in the shaping of the reports.

FIW’s and CPI’s analysts are mainly political scientists and also include historians, economists and human rights activists .59 The DB team, which relies upon lawyers to get the answers to its questionnaire, is overwhelmingly made up of developmental economists .60 Teams are typically large: roughly 60 people work for the DB and 130 for the FIW.61 Teams generally ensure gender and geographical balance, 62 although team members have often pursued their studies in a limited circle of Global North academic institutions and are therefore part of an epistemic community which is much in line with that of Westernised professional élites. 63 Teams often benefi t from the input by internal and external consultants and from contributions made by those with knowledge of mathematics, statistics or econometrics.64 Finally, since the FIW, CPI and DB teams are drawn from the organisation endorsing the indicator, the report is published under the name of the organisation, with little credit given to the work done behind the scenes.

From a comparativist’s point of view, it is hard to accept that such large-scale legal comparisons are not the exclusive domain of trained comparativists and are actually made without their contribution. There is indeed little doubt that the comparativists’ absence might explain many of the fallacies affecting global legal indicators. Yet, despite this major omission, the peculiar authorship of the global legal indicators is not entirely to blame.

The keyword here is teamwork. For various reasons such as ego of law professors, the academic career path, levels of research funding and the structure of legal publishing industry, lawyers in general and comparativists in particular have historically shown a strong preference to work alone and not engage in team work.65 Exceptionally, there are large projects involving a number of people from different jurisdictions — such as the collective research projects undertaken under

59 Cf. freedomhouse.org/report/freedom-world/freedom-world-2019/acknowledgements and https://www.transparency.org/whoweare/organisation/individual_members/0 (visited 15 May 2019).

60 WB (n.45).61 See the websites in n.59 and n.60. It is not known how many of TPI staff are working on the CPI.62 See n.58 and n.59.63 Cooley (n.56) p.31; Jedidiah Kroncke, “Law and Development As Anti-Comparative Law” (2012) 45

Vand J Trans L 477, 489–496; Santos (n.50) p.296 and David Kennedy, “Challenging Expert Rule: The Politics of Global Governance” (2005) 27 Sydney L Rev 5, 14–15.

64 See also Galit A Sarfaty, “Why Culture Matters in International Institutions: The Marginality of Human Rights at the World Bank” (2009) 103 AJIL 647, 673–674 and Santos (n.50) pp.255–299.

65 See, among others, Tracy E George and Chris C Guthrie, “Joining Forces: The Role of Collaboration in the Development of Legal Thought” (2002) 52 J Leg Educ 559, 560.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 299JICL-6(2)-7.Quantitative Legal Comparisons.indd 299 23/10/19 1:45 PM23/10/19 1:45 PM

300 Journal of International and Comparative Law

auspices of the International Academy of Comparative Law. The majority of our work as comparativists is authored by one or two professors, who are more often than not male and are either European or North American. 66

All of this might be perfectly legitimate, unavoidable and even desirable. Yet it is diffi cult to see why this way of working should per se be superior to researches carried out by large, multi-disciplinary, quasi-anonymised and gender and geographically diverse teams. One could observe that global legal indicators’ large teams are made possible by the resources available to those publishing global legal indicators. The observation, however, does not hold. While the DB is supported by a powerful and rich international organisation, this is not true of the FWI and CPI. The two NGOs that publish them are now supported by generous donors (eg, the US government for FH and the WB for TI), but many of these donors have stepped in only after, and partially because of, the publication of the organisations’ indicators.67 Having a large and diverse group of people involved in the production of global indicators appears to contribute in no small measure to their success, by minimising risk of bias and errors, which an individual comparativist or a small group of comparativists may be prone to.

VI. The State in the Spotlight

Global legal indicators are state centric. FIW, CPI, and DB all focus on states’ laws, covering all the sovereign states, from Afghanistan to Zimbabwe.

Global legal indicators’ statolatry derives from and reinforces the liberal, Western-driven faith in state institutions as “the primary locus of social control”.68 Statolatry is also instrumental to these indicators’ goal of leveraging states towards the adoption of a regulatory model that (invariably comes from the Global North, and) is advertised as the best possible one. Moreover, under the disguise of apparent egalitarianism, global legal indicators gloss over states’ vastly divergent capacities to exercise domestic and international agency69 and assign to them responsibility for success and failure, 70 invariably naming, ranking and blaming non-Western states for not being as Westernised as they should be.

66 Hirschl (n.30) pp.16, 211–212. Cf. Günther Frankenberg, Comparative Law as Critique (Cheltenham: Elgar, 2016) pp.85–96; Günter Frankenberg, “The Innocence of Method-Unveiled: Comparison As an Ethical and Political Act” (2016) 9 J Comp L 222, 223 [The Innocence]; William Twining, “General Jurisprudence” (2005) 39 Anales de la Cá tedra Francisco Suá rez 645, 652; Anne Peters and Heiner Schwenke, “Comparative Law beyond Post-Modernism” (2000) 49 ICLQ 800, 829 and Günther Frankenberg, “Critical Comparison: Re-thinking Comparative Law” (1985) Harvard Int’l L J 411, 422–424.

67 See Bukovansky (n.41) and Dutta (n.31) 458.68 David Trubek and Marc Galanter, “Scholars in Self-Estrangement: Some Refl ections on the Crisis in Law

and Development Studies in the United States” (1974) 4 Wisc L Rev 1062, 1075.69 Broome, Homolar and Kranke (n.52) 516.70 Ibid., 531; Sally Engle Merry (n.26) p.208 and Nehal Bhuta, “Governmentalizing Sovereignty: Indexes

of State Fragility and the Calculability of Political Order” in Davis et al. (n.27) pp.132, 134.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 300JICL-6(2)-7.Quantitative Legal Comparisons.indd 300 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 301

Much criticism has been levelled against the assumptions underlying global legal indicators’ aims and efforts to push for reform in states which they consider to be lagging behind.71 This aspect is dealt with below. What matters now is the signifi cance of indicators’ statolatry.

To most comparativists, indicators’ insistence on states and their laws might seem at best naïve, insofar as it foreshadows sub-national varieties and sources of law that do not emanate from state institutions. Yet, one cannot but note that State-centrism is not foreign to comparative law studies, which often take the form of state-to-state comparisons and fail to acknowledge the wide range of legal layers that — beyond and within the West — determine the daily life of law.72

Further, what is worth stressing from the perspective of this paper is that global legal indicators’ attention to all States alike is a partial solution to the “biased selection” trap affecting much comparative legal scholarship. Comparativists working alone inevitably tend to focus on the jurisdictions they know best, although the criteria underlying the chosen boundaries of their research usually remain unexpressed.73 The selection routinely rewards “systems, families, and regimes of Western law and legal culture”,74 “a small set of ‘usual suspect’ settings […] of the ‘Global Nor th’”.75 Moreover, comparativists are prone to draw conclusions from their spatially limited research whose signifi cance goes well beyond the geographical reach of the testing.76

Global legal indicators too tend to privilege the Global North and to celebrate its values and practices. But they do so by formally considering all states’ experiences as equally relevant and by transparently displaying their alignment with the Western legal mindset. With all their limitations, formal equality and full transparency seem a more defensible approach than comparativists’ hidden selectivity.

VII. The Perception of Law

A corollary of global legal indicators’ state-centrism is that they apparently look into offi cial, written “law-in-the-books” only. The most outspoken in this regard is the DB, which openly claims that “approximately two-thirds of the data embedded

71 See the authors cited above (n.26–n.28).72 For a similar observation, see Jakko Husa, A New Introduction to Comparative Law (Oxford-Portland:

Hart, 2015) p.211; Mauro Bussani, “Comparative Law beyond the Trap of Western Positivism” in Salvatore Mancuso and Tong-Io Cheng (eds.), New Frontiers of Comparative Law (Hong Kong: LexisNexis, 2013) p.1; Frankenberg, “Critical Comparisons: Re-thinking Comparative Law” (n.66) 445–448 and Alan Watson, Legal Transplants: An Approach to Comparative Law (Athens: Georgia U Press, 2nd ed., 1993) p.10.

73 Frankenberg, The Innocence (n.66) 223.74 Ibid.75 Hirschl (n.30) p.16; see also the authors quoted above (n.66).76 Hirschl (n.30) pp.16, 192, 193; Spamann (n.5) 802–803 and John Reitz, “Legal Origins, Comparative

Law, and Political Economy” (2009) 57 AJCL 847, 853.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 301JICL-6(2)-7.Quantitative Legal Comparisons.indd 301 23/10/19 1:45 PM23/10/19 1:45 PM

302 Journal of International and Comparative Law

in the DB indicators are based on a reading of the law”.77 It is not by chance that many have deplored the lack of attention given by the DB to the law as actually (not) applied and to rules governing people’s and business’ lives in the shadow of the state.78

To tell the truth, other global legal indicators, such as the FWI and most evidently the CPI, are interested not so much in what state law is but what “perceptions” of state law are.79 To measure perceptions, the FWI and the CPI rely upon experts’ assessments and other opinion-based data.80 This aspect too has been criticised on the ground of the unrepresentativeness of experts’ judgments, of their high subjectivity and of the low correlation between experts’ perceptions and the phenomena purportedly under examination.81

From the perspective of comparative law, these critiques seem reasonable. Indeed, comparativists too have often been criticised for their alleged superfi ciality, if not neglect, with respect to the unoffi cial layers of the law and the connected preference for focusing on more easily accessible and detectable “hard” legal materials, such as legislation and judicial decisions.82

That is why comparativists have something to learn from global legal indicators’ emphasis on the perception of the law. Albeit unrepresentative, subjective and not necessarily reliable, opinions on perceptions have the potential to shed light on dimensions that — no matter what they are called: social norms, traditional laws, cryptotypes, legal cultures — are too often under-considered by comparativists themselves.83 As an attempt to capture unoffi cial, yet powerful features of living law, global legal indicators’ interest in the perceptions of law appears to be a promising tool for performing what is often portrayed as the core of comparativists’ work: to go beyond legal façades and to relentlessly dig into the deeply rooted foundations of legal systems.

VIII. Methodology and Style

In terms of methodology, global legal indicators seem to subscribe to a hyper-simplifi ed and stylised version of comparative legal functionalism on the ground that all legal systems face the same problems and deal with them (or, alternatively, should deal with them) through the same set of rules. While the CPI investigates the content and the effectiveness of anti-corruption laws by collecting data from

77 WB (n.45) p.27.78 See especially the authors quoted above (n.30).79 See above, Section III.80 Above, Section III.81 See the authors quoted above (n.36 and 41).82 See the authors quoted (n.72) as well as Peters and Schwenke (n.66) 832.83 Cf. Mauro Bussani, “Strangers in the Law. Loyalties to the Laws” (2019) 40 Cardozo L Rev 3127–3184;

Bussani (n.72) pp.1–10 and Esin Ö rü cü , Enigma of Comparative Law. Variations on a Theme for the Twenty-fi rst Century (Dordrecht: Springer, 2014) pp.41–47.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 302JICL-6(2)-7.Quantitative Legal Comparisons.indd 302 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 303

other indicators,84 the FWI and the DB rely upon a questionnaire. The questionnaire is answered by in-house and external analysts and reporters, and the answers are complemented with the aid of web searches and software tools for the analysis of mass online information.85 The most advanced technique is the one developed by the DB, whose questionnaire takes a factual standpoint and provides national reporters with detailed instructions as to the assumptions on which answers should be given.86 After collecting data, indicators’ teams review them and ultimately translate them into numbers and scores. The summaries of the collected results are typically presented in a user-friendly and captivating format, either through a country ranking, such as in the DB, or through interactive world maps with countries coded in different colours, as in the case of the FIW and CPI.87 When a new edition is ready, the indicator and some of its background materials are made available for free on a dedicated website.

Global legal indicators’ overly simplifi ed approach to data research and collection is a key factor for explaining their ability to amass and treat on a yearly basis an enormous amount of information.88 Such an approach involuntarily mimics, albeit in a stylised and caricatural form, the way of working of many comparative law projects and researches.89 Many for instance have noticed the superfi cial resemblance between the DB’s methodology and the “Common Core” factual method developed by Schlesinger fi rst, and then refi ned by Mauro Bussani and Ugo Mattei.90 N ot surprisingly, indicators’ methodology has been subject to criticisms akin to those voiced by many against comparativists’ uses of functionalism.91

I f there is anything comparativists might learn from the methodology and style of global legal indicators, this lies on the dissemination side.

Global legal indicators have the ability to convey extremely complex judgments in a simplifi ed, easily accessible form. Their simple comparisons presented in coloured maps provide readers with an easy-to-use tool to quickly grasp the gist of the study, which is itself very simple; some states are bad performers, while others

84 See Section III.85 Section III.86 Section III.87 The aesthetics of global indicators is explored, among many others, by Broome, Homolar and Kranke

(n.52) 516; Kevin E Davis et al., “Introduction. The Local-Global Life of Indicators: Law, Power, and Resistance” in Merry et al. (n.27) pp.1, 12; Merry (n.26) p.210 and Nehal Bhuta (n.70) pp.132, 156.

88 Speaking of LLSV studies, Detlev F Vagts, “Comparative Company Law — The New Wave” in Rainer J Schweizer et al. (eds.), Festschrift für Jean Nicolas Druey (Zürich: Schulthess, 2000) pp.596, 604 noted that “[O]rthodox comparative lawyers would have shrunk back from such an ambitious endeavor and if they had attempted, it would have wound up with a tome of 2000 pages and 6000 footnotes fi lled with caveats and qualifi cations that would have rendered it unreadable”.

89 See the researches mentioned in Section V.90 Holger Spamann, “Empirical Comparative Law” (2015) 11 Ann Rev Soc Sci 131, 144; Spamann (n.5) 808

and Michaels (n.2) 779.91 See n.36, n.41 and n.52; see also Christopher A Whytock, “Legal Origins, Functionalism, and the Future

of Comparative Law” (2009) BYU L Rev 1879–1905 and Michaels (n.2) 778.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 303JICL-6(2)-7.Quantitative Legal Comparisons.indd 303 23/10/19 1:45 PM23/10/19 1:45 PM

304 Journal of International and Comparative Law

are good. Indicators’ free availability online is a further factor in facilitating their dissemination.

Clearly, the teams producing global legal indicators are not constrained by academic career and legal publishing requirements, which historically have not encouraged open access publication. It is also clear that global legal indicators are addressed to a public that is different from, and much broader than, the one targeted by comparativists, who usually talk among themselves.92 I t is clear that indicators pursue a political agenda rather than a scientifi c agenda, and that their packaging and aesthetics are subservient to amplifying the effect of “naming, blaming, ranking” states.

That being said, there is little doubt that their public relations strategy works well. This is not to advocate that comparativists should embrace a marketing mindset. Rather, the point is that a number of global legal indicators’ stylistic features and tactics of dissemination might be of some interest for comparativists too. Think of the use of illustrations and charts and of the idea of sharing content on the web in a user-friendly format. If transplanted into comparative legal studies, such features might help comparativists communicate beyond themselves without losing any of their scientifi c nobility.93

IX. Comparative Law As a Means to an End

Underlying the FWI, the CPI and the DB is an optimistic and simplistic belief in the transformative power of the law. On the premises that “law matters”, indicators embrace an instrumental and causal vision of legal phenomena. Under this vision, “good” laws (where “good” means Western) allow entrepreneurial activity to fl ourish and, therefore, lead to economic growth, accidentally also promoting the wellbeing of the society at large. As a fundamental ingredient of the recipe for development, “good” laws are good everywhere and will lead everywhere to the same result.94

From this perspective, global quantitative legal comparisons are both statistical tools for testing theories about law, growth and development, and nudging tools for spreading the adoption of the Western models embedded in these theories. In the world of global legal indicators, if law is a means of achieving an allegedly

92 Bussani and Mattei (n.4) p.5; James Q Whitman, “Consumerism Versus Producerism: A Study in Comparative Law” (2007) 117 Yale L J 340, 344–345 and Basil Markesinis, Comparative Law in the Courtroom and Classroom (Oxford-Portland: Hart, 2003) p.53 (holding that comparative law scholarship is “likely to satisfy only those who spend their time […] quoting each other with self-satisfaction”).

93 On similar lines, see Michaels (n.2) 780 and Mathias M Siems, “Numerical Comparative Law: Do We Need Statistical Evidence in Law in Order to Reduce Complexity?” (2005) 13 Cardozo J Int’l Comp L 521, 534.

94 For a summary of indicators’ assumptions about the law, cf. René Urueña, “Indicators and the Law: A Case Study of the Rule of Law Index” in Merry et al. (n.27) pp.75–102; Michaels (n.29) pp.56, 63 and Krever (n.1) 132–134.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 304JICL-6(2)-7.Quantitative Legal Comparisons.indd 304 23/10/19 1:45 PM23/10/19 1:45 PM

Quantitative Legal Comparisons 305

universal good, comparing laws is a means of fostering harmonisation towards that alleged good.

Many have questioned the accuracy and linearity of the above reasoning, as well as the appropriateness of indicators’ practice. A common criticism has for instance been directed at the direction of indicators’ causality, noting that it is far from established whether “good” laws (that is, in terms of global legal indicators: business-friendly laws) invariably produce economic growth.95

At fi rst sight, the indicators’ vision of the law just mentioned seems to have little to share with comparativists’ vision (better to say: visions) of legal phenomena. Comparativists do not explicitly look at legal issues through causal questions,96 rarely pursue an ostensible program for reform97 a nd even more rarely present their research in a way clearly intended for a practical purpose.98

At a closer look, however, differences tend to blur. Comparativists too often present their research as being purely descriptive and yet mix them with prescriptive suggestions. Comparativists too have often a model in mind as the best possible one. Often, that model is the one they are most familiar with and almost invariably stems either from Western Europe or the United States. Often, a more or less implicit goal of comparative studies is to demonstrate the potential for progress through harmonisation along the lines of that model — in other words, to sustain a progressive narrative of universalism modelled after Euro-American standards.99 B ut comparativists do that covertly and, as some would say, even unconsciously.100 By contrast, global legal indicators are outspoken in promoting their ideological and political agenda. No matter how debatable the latter is, indicators’ transparency of purpose and clarity of goals create an open space for critique. The same cannot be said for the opaqueness surrounding comparativists’ aims.

95 Cf. Kroncke (n.623) 498–500; Curtis J Milhaupt and Katharina Pistor, What Corporate Crises Reveal about Legal Systems and Economic Development around the World (Chicago: University of Chicago Press, 2008) p.5; Santos (n.50) pp.286–289 and Daniel Berkowitz, Katharina Pistor and Jean-Francois Richard, “The Transplant Effect” (2003) 51 AJCL 163, 174.

96 Hirschl (n.30) p.228; Whytock (n.91) 1892–897 and Spamann (n.90) 133. 97 Frankenberg, The Innocence (n.66) 239; Peters and Schwenke (n.66) 823–824; Günther Frankenberg,

“Stranger than Paradise: Identity and Politics in Comparative Law” (1997) Utah L Rev 259, 263–274 and David Kennedy, “New Approaches to Comparative Law: Comparativism and International Governance” (1997) Utah L Rev 545, 592–633.

98 Markesinis (n.92) pp.61–62. 99 See the authors quoted above (n.97) as well as Upendra Baxi, “The Colonialist Heritage” in Pierre

Legrand and Roderick Munday (eds.), Comparative Legal Studies: Traditions and Transitions (Cambridge: Cambridge University Press, 2003) pp.46, 49–54; Pierre Legrand, “The Same and the Different” in Pierre Legrand and Roderick Munday (eds.), Comparative Legal Studies: Traditions and Transitions (Cambridge: Cambridge University Press, 2003) pp.240, 247–249; Esin Ö rü cü , “Comparatists and Extraordinary Places” in Pierre Legrand and Roderick Munday (eds.), Comparative Legal Studies: Traditions and Transitions (Cambridge: Cambridge University Press, 2003) pp.467, 475 and Jorge L Esquirol, “The Fictions of Latin American Law (Part I)” (1995) Utah L Rev 425, 433–435.

100 Legrand (n.99) pp.247–248.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 305JICL-6(2)-7.Quantitative Legal Comparisons.indd 305 23/10/19 1:45 PM23/10/19 1:45 PM

306 Journal of International and Comparative Law

X. The Way Ahead: Beyond Pride and Prejudice

This paper attempts to demonstrate that, contrary to the mainstream view, global legal indicators are a comparative law exercise. Global legal indicators have many features in common with comparativists’ studies and even offer creative answers to some of the doubts and critiques that have long affected our fi eld. Global legal indicators remind comparativists of the unspoken assumptions that constrain their ways of narrating themselves and performing their work, of the hidden biases that infl uence the selection of the relevant themes and jurisdictions, of the limited self-awareness of their motives and aims and of the many options they have for enriching what they do — from engaging in inter-disciplinary work to cultivating statistical knowledge and from pursuing the virtues of simplifi cation to putting more attention on packaging and disseminating research results.

All the above of course does not mean that global legal indicators are not capable of being improved: they certainly are. It is equally certain that comparativists have a major role to play in pinpointing possible improvements and in taking their knowledge about laws, transplants, legal culture and change to indicators’ tables. But the point is that we as comparativists could learn from the experience of global indicators no less than they can we learn from our own. We can learn new techniques, styles, approaches and something more about ourselves. We can also take indicators as an “extraordinary place”101 for study. Comparativists might, for instance, investigate which features of indicators are distinctive and which are shared, what makes them successful, what are their trajectories and effects, how they work as instruments for legal harmonisation and which processes of acceptance, adjustment and resistance they open up.102

All the above of course implies that global legal indicators are here to stay. The current approach of comparativists — retrenching in a Norma Desmond-like refusal to accept the existence of new instruments and defending “truly” comparative law research against counterfeits — has the bitter taste of self-protection and scientifi c isolationism. As the paper tries to demonstrate, the space for comparativists’ role is still large, even if global legal indicators make it look small.

101 To use the words of Ö rü cü (n.99) pp.468–471.102 See Marta Infantino, “Comparative Law in the Global Context. Exploring the Pluralism of Human

Rights Indicators” (2015) 2 Eur J Comp L Gov 97, 123 and also Wendy Nelson Espeland and Michael Sauder, “The Dynamism of Indicators” in Davis et al. (n.27) pp.108–109.

JICL-6(2)-7.Quantitative Legal Comparisons.indd 306JICL-6(2)-7.Quantitative Legal Comparisons.indd 306 23/10/19 1:45 PM23/10/19 1:45 PM