Abstract. If there exist no incentive or selective mechanisms that make cooperation in large groups incentive-compatible under realistic circumstances, functional social institutions will require a divergence between subjective preferences and objective payoffs – a “noble lie”. This implies the existence of irreducible and irreconcilable “inside” and “outside” perspectives on social institutions; that is, between foundationalist and functionalist approaches, both of which have a long pedigree in political economy. The conflict between the two, and the inability in practice to dispense with either, has a number of surprising implications for human organizations, including the impossibility of algorithmic governance, the necessity of discretionary enforcement in the breach, and the difficulty of an ethical economics of institutions.
Leeson and Suarez (2015: 48) argue that “some superstitions, and perhaps many, support self-governing arrangements. The relationship between such scientifically false beliefs and private institutions is symbiotic and socially productive.” This paper stakes out a stronger claim: that something like superstition is essential for any governance arrangement, self- or otherwise.
Specifically, we argue that human social structure both requires and maintains a systematic divergence between subjective preferences and objective payoffs, in a way that usually (though in principle does not necessarily) entails “scientifically false beliefs” for at least a subset of agents. We will refer to the basis of such preferences from the perspective of those holding them as an “inside perspective”, as opposed to a functionalist-evolutionary explanation of their existence, which we will call an “outside perspective”. Drawing on the theory of cooperation, we then show that the two perspectives are in principle irreconcilable, and discuss some implications of that fact for political economy and the prospects of social organization.
For reasons that will be clearer in subsequent sections, the distinction between the inside and outside perspectives can be seen more clearly with some distance from the institution in question. Before proceeding to more familiar examples, therefore, we will use as our initial paradigmatic example something utterly foreign to most contemporary people’s experience: trial by ordeal.
In both medieval Europe (Leeson 2012) and contemporary Liberia (Leeson and Coyne 2012), belief that God punishes the guilty is operationalized in criminal justice rituals – ordeals – designed to discover the judgment of God in ambiguous cases. In Europe, the accused plunged his hand into boiling water. If God protected him from scalding, it was a sign of innocence; otherwise he was guilty. Similarly, in Liberia, the accused imbibes the brew of a toxic bark. If the spirits cause him to vomit it up, he is innocent; otherwise his resulting illness indicates guilt.
Such is the inside perspective on ordeals, something like the account one would get from someone living in that society. From the vantage point of modern criminal justice on the other hand, which does not share the basic presuppositions of divine justice, such practices seem backward and arbitrary. But Leeson argues that such procedures are feasible second-bests in the absence of modern standards of evidence and the state capacity to act on them. Specifically, trial by ordeal results in a separating equilibrium whereby the innocent willingly undergo the ordeal and the guilty refuse, meaning that willingness to undergo the ordeal conveys valuable information on the innocence of the accused.1 He then shows that a large proportion of ordeals were in fact successfully passed, establishing innocence, and implicating the administrators (priests) in consciously or unconsciously adjusting the severity of the ordeal conditional upon the accused’s willingness to undergo it.
This is an outside perspective on the institutions of ordeals, analyzing its functionality from some remove and without committing to the society’s presuppositions. The two perspectives are fundamentally incompatible, not only in the basic sense of their being alternative explanations of the same phenomena, but in the deeper sense that introducing an outside perspective to medieval Europe or contemporary Liberia would destroy the possibility of trial by ordeal. If criminals were to “see through” from the outside, their assent to the ordeal would carry no informational value, and the institution would be nonoperational. And indeed, Leeson shows that known nonbelievers were not subject to ordeals.
Leeson demonstrates the stability of such an institution provided people are believers.2 What is missing, however, is a strategic model of belief; an explanation of why susceptibility to manipulation would be a viable phenotype in the first place. This is not to say that one necessarily has a choice in one’s beliefs, but rather that credulity will erode in a population if unbelief results in persistently higher payoffs, eventually leaving an ordeal system nonfunctional.3 In such an environment believers will be outcompeted by nonbelievers – and particularly by nonbelievers who profess belief – regardless of their updating strategy. As is shown below, other institutional features intended to reverse the advantage (say, burning heretics) displace the unexplained element elsewhere, but ultimately do not account for it.
The following section shows briefly the inability of selfish and rational agents – the homines œconomici of neoclassical theory – to cooperate in large groups. Later sections then show where in such a model the inside/outside perspective distinction arises, how agents who do make this distinction can outcompete homines œconomici who do not, and some implications of the distinction for social science.
More generally, a signaling game with a costless signal (or where the costs are immaterial) reduces to a social dilemma, a class of games that includes prisoner’s dilemmas (two-person) and public goods, commons, and collective action problems (N-person). Social dilemmas are non-zero-sum games characterized by mutual gains from cooperation, but also a Nash equilibrium of mutual defection. In other words, the Pareto-optimum is not a Nash equilibrium. Social behavior is defined by cooperation in such games, against one’s own narrow interests.4
Unfortunately much of the literature on cooperation and governance generalizes from two-person games to N-person games, and therefore concludes that repeated play is sufficient to establish incentive-compatible governance structures even in the latter.5 This section shows that this inference is not warranted. We use for our paradigmatic game, therefore, a public goods game (or, equivalently, a collective action problem) rather than a prisoner’s dilemma. Governance, broadly speaking, consists in collective action of some sort or another. If rational and self-interested agents cannot cooperate in a public goods game, then governance and society more broadly will also be impossible for them.
The lack of an airtight solution, we argue, necessitates distinct “inside” and “outside” perspectives: that is, a divergence between the objective game structure, a social dilemma with an equilibrium of universal defection, and – for at least a subset of agents – a different reckoning of subjective costs, which transforms the game into one with a cooperative equilibrium.
The basic difficulty with sustaining social behavior can be seen in a one-shot public goods game. Suppose there are N agents, each with an endowment of 1. Each agent has the choice of contributing c ∈ [0, 1] to a communal pot, in which case γc (with γ>1) is distributed equally to all agents. Agent i’s payoff function, then, is
(1) $$p_i = 1-c_i + \sum^N_{n=1}\frac{\gamma c_n}{N}$$
whereas the total payoff function, summing pi over all i, simplifies to
(2) $$P = \sum_{n=1}^N (1 + (\gamma-1) c_n)$$
The total payout is maximized if cn = 1 for all n, but that – provided cn is independent of ci for all n ≠ i – individual payoff is maximized at ci = 0 so long as γ < N. There is a divergence between the private cost of non-contribution (∂pi/∂ci = γ/N – 1) and the social cost of non-contribution (∂P/∂ci = γ – 1).
In any game of this structure, defection is the dominant strategy for rational and self-interested agents. The public good is not provided; the signal has no informational value; the commons is depleted; collective action is not undertaken; society does not get off the ground.6 Ordeals may have been an important supporting institution in the medieval criminal justice regime, but they were not, by themselves, sufficient to establish peaceful society.
It is well known that repeated play can sustain cooperation in two-person prisoner’s dilemmas, provided the end of the game is not known, by allowing players to punish defectors. By playing a trigger strategy, for example, where one player responds to defection by defecting in all future games, one player can threaten the other with the loss of all future gains from cooperation. For narrower but still plausible ranges of discount rates, more forgiving strategies such as tit-for-tat (where the retaliation lasts only for a single subsequent period), or even tit-for-double-tat (where one period of retaliation is triggered only after two defections) can be cooperation-supporting equilibrium strategies (Axelrod 1984), especially where mistakes are made.
The same will be true in N-person dilemmas, provided players have perfect In a repeated N-person dilemma however, punishment is diffused over all agents, unlike the dyadic game that makes it possible to punish the defector and only the defector. Consider an infinitely repeated version of (1), with the simplifying modification that ci ∈{0,1}, meaning the agent has a binary choice of whether or not to contribute. A trigger strategy is not robust to the commission of any mistakes. If we introduce a parameter ε∈(0,0.5) for the probability that an agent mistakenly fails to contribute where he meant to or vice versa,7 a more forgiving strategy will be necessary if a single mistake is not to snowball into defection.
The more forgiving the strategy, however, the lower the difference in payoffs between cooperation and defection, and therefore the lower threshold discount rate necessary in order for cooperation to be feasible. Consider the N-person analogue to a tit-for-tat strategy, “contribute unless some fraction µ of the population failed to contribute in the last period”. As N becomes arbitrarily large, any individual’s choice of strategy matters increasingly less for the payoffs of his peers, making it increasingly difficult for him to punish defection and, in turn, for others to punish him. The strategy can therefore be invaded by a “never contribute” strategy. As Bowles and Gintis (2011: 63-67) show using a simulation, and Fehr and Gächter (2000) confirm in the lab, contribution to a public good drops off precipitously as N rises beyond about 5, even for very low error rates (0-0.02) and discount rates (0-0.04).8
The public goods game as set out so far is somewhat more limited than real-world public goods games. In particular, it is overly restrictive to assume that the only margin of choice is contribution or noncontribution. Real-world social behavior operates on many different margins, and choices along one can influence cooperation in another, for better or for worse (Reiter, et al. 2018).
Suppose now that individual i can pay some cost νij to “punish” non-contributor j by subtracting νij from j’s payoffs that period (the total product therefore falls by 2νij). If ∑i νij > 1–γ/N, there is no divergence between private and social cost for j, and j’s dominant strategy is to contribute.
Things look different from the perspective of agent i, however. An agent facing the choice of whether to punish j faces the cost νij, but – because this is a public good – the benefits of j’s future cooperation accrue to all agents. In other words, the “punish non-contributors” game is simply another public goods game superimposed upon the first. Even in a repeated game, it will be in i’s interest to free-ride on the punishment of j.
Targeted enforcement of contribution brings us into strategic territory that begins to look like governance. And immediately we run into the fundamental problem of governance: who watches the watchmen? – which in our case we can reformulate as: who punishes the punishers who fail to punish? Second-order punishment is beset by the same problem on another level, along with third- and fourth- order punishment and so on.
We have, therefore, an unbridgeable gulf between Pareto optimality and Nash equilibrium in large groups, provided there is no independent authority, external to the system, to appeal to. And whether or not such an authority can be said to exist with respect to any particular subgroup, it is always true that for society as a whole, all authority must be regarded as endogenous to the social system. We will call this problem the incentive gap: the impossibility in broad classes of social dilemmas of eliminating the incentive to defect among some subset of agents, whose defection would eventually lead to the total unraveling of cooperation.
The problem of incentive alignment has been studied most systematically in the theory of the firm, where incentive mechanisms and organizational relationships are most explicit. If we regard the firm as a locus of joint production (Alchian & Demsetz 1972),9 effort – to the extent that it is imperfectly monitorable – becomes a public good. The question then is: how can production be organized so that no agent has an incentive to shirk?
The conventional wisdom, per Alchian and Demsetz, holds that entrepreneurs provide monitoring services, and their own incentive to avoid shirking is ensured by their status as residual claimants. Holmström (1982), however, proved that there exists no set of incentives that can motivate employees to avoid shirking in joint production so long as the budget is balanced. This is the problem of imperfect monitoring in 2.2: where effort is partially unmonitorable, any incentive system will face a tradeoff between capricious punitiveness and allowing scope for profitable defection (i.e., between Type I and Type II errors). Eswaran & Kotwal (1984) then showed that even incentive schemes which aligned incentives for employees by failing to balance the budget (i.e. enforcing effort via a penalty of paying out less than the entire product) create perverse incentives for the residual claimant. This is the problem of second-order punishment in 2.3. They conclude that “the crucial necessity of monitoring the monitor is thus not met. . . . the problem of moral hazard [i.e. defection in the firm’s social dilemma] takes a different form but remains unsolved.”
Relationships between firms are similarly fraught. The inability to write complete contracts, for example, is a common assumption in organizational economics, which is simply to say that the variety of choice margins open to two transactors precludes the ability to ensure incentive compatibility ex post, even assuming perfect enforcement of written contracts. As Alchian and Demsetz (1972) note, “it is hard to imagine any contract, which, when taken solely in terms of its stipulations, could not be evaded by one of the parties.” Trust is commonly taken as an exogenous feature of functional social systems, but it is underappreciated that the problem of trust consists in the fact that trustworthiness is not individually rational. Without special assumptions, the capitalized value of reputation is necessarily less than the value of a one-time defection in intertemporal markets (such as credit or money issue), as the value of defection rises in proportion with the value of reputation (Harwick & Caton 2019; Bulow & Rogoff 1989; Taub 1985). Where this is the case, to the extent that information is not public and reliable, reputation will be insufficient to ensure cooperation even for dyadic interactions if they are drawn from a larger population (e.g. in Kandori 1992).
The class of social dilemmas is vast, particularly in the context of governance. Besides the number of people involved, games can vary on the imperfection of information and monitoring, agents may have a wider or narrower range of choices in contribution or punishment, games may be conditioned upon the results of other games, and so on.
Depending on these various factors, many of the dilemmas encountered by people in a society can be adequately solved by repeated play, especially if interactions are dyadic. Indeed, many social institutions – most importantly, property rights and market exchange – have the function of transforming would-be N-person social dilemmas into soluble dyadic interactions. Nevertheless, the enforcement and/or voluntary respect of the rules constituting these transformative institutions are themselves irreducibly public goods. Despite the importance in the developed world and (especially) in economic theory of opportunities for dyadic exchange, the very existence of a market – and, for that matter, of a state – rests on the provision of a number of genuinely public goods on both micro and macroeconomic levels. Similarly to the second-order punishment problem, even if we suppose that the provision of property rights could in turn be transformed into a dyadic game through some supervening institution, that institution itself would constitute a public good.
The open-endedness of human strategies can also be an impediment to cooperation and commitment (Stewart et al. 2016), analogous to the problem of incomplete contracts in organizational economics. In broader society, this problem inhibits the establishment of both potential exchange relationships (Harwick 2017) and governance solutions.10 The much-celebrated fact in economics that incentive-compatible Pareto-optimal resource allocations exist given well-defined property rights, complete contracts, and limited behavioral repertoire, should not blind us to the gulf separating the Arrow-Debreu world of general equilibrium from the real world, where open-ended behavior makes complete contracts impossible and property rights costly to establish.
The upshot is that, for plausible rates of discount and error, there exists no potential structure or set of strategies to ensure that every member in a large group has an incentive to cooperate in the face of social dilemmas, a problem as true for society broadly (Bowles & Gintis 2011, ch. 4-5) as it is for a firm. To the extent that social sanctions are effective to render cooperation the dominant strategy, they do so by placing the enforcers – whether the entire population or some specialized subset – into another social dilemma.
What then of the infinite variety of equilibrium strategies possible under the folk theorem? Bowles and Gintis argue that most of these equilibria, even for dyadic interactions, are “evolutionarily irrelevant” – that is, there is no reason to expect the folk theorem to be actually operational under conditions of imperfect information, and there is no feasible path for the emergence of such strategies from a starting point of noncooperation. A viable strategy must be robust to error, and be able to outcompete noncooperators under a wide variety of unfavorable situations. In other words, relevant cooperative strategies must – in addition to being Nash equilibria – be evolutionarily stable. This requirement binds even more tightly for N-person games. “Knife-edge” equilibria, trigger strategies, and other strategies that do not meet these criteria shed no light on the strategies actually employed by humans.
The previous section has been for the most part deliberately ambiguous on the question of interpretation. There are two main ways the payoffs can be interpreted:
Some of the examples given thus far are interpreted more naturally under one or the other, and the tension between the two in particular cases has been a matter of some controversy in the social sciences (Sugden 2001; Grüne-Yanoff 2011). But so far, both are valid for the previous section: regardless of whether strategies are selected or chosen, if social life is structured as in Section 2 – and it is generally assumed to be, at least on some critical margins – we should not observe cooperation.
This agreement between the two perspectives has sometimes been taken as an evolutionary foundation for the selfish and rational homo œconomicus. Any agent making conscious decisions on the basis of preferences must prefer and choose those things that maximize its objective payoffs, for agents with such preferences will be the ones that reproduce and pass on their predilections. If this is the case, there is no issue in conflating objective payoffs and subjective utility, at least in equilibrium. For individuals qua individuals, cooperative strategies are ineluctably maladaptive.
Homo œconomicus’ inability to cooperate in theory, however, stands in sharp contrast to the empirical Great Fact that functional firms and high-trust societies do in fact exist. If the incentive gap cannot be reconciled to this Great Fact either in terms of subjective utilities or objective fitness on their own, or with the former reduced to the latter, it will be necessary to show what kind of non-maximizing preferences might be selected for, and how. This section advances self-deception as just such an alternative: a divergence between subjective and objective payoffs, out of which arises the divergence between the inside and outside perspectives.
One important difference between the stylized public goods game of the previous section and the actual social world is that the latter is characterized by a group structure. Within groups, assortativity can ensure cooperators reap enough of the benefits of cooperation to outcompete noncooperators (Alger & Weibull 2013; Bergstrom 2003). And competition between groups presents itself to members as a coordination game, the gains from which can outweigh the losses from cooperating with fellow group members in social dilemmas. In other words, as Sober and Wilson (1998) argue, selection for cooperative groups can more than balance the within-group selection against cooperative individuals.
This difference, however, entails a mismatch between the level of selection from which a particular behavior arises, and the level at which strategies are employed. In humans, strategies are employed by individuals, not by groups as such, and selection on individuals necessarily favors noncooperation. If the individual’s cooperative predilections arise from selection at another level, and if we regard him as making conscious decisions on the basis of his interests, he must deceive himself regarding those interests if he is to live in a society capable of undertaking collective action.11 In other words, selection operating under these circumstances will cause subjective preferences to systematically diverge from the objective payoffs.12
Note that both assortativity and group competition require mechanisms to enforce the assortativity and the group structure, mechanisms whose provision – like the supervening institutions of the previous section – is itself a public good. They do not, therefore, make cooperation individually rational; rather, they make irrationality (from the individual’s perspective) viable. In either case, individuals must at minimum find intrinsic utility in punishing or excluding noncooperators in order to solve the second-order punishment problem. If a subpopulation employing such a strategy manages to achieve a mass sufficient to impose its preferences on the remaining selfish rational maximizers, false beliefs motivating cooperation can even be self-confirming in the sense of Fudenberg and Levine (1993) so long as the threat remains credible – it really will be in the interest of most people to cooperate. Punishers, for their part, will have to do minimal punishing on the equilibrium path of play. In this way, cooperation can be stabilized and the incentive gap closed – both in the firm (Miller 1992 ch. 10-11)13 and in society (Bowles & Gintis 2004; 2011 ch. 9) – allowing larger-scale collective action to get off the ground without depending on highly or uniformly altruistic preferences.
Furthermore, experimental evidence shows unequivocally that such a divergence between payoffs and preferences does in fact exist: humans are, on many margins, genuinely altruistic and pre-rationally inclined to cooperate against their own narrow interests (Bowles and Gintis 2011, ch. 1; Tomasello 2009).
In this light, the inside and the outside perspectives correspond, respectively, to looking at an institution from the perspective of its members’ subjective preferences and beliefs, and of the objective payoffs. The distinction is sufficiently general, however, that it bears on any dynamic system where (1) relative frequencies of strategies are governed by some sort of selection dynamic, and (2) influences on the strategies employed by decisionmaking agents are selected at levels other than the agents themselves. As in the previous section, both biological and market competition fit the bill. Regardless of what the objective payoffs consists in – whether biological fitness, as in the sociobiological literature, money, as in economics, or even utility, to the extent that utility functions are deterministic in their inputs14 – collective action with imperfect information requires that subjective preferences diverge from them.
The inside-outside perspective distinction is not identical with the fact-value distinction, but the latter does follow straightforwardly from the former. If social organization necessarily relies upon individually maladaptive altruistic preferences in the breach, and if the function of human morality is to coordinate cooperative strategies (Curry 2016; Curry et al. 2019), then it will be impossible to derive a morality that sustains human society from the nature of things (i.e. from the objective payoffs). To accept the broad and universal features of human moral life is ipso facto to deny the ability to derive normative force from the objective payoffs. Facts and values are related, of course – where else would morality come from if not the nature of things? – but the relationship cannot be a deductive one.
In contrast to the more naïve assumption that the incentive gap and the Great Fact can be reconciled straightforwardly, a number of strands of literature take an alternative route to obviate rather than to solve the problem. These strands together can be called ‘subjectivist’, and can be divided into rational subjectivism and empirical subjectivism.
The rational subjectivist in the Chicago tradition sees no reason why subjective preferences ought to correspond to objective payoffs in the first place – after all, de gustibus non est disputandum. For the subjectivist, homo œconomicus is not incompatible with cooperation if we model him with a preference for altruism, a preference which must simply be taken as given.
Even the thoroughgoing subjectivist, however, has to assume some correspondence between preferences and payoffs in order for the analysis to escape from tautological formalism into any empirical relevance at all. In orthodox analysis, this correspondence is ensured by treating preferences as preferences over consumer goods. If all goods have a positive income elasticity of demand, a strict preference for income – i.e. concordance of subjective utility with objective payoffs – can be derived by selection logic similar to that in Section 2: agents without a strict preference for income get outcompeted in the marketplace, and do not ultimately affect the conclusions of the model (Alchian 1950; Becker 1962). Thus the dilemma: either we sacrifice the empirical relevance of price theory by denying the correspondence of objective payoffs (in this case, income) with subjective utility, or by affirming the correspondence we are led back to the untenable selfish and rational homo œconomicus.
Besides the de gustibus strategy, a number of ostensible repudiations of the rational choice model should be understood as subjectivist in the sense of stipulating a utility or learning function as well: for example, modeling altruism or beliefs as consumption goods (e.g. Bénabou & Tirole 2011), or the literature on team reasoning (Sugden 2003; Gintis 2016) where shared intentionality impresses group goals onto individuals.
The important problem with these, however, is the fact that – like Leeson’s opening examples – all such models are essentially static. A static theory of human behavior does not attempt to explain how the incentive gap can be reconciled to the Great Fact; it simply observes – often correctly – that actual human decisionmaking bears little resemblance to homo œconomicus in many contexts. To consider altruism as a consumption good alongside other objects of preference is a valid analytical decision where we are not concerned with changes in the relative frequency of preferences or strategies. But altruism is of theoretical interest precisely because of its dynamic effect on these relative frequencies. Even if a subjectivist model with altruism is perhaps more empirically accurate as a model of human decisionmaking than homo œconomicus in many circumstances, the virtue of the latter is that it serves as a benchmark for dynamic stability.
Subjectivism, therefore – whether in its rational or empirical variety – is not an alternative reconciliation; it simply does not ask the question we are interested in.
The human capacity to deliberate is the capacity to explicitly justify behavior; that is, to ground strategy choice in terms of a more basic objective function. For an organism with this capacity, a divergence between payoffs and preferences will consist either in failure to perceive the lack of correspondence, or a deliberate decision to ignore the objective payoffs. The former corresponds to an inside perspective as a belief phenomenon; the latter to an inside perspective as a preference phenomenon.
The initial example of ordeals was a belief phenomenon. In this case, individuals must be convinced that it is really in their interest to employ a strategy which is in fact dominated by another – a “Noble Lie”, so to speak. Preference phenomena, on the other hand – as in many empirically informed subjectivist models – require individuals to voluntarily pursue goals at odds with their objective payoffs. All human societies and organizations rely on some mix of the two, though the ubiquity of motivated reasoning (Bénabou & Tirole 2011), and the near functional equivalence of the two in closing the incentive gap, might suggest that the distinction between preferences and beliefs is not quite so sharp as economists would have it.
To classify altruistic preferences as “self-deception” along with false beliefs is not a claim about the psychology of altruism. Rather, it is to take strict correspondence, as simple Darwinian logic demands, as the benchmark of strategic rationality for individuals qua individuals. In both cases, “self-deception” points to the fact that cooperative strategies such as humans in fact employ systematically fail to maximize individual fitness, and that the individual has adopted the fitness of something else (whether the group as a whole or other individual members) as a terminal goal.
There are tradeoffs to closing the incentive gap using predominantly beliefs versus preferences. Though less reliant on deliberate self-sacrifice, belief-based inside perspectives are not necessarily robust to outsider contact, for example: it is more difficult to maintain rich factual beliefs when confronted with other functional cultures maintaining incompatible factual beliefs (see Leeson 2013a for an example). Ecumenical polytheism and evangelical monotheism were both institutional technologies to deal with this problem, either by creating ideological space to preserve local norms, or through homogenization.
In principle, a population that preferred cooperation sufficiently strongly for its own sake could dispense with noble lies entirely, provided they were still willing to punish defection wherever it did arise.15 Nevertheless, in practice, a preference for altruism can only withstand so much defection. Humans do make deliberative choices on the margin, and in experimental public goods games, even groups highly inclined to cooperate at first will quickly decay to negligible contributions (Ledyard 1995). For this reason, any nonauthoritarian society – that is, one where overt punishment can be kept to a reasonable minimum – must rely on some combination of false facts and maladaptive preferences among the masses to maintain the divergence between objective and subjective reckonings of costs. The more intrinsically altruistic will be able to get by with fewer factual commitments, and (therefore) with more abstract religions and ideologies. A richer belief system can satisfy both groups with a single body of doctrine: metaphysics and theology for cooperators; the wrath of God for would-be defectors. Indeed, vengeful deities appear in the historical record to be strongly linked with the rise of large-scale political organization (Norenzayan, et al. 2016). Finally, for those who nevertheless expect gains or derive pleasure from defection, there’s punishment – which, when effective, itself relies primarily on the altruism of the first group.
Belief-based inside perspectives are a deliberative blind spot, almost by definition. If the criminal from Section I were to form his beliefs in full view of the objective payoffs, he could exploit the value of the signal and increase his own fitness. There is an unexploited arbitrage opportunity which he systematically overlooks. Similarly for preference-based inside perspectives, altruistic preferences as an ultimate fact cannot be argued about. If one prefers helping others over one’s own convenience in full view of the cost, there is no convincing him otherwise except on the basis of an even more fundamental preference or value.
Both of these situations make it difficult to criticize a culture’s norms from within that culture – again, unless this is done from the vantage point of another shared norm. An effective inside perspective must appear self-evident; in other words it must, whether through beliefs (e.g. in a moralistic deity) or preferences (e.g. the self-evidence of the Golden Rule among post-Christian Westerners), make itself invisible and present itself as an ultimate fact. Inside perspectives which fail to provide for their own survival this way, quite simply, do not persist.
Thus, In the absence of outside contact insular societies are prone to normative drift, which is to say there are no internal or external forces tending to select for prosocial rather than antisocial norms: no internal forces because its inside perspective remains invisible to its own practitioners, and no external forces by hypothesis. Phylogenetically, Bowles and Gintis (2011, ch. 10) show that, in the absence of strong external pressure, fitness-reducing norms can hitchhike on a more general norm-internalization capacity. And ontogenetically, the invisibility of the inside perspective indicates how exactly the human deliberative capacity can fail to weed out pathological norms.
Antisocial punishment is a particularly significant manifestation of normative drift (Hermann et al. 2008), which we may think of generally as the direction of altruistic punishment against the emergence of Pareto-superior norms, distinguished from mere selfishness or retaliation. There are numerous examples, especially – though not exclusively – in more isolated societies: self-destructive food taboos, human sacrifice (Edgerton 1992), female genital mutilation, forced marriages (Bicchieri 2016), and so on. And indeed, antisocial punishment has been shown both theoretically and experimentally to be a viable strategy in public goods games (Nikiforakis 2008; Rand et al. 2010). In some instances, practitioners have been more than happy to abandon such norms when given the opportunity to coordinate around new ones.
The same logic holds for hegemonic societies as well as insular societies: both cases lack effective inter-societal competition to weed out pathological norms, beliefs, and practices. Thus, the fact that many apparently backward cultural practices are rationalizable from an outside perspective as in Section 1, should not be taken as an argument for unqualified cultural conservatism or relativism. That coordination around self-deceptive beliefs and/or preferences is necessary in general does not imply that any particular complex of norms is in any sense Pareto-optimal, even among close and feasible alternatives, except – perhaps – under circumstances of especially intense intercultural competition.
The fact that economists frequently find themselves on the wrong side of sacred values should not be taken to imply that economics as a discipline stands firmly in the outside perspective. There is a rich tradition of inside-perspective economics: as radical critics of neoclassical economics point out, economics has come to serve a minor legitimating function for the role of markets in modern life, and it relies on tautologies (e.g. utility maximization) and descriptively false simplifications (e.g. perfect competition) at precisely those points in the intellectual edifice where the danger of defection (self-interested rent-seeking) or antisocial punishment (radical zeal) is greatest.
Pace the radicals, however, to point out these “lies” is not sufficient to impugn the status and utility of mainstream economics. To the extent that they obscure opportunities for strategic rent-seeking from policymakers, such “lies” may be truly noble, cooperation-enhancing, and self-confirming in exactly the same sense as belief in the wrath of God, regardless of whether that intent played any role in their development.16 Indeed it is hard to imagine any social-scientific analytical framework – including the one underlying such critiques (see the following section) – which does not rely on tautologies or descriptively false simplifications to legitimate cooperation or collective action of some sort or another, whether for or against the existing social order.
The inside-outside perspective distinction also runs directly through the middle of the economics of institutions, with Nobel prizes on both sides. On the outside are economic historians such as North (e.g. 1990; 2005) and Acemoglu and Robinson (2005; 2012), who – though they have a normative goal of economic development – approach the question functionally and historically. On the inside are “rational reconstructions” such as Buchanan and Tullock (1962)17 and Rawls (1971), who are concerned to connect existing or potential institutions with widely shared moral intuitions (sacred values) using thought experiments rather than history. The same distinction can be traced very far back through the Western canon: quite apart from the quality of the respective analyses, Hobbes ([1668] 2012) and Locke ([1690] 1960) for example were engaged in projects on decisively different sides of the divide. If it is true that the inside and outside perspectives are irreducible one into the other, it is hardly surprising that the arguments of Hobbes and Locke have both maintained appeal and plausibility in the ensuing centuries despite their basic incompatibility.18
Even with a meaningful methodological distinction between analysis and legitimation, it would be a mistake to draw the lines of economics, or of science more broadly, to exclude the latter. Such is the goal of critical theory and its offshoots; perhaps the most salient example of normative drift in the developed world.
Critical theory can be understood as, among other things, a method for analyzing social institutions in terms of objective payoffs, with “power” understood either directly as the index of those payoffs or as the ability to obtain them at the expense of others. The beliefs and preferences that pry apart a community’s subjective preferences from their objective payoffs are understood as an exercise of power against them, even in the absence of overt or threatened punishment.19 In other words, supposedly oppressed or marginalized classes could do better for themselves by minding their own payoffs and declining to buy into their community’s noble lies.
Per the foregoing analysis, this contention is correct – or at least, there always exists some such class. And yet, whether or not critical theory in fact has a tractable formulation of the objective payoffs, understanding social institutions as epiphenomena of power relations (or of any other objective payoffs) throws us back to the dilemma of Section 2 and renders social cooperation impossible (cf. Hayek 1988: 68). We have argued that there will always be parties in a society whose dominant strategy is defection. Critical theory, especially with its liberationist bent, is simply a method for identifying those parties and alerting them to that possibility20 – perhaps the most deliberate method of doing so, but far from the only method. Indeed, the game theory in this paper points to the very same possibility.
This poses an ethical dilemma for the student of society, no less for the game theorist and the new institutionalist than for the critical theorist. On the one hand, a functionalist outside perspective is valuable for identifying systemic problems in economic development and institution-building (e.g. Acemoglu 2003). Without the ability to accurately identify the source of institutional failure, efforts at foreign aid and development are likely to be Sisyphean, if not actively harmful (cf. Easterly 2001, ch. 2-7). On the other hand, given that approaching social institutions from an outside perspective (whether critically or not) can render them impossible to maintain, it may also be the case that a scientific approach itself will do more harm than good.
For the same reason that explicit rules have a limited ability to support cooperation, there can likely be no hard-and-fast set of prescriptions for dealing with this problem. Nevertheless, there is some reason for optimism. First, many inside-perspective beliefs are quite resilient to disconfirmation, especially where an aspect of sacredness is involved – a fact which has often consternated iconoclastic intellectuals, but which may limit any damage done by the scientist interested in understanding rather than revolution. Trial by ordeal may be impossible to maintain in a population of atheists, but there is evidence that people believe in order to support such institutions, rather than the institutions existing to prop up belief (Chen 2010; Ager and Ciccone 2016; Auriol et al. 2018). It may, therefore, be difficult to “deconvert” a population without obviating the institution, a fact which would give the scientist much more latitude in inquiry.
Second, the scientist may resort to what Melzer (2014, ch. 6) called “protective esotericism” and self-censor in popular works, a tactic with a long history (as Melzer documents) among intellectuals dealing with contemporary inside perspectives. To the extent that academics can be relied upon for preference-based rather than belief-based altruism (as suggested by Eisenberg-Berg [1979] and Millet & Dewitte [2007], though see Madison et al. [2017]), it will not be necessary to censor more technical social-scientific work.
Even so, the task of deriving policy implications from social scientific work is complicated by this analysis. As organizational and new institutional economists have long recognized, optimal policies may be outside the feasible opportunity set in the absence of commitment power. But in a fitness landscape riddled with local optima and varying distributions of altruists willing to take up the slack left by failing belief, the importation of scientific-rationalistic modes of thought, even in full recognition of the commitment problems in the way, may clear away the coordinating power that previous institutions offered. And without a sufficient proportion of preference-altruists to maintain Western-style liberal democratic institutions, more virulent ideologies may rush in to fill the gap.21
The logic of social behavior gives rise to a structure of human motivation that implies an irreducible distinction between inside and outside perspectives on social institutions – that is, between legitimating exercises on the one hand, and analytical exercises on the other. That same logic implies that the distinction will in normal circumstances be invisible to the member of a particular society, to the extent that invisibility aids the internalization of an inside perspective. Because of the incentives inherent in the social organization of distantly related agents, it is necessary that the subjective preferences of those agents diverge from their objective payoffs in precisely the places that support the provision of public goods and the punishment of noncontributors.
Thus, as the world continues to adjust to communication technologies that facilitate the transfer of knowledge, norms, and modes of thought, there are two existential and potentially reinforcing dangers to be avoided: first, the ascendancy of institutions within which individual selection dominates, eventually leading to the nonviability and extinction of cooperative strategies; and second, the drift of altruism into antisocial punishment.
On the one hand, this analysis connects the game theory of cooperation with the logical structure of human morality and offers a number of important practical considerations for both economics and policy. These implications are especially significant when varying cultural norms become a significant factor, as in the economic development literature. On the other hand, if clearsightedness can itself be detrimental, if functional institutions do depend on “noble lies” at some critical juncture, the actionability of those considerations can be ambiguous and fraught. Such, perhaps, is the great tragedy of the human condition.
Leave a Reply