dw2

27 July 2024

Disbelieve? Accept? Resist? Steer? Simplify? or Enhance?

Six possible responses as the Economic Singularity approaches. Which do you pick?

Over the course of the next few decades, work and income might be fundamentally changed. A trend that has been seen throughout human history might be raised to a pivotal new level:

  • New technologies – primarily the technologies of intelligent automation – will significantly reduce the scope for human involvement in many existing work tasks;
  • Whilst these same technologies will, in addition, lead to the creation of new types of work tasks, these new tasks, like the old ones, will generally also be done better by intelligent automation than via human involvement;
  • That is, the new jobs (such as “robot repair engineer” or “virtual reality experience designer”) will be done better, for the most part, by advanced robots than by humans;
  • As a result, more and more people will be unable to find work that pays them what they consider to be a sufficient income.

Indeed, technological changes result, not only in new products, but in new ways of living. The faster and more extensive the technological changes, the larger the scope for changes in lifestyle, including changes in how we keep healthy, how we learn things, how we travel, how we house ourselves, how we communicate and socialise, how we entertain ourselves, and – of particular interest for this essayhow we work and how we are paid.

But here’s the dilemma in this scenario. Although automation will be capable of producing everything that people require for a life filled with flourishing, most people will be unable to pay for these goods and services. Lacking sufficient income, the majority of people will lose access to good quality versions of some or all of the following: healthcare, education, travel, accommodation, communications, and entertainment. In short, whilst a small group of people will benefit handsomely from the products of automation, the majority will be left behind.

This dilemma cannot be resolved merely by urging the left behinds to “try harder”, to “learn new skills”, or (in the words attributed to a 1980s UK politician) to “get on a bike and travel to where work is available”. Such advice was relevant in previous generations, but it will no longer be sufficient. No matter how hard they try, the majority of people won’t be able to compete with tireless, relentless smart machinery powered by new types of artificial intelligence. These robots, avatars, and other automated systems will demonstrate not only diligence and dexterity but also creativity, compassion, and even common sense, making them the preferred choice for most tasks. Humans won’t be able to compete.

This outcome is sometimes called “The Economic Singularity” – a term coined by author and futurist Calum Chace. It will involve a singular transition in humanity’s mode of economics:

  • From when most people expect to be able to earn money by undertaking paid work for a significant part of their life
  • To when most people will be unable to earn sufficient income from paid work.

So what are our options?

Here are six to consider, each of which have advocates rooting for them:

  1. Disbelieve in the possibility of any such large-scale job losses within the foreseeable future
  2. Accept the rise of new intelligent automation technologies, but take steps to place ourselves in the small subset of society that particularly benefits from them
  3. Resist the rise of these new technologies. Prevent these systems from being developed or deployed at scale
  4. Steer the rise of these new technologies, so that plenty of meaningful, high-value roles remain for humans in the workforce
  5. Simplify our lifestyles, making do with less, so that most of us can have a pleasant life even without access to the best outputs of intelligent automation technologies
  6. Enhance, with technology, not just the mechanisms to create products but also the mechanisms used in society for the sharing of the benefits of products.

In this essay, I’ll explore the merits and drawbacks of these six options. My remarks split into three sections:

  1. Significant problems with each of the first five options listed
  2. More details of the sixth option – “enhance” – which is the option I personally favour
  3. A summary of what I see as the vital questions arising – questions that I invite other writers to address.

A: Significant challenges ahead

A1: “Disbelieve”

At first glance, there’s a lot in favour of the “disbelieve” option. The evidence from human history, so far, is that technology has had three different impacts on the human workforce, with the net impact always being positive:

  • A displacement factor, in which automation becomes able to do some of the work tasks previously performed by humans
  • An augmentation factor, in which humans become more capable when they take advantage of various tools provided by technology, and are able to do some types of work task better than before – types of work that take on a new significance
  • An expansion factor, in which the improvements to productivity enabled by the two previous factors generate economic growth, leading to consumers wanting more goods and services than before. This in turn provides more opportunities for people to gain employment helping to provide these additional goods and services.

For example, some parts of the work of a doctor may soon be handled by systems that automatically review medical data, such as ultrasound scans, blood tests, and tissue biopsies. These systems will be better than human doctors in detecting anomalies, in distinguishing between false alarms and matters of genuine concern, and in recommending courses of treatment that take fully into account the unique personal circumstances of each patient. That’s the displacement effect. In principle, that might leave doctors more time to concentrate on the “soft skills” parts of their jobs: building rapport with patients, gently coaxing them to candidly divulge all factors relevant to their health, and inspiring them to follow through on courses of treatment that may, for a while, have adverse side effects. The result in this narrative: patients receive much better healthcare overall, and are therefore especially grateful to their doctors. Human doctors will remain much in demand!

More generally, automation systems might cover the routine parts of existing work, but leave in human hands the non-routine aspects – the parts which cannot be described by any “algorithm”.

However, there are three problems with this “disbelieve” narrative.

First, automation is increasingly able to cover supposedly “non-routine” tasks as well as routine tasks. Robotic systems are able to display subtle signs of emotion, to talk in a reassuring tone of voice, to suggest creative new approaches, and, more generally, to outperform humans in soft skills (such as apparent emotional intelligence) as well as in hard skills (such as rational intelligence). These systems gain their abilities, not by any routine programming with explicit instructions, but by observing human practices and learning from them, using methods known as “machine learning”. Learning via vast numbers of repeated trials in simulated virtual environments adds yet more capabilities to these systems.

Second, it may indeed be the case that some tasks will remain to be done by humans. It may be more economically effective that way: consider the low-paid groups of human workers who manually wash people’s cars, sidelining fancy machines that can also do that task. It may also be a matter of human preference: we might decide we occasionally prefer to buy handmade goods rather than ones that have been expertly produced by machines. However, there is no guarantee that there will be large numbers of these work roles. Worse, there is no guarantee that these jobs will be well-paid. Consider again the poorly paid human workers who wash cars. Consider also the lower incomes received by Uber drivers than, in previous times, by drivers of old-fashioned taxis where passengers paid a premium for the specialist navigational knowledge acquired by the drivers over many years of training.

Third, it may indeed be the case that companies that operate intelligent automation technologies receive greater revenues as a result of the savings they make in replacing expensive human workers with machinery with a lower operating cost. But there is no guarantee that this increased income, and the resulting economic expansion, will result in more jobs for humans. Instead, the extra income may be invested in yet more technology, rather than in hiring human workers.

In other words, there is no inevitability about the ongoing relevance of the augmentation and expansion factors.

What’s more, this can already be seen in the statistics of rising inequality within society:

  • A growing share of income in the hands of the top 0.1% of salaries
  • A growing share of income from investments instead of from salaries
  • A growing share of wealth in the hands of the top 0.1% wealth owners
  • Declining median incomes at the same time as mean incomes rise.

This growing inequality is due at least in part to the development and adoption of more powerful automation technologies:

  • Companies can operate with fewer human staff, and gain their market success due to the technologies they utilise
  • Online communications and comparison tools mean that lower-quality output loses its market presence more quickly to output with higher quality; this is the phenomenon of “winner takes all” (or “winner takes most”)
  • Since the contribution of human workers is less critical, any set of workers who try to demand higher wages can more easily be replaced by other workers (perhaps overseas) who are willing to accept lower wages (consider again the example of teams of car washers).

In other words, we may already be experiencing an early wave of the Economic Singularity, arriving before the full impact takes place:

  • Intelligent automation technologies are already giving rise to a larger collection of people who consider themselves to be “left behind”, unable to earn as much money as they previously expected
  • Oncoming, larger waves will rapidly increase the number of left behinds.

Any responses we have in mind for the Economic Singularity should, therefore, be applied now, to address the existing set of left behinds. That’s instead of society waiting until many more people find themselves, perhaps rather suddenly, in that situation. By that time, social turmoil may make it considerably harder to put in place a new social contract.

To be clear, there’s no inevitability about how quickly the full impact of the Economic Singularity will be felt. It’s even possible that, for unforeseen reasons, such an impact might never arise. However, society needs to think ahead, not just about inevitabilities, but also about possibilities – and especially about possibilities that seem pretty likely.

That’s the case for not being content with the “disbelieve” option. It’s similar to the case for rejecting any claims that:

  • Many previous predictions of global pandemics turned out to be overblown; therefore we don’t need to make any preparations for any future breakthrough global pandemic
  • Previous predictions of nuclear war between superpowers turned out not to be fulfilled; therefore we can stop worrying about future disputes escalating into nuclear exchanges.

No: that ostrich-like negligence, looking away from risks of social turmoil in the run-up to a potential Economic Singularity, would be grossly irresponsible.

A2: “Accept”

As a reminder, the “accept” option is when some people accept that there will be large workplace disruption due to the rise of new intelligent automation technologies, with the loss of most jobs, but when these people are resolved to take steps to place themselves in the small subset of society that particularly benefits from these disruptions.

Whilst it’s common to hear people argue, in effect, for the “disbelieve” viewpoint covered in the previous subsection, it’s much rarer for someone to openly say they are in favour of the “accept” option.

Any such announcement would tend to mark the speaker as being self-centred and egotistical. They evidently believe they are among a select group who have what it takes to succeed in circumstances where most people will fail.

Nevertheless, it’s a position that some people might see as “the best of a set of bad options”. They may think to themselves: Waves of turbulence are coming. It’s not possible to save everyone. Indeed, it’s only possible to save a small subset of the population. The majority will be left behind. In that context, they urge themselves: Stop overthinking. Focus on what’s manageable: one’s own safety and security. Find one of the few available lifeboats and jump in quickly. Don’t let yourself worry about the fates of people who are doomed to a less fortunate future.

This position may strike someone as credible to the extent that they already see themselves as one of society’s winners:

  • They’ve already been successful in business
  • They assess themselves as being healthy, smart, focused, and pragmatic
  • They intend to keep on top of new technological possibilities: they’ll learn about the strengths and weaknesses of various technologies of intelligent automation, and exploit that knowledge.

What’s more, they may subscribe to a personal belief that “heroes make their own destiny”, or similar.

But before you adopt the “accept” stance, here are six risks you should consider:

  1. The skills in which you presently take pride, as supposedly being beyond duplication by any automated system, may unexpectedly be rendered obsolete due to technology progressing more quickly and more comprehensively than you expected. You might therefore find yourself, not as one of society’s winners, but as part of the growing “left behind” community
  2. Even if some of your skills remain unmatched by robots or AIs, these skills may have played less of a role than you thought in your past successes; some of these past successes may also have involved elements of good fortune, or personal connections, and so on. These auxiliary factors may give you a different outcome the next time you “roll the dice” and try to change from one business opportunity to another. Once again, you may find yourself unexpectedly in the social grouping left behind by technological change
  3. Even if you personally do well in the turmoil of increased job losses and economic transformation, what about all the people that matter a lot to you, such as family members and special friends? Is your personal success going to be sufficient that you can provide a helping hand to everyone to whom you feel a tie of closeness? Or are you prepared to stiffen your attitudes and to break connections with people from these circles of family and friends, as they become “left behind”?
  4. Many people who end up as left behinds will suffer physical, mental, or emotional pain, potentially including what are known as “deaths of despair”. Are you prepared to ignore all that suffering?
  5. Some of the left behinds may be inclined to commit crimes, to acquire some of the goods and services from which they are excluded by their state of relative poverty. That implies that security measures will have to be stepped up, including strict borders. You might be experiencing a life of material abundance, but with the drawback of living inside a surveillance-state society that is psychologically embittered
  6. Some of the left behinds might go one step further, obtaining dangerous weapons, leading to acts of mass terrorism. In case they manage to access truly destructive technologies, the result might be catastrophic harm or even existential destruction.

In deciding between different social structures, it can be helpful to adopt an approach proposed by the philosopher John Rawls, known as “the veil of ignorance”. In this approach, we are asked to set aside our prior assumptions about which role in society we will occupy. Instead, we are asked to imagine that we have an equal probability of obtaining any of the positions within that society.

For example, consider a society we’ll call WLB, meaning “with left behinds”, in which 995 people out of every one thousand are left behind, and five of every thousand have an extremely good standard of living (apart from having to deal with the problems numbered 4, 5, and 6 in the above list). Consider, as an alternative, a society we’ll call NLB, “no one left behind”, in which everyone has a quality of living that can be described as “good” (if, perhaps, not as “extremely good”).

If we don’t know whether we’ll be one of the fortunate 0.5% of the population, would we prefer society WLB or society NLB?

The answer might seem obvious: from behind the veil of ignorance, we should strongly prefer NLB. However, this line of argument is subject to two objections. First, someone might feel sure that they really will end up as part of the 0.5%. But that’s where the problems numbered 1 and 2 in the above list should cause a reconsideration.

The second objection deserves more attention. It is that a society such as NLB may be an impossibility. Attempts to create NLB might unintentionally lead to even worse outcomes. After all, bloody revolutions over recent centuries have often veered catastrophically out of control. Self-described “vanguards” of a supposedly emergent new society have turned into brutal demagogues. Attempts to improve society through the ballot box have frequently failed too – prompting the acerbic remark by former British Prime Minister Margaret Thatcher that (to paraphrase) “the problem with socialism is that you eventually run out of other people’s money”.

It is the subject of the remainder of this essay to assess whether NLB is actually practical. (If not, we might have to throw our efforts behind “Accept” after all.)

A3: “Resist”

The “resist” idea starts from a good observation. Just because something is possible, it doesn’t mean that society should make it happen. In philosophical language, a could does not imply a should.

Consider some examples. Armed forces in the Second World War could have deployed chemical weapons that emitted poison gas – as had happened during the First World War. But the various combatants decided against that option. They decided: these weapons should not be used. In Victorian times, factory owners could have employed young children to operate dangerous machinery with their nimble fingers, but society decided, after some deliberation, that such employment should not occur. Instead, children should attend school. More recently, nuclear power plants could have been constructed with scant regard to safety, but, again, society decided that should not happen, and that safety was indeed vital in these designs.

Therefore, just because new technologies could be developed and deployed to produce various goods and services for less cost than human workers, there’s no automatic conclusion in favour of that happening. Just as factory owners were forbidden from employing young children, they could also be forbidden from employing robots. Societal attitudes matter.

In this line of thinking, if replacing humans with robots in the workplace will have longer term adverse effects, society ought to be able to decide against that replacement.

But let’s look more closely at the considerations in these two cases: banning children from factories, and banning robots from factories. There are some important differences:

  • The economic benefits to factory owners from employing children were significant but were declining: newer machinery could operate without requiring small fingers to interact with them
  • The economy as a whole needed more workers who were well educated; therefore it made good economic sense for children to attend school rather than work in factories
  • The economic benefits to factory owners from deploying robots are significant and are increasing: newer robots can work at even higher levels of efficiency and quality, and cost less to operate
  • The economy as a whole has less need of human workers, so there is no economic argument in favour of prioritising the employment and training of human workers instead of the deployment of intelligent automation.

Moreover, it’s not just “factory owners” who benefit from being able to supply goods and services at lower cost and higher quality. Consumers of these goods and services benefit too. Consider again the examples of healthcare, education, travel, accommodation, communications, and entertainment. Imagine choices between:

  • High-cost, low-quality healthcare, provided mainly by humans, versus low-cost, high-quality healthcare, provided in large part by intelligent automation
  • High-cost, low-quality education, provided mainly by humans, versus low-cost, high-quality education, provided in large part by intelligent automation
  • And so on.

The “resist” option therefore would imply acceptance of at least part of the “simplify” option (discussed in more depth later): people in that circumstance would need to accept lower quality provision of healthcare, education, travel, accommodation, communications, and entertainment.

In other words, the resist option implies saying “no” to many possible elements of technological progress and the humanitarian benefits arising from it.

In contrast, the “steer” option tries to say “yes” to most of the beneficial elements of technological progress, whilst still preserving sufficient roles for humans in workforces. Let’s look more closely at it.

A4: “Steer”

The “steer” option tries to make a distinction between:

  • Work tasks that are mainly unpleasant or tedious, and which ought to be done by intelligent automation rather than by humans
  • Work tasks that can be meaningful or inspiring, especially when the humans carrying out these tasks have their abilities augmented (but not superseded) by intelligent automation (this concept was briefly mentioned in discussion of the “Disbelieve” option).

The idea of “steer” is to prioritise the development and adoption of intelligent automation technologies that can replace human workers in the first, tedious, category of tasks, whilst augmenting humans so they can continue to carry out the second, inspiring, category of tasks.

This also means a selective resistance to improvements in automation technologies, namely to those improvements which would result in the displacement of humans from the second category of tasks.

This proposal has been championed by, for example, the Stanford economist Erik Brynjolfsson. Brynjolfsson has coined the phrase “the Turing Trap”, referring to what he sees as a mistaken direction in the development of AI, namely trying to create AIs that can duplicate (and then exceed) human capabilities. Such AIs would be able to pass the “Turing Test” that Alan Turing famously described in 1950, but that would lead, in Brynjolfsson’s view, to a fearsome “peril”:

Building machines designed to pass the Turing Test and other, more sophisticated metrics of human-like intelligence… is a path to unprecedented wealth, increased leisure, robust intelligence, and even a better understanding of ourselves. On the other hand, if [that] leads machines to automate rather than augment human labor, it creates the risk of concentrating wealth and power. And with that concentration comes the peril of being trapped in an equilibrium where those without power have no way to improve their outcomes.

Here’s how Brynjolfsson introduces his ideas:

Creating intelligence that matches human intelligence has implicitly or explicitly been the goal of thousands of researchers, engineers, and entrepreneurs. The benefits of human-like artificial intelligence (HLAI) include soaring productivity, increased leisure, and perhaps most profoundly, a better understanding of our own minds.

But not all types of AI are human-like – in fact, many of the most powerful systems are very different from humans – and an excessive focus on developing and deploying HLAI can lead us into a trap. As machines become better substitutes for human labor, workers lose economic and political bargaining power and become increasingly dependent on those who control the technology. In contrast, when AI is focused on augmenting humans rather than mimicking them, then humans retain the power to insist on a share of the value created. What’s more, augmentation creates new capabilities and new products and services, ultimately generating far more value than merely human-like AI. While both types of AI can be enormously beneficial, there are currently excess incentives for automation rather than augmentation among technologists, business executives, and policymakers.

Accordingly, here are his recommendations:

The future is not preordained. We control the extent to which AI either expands human opportunity through augmentation or replaces humans through automation. We can work on challenges that are easy for machines and hard for humans, rather than hard for machines and easy for humans. The first option offers the opportunity of growing and sharing the economic pie by augmenting the workforce with tools and platforms. The second option risks dividing the economic pie among an ever-smaller number of people by creating automation that displaces ever-more types of workers.

While both approaches can and do contribute to progress, too many technologists, businesspeople, and policymakers have been putting a finger on the scales in favor of replacement. Moreover, the tendency of a greater concentration of technological and economic power to beget a greater concentration of political power risks trapping a powerless majority into an unhappy equilibrium: the Turing Trap….

The solution is not to slow down technology, but rather to eliminate or reverse the excess incentives for automation over augmentation. In concert, we must build political and economic institutions that are robust in the face of the growing power of AI. We can reverse the growing tech backlash by creating the kind of prosperous society that inspires discovery, boosts living standards, and offers political inclusion for everyone. By redirecting our efforts, we can avoid the Turing Trap and create prosperity for the many, not just the few.

But a similar set of questions arise for the “steer” option as for the more straightforward “resist” option. Resisting some technological improvements, in order to preserve employment opportunities for humans, means accepting a lower quality and higher cost of the corresponding goods and services.

Moreover, that resistance would need to be coordinated worldwide. If you resist some technological innovations but your competitors accept them, and replace expensive human workers with lower cost AI, their products can be priced lower in the market. That would drive you out of business – unless your community is willing to stick with the products that you produce, relinquishing the chance to purchase cheaper products from your competitors.

Therefore, let’s now consider what would be involved in such a relinquishment.

A5: “Simplify”

If some people prefer to adopt a simpler life, without some of the technological wonders that the rest of us expect, that choice should be available to them.

Indeed, human society has long upheld the possibility of choice. Communities are able, if they wish, to make their own rules about the adoption of various technologies.

For example, organisers of various sports set down rules about which technological enhancements are permitted, within those sports, and which are forbidden. Bats, balls, protective equipment, sensory augmentation – all of these can be restricted to specific dimensions and capabilities. The restrictions are thought to make the sports better.

Similarly, goods sold in various markets can carry markings that designate them as being manufactured without the use of certain methods. Thus consumers can see an “organic” label and be confident that certain pesticides and fertilisers have been excluded from the farming methods used to produce these foods. Depending on the type of marking, there can also be warranties that these foods contain no synthetic food additives and have not been processed using irradiation or industrial solvents.

Consider also the Amish, a group of traditionalist communities from the Anabaptist tradition, with their origins in Swiss German and Alsatian (French) cultures. These communities have made many decisions over the decades to avoid aspects of the technology present in wider society. Their clothing has avoided buttons, zips, or Velcro. They generally own no motor cars, but use horse-drawn carts for local transport. Different Amish communities have at various times forbidden (or continue to forbid) high-voltage electricity, powered lawnmowers, mechanical milking machines, indoor flushing toilets, bathtubs with running water, refrigerators, telephones inside the house, radios, and televisions.

Accordingly, whilst some parts of human society might in the future adopt fuller use of intelligent automation technologies, deeply transforming working conditions, other parts might, Amish-like, decide to abstain. They may say: “we already have enough, thank you”. Whilst people in society as a whole may be unable to find work that pays them good wages, people in these “simplified” communities will be able to look after each other.

Just as Amish communities differ among themselves as to how much external technology they are willing to incorporate into their lives, different “simplified” communities could likewise make different choices as to how much they adopt technologies developed outside their communities. Some might seek to become entirely self-sufficient; others might wish to take advantage of various medical treatments, educational software, transportation systems, robust housing materials, communications channels, and entertainment facilities provided by the technological marvels created in wider society.

But how will these communities pay for these external goods and services? In order to be able to trade, what will they be able to create that is not already available in better forms outside their communities, where greater use is made of intelligent automation?

We might consider tourist visits, organic produce, or the equivalent of handmade ornaments. But, again, what will make these goods more attractive, to outsiders, than the abundance of goods and services (including immersive virtual reality travel) that is already available to them?

We therefore reach a conclusion: groups that choose to live apart from deeply transformative technologies will likely lack access to many valuable goods and services. It’s possible they may convince themselves, for a while, that they prefer such a lifestyle. However, just as the attitudes of Amish communities have morphed over the decades, so that these groups now see (for example) indoor flushing toilets as a key part of their lives, it is likely that the attitudes of people in these simplified communities will also alter. When facing death from illness, or when facing disruption to their relatively flimsy shelters from powerful weather, they may well find themselves deciding they prefer, after all, to access more of the fruits of technological abundance.

With nothing to exchange or barter for these fruits, the only way they will receive them is via a change in the operation of the overall economy. That brings us to the sixth and final option from my original list, “enhance”.

Whereas the previous options have looked at various alterations in how technology is developed or applied, “enhance” looks at a different possibility: revising how the outputs and benefits of technology are planned and distributed throughout society. These are revisions to the economy, rather than revisions in technology.

In this vision, with changes in both technology and the economy, everyone will benefit handsomely. Simplicity will remain a choice, for those who prefer it, but it won’t be an enforced choice. People who wish to participate in a life of abundance will be able to make that choice instead, without needing to find especially remunerative employment to pay for it.

I’ll accept, in advance, that many critics may view such a possibility as a utopian fantasy. But let’s not rush to a conclusion. I’ll build my case in stages.

B: Enhancing the operation of the economy

Let’s pick up the conversation with the basics of economics, which is the study of how to deal with scarcity. When important goods and services are scarce, humans can suffer.

Two fundamental economic forces that have enabled astonishing improvements in human wellbeing over the centuries, overcoming many aspects of scarcity, are collaboration and competition:

  • Collaboration: person A benefits from the skills and services of person B, whereas person B benefits reciprocally from a different set of skills and services of person A; this allows both A and B to specialise, in different areas
  • Competition: person C finds a way to improve the skills and services that they offer to the market, compared to person D, and therefore receives a higher reward – causing person D to consider how to improve their skills and services in turn, perhaps by copying some of the methods and approach of person C.

What I’ve just described in terms of simple interactions between two people is nowadays played out, in practice, via much larger communities, and over longer time periods:

  • Collaboration includes the provision of a social safety net, for looking after individuals who are less capable, older, lack resources, or who have fallen on hard times; these safety nets can operate at the family level, tribe (extended family) level, community level, national level, or international level
  • The prospect of gaining extra benefits from better skills and services leads people to make personal investments, in training and tools, so that they can possess (for a while at least) an advantage in at least one market niche.

Importantly, it needs to be understood that various forms of collaboration and competition can have negative consequences as well as positive ones:

  • A society that keeps extending an unconditional helping hand to someone who avoids taking personal responsibility, or to a group that is persistently dysfunctional, might end up diverting scarce resources from key social projects to being squandered by people for no good purpose
  • In a race to become more economically dominant, other factors may be overlooked, such as social harmony, environmental wellbeing, and other so-called externalities.

In other words, the forces that can lead to social progress can also lead to social harm.

In loose terms, the two sets of negative consequences can be called “failure modes of socialism” and “failure modes of capitalism” – to refer to two historically significant terms in theories of economics, namely “socialism” and “capitalism”. These two broad frameworks are covered in the subsections ahead, along with key failure modes in each case. After that, we’ll consider models that aspire to transcend both sets of failure by delivering “the best of both worlds”.

To look ahead, it is the “best of both worlds” model that has the potential to be the best solution to the Economic Singularity.

B1: Need versus greed?

When there is a shortage of some product or service, how should it be distributed? To the richest, the strongest, the people who shout the loudest, the special friends of the producers, or to whom?

One answer to that question is given in the famous slogan, “From each according to his ability, to each according to his needs”. In other words, each person should receive whatever they truly need, be it food, clothing, healthcare, accommodation, transportation, and so on.

That slogan was popularised by Karl Marx in an article he wrote in 1875, but earlier political philosophers had used it in the 1840s. Indeed, an antecedent can be found in the Acts of the Apostles in the New Testament, referring to the sharing of possessions within one of the earliest groups of Christian believers:

All the believers were one in heart and mind. No one claimed that any of their possessions was their own, but they shared everything they had… There were no needy persons among them. For from time to time those who owned land or houses sold them, brought the money from the sales and put it at the apostles’ feet, and it was distributed to anyone who had need.

Significantly, Marx foresaw that principle of full redistribution as being possible only after technology (“the productive forces”) had sufficiently “increased”. It was partly for that reason that Joseph Stalin, despite being an avowed follower of Marx, wrote a different principle into the 1936 constitution of the Soviet Union: “From each according to his ability, to each according to his work”. Stalin’s justification was that the economy had not yet reached the required level of production, and that serious human effort was first required to reach peak industrialization.

This highlights one issue with the slogan, and with visions of society that seek to place that slogan at the centre of their economy: before products and services can be widely distributed, they need to be created. A preoccupation with distribution will fail unless it is accompanied by sufficient attention to creation. Rather than fighting over how a pie is divided, it’s important to make the pie larger. Then there will be much more to share.

A second issue is in the question of what counts as a need. Clothing is a need, but what about the latest fashion? Food is a need, but what about the rarest of fruits and vegetables? And what about “comfort food”: is that a need? Healthcare is a need, but what about a heart transplant? Transportation is a need, but what about intercontinental aeroplane flights?

A third issue with the slogan is that a resource that is assigned to someone’s perceived need is, potentially, a resource denied from a more productive use to which another person might put that resource. Money spent to provide someone with what they claim they need might have been invested elsewhere to create more resources, allowing more people to have what they claim that they need.

Thus the oft-admired saying attributed to Mahatma Gandhi, “The world has enough for everyone’s needs, but not everyone’s greed”, turns out to be problematic in practice. Who is to say what is ‘need’ and what is ‘greed’? Are desires for luxury goods always to be denigrated as ‘greed’? Isn’t life about enjoyment, vitality, and progress, rather than just calmly sitting down in a state of relative poverty?

B2: Socialism and its failures

There are two general approaches to handling the problems just described: centralised planning, and free-market allocation.

With centralised planning, a group of reputedly wise people:

  • Keep on top of information about what the economy can produce
  • Keep on top of information about what people are believed to actually need
  • Direct the economy so that it makes a better job of producing what it has been decided that people need.

Therefore a central planner may dictate that more shoes of a certain type need to be produced. Or that drinks should be manufactured with less sugar in them, that particular types of power stations should be built, or that particular new drugs should be created.

That’s one definition of socialism: representatives of the public direct the economy, including the all-important “means of production” (factories, raw materials, infrastructure, and so on), so that the assumed needs of all members of society are met.

However, when applied widely within an economy, centralised planning approaches have often failed abysmally. Assumptions about what people needed often proved wrong, or out-of-date. Indeed, members of the public often changed their minds about what products were most important for them, especially after new products came into use, and their upsides and downsides could be more fully appreciated. Moreover, manufacturing innovations, such as new drugs, or new designs for power stations, could not be achieved simply by wishing them or “planning” them. Finally, people working in production roles often felt alienated, lacking incentives to apply their best ideas and efforts.

That’s where the alternative coordination mechanism – involving free markets – often fared better (despite problems of its own, which we’ll review in due course). The result of free markets has been significant improvements in the utility, attractiveness, performance, reliability, and affordability of numerous types of goods and services. As an example, modern supermarkets are one of the marvels of the world, being stocked from floor to ceiling with all kinds of items to improve the quality of daily life. People around the globe have access to a vast variety of all-around nourishment and experience that would have astonished their great-grandparents.

In recent decades, there have been similar rounds of sustained quality improvement and cost reduction for personal computers, smartphones, internet access, flatscreen TVs, toys, kitchen equipment, home and office furniture, clothing, motor cars, aeroplane tickets, solar panels, and much more. The companies that found ways to improve their goods and services flourished in the marketplace, compelling their competitors to find similar innovations – or go out of business.

It’s no accident that the term “free market” contains the adjective “free”. The elements of a free market which enable it to produce a stream of quality improvements and cost reductions include the following freedoms:

  1. The freedom for companies to pursue profits – under the recognition that the prospect of earning profits can incentivise sustained diligence and innovation
  2. The freedom for companies to adjust the prices for their products, and to decide by themselves the features contained in these products, rather than following the dictates of any centralised planner
  3. The freedom for groups of people to join together and start a new business
  4. The freedom for companies to enter new markets, rather than being restricted to existing product lines; new competitors keep established companies on their toes
  5. The freedom for employees to move to new roles in different companies, rather than being tied to their existing employers
  6. The freedom for companies to explore multiple ways to raise funding for their projects
  7. The freedom for potential customers to not buy products from established vendors, but to switch to alternatives, or even to stop using that kind of product altogether.

What’s more, the above freedoms are permissionless in a free market. No one needs to apply for a special licence from central authorities before one of these freedoms becomes available.

Any political steps that would curtail the above freedoms need careful consideration. The result of such restrictions could (and often do) include:

  • A disengaged workforce, with little incentive to apply their inspiration and perspiration to the tasks assigned to them
  • Poor responsiveness to changing market interest in various products and services
  • Overproduction of products for which there is no market demand
  • Companies having little interest in exploring counterintuitive combinations of product features, novel methods of assembly, new ways of training or managing employees, or other innovations.

Accordingly, anyone who wishes to see the distribution of high-quality products to the entire population needs to beware curtailing freedoms of entrepreneurs and innovators. That would be taking centralised planning too far.

That’s not to say that the economy should dispense with all constraints. That would raise its own set of deep problems – as we’ll review in the next subsection.

B3: Capitalism and its failures

Just as there are many definitions of socialism, there are many definitions of capitalism.

Above, I offered this definition of socialism: an economy in which production is directed by representatives of the public, with the goal that the assumed needs of all members of society are met. For capitalism, at least parts of the economy are directed, instead, by people seeking returns on the capital they invest. This involves lots of people making independent choices, of the types I have just covered: choices over prices, product features, types of product, areas of business to operate within, employment roles, manufacturing methods, partnership models, ways of raising investment, and so on.

But these choices depend on various rules being set and observed by society:

  1. Protection of property: goods and materials cannot simply be stolen, but require the payment of an agreed price
  2. Protection of intellectual property: various novel ideas cannot simply be copied, but require, for a specified time, the payment of an agreed licence fee
  3. Protection of brand reputation: companies cannot use misleading labelling or other trademarked imagery to falsely imply an association with another existing company with a good reputation
  4. Protection of contract terms: when companies or individuals enter into legal contracts, regarding employment conditions, supply timelines, fees for goods and services, etc., penalties for any breach of contract can be enforced
  5. Protection of public goods: shared items such as clean air, usable roads, and general safety mechanisms, need to be protected against decay.

These protections all require the existence and maintenance of a legal system in which justice is available to everyone – not just to the people who are already well-placed in society.

These are not the only preconditions for the healthy operation of free markets. The benefits of these markets also depend on the existence of viable competition, which prevents companies from resting on their laurels. However, seeking an easier life for themselves, companies may be tempted to organise themselves into cartels, with agreed pricing, or with products with built-in obsolescence. The extreme case of a cartel is a monopoly, in which all competitors have gone out of business, or have been acquired by the leading company in an industry. A monopoly lacks incentive to lower prices or to improve product quality. A related problem is “crony capitalism”, in which governments preferentially award business contracts to companies with personal links to government ministers. The successful operation of a free market depends, therefore, upon society’s collective vigilance to notice and break up cartels, to prevent the misuse of monopoly power, and to avoid crony capitalism.

Further, even when markets do work well, in ways that provide short-term benefits to both vendors and customers, the longer-term result can be profoundly negative. So-called “commons” resources can be driven into a state of ruin by overuse. Examples include communal grazing land, the water flowing in a river, fish populations, and herds of wild livestock. All individual users of such a resource have an incentive to take from it, either to consume it themselves, or to include it in a product to be sold to a third party. As the common stock declines, the incentive for each individual person to take more increases, so that they’re not excluded. But finally, the grassland is all bare, the river has dried up, the stocks of fish have been obliterated, or the passenger pigeon, great auk, monk seal, sea mink, etc., have been hunted to extinction. To guard against these perils of short-termism, various sorts of protective mechanisms need to be created, such as quotas or licences, with clear evidence of their enforcement.

What about when suppliers provide shoddy goods? In some cases, members of a society can learn which suppliers are unreliable, and therefore cease purchasing goods from them. In these cases, the market corrects itself: in order to continue in business, poor suppliers need to make amends. But when larger groups of people are involved, there are three drawbacks with just relying on this self-correcting mechanism:

  1. A vendor who deceives one purchaser in one vicinity can relocate to a different vicinity – or can simply become “lost in the crowd” – before deceiving another purchaser
  2. A vendor who produces poor-quality goods on a large scale can simultaneously impact lots of people’s wellbeing – as when a restaurant skimps on health and safety standards, and large numbers of diners suffer food poisoning as a result
  3. It may take a long time before defects in someone’s goods or services are discovered – for example, if no funds are available for an insurance payout that was contracted many years earlier.

It’s for such reasons that societies generally decide to augment the self-correction mechanisms of the free market with faster-acting preventive mechanisms, including requirements for people in various trades to conform to sets of agreed standards and regulations.

A final cause of market failure is perhaps the most significant: the way in which market exchanges fail to take “externalities” into account. A vendor and a purchaser may both benefit when a product is created, sold, and used, but other people who are not party to that transaction can suffer as a side effect – if, for example, the manufacturing process emits loud noises, foul smells, noxious gases, or damaging waste products. Since they are not directly involved in the transaction, these third parties cannot influence the outcome simply by ceasing to purchase the goods or services involved. Instead, different kinds of pressure need to be applied: legal restrictions, taxes, or other penalties or incentives.

It’s not just negative externalities that can cause free markets to misbehave. Consider also positive externalities, where an economic interaction has a positive impact on people who do not pay for it. Some examples:

  1. If a company purchases medical vaccinations for its employees, to reduce their likelihood of becoming ill with the flu, others in the community benefit too, since there will be fewer ill people in that neighbourhood, from whom they might catch flu
  2. If a company purchases on-the-job training for an employee, the employee may pass on to family members and acquaintances, free of charge, tips about some of the skills they learned
  3. If a company pays employees to carry out fundamental research, which is published openly, people in other companies can benefit from that research too, even though they did not pay for it.

The problem here is that the company may decide not to go ahead with such an investment, since they calculate that the benefits for them will not be sufficient to cover their costs. The fact that society as a whole would benefit, as a positive externality, generally does not enter their calculation.

This introduces the important concept of public goods. When there’s insufficient business case for an individual investor to supply the funding to cover the costs of a project, that project won’t get off the ground – unless there’s a collective decision for multiple investors to share in supporting it. Facilitating that kind of collective decision – one that would benefit society as a whole, rather than just a cartel of self-interested companies – takes us back to the notion of central planning. Central planners can consider longer-term possibilities – in ways that, as noted, are problematic for a free market to achieve – and can design and oversee what is known as industrial strategy or social strategy.

B4: The mixed market

To recap the last two subsections: there are problems with over-application of central planning, and there are also problems with free markets that have no central governance.

The conclusion to draw from this, however, isn’t to give up on both these ideas. It’s to seek an appropriate combination of these ideas. That combination is known as “the mixed market”. It involves huge numbers of decisions being taken locally, by elements of a free market, but all subject to democratic political oversight, aided by the prompt availability of information about the impacts of products in society and on the environment.

This division of responsibility between the free market and political oversight is described particularly well in the writing of political scientists Jacob Hacker and Paul Pierson. They offer fulsome praise to something they say “may well be the greatest invention in history”. Namely, the mixed economy:

The combination of energetic markets and effective governance, deft fingers and strong thumbs.

Their reference to “deft fingers and strong thumbs” expands Adam Smith’s famous metaphor of the invisible hand which is said to guide the free market. Hacker and Pierson develop their idea as follows:

Governments, with their capacity to exercise authority, are like thumbs: powerful but lacking subtlety and flexibility. The invisible hand is all fingers. The visible hand is all thumbs. Of course, one wouldn’t want to be all thumbs. But one wouldn’t want to be all fingers, either. Thumbs provide countervailing power, constraint, and adjustment to get the best out of those nimble fingers…

The mixed economy… tackles a double bind. The private markets that foster prosperity so powerfully nonetheless fail routinely, sometimes spectacularly so. At the same time, the government policies that are needed to respond to these failures are perpetually under siege from the very market players who help to fuel growth. That is the double bind. Democracy and the market – thumbs and fingers – have to work together, but they also need to be partly independent from each other, or the thumb will cease to provide effective counterpressure to the fingers.

I share the admiration shown by Hacker and Pierson for the mixed market. I also agree that it’s hard to get the division of responsibilities right. Just as markets can fail, so also can politicians fail. But just as the fact of market failures should not be taken as a reason to dismantle free markets altogether, so should the fact of political failures not be taken as a reason to dismantle all political oversight of markets. Each of these two sorts of fundamentalist approaches – anti-market fundamentalism and pro-market fundamentalism – are dangerously one-sided. The wellbeing of society requires, not so much the reduction of government, but the rejuvenation of government, in which key aspects of government operation are improved:

  1. Smart, agile, responsive regulatory systems
  2. Selected constraints on the uses to which various emerging new technologies can be put
  3. “Trust-busting”: measures to prevent large businesses from misusing monopoly power
  4. Equitable redistribution of the benefits arising from various products and services, for the wellbeing and stability of society as a whole
  5. Identification, protection, and further development of public goods
  6. Industrial strategy: identifying directions to be pursued, and providing suitable incentives so that free market forces align toward these directions.

None of what I’m saying here should be controversial. However, both fundamentalist outlooks I mentioned often exert a disproportionate influence over political discourse. Part of the reason for this is explained at some length in the book by the researchers Hacker and Pierson which contained their praise for the mixed market. The title of that book is significant: American Amnesia: Business, Government, and the Forgotten Roots of Our Prosperity.

It’s not just that the merits of the mixed market have been “forgotten”. It’s that these merits have been deliberately obscured by a sustained ideological attack. That attack serves the interest of various potentially cancerous complexes that seek to limit governmental oversight of their activities:

  • Big Tobacco, which tends to resist government oversight of the advertising of products containing tobacco
  • Big Oil, which tends to resist government oversight of the emissions of greenhouse gases
  • Big Armaments, which tends to resist government oversight of the growth of powerful weapons of mass destruction
  • Big Finance, which tends to resist government oversight of “financial weapons of mass destruction” (to use a term coined by Warren Buffett)
  • Big Agrotech, which tends to resist government oversight of new crops, new fertilisers, and new weedkillers
  • Big Media, who tend to resist government oversight of press standards
  • Big Theology, which resists government concerns about indoctrination and manipulation of children and others
  • Big Money: individuals, families, and corporations with large wealth, who tend to resist the power of government to levy taxes on them.

All these groups stand to make short-term gains if they can persuade the voting public that the power of government needs to be reduced. It is therefore in the interest of these groups to portray the government as being inevitably systematically incompetent – and, at the same time, to portray the free market as being highly competent. But for the sake of society as a whole, these false portrayals must be resisted.

In summary: better governments can oversee economic frameworks in which better goods and services can be created (including all-important public goods):

  • Frameworks involving a constructive combination of entrepreneurial flair, innovative exploration, and engaged workforces
  • Frameworks that prevent the development of any large societal cancers that would divert too many resources to localised selfish purposes.

In turn, for the mixed model to work well, governments themselves must be constrained through oversight, by well-informed independent press, judiciary, academic researchers, and diverse political groupings, all supported by a civil service and challenged on a regular basis by free and fair democratic elections.

That’s the theory. Now for some complications – and solutions to the complications.

B5: Technology changes everything

Everything I’ve written in this section B so far makes sense independently of the oncoming arrival of the Economic Singularity. But the challenges posed by the Economic Singularity make it all the more important that we learn to temper the chaotic movements of the economy, with it operating responsively and thoughtfully under a high-calibre mixed market model.

Indeed, rapidly improving technology – especially artificial intelligence – is transforming the landscape, introducing new complications and new possibilities:

  1. Technology enables faster and more comprehensive monitoring of overall market conditions – including keeping track of fast-changing public expectations, as well as any surprise new externalities of economic transactions; it can thereby avoid some of the sluggishness and short-sightedness that bedevilled older (manual) systems of centralised planning and the oversight of entire economies
  2. Technology gives more information more quickly, not only to the people planning production (at either central or local levels), but also to consumers of products, with the result that vendors of better products will drive vendors of poorer products out of the market more quickly (this is the “winner takes all” phenomenon)
  3. With advanced technology playing an ever-increasing role in determining the success or failure of products, the companies that own and operate the most successful advanced technology platforms will become among the most powerful forces on the planet
  4. As discussed earlier (in Section A), technology will significantly reduce the opportunities for people to earn large salaries in return for work that they do
  5. Technology enables more goods to be produced at much lower cost – including cheaper clean energy, cheaper nutritious food, cheaper secure accommodation, and cheaper access to automated education systems.

Here, points 2, 3, and 4 raise challenges, leading to a world with greater inequalities:

  • A small number of companies, and a small number of people working for them, will do very well in terms of income, and they will have unprecedented power
  • The majority of companies, and the majority of people, will experience various aspects of failure and being “left behind”.

But points 1 and 5 promote a world where governance systems perform better, and where people need much less money in order to experience a high quality of wellbeing. They highlight the possibility of the mixed market model working better, distributing more goods and services to the entire population, and thereby meeting a wider set of needs. This comprehensive solution is what is meant by the word “enhance”, as in the name of my preferred solution to the Economic Singularity.

However, these improvements will depend on societies changing their minds about what matters most – the things that need to be closely measured, monitored, and managed. In short, it will depend on some fundamental changes in worldview.

B6: Measuring what matters most

The first key change in worldview is that the requirement for people to seek paid employment belongs only to a temporary phase in the evolution of human culture. That phase is coming to an end. From now on, the basis for societies to be judged as effective or defective shouldn’t be the proportion of people who have positions of well-paid employment. Instead, it should be the proportion of people who can flourish, every single day of their lives.

Moreover, measurements of prosperity must include adequate analysis of the externalities (both positive and negative) of economic transactions – externalities which market prices often ignore, but which modern AI systems can measure and monitor more accurately. These measurements will continue to include features such as wealth and average lifespan, as monitored by today’s politicians, but they’ll put a higher focus on broader measurements of wellbeing, therefore transforming where politicians will apply most of their attention.

In parallel, we should look forward to a stage-by-stage transformation of the social safety net – so that all members of society have access to the goods and services that are fundamental to experiencing an agreed base level of human flourishing, within a society that operates sustainably and an environment that remains healthy and vibrant.

I therefore propose the following high-level strategic direction for the economy: prioritise the reduction of prices for all goods and services that are fundamental to human flourishing, where the prices reflect all the direct and indirect costs of production.

This kind of price reduction is already taking place for a range of different products, such as many services delivered online, but there are too many other examples where prices are rising (or dropping too slowly).

In other words, the goal of the economy should no longer be to increase the GDP – the gross domestic product, made up of higher prices and greater commercial activity. Instead, the goal should be to reduce the true costs of everything that is required for a good life, including housing, food, education, security, and much more. This will be part of taking full advantage of the emerging tech-driven abundance.

It is when prices come down, that politicians should celebrate, not when prices go up, or when profit margins rise, or when the stock market soars.

The end target of this strategy is that all goods and services fundamental to human flourishing should, in effect, have zero price. But for the foreseeable future, many items will continue to have a cost.

For those goods and services which carry prices above zero, combinations of three sorts of public subsidies can be made available:

  • An unconditional payment, sometimes called a UBI – an unconditional basic income – can be made available to all citizens of the country
  • The UBI can be augmented by conditional payments, dependent on recipients fulfilling requirements agreed by society, such as, perhaps, education or community service
  • There can be individual payments for people with special needs, such as particular healthcare requirements.

Such suggestions are not new, of course. Typically they face five main objections:

  1. A life without paid work will be one devoid of meaning – humans will atrophy as a result
  2. Giving people money for nothing will encourage idleness and decadence, and will be a poor use of limited resources
  3. A so-called “basic” income won’t be sufficient; what should be received by people who cannot (due to any fault of their own) earn a good salary, isn’t a basic income but a generous income (hence a UGI rather than a UBI) that supports a good quality of life rather than a basic existence
  4. The large redistribution of money to pay for a widespread UGI will cripple the rest of the economy, forcing taxpayers overseas; alternatively, if the UGI is funded by printing more money (as is sometimes proposed), this will have adverse inflationary implications
  5. Although a UBI might be affordable within a country that has an advanced developed economy, it will prove unaffordable in less developed countries, where the need for a UBI will be equally important; indeed, an inflationary spiral in countries that do pay their citizens a UBI will result in tougher balance-of-payments situations in the other countries of the world.

Let’s take these objections one at a time.

B7: Options for universal income

The suggestion that a life without paid work will have no possibility of deep meaning is, when you reflect on it, absurd, given the many profound experiences that people often have outside of the work context. The fact that this objection is raised so often is illuminating: it suggests a pessimism about one’s fellow human beings. People raising this objection usually say that they, personally, could have a good life without paid work; it’s just that “ordinary people” would be at a loss and go downhill, they suggest. After all, these critics may continue, look at how people often waste welfare payments they receive. Which takes us to the second objection on the list above.

However, the suggestion that unconditional welfare payments result in idleness and decadence has little evidence to support it. Many people who receive unconditional payments from the state – such as pension payments in their older age – live a fulfilling, active, socially beneficial life, so long as they remain in good health.

The criteria “remain in good health” is important here. People who abuse welfare payments often suffer from prior emotional malaise, such as depression, or addictive behaviours. Accordingly, the solution to welfare payments being (to an extent) wasted, isn’t to withdraw these payments, but is to address the underlying emotional malaise. This can involve:

  • Making society healthier generally, via a fuller and wider share of the benefits of tech-enabled abundance
  • Highlighting credible paths forward to much better lifestyles in the future, as opposed to people seeing only a bleak future ahead of them
  • High-quality (but potentially low-cost) mental therapy, perhaps delivered in part by emotionally intelligent AI systems
  • Addressing the person’s physical and social wellbeing, which are often closely linked to their emotional wellbeing.

In any case, worries about “resources being wasted” will gradually diminish, as technology progresses further, removing more and more aspects of scarcity. (Concerns about waste arise primarily when resources are scarce.)

It is that same technological progress that answers the second objection, namely that a UGI will be needed rather than a UBI. The point is that the cost of a UGI soon won’t be much more than the cost of a UBI. That’s provided that the economy has indeed been managed in line with the guiding principle offered earlier, namely the prioritisation of the reduction of prices for all goods and services that are fundamental to human flourishing.

In the meantime, turning to the third objection, payments in support of UGI can come from a selection of the following sources:

  • Stronger measures to counter tax evasion, addressing issues exposed by the Panama Papers as well as unnecessary inconsistencies of different national tax systems
  • Increased licence fees and other “rents” paid by organisations who specially benefit from public assets such as land, the legal system, the educational system, the wireless spectrum, and so on
  • Increased taxes on activities with negative externalities, such as a carbon tax for activities leading to greenhouse gas emissions, and a Tobin tax on excess short-term financial transactions
  • A higher marginal tax on extreme income and/or wealth
  • Reductions in budgets such as healthcare, prisons, and defence, where the needs should reduce once people’s mental wellbeing has increased
  • Reductions in the budget for the administration of currently overcomplex means-tested benefits.

Some of these increased taxes might encourage business leaders to relocate their businesses abroad. However, it’s in the long-term interest of each different country to coordinate regarding the levels of corporation tax, thereby deterring such relocations.

That brings us to the final objection: that a UGI needs, somehow, to be a GUGI – a global universal generous income – which makes it (so it is claimed) particularly challenging.

B8: The international dimension

Just as the relationship between two or more people is characterised by a combination of collaboration and competition, so it is with the relationship between two or more countries.

Sometimes both countries benefit from an exchange of trade. For example, country A might provide low-cost, high-calibre remote workers – software developers, financial analysts, and help-desk staff. In return, country B provides hard currency, enabling people in country A to purchase items of consumer electronics designed in country B.

Sometimes the relationship is more complicated. For example, country C might gain a competitive advantage over country D in the creation of textiles, or in the production of oil, obliging country D to find new ways to distinguish itself on the world market. And in these cases, sometimes country D could find itself being left behind, as a country.

Just as the fast improvements in artificial intelligence and other technologies are complicating the operation of national economies, they are also complicating the operation of the international economy:

  • Countries which used to earn valuable income from overseas due to their remote workers in fields such as software development, financial analysis, and help desks, will find that the same tasks can now be performed better by AI systems, removing the demand for offshore personnel and temporary worker visas
  • Countries whose products and services were previously “nearly good enough” will find that they increasingly lose out to products and services provided by other countries, on account of faster transmission of both electronic and physical goods
  • The tendencies within countries for the successful companies to be increasingly wealthy, leaving others behind, will be mirrored at the international level: successful countries will become increasingly powerful, leaving others behind.

Just as the local versions of these tensions pose problems inside countries, the international versions of these tensions pose problems at the geopolitical level. In both cases, the extreme possibility is that a minority of angry, alienated people might unleash a horrific campaign of terror. A less extreme possibility – which is still one to be avoided – is to exist in a world full of bitter resentment, hostile intentions, hundreds of millions of people seeking to migrate to more prosperous countries, and borders which are patrolled to avoid uninvited immigration.

Just as there is a variety of possible responses to the scenario of the Economic Singularity within one country, there is a similar variety of possible responses to the international version of the problem:

  1. Disbelieve that there is any fundamental new challenge arising. Tell people in countries around the world that their destiny is within their own hands; all they need to do is buckle down, reskill, and find new ways of bringing adequate income to their countries
  2. Accept that there will be many countries losing out, and take comprehensive steps to ensure that migration is carefully controlled
  3. Resist the growth in the use of intelligent automation technologies in industries that are particularly important to various third world countries
  4. Urge people in third world countries to plan to simplify their lifestyles, preparing to exist at a lower degree of flourishing than, say, in the US and the EU, but finding alternative pathways to personal satisfaction
  5. Enhance the mechanisms used globally for the redistribution of the fruits of technology.

You won’t be surprised to hear that I recommend, again, the “enhance” option from this list.

What underpins that conclusion is my prediction that the fruits of forthcoming technological improvements won’t just be sufficient for a good quality of life in a few countries. They’ll enable a good quality of life for everyone all around the world.

I’m thinking of the revolutions that are gathering pace in four overlapping fields of technology: nanotech, biotech, infotech, and cognotech, or NBIC for short. In combination, these NBIC revolutions offer enormous new possibilities:

  • Nanotech will transform the fields of energy and manufacturing
  • Biotech will transform the fields of agriculture and healthcare
  • Cognotech will transform the fields of education and entertainment
  • Infotech will, by enabling greater application of intelligence, accelerate all the above improvements (and more).

But, once again, these developments will take time. Just as national economies cannot, overnight, move to a new phase in which abundance completely replaces scarcity, so also will the transformation of the international economy require a number of stages. It is the turbulent transitional stages that will prove the most dangerous.

Once again, my recommendation for the best way forwards is the mixed model – local autonomy, aided and supported by an evolving international framework. It’s not a question of top-down control versus bottom-up emergence. It’s a question of utilising both these forces.

Once again, wise use of new technology can enhance how this mixed model operates.

Once again, it will be new metrics that guide us in our progress forward. The UN’s framework of SDGs – sustainable development goals – is a useful starting point, but it sets the bar too low. Rather than (in effect) considering “sustainability with less”, it needs to more vigorously embrace “sustainability with more” – or as I have called it, “Sustainable superabundance for all”.

B9: Anticipating a new mindset

The vision of the near future that I’ve painted may strike some readers as hopelessly impractical. Critics may say:

  • “Countries will never cooperate sufficiently, especially when they have very different political outlooks”
  • “Even within individual countries, the wealthy will resist parts of their wealth being redistributed to the rest of the population”
  • “Look, the world is getting worse – by many metrics – rather than getting better”.

But here’s why I predict that positive changes can accelerate.

First, alongside the metrics of deterioration in some aspects of life, there are plenty of metrics of improvement. Things are getting better at the same time as other things are getting worse. The key question is whether the things getting better can assist with a sufficiently quick reversal of the things that are getting worse.

Second, history has plenty of examples of cooperation between groups of people that previously felt alien or hostile toward each other. What catalyses collaboration is the shared perception of enormous transcendent challenges and opportunities. It’s becoming increasingly clear to governments of all stripes around that world that, if tomorrow’s technology goes wrong, it could prove catastrophic in so many ways. That shared realisation has the potential to inspire political and other leaders to find new methods for collaboration and reconciliation.

As an example, consider various unprecedented measures that followed the tragedies of the Second World War:

  • Marshall Plan investments in Europe and Japan
  • The Bretton Woods framework for economic stability
  • The International Monetary Fund and the World Bank
  • The United Nations.

Third, it’s true that political and other leaders frequently become distracted. They may resolve, for a brief period of time, to seek new international methods for dealing with challenges like the Economic Singularity, but then rush off to whatever new political scandal takes their attention. Accordingly, we should not expect politicians to solve these problems by themselves. But what we can expect them to do is to ask their advisors for suggestions, and these advisors will in turn look to futurist groups around the world for assistance.

C: The vital questions arising

Having laid out my analysis, it’s time to ask for feedback. After all, collaborative intelligence can achieve much more than individual intelligence.

So, what are your views? Do you have anything to add or change regarding the various accounts given above:

  1. Assessments of growing societal inequality
  2. Assessments of the role of new technologies in increasing (or decreasing) inequality
  3. The likely ability of automation technologies, before long, to handle non-routine tasks, including compassion, creativity, and common sense
  4. The plausibility of the “Turing Trap” analysis
  5. Repeated delays in the replacement of GDP with more suitable all-round measures of human flourishing
  6. The ways in which new forms of AI could supercharge centralised planning
  7. The reasons why some recipients of welfare squander the payments they receive
  8. The uses of new technology to address poor emotional health
  9. Plausible vs implausible methods to cover the cost of a UGI (Universal Generous Income)
  10. Goods and services that are critical to sustained personal wellbeing that, however, seem likely to remain expensive for the foreseeable future
  11. Likely cash flows between different countries to enable something like a GUGI (Global Universal Generous Income)
  12. The best ways to catch the attention of society’s leaders so that they understand that the Economic Singularity is an issue that is both pressing and important
  13. The possibility of substantial agreements between countries that have fiercely divergent political systems
  14. The practical implementation of systems that combine top-down and bottom-up approaches to global cooperation
  15. Broader analysis of major trends in the world that capture both what is likely to improve and what is likely to become worse, and of how these various trends could interact
  16. Factors that might undermine the above analysis but which deserve further study.

These are what I call the vital questions regarding possible solutions to the Economic Singularity. They need good answers!

D: References and further reading

This essay first appeared in the 2023 book Future Visions: Approaching the Economic Singularity edited and published by the Omnifuturists. It is republished here with their permission, with some minor changes. Other chapters in that book explore a variety of alternative responses to the Economic Singularity.

The term “The Economic Singularity” was first introduced in 2016 by writer and futurist Calum Chace in the book with that name.

For a particularly good analysis of the issues arising, and why no simple solutions are adequate, see A World Without Work: Technology, Automation, and How We Should Respond by Oxford economist Daniel Susskind (2020).

A longer version of my argument against the “disbelieve” option is contained in Chapter 4, “Work and purpose”, of my 2018 book Transcending Politics: A Technoprogressive Roadmap to a Comprehensively Better Future.

Several arguments in this essay have been anticipated, from a Marxist perspective, by the book Fully Automated Luxury Communism by Aaron Bastani; see here for my extended review of that book.

A useful account of both the strengths and weaknesses of capitalism can be found in the 2020 book More from Less: The Surprising Story of How We Learned to Prosper Using Fewer Resources – and What Happens Next by Andrew McAfee.

The case for the mixed market – and why economic discussion is often distorted by anti-government rhetoric – is covered in American Amnesia: Business, Government, and the Forgotten Roots of Our Prosperity by Jacob S. Hacker and Paul Pierson (2016).

The case that adoption of technology often leads to social harms, including an increase in inequality – and the case for thoughtful governance of how technology is developed and deployed – is given in Power and Progress: Our Thousand-Year Struggle Over Technology and Prosperity by Daron Acemoglu and Simon Johnson (2023).

A marvellous positive account of human nature, especially when humans are placed in positions of trust, is contained in Humankind: A Hopeful History by Rutger Bregman.

Options for reform of geopolitics are discussed – along with prior encouraging examples – in chapter 14 of my 2021 book Vital Foresight: The Case For Active Transhumanism.

14 May 2018

The key questions about UBIA

The first few times I heard about the notion of Universal Basic Income (UBI), I said to myself, that’s a pretty dumb idea.

Paying people without them doing any work is going to cause big problems for society, I thought. It’s going to encourage laziness, and discourage enterprise. Why should people work hard, if the fruits of their endeavour are taken away from them to be redistributed to people who can’t be bothered to work? It’s not fair. And it’s a recipe for social decay.

But since my first encounters with the idea of UBI, my understanding has evolved a long way. I have come to see the idea, not as dumb, but as highly important. Anyone seriously interested in the future of human society ought to keep abreast of the discussion about UBI:

  • What are the strengths and (yes) the weaknesses of UBI?
  • What alternatives could be considered, that have the strengths of UBI but avoid its weaknesses?
  • And, bearing in mind that the most valuable futurist scenarios typically involve the convergence (or clash) of several different trend analyses, what related ideas might transform our understanding of UBI?

For these reasons, I am hosting a day-long London Futurists event at Birkbeck College, Central London, on Saturday 2nd June, with the title “Universal Basic Income and/or Alternatives: 2018 update”.

The event is defined by the question,

What do we know, in June 2018, about Universal Basic Income and its alternatives (UBIA), that wasn’t known, or was less clear, just a few years ago?

The event website highlights various components of that question, which different speakers on the day will address:

  • What are the main risks and issues with the concept of UBIA?
  • How might the ideas of UBIA evolve in the years ahead?
  • If not a UBI, what alternatives might be considered, to meet the underlying requirements which have led many people to propose a UBI?
  • What can we learn from the previous and ongoing experiments in Basic Income?
  • What are the feasible systems (new or increased taxes, or other means) to pay for a UBIA?
  • What steps can be taken to make UBIA politically feasible?
  • What is a credible roadmap for going beyond a “basic” income towards enabling attainment of a “universal prosperity” by everyone?

As you can see from the event website, an impressive list of speakers have kindly agreed to take part. Here’s the schedule for the day:

09:30: Doors open
10:00: Chair’s welcome: The questions that deserve the most attention: David Wood
10:15: Opening keynote: Basic Income – Making it happenProf Guy Standing
11:00: Implications of Information TechnologyProf Joanna Bryson
11:30: Alternatives to UBI – Exploring the PossibilitiesRohit TalwarHelena Calle and Steve Wells
12:15: Q&A involving all morning speakers
12:30: Break for lunch (lunch not provided)

14:00: Basic Income as a policy and a perspective: Barb Jacobson
14:30: Implications of Artificial Intelligence on UBIATony Czarnecki
15:00: Approaching the Economic SingularityCalum Chace
15:30: What have we learned? And what should we do next? David Wood
16:00-16:30: Closing panel involving all speakers
16:30: Event closes. Optional continuation of discussion in nearby pub

A dumb idea?

In the run-up to the UBIA 2018 event, I’ll make a number of blogposts anticipating some of the potential discussion on the day.

First, let me return to the question of whether UBI is a dumb idea. Viewing the topic from the angle of laziness vs. enterprise is only one possible perspective. As is often the case, changing your perspective often provides much needed insight.

Instead, let’s consider the perspective of “social contract”. Reflect on the fact that society already provides money to people who aren’t doing any paid work. There are basic pension payments for everyone (so long as they are old enough), basic educational funding for everyone (so long as they are young enough), and basic healthcare provisions for people when they are ill (in most countries of the world).

These payments are part of what is called a “social contract”. There are two kinds of argument for having a social contract:

  1. Self-interested arguments: as individuals, we might need to take personal benefit of a social contract at some stage in the future, if we unexpectedly fall on hard times. What’s more, if we fail to look after the rest of society, the rest of society might feel aggrieved, and rise up against us, pitchforks (or worse) in hand.
  2. Human appreciation arguments: all people deserve basic stability in their life, and a social contract can play a significant part in providing such stability.

What’s harder, of course, is to agree which kind of social contract should be in place. Whole libraries of books have been written on that question.

UBI can be seen as fitting inside a modification of our social contract. It would be part of what supporters say would be an improved social contract.

Note: although UBI is occasionally suggested as a replacement for the entirety of the current welfare system, it is more commonly (and, in my view, more sensibly) proposed as a replacement for only some of the current programmes.

Proponents of UBI point to two types of reason for including UBI as part of a new social contract:

  1. Timeless arguments – arguments that have been advanced in various ways by people throughout history, such as Thomas More (1516), Montesquieu (1748), Thomas Paine (1795), William Morris (1890), Bertrand Russell (1920), Erich Fromm (1955), Martin Luther King (1967), and Milton Friedman (1969)
  2. Time-linked arguments – arguments that foresee drastically changed circumstances in the relatively near future, which increase the importance of adopting a UBI.

Chief among the time-linked arguments are that the direct and indirect effects of profound technological change is likely to transform the work environment in unprecedented ways. Automation, powered by AI that is increasingly capable, may eat into more and more of the skills that we humans used to think are “uniquely human”. People who expected to earn money by doing various tasks may find themselves unemployable – robots will do these tasks more reliably, more cheaply, and with greater precision. People who spend some time retraining themselves in anticipation of a new occupation may find that, over the same time period, robots have gained the same skills faster than humans.

That’s the argument for growing technological unemployment. It’s trendy to criticise this argument nowadays, but I find the criticisms to be weak. I won’t repeat all the ins and outs of that discussion now, since I’ve covered them at some length in Chapter 4 of my book Transcending Politics. (An audio version of this chapter is currently available to listen to, free of charge, here.)

A related consideration talks, not about technological unemployment, but about technological underemployment. People may be able to find paid work, but that work pays considerably less than they expected. Alternatively, their jobs may have many rubbishy aspects. In the terminology of David Graeber, increasing numbers of jobs are “bullshit jobs”. (Graeber will be speaking on that very topic at the RSA this Thursday. At time of writing, tickets are still available.)

Yet another related concept is that of the precariat – people whose jobs are precarious, since they have no guarantee of the number of hours of work they may receive in any one week. People in these positions would often prefer to be able to leave these jobs and spend a considerable period of time training for a different kind of work – or starting a new business, with all the risks and uncertainties entailed. If a UBI were available to them, it would give them the stability to undertake that personal voyage.

How quickly will technological unemployment and technological underemployment develop? How quickly will the proportion of bullshit jobs increase? How extensive and socially dangerous will the precariat become?

I don’t believe any futurist can provide crisp answers to these questions. There are too many unknowns involved. However, equally, I don’t believe anyone can say categorically that these changes won’t occur (or won’t occur any time soon). My personal recommendation is that society needs to anticipate the serious possibility of relatively rapid acceleration of these trends over the next couple of decades. I’d actually put the probability of a major acceleration in these trends over the next 20 years as greater than 50%. But even if you assess the odds more conservatively, you ought to have some contingency plans in mind, just in case the pace quickens more than you expected.

In other words, the time-linked arguments in favour of exploring a potential UBI have considerable force.

As it happens, the timeless arguments may gain increased force too. If it’s true that the moral arc of history bends upwards – if it’s true that moral sensibilities towards our fellow humans increase over the passage of time – then arguments which at one time fell below society’s moral radar can gain momentum in the light of collective experience and deliberative reflection.

An impractical idea?

Many people who are broadly sympathetic to the principle of UBI nevertheless consider the concept to be deeply impractical. For example, here’s an assessment by veteran economics analyst John Kay, in his recent article “Basic income schemes cannot work and distract from sensible, feasible and necessary welfare reforms”:

The provision of a universal basic income at a level which would provide a serious alternative to low-paid employment is impossibly expensive. Thus, a feasible basic income cannot fulfil the hopes of some of the idea’s promoters: it cannot guarantee households a standard of living acceptable in a modern society, it cannot compensate for the possible disappearance of existing low-skilled employment and it cannot eliminate “bullshit jobs”. Either the level of basic income is unacceptably low, or the cost of providing it is unacceptably high. And, whatever the appeal of the underlying philosophy, that is essentially the end of the matter.

Kay offers this forthright summary:

Attempting to turn basic income into a realistic proposal involves the reintroduction of elements of the benefit system which are dependent on multiple contingencies and also on income and wealth. The outcome is a welfare system which resembles those that already exist. And this is not surprising. The complexity of current arrangements is not the result of bureaucratic perversity. It is the product of attempts to solve the genuinely difficult problem of meeting the variety of needs of low-income households while minimising disincentives to work for households of all income levels – while ensuring that the system established for that purpose is likely to sustain the support of those who are required to pay for it.

I share Piachaud’s conclusion that basic income is a distraction from sensible, feasible and necessary welfare reforms. As in other areas of policy, it is simply not the case that there are simple solutions to apparently difficult issues which policymakers have hitherto been too stupid or corrupt to implement.

Supporters of UBI have rebuttals to this analysis. Some of these rebuttals will no doubt be presented at the UBIA 2018 event on 2nd June.

One rebuttal seeks to rise above “zero sum” considerations. Injecting even a small amount of money into everyone’s hands can have “multiplier” effects, as that new money passes in turn through several people’s hands. One person’s spending is another person’s income, ready for them to spend in turn.

Along similar lines, Professor Guy Standing, who will be delivering the opening keynote at UBIA 2018, urges readers of his book Basic Income: And How We Can Make It Happen to consider positive feedback cycles: “the likely impact of extra spending power on the supply of goods and services”. As he says,

In developing countries, and in low-income communities in richer countries, supply effects could actually lower prices for basic goods and services. In the Indian basic income pilots, villagers’ increased purchasing power led local farmers to plant more rice and wheat, use more fertilizer and cultivate more of their land. Their earnings went up, while the unit price of the food they supplied went down. The same happened with clothes, since several women found it newly worthwhile to buy sewing machines and material. A market was created where there was none before.

A similar response could be expected in any community where there are people who want to earn more and do more, alongside people wanting to acquire more goods and services to improve their living standard.

(I am indebted to Standing’s book for many other insights that have influenced my thinking and, indeed, points raised in this blogpost. It’s well worth reading!)

There’s a broader point that needs to be raised, about the “prices for basic goods and services”. Since a Basic Income needs to cover payments for these goods and services, two approaches are possible:

  1. Seek to raise the level of Basic Income payments
  2. Seek to lower the cost of basic goods and services.

I believe both approaches should be pursued in parallel. The same technologies of automation that pose threats to human employment also hold the promise for creating goods and services at significantly lower costs (and with higher quality). However, any such reduction in cost sits in tension with the prevailing societal focus on boosting economic prices (and increasing GDP). It is for this reason that we need a change of societal values as well as changes in the mechanics of the social contract.

The vision of goods and services having prices approaching zero is, by the way, sometimes called “the Star Trek economy”. Futurist Calum Chace – another of the UBIA 2018 speakers – addresses this topic is his provocatively titled book The Economic Singularity: Artificial intelligence and the death of capitalism. Here’s an extract from one of his blogposts, a “un-forecast” (Chace’s term) for a potential 2050 scenario, “Future Bites 7 – The Star Trek Economy”, featuring Lauren (born 1990):

The race downhill between the incomes of governments and the costs they needed to cover for their citizens was nerve-wracking for a few years, but by the time Lauren hit middle age it was clear the outcome would be good. Most kinds of products had now been converted into services, so cars, houses, and even clothes were almost universally rented rather than bought: Lauren didn’t know anyone who owned a car. The cost of renting a car for a journey was so close to zero that the renting companies – auto manufacturers or AI giants and often both – generally didn’t bother to collect the payment. Money was still in use, but was becoming less and less necessary.

As a result, the prices of most asset classes had crashed. Huge fortunes had been wiped out as property prices collapsed, especially in the hot-spot cities, but few people minded all that much as they could get whatever they needed so easily.

As you may have noticed, the vision of a potential future “Star Trek” economy is part of the graphic design for UBIA 2018.

I’ll share one further comment on the question of the affordability of UBI. Specifically, I’ll quote some comments made by Guardian writer Colin Holtz in the wake of the discovery of the extent of tax evasion revealed by the Panama Papers. The article by Holtz has the title “The Panama Papers prove it: America can afford a universal basic income”. Here’s an extract:

If the super-rich actually paid what they owe in taxes, the US would have loads more money available for public services.

We should all be able to agree: no one should be poor in a nation as wealthy as the US. Yet nearly 15% of Americans live below the poverty line. Perhaps one of the best solutions is also one of the oldest and simplest ideas: everyone should be guaranteed a small income, free from conditions.

Called a universal basic income by supporters, the idea has has attracted support throughout American history, from Thomas Paine to Martin Luther King Jr. But it has also faced unending criticism for one particular reason: the advocates of “austerity” say we simply can’t afford it – or any other dramatic spending on social security.

That argument dissolved this week with the release of the Panama Papers, which reveal the elaborate methods used by the wealthy to avoid paying back the societies that helped them to gain their wealth in the first place…

While working and middle-class families pay their taxes or face consequences, the Panama Papers remind us that the worst of the 1% have, for years, essentially been stealing access to Americans’ common birthright, and to the benefits of our shared endeavors.

Worse, many of those same global elite have argued that we cannot afford to provide education, healthcare or a basic standard of living for all, much less eradicate poverty or dramatically enhance the social safety net by guaranteeing every American a subsistence-level income.

The Tax Justice Network estimates the global elite are sitting on $21–32tn of untaxed assets. Clearly, only a portion of that is owed to the US or any other nation in taxes – the highest tax bracket in the US is 39.6% of income. But consider that a small universal income of $2,000 a year to every adult in the US – enough to keep some people from missing a mortgage payment or skimping on food or medicine – would cost only around $563bn each year.

This takes us from the question of affordability to the question of political feasibility. Read on…

A politically infeasible idea?

A potential large obstacle to adopting UBI is that powerful entities within society will fight hard against it, being opposed to any idea of increased taxation and a decline in their wealth. These entities don’t particularly care that the existing social contract provides a paltry offering to the poor and precarious in society – or to those “inadequates” who happen to lose their jobs and their standing in the economy. The existing social contract provides them personally (and those they consider their peers) with a large piece of the cake. They’d like to keep things that way, thank you very much.

They defend the current setup with ideology. The ideology states that they deserve their current income and wealth, on account of the outstanding contributions they have made to the economy. They have created jobs, or goods, or services of one sort or another, that the marketplace values. And no-one has any right to take their accomplishments away from them.

In other words, they defend the status quo with a theory of value. In order to overcome their resistance to UBIA, I believe we’ll need to tackle this theory of value head on, and provide a better theory in its place. I’ll pick up that thread of thought shortly.

But an implementation of UBI doesn’t need to happen “big bang” style, all at once. It can proceed in stages, starting with a very low level, and (all being well) ramping up from there in phases. The initial payment from UBI could be funded from new types of tax that would, in any case, improve the health of society:

  • A tax on financial transactions (sometimes called a “Tobin tax”) – that will help to put the brakes on accelerated financial services taking place entirely within the financial industry (without directly assisting the real economy)
  • A “Greenhouse gas tax” (such as a “carbon tax”) on activities that generate greenhouse gas pollution.

Continuing the discussion

The #ubia channel in the newly created London Futurists Slack workspace awaits comments on this topic. For a limited time, members and supporters of London Futurists can use this link to join that workspace.

1 January 2017

The best books I read in 2016

Antidotes to the six horsemen of the Trumpocalypse

Here’s one of my deeply held beliefs. We owe it to ourselves to take best advantage of the insights and experiences of those who have gone before us. Where researchers have seen more clearly or understood more deeply than their predecessors or contemporaries, we should pay special attention to their words and concepts. Where these researchers have written books that make accessible key aspects of their hard-won expertise, we should prioritise finding the time to read these books.

But in 2016, not everyone agreed that expertise is worth attention. Experts are over-rated, we heard. The elites deserve a comeuppance.

That sentiment is an ominous echo of the Chinese Cultural Revolution and its opposition to the “four olds” – a revolution which, between the years 1966-1976, resulted in horrific damage to the country and many millions of deaths. A later candid assessment by the Chinese government described that period of wilful ignorance as being

Responsible for the most severe setback and the heaviest losses suffered by the Party, the country, and the people since the founding of the People’s Republic.

I have no truck for those rabble-rousers who declared in 2016 that “we have had enough of experts”. I choose expertise every time, over wishful thinking, hearsay, and dogmatism. I choose to keep on educating myself in the arts of critical thinking, rather than bowing my honest opinion to the rants of the populist press or the false certainties of the demagogues in our midst.

At a time where the six dreadful horsemen of the Trumpocalypse are gathering speed – when perverse interactions are growing more unpredictable between radical over-confidence, divisive boasts of “my tribe first”, enthralment to personal egos, trigger-happy vindictiveness, shameless lying, and fake news designed to inflame rather than to enlighten – we need calm, rational, evidence-based thinking more than ever.

The hard thing, of course, is knowing where true expertise really lies. It can be difficult to distinguish the trustworthy experts from self-declared “experts”. And it is important to perceive the limitations of the expertise of any one person or any one discipline. Thankfully, these tasks can be aided  group intelligence, as we collectively develop an appreciation for which writers are the most reliable in particular areas.

In that spirit, I list below the books that I read and rated as “5 stars” during 2016 on GoodReads. I tend to rate books that highly if:

  • They contain novel material which addresses highly important themes
  • They are well-written – giving good evidence and rationale for the points of view they advance
  • They maintained my interest all the way to the end of the book.

Hopefully my brief reviews will provide some inspiration to guide you in your own reading, research, and projects during 2017. Do let me know.

(Click on any book cover below, to visit the GoodReads page for the book.)

Homo Deus: A Brief History of Tomorrow

homo-deus

Written by Yuval Noah Harari. Of all the books on my list, this is the one that provides the largest perspective. This book explains how the three terrible scourges which have confronted humans throughout history – plague, famine, and war – will be replaced in the 21st century by three huge new projects, labelled as “immortality”, “happiness”, and “divinity”. Here are three brief quotes from Harari’s book on these grand projects:

  • “Struggling against old age and death will merely carry on the time-honoured fight against famine and disease, and manifest the supreme value of contemporary culture: the worth of human life… Modern science and modern culture don’t think of death as a metaphysical mystery, and they certainly don’t view death as the source of life’s meaning. Rather, for modern people death is a technical problem that we can and should solve”
  • “Being happy doesn’t come easy. Despite our unprecedented achievements in the last few decades, it is far from obvious that contemporary people are significantly more satisfied than their ancestors in bygone years. Indeed, it is an ominous sign that despite higher prosperity, comfort and security, the rate of suicide in the developed world is also much higher than in traditional societies… The bad news is that pleasant sensations quickly subside and sooner or later turn into unpleasant ones… This is all the fault of evolution. For countless generations our biochemical system adapted to increasing our chances of survival and reproduction, not our happiness”
  • “In seeking bliss and immortality humans are in fact trying to upgrade themselves into gods. Not just because these are divine qualities, but because in order to overcome old age and misery humans will first have to acquire godlike control of their own biological substratum… If we ever have the power to engineer death and pain out of our system, that same power will probably be sufficient to engineer our system in almost any manner we like, and manipulate our organs, emotions and intelligence in myriad ways. You could buy for yourself the strength of Hercules, the sensuality of Aphrodite, the wisdom of Athena or the madness of Dionysus if that is what you are into.”

Harari’s book also makes plain that these projects risk enormous upheavals in society – potentially facturing humanity into “the near gods” and “the near useless”. Even that thought isn’t the largest in the book. He writes near the end:

  • “The Internet-of-All-Things may soon create such huge and rapid data flows that even upgraded human algorithms cannot handle it. When the car replaced the horse-drawn carriage, we didn’t upgrade the horses – we retired them. Perhaps it is time to do the same with Homo sapiens…”
  • “When genetic engineering and artificial intelligence reveal their full potential, liberalism, democracy and free markets might become as obsolete as flint knives, tape cassettes, Islam and communism.”

I therefore pick Homo Deus: A Brief History of Tomorrow as the single most profound book of 2016.

Note: I presented a personal review of this book near the start of a London Futurists event on the 4th of October. Here’s a video recording:
.

The Story of the Human Body: Evolution, Health, and Disease

the-story-of-the-human-body

Written by Daniel E. Lieberman. This book shares with Homo Deus the fact that it has an enormous scope. It casts a careful eye back over the long prehistory of human (and hominid) evolution, and draws fascinating conclusions about problems of disease and health experienced by people in the 21st century.

The book presents a wealth of compelling evidence about the various stages of evolution between ape and modern-day human. It also introduces the concepts of “dysevolution” and “mismatch diseases”. Aspects of human nature that made great sense in our previous environments sit uneasily in the new environments in which we now exist. This includes aspects of our physiology and aspects of our psychology.

To what extent can these aspects of our physiology and psychology be re-engineered, using 21st century skills in genetics, nanotech, 3D printing, smart drugs, and so so? Lieberman is cautious in drawing conclusions, suggesting that we’ll find it easier to re-engineer our environment than to reengineer ourselves. His view deserves attention, even though I believe he underestimates the pace of forthcoming technological change.

The Industries of the Future

the-industries-of-the-future

Written by Alec J. Ross, who spent four years working as Senior Advisor for Innovation to the Hilary Clinton when she was Secretary of State for Defence. The style of writing is highly accessible to people in political roles – whether in office, in the civil service, or in an advisory capacity.

The subjects Ross covers – including robots, genomics, cryptocurrency, cyberwarfare, big data, and the Internet of Things – can also be found in books by other futurists. But he provides a refreshingly international perspective, highlighting ways in which different parts of the world are adapting (or failing to adapt) to various technological trends. He also has a candid view on potential downsides to these technology trends, alongside their potential upsides. He gives plenty of reasons for believing that there will many large changes ahead, but he emphasises that the actual outcomes will need careful shepherding.

If Hilary Clinton had become the US President, I would have felt comfortable in knowing that she could draw on insight about future trends from such a well-informed, balanced advisor. This is not an author who offers brash over-confidence or wishful thinking.

Bitcoin: the Future of Money?

bitcoin-the-future-of-money

Written by Dominic Frisby. Bitcoin, along with its underlying “blockchain” technology, remains the subject of a great deal of speculation as 2016 draws to a close. I read a number of books on this topic in the last 12 months. Of these books, this was the one I enjoyed the most.

Frisby has a pleasant conversational style, but also has an eye for the big picture. Bitcoin/blockchain is too important a topic to ignore. The biggest disruptions it creates may well be in areas outside of present-day mainstream focus.

London Futurists will be returning to Bitcoin and/or blockchain several times in the months ahead. Watch this space!

The Future of the Professions: How Technology Will Transform the Work of Human Experts

the-future-of-the-professions

Written by by Richard Susskind and Daniel Susskind. This book provides a comprehensive account of how technology and automation are transforming work within professions such as law, auditing, education, architecture, healthcare, accounting, and the clergy.

The writers – a father and son – have been researching this field since the 1980s. They have interviewed leading practitioners from numerous professions, and are fully aware of the arguments as to why automation will slow down in its impact on the workforce. They assess these arguments at great length (perhaps almost too fully), and give strong reasons why all professions will, on the contrary, be significantly transformed by ever-more powerful software in the decades ahead. As they make clear, this is not something to be feared, but is something that will provide low-cost high-quality expertise to ever-larger numbers of people – rather than such expertise being accessible to the wealthy.

Inventing the Future: Postcapitalism and a World Without Work

inventing-the-future

Written by Nick Srnicek and Alex Williams. This book makes a powerful case that movements for political change need to find a powerful over-arching positive vision. Merely “occupying” and “criticising” isn’t going to take things very far.

The vision offered in this book is that automation, rather than being seen as a threat to jobs, should be embraced as a precondition for a new society in which people no longer need to work.

Note: the authors gave a presentation about their ideas at a London Futurists event on the 20th of August. Here’s the video recording from that event:

The Economic Singularity: Artificial intelligence and the death of capitalism

the-economic-singularity

Written by Calum Chace. This book is the third on my list that focuses on technological unemployment as caused by automation and AI (artificial intelligence). Of the three, it’s probably the easiest to read, and the one that paints the widest context.

Like Srnicek and Williams (the authors of Inventing the Future: Postcapitalism and a World Without Work), Chace foresees that technological unemployment may portend the end of capitalism. Whether this forthcoming “Economic Singularity” will be a positive or negative development remains to be seen. The Economic Singularity therefore shares some of the characteristics of the “Technological Singularity”, which Chace also covers in this book.

Note: the author gave a presentation on his ideas to London Futurists on the 8th of October. Here’s the video recording:
.

The Gene: An Intimate History

the-gene-an-intimate-history

Written by Siddhartha Mukherjee. This book covers the history of ideas and experiments on the subject of genetic inheritance, from the thinkers of ancient Greece right up to the latest research. Along the way, the author weaves in accounts from the medical experiences of his own family members that suffered from inherited diseases. He is a compelling story-teller. He is also an accomplished cancer physician, with training from Stanford University, University of Oxford, Harvard Medical School, and Columbia University Medical Center.

I was familiar with many of the historical episodes from my own prior reading, but I learnt a great deal from the additional material assembled by Mukherjee – for example about the attempts at different times by eugenics enthusiasts to alter society by human interference with “natural selection”. The book is particularly strong on the interplay of nature and nurture.

I also appreciated the way the author highlighted the drawbacks of the haphazard quality control  in the early experiments in gene replacement therapies – experiments with tragic consequences. The lack of care in these experiments led to an understandable institutional backlash which arguably set back this field of therapies by around a decade.

By the time I read this book, I had already published my own book “The Abolition of Aging: The forthcoming radical extension of healthy human longevity”. I was relieved to find no reason to alter any of the conclusions or recommendations in my book as a result of the magisterial quantity of research reviewed by Mukherjee.

The Youth Pill: Scientists at the Brink of an Anti-Aging Revolution

the-youth-pill

Written by David Stipp. During the course of writing my own book “The Abolition of Aging” I consulted many books on medical treatments for anti-aging. I read this particular book all the way through, twice, at different stages of my research.

Stipp has been writing on the subject of medicine and aging for leading publications such as the Wall Street Journal and Fortune since the early 1980s. Over that time, he has built up an impressive set of contacts within the industry.

Stipp’s book is full of fascinating nuggets of insight, including useful biographical background details about many of the researchers who are pushing back the boundaries of knowledge in what is still a relatively young field.

Inhuman Bondage: The Rise and Fall of Slavery in the New World

inhuman-bondage

Written by David Brion Davis. This sweeping account of the history of slavery draws on many decades of the author’s research as one of the preeminent researchers in the field. The book interweaves heart-rending accounts with careful reflection. This is a story that includes both dreadful low points and inspiring high points of human behaviour. There’s a great deal to be learned from it.

Davis quotes with approval the prominent Irish historian W.E.H. Lecky who concluded in 1869 that:

The unwearied, unostentatious, and inglorious crusade of England against slavery very may probably be regarded as among the three or four perfectly virtuous acts recorded in the history of nations.

The thorough analysis by Davis makes it clear that:

  • The abolition of slavery was by no means inevitable or predetermined
  • There were strong arguments against the abolition of slavery – arguments raised by clever, devout people in both the United States and the United Kingdom – arguments concerning economic well-being, among many other factors
  • The arguments of the abolitionists were rooted in a conception of a better way of being a human – a way that avoided the harsh bondage and subjugation of the slave trade, and which would in due course enable many millions of people to fulfil a much greater potential
  • The cause of the abolition of slavery was significantly advanced by public activism – including pamphlets, lectures, petitions, and municipal meetings
  • The abolition of slavery cannot be properly understood without appreciating the significance of moral visions that “could transcend narrow self-interest and achieve genuine reform.”

On reason I read this book was to consider the strengths of a comparison I wanted to make in my own writing: a comparison between the abolition of slavery and the abolition of aging. My conclusion is that the comparison is a good one – although I recognise that some readers find it shocking:

  • With its roots in the eighteenth century, and growing in momentum as the nineteenth century proceeded, the abolition of slavery eventually became an idea whose time had come – thanks to brave, smart, persistent activism by men and women with profound conviction
  • With a different set of roots in the late twentieth century, and growing in momentum as the twenty-first century proceeds, the abolition of aging can, likewise, become an idea whose time has come. It’s an idea about an overwhelmingly better future for humanity – a future that will allow billions of people to fulfil a much greater potential. But as well as excellent engineering – the creation of reliable, accessible rejuvenation therapies – this project will also require brave, smart, persistent activism, to change the public landscape from one hostile (or apathetic) to rejuveneering into one that deeply supports it.

American Amnesia: Business, Government, and the Forgotten Roots of Our Prosperity

american-amnesia

Written by Jacob S. Hacker and Paul Pierson. Many of the great social reforms of the last few centuries required sustained government action to make them happen. But governments need to work effectively alongside the remarkable capabilities of the market economy. Getting the right balance between these two primal forces is crucial.

The authors of this book defend a very interesting viewpoint, namely that the mixed economy was the most important social innovation of the 20th century:

The mixed economy spread a previously unimaginable level of broad prosperity. It enabled steep increases in education, health, longevity, and economic security.

They explain the mixed economy by an elaboration of Adam Smith’s notion of “the invisible hand”:

The political economist Charles Lindblom once described markets as being like fingers: nimble and dexterous. Governments, with their capacity to exercise authority, are like thumbs: powerful but lacking subtlety and flexibility. The invisible hand is all fingers. The visible hand is all thumbs. Of course, one wouldn’t want to be all thumbs. But one wouldn’t want to be all fingers either. Thumbs provide countervailing power, constraint, and adjustments to get the best out of those nimble fingers.

The authors’ characterisation of the positive role of government is, to my mind, spot on correct. It’s backed up by lots of instructive episodes from American history, going all the way back to the revolutionary founders:

  • Governments provide social coordination of a type that fails to arise by other means of human interaction, such as free markets
  • Markets can accomplish a great deal, but they’re far from all-powerful. Governments ensure that suitable investment takes place of the sort that would not happen, if it was left to each individual to decide by themselves. Governments build up key infrastructure where there is no short-term economic case for individual companies to invest to create it
  • Governments defend the weak from the powerful. They defend those who lack the knowledge to realise that vendors may be on the point of selling them a lemon and then beating a hasty retreat. They take actions to ensure that social free-riders don’t prosper, and that monopolists aren’t able to take disproportionate advantage of their market dominance
  • Governments prevent all the value in a market from being extracted by forceful, well-connected minority interests, in ways that would leave the rest of society impoverished. They resist the power of “robber barons” who would impose numerous tolls and charges, stifling freer exchange of ideas, resources, and people. Therefore governments provide the context in which free markets can prosper (but which those free markets, by themselves, could not deliver).

It’s a deeply troubling development that the positive role of enlightened government is something that is increasingly poorly understood. Instead, as a result of a hostile barrage of ideologically-driven misinformation, more and more people are calling for a reduction in the scope and power of government. This book describes that process as a form of collective “amnesia” (forgetfulness). It was one of the most frightening books I read in 2016.

In describing this book as “frightening”, I don’t mean that the book is bad. Far from it. What’s frightening is the set of information clearly set out in the book:

  • The growing public hostility, especially in America (but shared elsewhere, to an extent) towards the idea that government should be playing any significant role in the well-being of society
  • The growing identification of government with self-serving empire-building bureaucracy
  • The widespread lack of understanding of the remarkable positive history of public action by governments that promoted overall social well-being (that is the “amnesia” of the title of the book)
  • The decades-long growing tendency of many in America – particularly from the Republicans – to denigrate and belittle the role of government, for their own narrow interests
  • The decades-long growing tendency of many others in America to keep quiet, in the face of Republican tirades against government, rather than speaking up to defend it.

I listened to the concluding chapters of American Amnesia during the immediate aftermath of the referendum in the UK on the merits of remaining within the EU. The parallels were chilling:

  • In the EU, the positive role of EU governance has been widely attacked, over many decades, and only weakly defended. This encouraged a widespread popular hostility towards all aspects of EU governance
  • In the US, the positive role of US governance has been widely attacked, over many decades, and only weakly defended. This encouraged a widespread popular hostility towards all aspects of US governance. The commendable ambitions of the Obama government therefore ran into all sorts of bitter opposition.

I wrote the following in July, in a Transpolitica review article “Flawed humanity, flawed politics”:

The parallels might run one step further. To me, and many others, it was almost unthinkable that the referendum in the UK would come down in favour of leaving the EU. Likewise, it’s unthinkable to many in the US that Donald Trump will receive a popular mandate in the forthcoming November elections.

But all bets are off if the electorate (1) Feel sufficiently alienated; (2) Imbibe a powerful sense of grievance towards “the others” who are perceived to run government; (3) Lack a positive understanding of the actual role of big government.

I take no pleasure in what turned out to be the prescience of those remarks. That was a prediction where I did not want to be correct.

And the Weak Suffer What They Must?: Europe’s Crisis and America’s Economic Future

and-the-weak-suffer-what-they-must

Written by Yanis Varoufakis. This book has some striking parallels with American Amnesia: the author provides an gripping survey of many parts of history that have consequences for the present time. Varoufakis focuses on the development of the European Union.

Time and again I discovered in the pages of this book important new aspects of events that I thought I already knew well, but where it turned out there were key connections that I had missed. In short, the book is full of powerful back stories to the current EU situation.

Whilst supporting many of the ideals of the EU, Varoufakis is an incisive critic of many of its aspects. Like the supporters of Brexit, he sees plenty that is deeply dysfunctional about  the current organisation of the EU. However, he believes that fixing the EU is both more practical and more desirable than turning our backs on it, and hoping to benefit from its likely subsequent unravelling. Varoufakis is one the leaders of the DiEM25 movement that describes itself as follows:

DiEM25 is a pan-European, cross-border movement of democrats.

We believe that the European Union is disintegrating. Europeans are losing their faith in the possibility of European solutions to European problems. At the same time as faith in the EU is waning, we see a rise of misanthropy, xenophobia and toxic nationalism.

If this development is not stopped, we fear a return to the 1930s. That is why we have come together despite our diverse political traditions – Green, radical left, liberal – in order to repair the EU. The EU needs to become a realm of shared prosperity, peace and solidarity for all Europeans. We must act quickly, before the EU disintegrates.

I expect the influence of DiEM25 to grow during the next few months, as the public discussion about the future of Europe becomes more contentious. They’re holding a public meeting in London on the evening of Friday 27th January:

A troubled Britain is on its way out of a troubled European Union. Disintegration and xenophobia are in the air. The government in London is in disarray. But so is every other government in Europe, not to mention the European Commission whose authority is tending increasingly towards zero.

The only forces to be gathering strength everywhere are those of what might be called a Nationalist International, spreading their belligerent reach to Trump’s America. Bellicose nativism is on the rise propagating a thinly-veiled discursive ethnic cleansing. Even sections of the Left are succumbing to arguments in favour of retreating behind the nation-state and stricter border controls.

Srećko Horvat, a Croat philosopher, Elif Shafak, renowned Turkish novelist, and Yanis Varoufakis, Greece’s former finance minister, bring to this conversation an intriguing perspective. As intellectuals who know Britain well, they understand first hand the perils of nationalism, disintegration, isolationism and marginalisation. They will place post-Brexit Britain in a context informed by a view of Europe and Britain from the continent’s opposite ‘corner’, sharing insights from Greece’s tensions with Brussels and Berlin, Yugoslavia’s disintegration, and Turkey’s fraught relationship with a Europe that both courts and marginalises it.

Moderated by Owen Jones, a passionate campaigner for a quite different Britain in a quite different Europe, it promises to be an evening that restores confidence in Britain’s and Europe’s humanist and internationalist potential.

I’m looking forward to it!

Red Notice: A True Story of High Finance, Murder, and One Man’s Fight for Justice

red-notice

Written by Bill Browder. Any vision for a better future needs to include an assessment of the power and intentions of the regime of Vladimir Putin in Russia. Since there are many dark clouds on the international horizon, it’s understandable that some thinkers are clutching at straws of hope that Putin could become a reliable partner in the evolution of the international system. Perhaps. But any such thoughts need to be well aware of the horrific dark side of the Kremlin. We would be foolish to risk rose-tinted spectacles in this case.

This book provides ample documentation of many truly shocking abuses of power in Russia. Browder has an intriguing personal back story, which takes up the first half of the book. This part of the book explains how Browder’s investment fund Hermitage Capital, came to be the leading non-Russian participant in Russia companies following the wave of post-Soviet privatisations. It also explains Browder’s fierce legal conflicts with some of the Russian oligarchs, as Browder sought to prevent further fleecing of the assets of companies in which he had invested.

For a while, it seems that Putin supported what Browder was doing. But then Browder became an increasing annoyance to the Kremlin. What happens next is astonishing. Of all the books I read in 2016, this was the most gripping.

Browder is sometimes described as “Putin’s No. 1 enemy”. The book provides considerable justification for that claim. The story is by no means over. Browder continues to speak publicly about his story: I saw him speak at the Wired 2016 event in November in London. I commend the Wired organisers for having the breadth of vision to provide Browder with a key speaking slot.

Politics: Between the Extremes

politics-between-the-extremes

Written by Nick Clegg. Clegg is the former leader of the Liberal Democrat party who was deputy prime minister of the UK from 2010 to 2015. His subsequent fall from power, as the LibDems were trounced in the May 2015 general election, was harsh and bitter. Huge numbers of former supporters of the party turned against it.

Nevertheless, Clegg is one of the most thoughtful politicians in the UK today. His book includes candid assessments of the mistakes he made, and his regrets for not doing things differently. One of the biggest regrets is not paying more attention to matters of communication: the LibDems frequently failed to get the credit for important contributions to the coalition government. As such, the party was out-manoeuvred by more powerful forces.

The book is an eloquent appeal for greater “liberalism” in politics – less certainty and dogmatism, more tolerance of diversity, more openness to new opportunities, and more willingness to embrace tricky coalitions. Despite the notes of sadness in the book, there are real grounds for optimism too.

Clegg comes across in the book the same as I have observed from several public events where I have seen him speak at close hand – as an eminently likeable person, honest about his mistakes, with a passionate belief in better politics and a willingness to build bridges. I’m sure we’ll be seeing more of him in 2017.

Scrum: The Art of Doing Twice the Work in Half the Time

scrum

Written by Jeff Sutherland. No matter how much we improve our foresight skills, we’re still likely to encounter surprises as our projects unfold. The world is full of uncertainty. We therefore need to improve our agility skills in parallel with our foresight skills. Agility gives us the ability to change our focus quickly, in the light of better feedback about likely future scenarios.

Scrum is one of the most influential sets of practice for agile working. This book, by one of the co-creators of Scrum, makes it clear that Scrum has wide applicability beyond the context of software development in which it initially grew to fame. Sutherland provides a host of telling examples of how large, cumbersome projects could be transformed into sleeker, more effective vehicles by the application of Scrum ideas such as sprints, scrum masters, transparency, estimation, waste management, and pivots.

If anyone ever feels overwhelmed by having too much to do – or too much to think about – the ideas in Sutherland’s book could help you break out from being bogged down in analysis-paralysis.

In my own futurist consulting activities, I’m finding that professional audiences are showing increasing interest in the few slides I sometimes include on the topic of “Agile futurism”. Perhaps I ought to flesh out these slides into a new service offering in its own right!

books-2016

11 April 2015

Opening Pandora’s box

Should some conversations be suppressed?

Are there ideas which could prove so incendiary, and so provocative, that it would be better to shut them down?

Should some concepts be permanently locked into a Pandora’s box, lest they fly off and cause too much chaos in the world?

As an example, consider this oft-told story from the 1850s, about the dangers of spreading the idea of that humans had evolved from apes:

It is said that when the theory of evolution was first announced it was received by the wife of the Canon of Worcester Cathedral with the remark, “Descended from the apes! My dear, we will hope it is not true. But if it is, let us pray that it may not become generally known.”

More recently, there’s been a growing worry about spreading the idea that AGI (Artificial General Intelligence) could become an apocalyptic menace. The worry is that any discussion of that idea could lead to public hostility against the whole field of AGI. Governments might be panicked into shutting down these lines of research. And self-appointed militant defenders of the status quo might take up arms against AGI researchers. Perhaps, therefore, we should avoid any public mention of potential downsides of AGI. Perhaps we should pray that these downsides don’t become generally known.

tumblr_static_transcendence_rift_logoThe theme of armed resistance against AGI researchers features in several Hollywood blockbusters. In Transcendence, a radical anti-tech group named “RIFT” track down and shoot the AGI researcher played by actor Johnny Depp. RIFT proclaims “revolutionary independence from technology”.

As blogger Calum Chace has noted, just because something happens in a Hollywood movie, it doesn’t mean it can’t happen in real life too.

In real life, “Unabomber” Ted Kaczinski was so fearful about the future destructive potential of technology that he sent 16 bombs to targets such as universities and airlines over the period 1978 to 1995, killing three people and injuring 23. Kaczinski spelt out his views in a 35,000 word essay Industrial Society and Its Future.

Kaczinki’s essay stated that “the Industrial Revolution and its consequences have been a disaster for the human race”, defended his series of bombings as an extreme but necessary step to attract attention to how modern technology was eroding human freedom, and called for a “revolution against technology”.

Anticipating the next Unabombers

unabomber_ely_coverThe Unabomber may have been an extreme case, but he’s by no means alone. Journalist Jamie Bartlett takes up the story in a chilling Daily Telegraph article “As technology swamps our lives, the next Unabombers are waiting for their moment”,

In 2011 a new Mexican group called the Individualists Tending toward the Wild were founded with the objective “to injure or kill scientists and researchers (by the means of whatever violent act) who ensure the Technoindustrial System continues its course”. In 2011, they detonated a bomb at a prominent nano-technology research centre in Monterrey.

Individualists Tending toward the Wild have published their own manifesto, which includes the following warning:

We employ direct attacks to damage both physically and psychologically, NOT ONLY experts in nanotechnology, but also scholars in biotechnology, physics, neuroscience, genetic engineering, communication science, computing, robotics, etc. because we reject technology and civilisation, we reject the reality that they are imposing with ALL their advanced science.

Before going any further, let’s agree that we don’t want to inflame the passions of would-be Unabombers, RIFTs, or ITWs. But that shouldn’t lead to whole conversations being shut down. It’s the same with criticism of religion. We know that, when we criticise various religious doctrines, it may inflame jihadist zeal. How dare you offend our holy book, and dishonour our exalted prophet, the jihadists thunder, when they cannot bear to hear our criticisms. But that shouldn’t lead us to cowed silence – especially when we’re aware of ways in which religious doctrines are damaging individuals and societies (by opposition to vaccinations or blood transfusions, or by denying female education).

Instead of silence (avoiding the topic altogether), what these worries should lead us to is a more responsible, inclusive, measured conversation. That applies for the drawbacks of religion. And it applies, too, for the potential drawbacks of AGI.

Engaging conversation

The conversation I envisage will still have its share of poetic effect – with risks and opportunities temporarily painted more colourfully than a fully sober evaluation warrants. If we want to engage people in conversation, we sometimes need to make dramatic gestures. To squeeze a message into a 140 character-long tweet, we sometimes have to trim the corners of proper spelling and punctuation. Similarly, to make people stop in their tracks, and start to pay attention to a topic that deserves fuller study, some artistic license may be appropriate. But only if that artistry is quickly backed up with a fuller, more dispassionate, balanced analysis.

What I’ve described here is a two-phase model for spreading ideas about disruptive technologies such as AGI:

  1. Key topics can be introduced, in vivid ways, using larger-than-life characters in absorbing narratives, whether in Hollywood or in novels
  2. The topics can then be rounded out, in multiple shades of grey, via film and book reviews, blog posts, magazine articles, and so on.

Since I perceive both the potential upsides and the potential downsides of AGI as being enormous, I want to enlarge the pool of people who are thinking hard about these topics. I certainly don’t want the resulting discussion to slide off to an extreme point of view which would cause the whole field of AGI to be suspended, or which would encourage active sabotage and armed resistance against it. But nor do I want the discussion to wither away, in a way that would increase the likelihood of adverse unintended outcomes from aberrant AGI.

Welcoming Pandora’s Brain

cropped-cover-2That’s why I welcome the recent publication of the novel “Pandora’s Brain”, by the above-mentioned blogger Calum Chace. Pandora’s Brain is a science and philosophy thriller that transforms a series of philosophical concepts into vivid life-and-death conundrums that befall the characters in the story. Here’s how another science novellist, William Hertling, describes the book:

Pandora’s Brain is a tour de force that neatly explains the key concepts behind the likely future of artificial intelligence in the context of a thriller novel. Ambitious and well executed, it will appeal to a broad range of readers.

In the same way that Suarez’s Daemon and Naam’s Nexus leaped onto the scene, redefining what it meant to write about technology, Pandora’s Brain will do the same for artificial intelligence.

Mind uploading? Check. Human equivalent AI? Check. Hard takeoff singularity? Check. Strap in, this is one heck of a ride.

Mainly set in the present day, the plot unfolds in an environment that seems reassuringly familiar, but which is overshadowed by a combination of both menace and promise. Carefully crafted, and absorbing from its very start, the book held my rapt attention throughout a series of surprise twists, as various personalities react in different ways to a growing awareness of that menace and promise.

In short, I found Pandora’s Brain to be a captivating tale of developments in artificial intelligence that could, conceivably, be just around the corner. The imminent possibility of these breakthroughs cause characters in the book to re-evaluate many of their cherished beliefs, and will lead most readers to several “OMG” realisations about their own philosophies of life. Apple carts that are upended in the processes are unlikely ever to be righted again. Once the ideas have escaped from the pages of this Pandora’s box of a book, there’s no going back to a state of innocence.

But as I said, not everyone is enthralled by the prospect of wider attention to the “menace” side of AGI. Each new novel or film in this space has the potential of stirring up a negative backlash against AGI researchers, potentially preventing them from doing the work that would deliver the powerful “promise” side of AGI.

The dual potential of AGI

FLIThe tremendous dual potential of AGI was emphasised in an open letter published in January by the Future of Life Institute:

There is now a broad consensus that AI research is progressing steadily, and that its impact on society is likely to increase. The potential benefits are huge, since everything that civilization has to offer is a product of human intelligence; we cannot predict what we might achieve when this intelligence is magnified by the tools AI may provide, but the eradication of disease and poverty are not unfathomable. Because of the great potential of AI, it is important to research how to reap its benefits while avoiding potential pitfalls.

“The eradication of disease and poverty” – these would be wonderful outcomes from the project to create AGI. But the lead authors of that open letter, including physicist Stephen Hawking and AI professor Stuart Russell, sounded their own warning note:

Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks. In the near term, world militaries are considering autonomous-weapon systems that can choose and eliminate targets; the UN and Human Rights Watch have advocated a treaty banning such weapons. In the medium term, as emphasised by Erik Brynjolfsson and Andrew McAfee in The Second Machine Age, AI may transform our economy to bring both great wealth and great dislocation…

One can imagine such technology outsmarting financial markets, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand. Whereas the short-term impact of AI depends on who controls it, the long-term impact depends on whether it can be controlled at all.

They followed up with this zinger:

So, facing possible futures of incalculable benefits and risks, the experts are surely doing everything possible to ensure the best outcome, right? Wrong… Although we are facing potentially the best or worst thing to happen to humanity in history, little serious research is devoted to these issues outside non-profit institutes… All of us should ask ourselves what we can do now to improve the chances of reaping the benefits and avoiding the risks.

Criticisms

Critics give a number of reasons why they see these fears as overblown. To start with, they argue that the people raising the alarm – Stephen Hawking, serial entrepreneur Elon Musk, Oxford University philosophy professor Nick Bostrom, and so on – lack their own expertise in AGI. They may be experts in black hole physics (Hawking), or in electric cars (Musk), or in academic philosophy (Bostrom), but that gives them no special insights into the likely course of development of AGI. Therefore we shouldn’t pay particular attention to what they say.

A second criticism is that it’s premature to worry about the advent of AGI. AGI is still situated far into the future. In this view, as stated by Demis Hassabis, founder of DeepMind,

We’re many, many decades away from anything, any kind of technology that we need to worry about.

The third criticism is that it will be relatively simple to stop AGI causing any harm to humans. AGI will be a tool to humans, under human control, rather than having its own autonomy. This view is represented by this tweet by science populariser Neil deGrasse Tyson:

Seems to me, as long as we don’t program emotions into Robots, there’s no reason to fear them taking over the world.

I hear all these criticisms, but they’re by no means the end of the discussion. They’re no reason to terminate the discussion about AGI risks. That’s the argument I’m going to make in the remainder of this blogpost.

By the way, you’ll find all these of these criticisms mirrored in the course of the novel Pandora’s Brain. That’s another reason I recommend that people should read that book. It manages to bring a great deal of serious arguments to the table, in the course of entertaining (and sometimes frightening) the reader.

Answering the criticisms: personnel

Elon Musk, one of the people who have raised the alarm about AGI risks, lacks any PhD in Artificial Intelligence to his name. It’s the same with Stephen Hawking and with Nick Bostrom. On the other hand, others who are raising the alarm do have relevant qualifications.

AI a modern approachConsider as just one example Stuart Russell, who is a computer-science professor at the University of California, Berkeley and co-author of the 1152-page best-selling text-book “Artificial Intelligence: A Modern Approach”. This book is described as follows:

Artificial Intelligence: A Modern Approach, 3rd edition offers the most comprehensive, up-to-date introduction to the theory and practice of artificial intelligence. Number one in its field, this textbook is ideal for one or two-semester, undergraduate or graduate-level courses in Artificial Intelligence.

Moreover, other people raising the alarm include some the giants of the modern software industry:

Wozniak put his worries as follows – in an interview for the Australian Financial Review:

“Computers are going to take over from humans, no question,” Mr Wozniak said.

He said he had long dismissed the ideas of writers like Raymond Kurzweil, who have warned that rapid increases in technology will mean machine intelligence will outstrip human understanding or capability within the next 30 years. However Mr Wozniak said he had come to recognise that the predictions were coming true, and that computing that perfectly mimicked or attained human consciousness would become a dangerous reality.

“Like people including Stephen Hawking and Elon Musk have predicted, I agree that the future is scary and very bad for people. If we build these devices to take care of everything for us, eventually they’ll think faster than us and they’ll get rid of the slow humans to run companies more efficiently,” Mr Wozniak said.

“Will we be the gods? Will we be the family pets? Or will we be ants that get stepped on? I don’t know about that…

And here’s what Bill Gates said on the matter, in an “Ask Me Anything” session on Reddit:

I am in the camp that is concerned about super intelligence. First the machines will do a lot of jobs for us and not be super intelligent. That should be positive if we manage it well. A few decades after that though the intelligence is strong enough to be a concern. I agree with Elon Musk and some others on this and don’t understand why some people are not concerned.

Returning to Elon Musk, even his critics must concede he has shown remarkable ability to make new contributions in areas of technology outside his original specialities. Witness his track record with PayPal (a disruption in finance), SpaceX (a disruption in rockets), and Tesla Motors (a disruption in electric batteries and electric cars). And that’s even before considering his contributions at SolarCity and Hyperloop.

Incidentally, Musk puts his money where his mouth is. He has donated $10 million to the Future of Life Institute to run a global research program aimed at keeping AI beneficial to humanity.

I sum this up as follows: the people raising the alarm in recent months about the risks of AGI have impressive credentials. On occasion, their sound-bites may cut corners in logic, but they collectively back up these sound-bites with lengthy books and articles that deserve serious consideration.

Answering the criticisms: timescales

I have three answers to the comment about timescales. The first is to point out that Demis Hassabis himself sees no reason for any complacency, on account of the potential for AGI to require “many decades” before it becomes a threat. Here’s the fuller version of the quote given earlier:

We’re many, many decades away from anything, any kind of technology that we need to worry about. But it’s good to start the conversation now and be aware of as with any new powerful technology it can be used for good or bad.

(Emphasis added.)

Second, the community of people working on AGI has mixed views on timescales. The Future of Life Institute ran a panel discussion in Puerto Rico in January that addressed (among many other topics) “Creating human-level AI: how and when”. Dileep George of Vicarious gave the following answer about timescales in his slides (PDF):

Will we solve the fundamental research problems in N years?

N <= 5: No way
5 < N <= 10: Small possibility
10 < N <= 20: > 50%.

In other words, in his view, there’s a greater than 50% chance that artificial general human-level intelligence will be solved within 20 years.

SuperintelligenceThe answers from the other panellists aren’t publicly recorded (the event was held under Chatham House rules). However, Nick Bostrom has conducted several surveys among different communities of AI researchers. The results are included in his book Superintelligence: Paths, Dangers, Strategies. The communities surveyed included:

  • Participants at an international conference: Philosophy & Theory of AI
  • Participants at another international conference: Artificial General Intelligence
  • The Greek Association for Artificial Intelligence
  • The top 100 cited authors in AI.

In each case, participants were asked for the dates when they were 90% sure human-level AGI would be achieved, 50% sure, and 10% sure. The average answers were:

  • 90% likely human-level AGI is achieved: 2075
  • 50% likely: 2040
  • 10% likely: 2022.

If we respect what this survey says, there’s at least a 10% chance of breakthrough developments within the next ten years. Therefore it’s no real surprise that Hassabis says

It’s good to start the conversation now and be aware of as with any new powerful technology it can be used for good or bad.

Third, I’ll give my own reasons for why progress in AGI might speed up:

  • Computer hardware is likely to continue to improve – perhaps utilising breakthroughs in quantum computing
  • Clever software improvements can increase algorithm performance even more than hardware improvements
  • Studies of the human brain, which are yielding knowledge faster than ever before, can be translated into “neuromorphic computing”
  • More people are entering and studying AI than ever before, in part due to MOOCs, such as that from Stanford University
  • There are more software components, databases, tools, and methods available for innovative recombination
  • AI methods are being accelerated for use in games, financial trading, malware detection (and in malware itself), and in many other industries
  • There could be one or more “Sputnik moments” causing society to buckle up its motivation to more fully support AGI research (especially when AGI starts producing big benefits in healthcare diagnosis).

Answering the critics: control

I’ve left the hardest question to last. Could there be relatively straightforward ways to keep AGI under control? For example, would it suffice to avoid giving AGI intentions, or emotions, or autonomy?

For example, physics professor and science populariser Michio Kaku speculates as follows:

No one knows when a robot will approach human intelligence, but I suspect it will be late in the 21st century. Will they be dangerous? Possibly. So I suggest we put a chip in their brain to shut them off if they have murderous thoughts.

And as mentioned earlier, Neil deGrasse Tyson proposes,

As long as we don’t program emotions into Robots, there’s no reason to fear them taking over the world.

Nick Bostrom devoted a considerable portion of his book to this “Control problem”. Here are some reasons I think we need to continue to be extremely careful:

  • Emotions and intentions might arise unexpectedly, as unplanned side-effects of other aspects of intelligence that are built into software
  • All complex software tends to have bugs; it may fail to operate in the way that we instruct it
  • The AGI software will encounter many situations outside of those we explicitly anticipated; the response of the software in these novel situations may be to do “what we asked it to do” but not what we would have wished it to do
  • Complex software may be vulnerable to having its functionality altered, either by external hacking, or by well-intentioned but ill-executed self-modification
  • Software may find ways to keep its inner plans hidden – it may have “murderous thoughts” which it prevents external observers from noticing
  • More generally, black-box evolution methods may result in software that works very well in a large number of circumstances, but which will go disastrously wrong in new circumstances, all without the actual algorithms being externally understood
  • Powerful software can have unplanned adverse effects, even without any consciousness or emotion being present; consider battlefield drones, infrastructure management software, financial investment software, and nuclear missile detection software
  • Software may be designed to be able to manipulate humans, initially for purposes akin to advertising, or to keep law and order, but these powers may evolve in ways that have worse side effects.

A new Columbus?

christopher-columbus-shipsA number of the above thoughts started forming in my mind as I attended the Singularity University Summit in Seville, Spain, a few weeks ago. Seville, I discovered during my visit, was where Christopher Columbus persuaded King Ferdinand and Queen Isabella of Spain to fund his proposed voyage westwards in search of a new route to the Indies. It turns out that Columbus succeeded in finding the new continent of America only because he was hopelessly wrong in his calculation of the size of the earth.

From the time of the ancient Greeks, learned observers had known that the earth was a sphere of roughly 40 thousand kilometres in circumference. Due to a combination of mistakes, Columbus calculated that the Canary Islands (which he had often visited) were located only about 4,440 km from Japan; in reality, they are about 19,000 km apart.

Most of the countries where Columbus pitched the idea of his westward journey turned him down – believing instead the figures for the larger circumference of the earth. Perhaps spurred on by competition with the neighbouring Portuguese (who had, just a few years previously, successfully navigated to the Indian ocean around the tip of Africa), the Spanish king and queen agreed to support his adventure. Fortunately for Columbus, a large continent existed en route to Asia, allowing him landfall. And the rest is history. That history included the near genocide of the native inhabitants by conquerors from Europe. Transmission of European diseases compounded the misery.

It may be the same with AGI. Rational observers may have ample justification in thinking that true AGI is located many decades in the future. But this fact does not deter a multitude of modern-day AGI explorers from setting out, Columbus-like, in search of some dramatic breakthroughs. And who knows what intermediate forms of AI might be discovered, unexpectedly?

It all adds to the argument for keeping our wits fully about us. We should use every means at our disposal to think through options in advance. This includes well-grounded fictional explorations, such as Pandora’s Brain, as well as the novels by William Hertling. And it also includes the kinds of research being undertaken by the Future of Life Institute and associated non-profit organisations, such as CSER in Cambridge, FHI in Oxford, and MIRI (the Machine Intelligence Research Institute).

Let’s keep this conversation open – it’s far too important to try to shut it down.

Footnote: Vacancies at the Centre for the Study of Existential Risk

I see that the Cambridge University CSER (Centre for the Study of Existential Risk) have four vacancies for Research Associates. From the job posting:

Up to four full-time postdoctoral research associates to work on the project Towards a Science of Extreme Technological Risk (ETR) within the Centre for the Study of Existential Risk (CSER).

CSER’s research focuses on the identification, management and mitigation of possible extreme risks associated with future technological advances. We are currently based within the University’s Centre for Research in the Arts, Social Sciences and Humanities (CRASSH). Our goal is to bring together some of the best minds from academia, industry and the policy world to tackle the challenges of ensuring that powerful new technologies are safe and beneficial. We focus especially on under-studied high-impact risks – risks that might result in a global catastrophe, or even threaten human extinction, even if only with low probability.

The closing date for applications is 24th April. If you’re interested, don’t delay!

Blog at WordPress.com.