Книга - The Black Door: Spies, Secret Intelligence and British Prime Ministers

The Black Door: Spies, Secret Intelligence and British Prime Ministers
Richard Aldrich

Rory Cormac


The Black Door explores the evolving relationship between successive British prime ministers and the intelligence agencies, from Asquith’s Secret Service Bureau to Cameron’s National Security Council.Intelligence can do a prime minister’s dirty work. For more than a century, secret wars have been waged directly from Number 10. They have staved off conflict, defeats and British decline through fancy footwork, often deceiving friend and foe alike. Yet as the birth of the modern British secret service in 1909, prime ministers were strangers to the secret world – sometimes with disastrous consequences. During the Second World War, Winston Churchill oversaw a remarkable revolution in the exploitation of intelligence, bringing it into the centre of government. Chruchill’s wartime regime also formed a school of intelligence for future prime ministers, and its secret legacy has endured. Margaret Thatcher, Tony Blair and David Cameron all became great enthusiasts for spies and special forces. Although Britain’s political leaders have often feigned ignorance about what one prime minister called this ‘strange underworld’, some of the most daring and controversial intelligence operations can be traced straight back to Number 10.










(#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)




Copyright (#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)


William Collins

An imprint of HarperCollinsPublishers

1 London Bridge Street

London SE1 9GF

www.WilliamCollinsBooks.com (http://www.WilliamCollinsBooks.com)

First published in Great Britain by William Collins in 2016

Copyright © Richard J. Aldrich and Rory Cormac 2016, 2017

Richard J. Aldrich and Rory Cormac assert the moral right to be identified as the authors of this work

A catalogue record for this book is available from the British Library

Cover photograph © Dan Kitwood/Getty Images (door)

Cover design by Kate Gaughran

The author and publishers are committed to respecting the intellectual property rights of others and have made all reasonable efforts to trace the copyright owners of the images reproduced, and to provide appropriate acknowledgement within this book. In the event that any untraceable copyright owners come forward after the publication of this book, the author and publishers will use all reasonable endeavours to rectify the position accordingly.

All rights reserved under International and Pan-American Copyright Conventions. By payment of the required fees, you have been granted the non-exclusive, non-transferable right to access and read the text of this e-book on screen. No part of this text may be reproduced, transmitted, down-loaded, decompiled, reverse engineered, or stored in or introduced into any information storage and retrieval system, in any form or by any means, whether electronic or mechanical, now known or hereinafter invented, without the express written permission of HarperCollins.

Source ISBN: 9780007555475

Ebook Edition © April 2016 ISBN: 9780007555451

Version: 2017-03-29




Dedication (#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)


To Joanne and Libby

(two espionage experts)




Contents


Cover (#u41d65073-ac65-5969-87dd-5b775cd58dd6)

Title Page (#ulink_57e5ffb3-7558-522e-942b-f6e4c5c72cf2)

Copyright (#ulink_e2ef62a8-f381-59b6-8705-b3b9ff32e907)

Dedication (#ulink_8a461bfc-e6fa-55ae-b6e0-c7e7c3a71b15)

Abbreviations and Acronyms (#ulink_e1a35f5e-73b2-503c-abd1-ba6ca786d312)

Introduction (#ulink_365230dd-19fe-5f90-b096-4f02fa9a771e)

PART ONE: CREATING SECRET SERVICE (#ulink_6caa841f-432f-5a6a-af55-803bc35de2b0)

1 Herbert Asquith, David Lloyd George and Andrew Bonar Law (1908–1923) (#ulink_a3f387f8-e17b-51df-ba42-577438b560b8)

2 Stanley Baldwin and Ramsay MacDonald (1923–1937) (#ulink_ccf508f2-e17a-5a81-8823-245408fccf46)

PART TWO: THE WINDS OF WAR

3 Neville Chamberlain (1937–1940)

4 Winston Churchill (1940–1941)

5 Winston Churchill (1942–1945)

PART THREE: THE HOT COLD WAR

6 Clement Attlee (1945–1951)

7 Winston Churchill (1951–1955)

8 Anthony Eden (1955–1957)

9 Harold Macmillan (1957–1963)

10 Alec Douglas-Home (1963–1964)

PART FOUR: DÉTENTE AND DISSENT

11 Harold Wilson (1964–1970)

12 Edward Heath (1970–1974)

13 Harold Wilson (1974–1976)

14 James Callaghan (1976–1979)

15 Margaret Thatcher (1979–1990)

PART FIVE: TURBULENT TIMES

16 John Major (1990–1997)

17 Tony Blair (1997–2007)

18 Gordon Brown (2007–2010)

19 David Cameron (2010–2016)

Conclusion: Prime Ministers and the Future of Intelligence (#ulink_01c6502c-724f-563b-b7ce-2ae53fe37f59)

Appendix I: Key Officials Since 1909 (#ulink_0e75a30f-b92e-5fce-b268-40d27d8b3572)

Appendix II: Key Intelligence and Security Machinery (#ulink_18273679-fa10-5762-81c5-1cf4de220997)

‘Eat Before Reading’: A Short Essay on Methodology (#ulink_677b1e6e-44ce-581f-8fcb-eb287c5355cf)

Picture Section (#u7f445e99-8abc-5687-8de4-be5069a28957)

Acknowledgements (#ulink_8c9c8e60-9693-5938-80e1-0cb231f661b0)

Notes (#ulink_ef72313a-0a1a-523a-b196-d07a10f1c827)

Bibliography (#ulink_52abfe7a-d8df-584e-9819-735156feadc6)

Index (#ulink_1f54c162-be88-5388-9fda-df3fd626554b)

About the Authors (#u7d7a98a1-22d6-54c1-a5dd-dd7ff8fc81f3)

About the Publisher (#ud6f63ce7-e32f-53ff-9021-0af6fd4550db)




Abbreviations and Acronyms (#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)


‘C’ – Chief of the British Secret Intelligence Service (SIS)

CCC – Churchill College Cambridge

CIA – Central Intelligence Agency [American]

CIGS – Chief of the Imperial General Staff

CND – Campaign for Nuclear Disarmament

Comint – Communications intelligence

Comsec – Communications security

COS – Chiefs of Staff

CPGB – Communist Party of Great Britain

CSC – Counter Subversion Committee

CX – Prefix for a report originating with SIS

DCI – Director of Central Intelligence, the head of the CIA

DIS – Defence Intelligence Staff

DMI – Director of Military Intelligence

DNI – Director of Naval Intelligence

D-Notice – Defence Notice to the media covering security issues

DOPC – Defence and Overseas Policy Committee

Elint – Electronic intelligence

FBI – Federal Bureau of Investigation [American]

FCO – Foreign and Commonwealth Office

GC&CS – Government Code and Cypher School

GCHQ – Government Communications Headquarters

GOC – General Officer Commanding

GRU – Soviet Military Intelligence

IRD – Information Research Department of the Foreign Office

ISC – Intelligence and Security Committee

ISI – Inter-Services Intelligence [Pakistan]

ISP – Internet Service Provider

JAC – Joint Action Committee

JIC – Joint Intelligence Committee

JTAC – Joint Terrorism Analysis Centre

LHCMA – Liddell Hart Centre for Military Archives

MI5 – Security service

MI6 – Secret Intelligence Service (also SIS)

MIT – Turkish Intelligence Service

MoD – Ministry of Defence

NATO – North Atlantic Treaty Organisation

NSA – National Security Agency [American]

NSC – National Security Council [American]

NUM – National Union of Mineworkers

OSS – Office of Strategic Services [American]

PKI – Indonesian Communist Party

PLO – Palestine Liberation Organisation

PSIS – Permanent Secretaries’ Committee on the Intelligence Services

PUSC – Permanent Under-Secretary’s Committee of the Foreign Office

PUSD – Permanent Under-Secretary’s Department

PV – Positive vetting

RAW – Research and Analysis Wing [Indian]

RUC – Royal Ulster Constabulary

SAS – Special Air Service

SAVAK – Iranian Security Service

SBS – Special Boat Service

Sigint – Signals intelligence

SIS – Secret Intelligence Service (also MI6)

SOE – Special Operations Executive

TASS – Soviet Press Agency

TUC – Trades Union Congress

Ultra – British classification for signals intelligence

UKUSA – UK–USA signals intelligence agreements 1948

WMD – Weapons of Mass Destruction




Introduction (#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)


This is my own true spy story …

Winston Churchill1 (#u295ad13f-21cb-56f6-ae6d-53a8642773fc)

On Saturday, 6 September 1941, Winston Churchill stood on a pile of bricks outside the newly built Bletchley Park. Here, in the Buckinghamshire countryside, the mysteries of the German Enigma encryption machine were being patiently unravelled. Each day the codebreakers’ product was fed to a prime minister in Downing Street who was beside himself with anticipation. Now, with some emotion, Churchill expressed his profound gratitude and explained to the codebreakers how they had already transformed decision-making at the highest levels, and with it the course of the Second World War. A decade later – and now approaching his eightieth year – Churchill was back in Downing Street. His keen interest in intelligence had not diminished. In 1952, top-secret spy flights took pictures over Moscow at the express instruction of the prime minister. Over Minsk and Lvov, his airborne intelligence emissaries were greeted by a formidable wall of Soviet anti-aircraft fire.

Churchill also relished covert action. In 1953, he positively purred with enthusiasm over a joint CIA–MI6 plot that had overthrown the government of Iran. This underlines the way in which intelligence was not just a secret window on the world for Britain’s leaders, but also a discreet means of manipulating it. In 1956 Churchill’s successor, a furious Anthony Eden, neurotic and plagued by ill-health, barked into a telephone that he wanted Egyptian President Nasser destroyed by MI6. Harold Macmillan’s government drew up what he called a ‘formidable’ plan for Syria which involved assassinating several leaders. Alec Douglas-Home added Indonesia’s President Sukarno to the list of foreign leaders that prime ministers wished to see toppled using Britain’s intelligence agencies. However, when Harold Wilson asked for the liquidation of the Ugandan dictator Idi Amin, officials responded with horror, and refused to investigate the options. When secret intelligence took extreme risks, it was usually at the direction of Downing Street.

Harold Wilson evoked the dark side of intelligence. He was convinced that plotters within MI5, MI6 and especially renegade generals in the Ministry of Defence were out to undermine his government. Notably terrified of the South African secret service, known as ‘BOSS’, he chose to develop close personal relations with the Israeli secret service Mossad instead. Speaking with American officials who were inquiring into illegal activities by the CIA in the wake of Watergate, he agreed with them that the CIA failed to tell British authorities everything it did in London. Yet he remained fascinated by the secret world, and valued the intelligence machinery in Downing Street, engaging in academic debate with his intelligence analysts on points of detail like the Oxford junior research fellow he once was.

Intelligence imperilled more than one British prime minister. Within weeks of her arrival at Downing Street, Margaret Thatcher insisted on sitting in with the Joint Intelligence Committee to better understand how intelligence was prepared for those at the top. Only three years later, a major intelligence failure by the same mechanism over the Falkland Islands almost ended her government. John Major found himself confronted by the Arms to Iraq affair, in which ministers had sought to cover up the control of arms export companies by MI5 and MI6. The subsequent inquiry by Lord Scott revealed only part of the murky tale, and brought Major’s government close to defeat in the House of Commons. Tony Blair’s era was defined by vicious public arguments over intelligence. Despite his successful use of secret service during the creation of the Good Friday Agreement in Northern Ireland, it was accusations of the misuse of intelligence over Iraq that would leave his reputation in tatters. His bold decision to use intelligence publicly to justify the war on Iraq quickly backfired, and by 2005 the missing WMD fiasco threatened to end his government prematurely. Blair’s administration also left a toxic legacy of allegations about complicity in torture with which Gordon Brown and David Cameron have both struggled. Most recently, the deluge of secrets revealed by NSA contractor Edward Snowden has reshaped relations between David Cameron, Barack Obama and other world leaders including Angela Merkel. In an era when secret services are increasingly kept in check by whistleblowers and their remarkable revelations, British prime ministers live in constant fear of intelligence ‘blowback’.

For good or ill, intelligence matters to prime ministers. It may be only one factor shaping their thinking, but it can be critical and very personal, often revealing what their opponents think about them.2 (#u295ad13f-21cb-56f6-ae6d-53a8642773fc) Intelligence can provide warning of dangerous future events, and has certainly averted major terrorist attacks on London. It can help to prevent wars, or – once they begin – mean the difference between victory and defeat. Yet it can also be misused to justify preconceived policy desires. The secret world can help to resolve a prime minister’s most difficult dilemmas by providing a hidden hand that shapes events behind the scenes. It can also become a seductive apparent panacea, whereby secret service is employed to carry out a leader’s dirty work, at home and abroad. In its darkest moments, intelligence can consume prime ministers.

The relationship has become ever closer. The link between Number 10 and Britain’s intelligence agencies, as intimate as it is secret, lies at the heart of the British establishment. For almost a century, a stream of secret boxes – red for MI6 material and blue for intercepted communications from GCHQ – made their way to 10 Downing Street. Sifted by the cabinet secretary, the best material was placed in a special striped box, nicknamed ‘Old Stripey’, for the early attention of the prime minister. Since the creation of Britain’s intelligence agencies in 1909, the relationship between prime ministers and the secret world has moved from circumspection to centrality. One thing is clear from this story. Intelligence is not about rogue agents operating wildly and freely; nor is it an unaccountable business far removed from the corridors of political power. Many of the most hair-raising intelligence activities and many of the most dangerous covert operations have involved Number 10 directly. Intelligence is part of the beating heart of Britain’s core executive, and has long held a special place behind the famous black door of 10 Downing Street.

The use of secret intelligence is one of the dark arts of statecraft. Yet during the early years of the twentieth century, British prime ministers were notably inept practitioners. Relative strangers to the murky world of espionage and clandestine warfare, they treated the subject with either indifference or outright suspicion. When prime ministers did draw on intelligence, they demonstrated remarkable inexperience and naïvety in its use. While Herbert Asquith presided over the creation of the modern British intelligence services in 1909, he had little interest in secret matters other than his mistress. David Lloyd George and Stanley Baldwin enjoyed the first fruits of Britain’s revived wartime codebreaking operations, but squandered them by publicising not only German but also American and Russian intercepts, compromising the source and causing anguish among the denizens of secret service. Ramsay MacDonald, Britain’s first Labour prime minister, distanced himself from the secret services, fearing they may have been out to plot the demise of his government; while Neville Chamberlain arrogantly ignored invaluable secret intelligence provided by brave Germans who personally visited Downing Street at the risk of their own lives. Instead, he preferred to rely on diplomatic reports from those sympathetic to Hitler, which reinforced his own preconceptions.

In 1940, Churchill changed all this. Indeed, a Churchillian revolution in intelligence occurred during the middle of the twentieth century. For five years Britain’s fate hung in the balance, and intelligence, especially Ultra material provided by Bletchley Park, often proved the operational advantage. Churchill placed a premium on intelligence chiefs telling truth to power: he believed that craven intelligence officers accounted for some of Sir Douglas Haig’s failings during the First World War. ‘The temptation to tell a Chief in a great position the things he most likes to hear,’ Churchill later observed, ‘is one of the commonest explanations of mistaken policy.’3 As prime minister he developed close links with the secret world, especially through Stewart Menzies, chief of MI6, whom he sometimes summoned to his bedside in the middle of the night. The prime minister was obsessed with secret intelligence, and – more importantly – strained every sinew to make sure that the government used it to efficient purpose.

Churchill was impulsive, and so constituted a mixed blessing. As David Reynolds argues in his magisterial study, there were reasons why both Baldwin and Chamberlain had kept him out of office. He had imagination, industry, energy and eloquence, but he lacked judgement and wisdom. Lloyd George was of much the same opinion, arguing that in an emergency Churchill’s vision and imagination were essential, and should be used to the full, but at the same time he should be kept under a ‘vigilant eye’.4 Churchill’s over-enthusiasm led to friction with the chiefs of staff, who had the onerous duty of vigilance, and indeed to occasional blunders. Yet his determination to harness the power of intelligence transformed not only the centre of government, but also the very nature of British statecraft.5

Uniquely, Churchill brought with him vast intelligence experience. In charge of the Admiralty during the First World War, he had seen the work of Britain’s most proficient codebreakers at first hand. In the interwar years he had been deeply interested in intelligence, and repeatedly shaped its development. Once he became prime minister in May 1940, he was finally empowered to change procedure at the top. He demanded raw intelligence fresh from MI6 agents in the field or from Bletchley Park. This annoyed the chiefs of staff, and triggered a revolution in Whitehall’s intelligence assessment machinery – the Joint Intelligence Committee moved centre stage – laying the foundations of the successful body which still operates today. Moreover, the impetuous Churchill loved action. He not only nurtured Number 10’s direct connection with espionage, but also encouraged a new focus on special operations and covert warfare. His personal interest in ‘funnies’ and oddball units – ranging from the Chindits and the Commandos to the Special Operations Executive and most famously the SAS – changed how Britain approached warfare for decades to come.6

Churchill’s wartime government was itself a school for secret service. Around him, Britain’s future leaders learned the business of intelligence and its importance to the practice of statecraft. Thereafter, Britain’s next few prime ministers – all veterans of Churchill’s wartime government – understood the value of secret sources and the event-shaping power of intelligence. Trained in the sophisticated integration of intelligence and policy, his successors realised that it formed a crucial instrument for any leader in a perilous period of British decline. Secret service was part of the ‘fancy footwork’ of retreating empire that could potentially turn the tide in colonial bushfire wars, gain an upper hand in manoeuvrings against the Soviets, and even deceive Washington or Brussels.7

Churchill constituted an improbable double act with Clement Attlee. Serving as Churchill’s wartime deputy, Attlee took a quiet interest in intelligence from the very first week he entered office, including the sensitive matter of interning Nazi sympathisers.8 As early as the autumn of 1940, he was arguing for a single authority to coordinate and improve intelligence.9 Later, he led an inquiry into one of darkest episodes of the war, the Gestapo penetration of Britain’s resistance efforts. Despite his public reputation for timidity, Attlee hid an inner toughness. After 1945, he quietly sanctioned numerous covert operations behind the Iron Curtain and across the Middle East. He also recognised the importance of MI5, of positive vetting and of domestic counter-subversion – even at the risk of frustrating his own backbenchers. Most importantly, he completed Churchill’s project, developing new mechanisms that improved Downing Street’s control over secret service. Indeed, by 1951, deliberately seeking to capture corporate memory and learn the lessons of the preceding ten years, Attlee completed the Churchillian revolution, harnessing the power of the hidden hand to state policy and creating a connected British intelligence community for the first time.10

Anthony Eden and Harold Macmillan had also learned about the growing power of secret service during the war. Eden in particular had endured a series of vexatious confrontations with SOE, which appeared at times to be conducting a parallel foreign policy. In 1942, confronted with yet another improbable episode, he peevishly exclaimed, ‘Am I foreign secretary or am I not?’ Yet once ensconced in Downing Street, both Eden and Macmillan recognised the value of secret service. They also realised that the CIA was quietly being used to expand American influence while bypassing the political, economic and military constraints associated with overt intervention. Accordingly, as well as launching their own covert operations, the prime ministers’ relations with presidents Eisenhower and Kennedy often involved selling cooperation on Anglo–American secret wars against figures like Nasser and Sukarno to the White House.11

More recent prime ministers did not, of course, serve under Churchill or Attlee. But all experienced their legacy inside Number 10. Churchill brought the intelligence machine more firmly into Downing Street, while Attlee, as his partner and immediate successor, greatly strengthened the central control of the cabinet secretary over the secret world and began the creation of a refined national security apparatus. Together, they created an intelligence community and made it a familiar part of the working lives of prime ministers for the first time. Thereafter, intelligence became part of the growing ‘presidentialism’ of the British prime minister. While Harold Wilson may have nurtured a curious love–hate relationship with intelligence, Burke Trend, his cabinet secretary, continued Churchill’s drive to connect secret service with the centre. Under Wilson, the involvement of the Cabinet Office with the intelligence services became so great that Trend created a new post of Cabinet Office Intelligence Coordinator to help manage their business. To Wilson’s pleasure, Dick White, who had served as a much-admired director-general of MI5 and then chief of MI6, was the first incumbent.

The growing power of premiers, presidents and prime ministers in the twentieth century went hand in hand with secret service. In Britain, this meant the rise of special policy advisers, spin doctors and the increasing tendency of Downing Street to impinge on the territory of cabinet ministers. Typically, Edward Heath created a Central Policy Review Staff under Victor Rothschild, a wartime MI5 officer who also served as a back channel to the secret services. Margaret Thatcher took this further, appointing Percy Cradock to serve simultaneously as her personal foreign policy adviser and also as Chair of the Joint Intelligence Committee. Unhappy with the reluctance of the ‘wets’ in MI5 and the Foreign Office to confront what she saw as Britain’s enemies, Thatcher even created a network of private secret services around Downing Street that paralleled Ronald Reagan’s piratical adventures with the US National Security Council during Iran–Contra. In Whitehall and Washington, secret service now bestowed upon Western leaders their own hidden and deniable foreign policy.12

The twenty-first century witnessed the final convergence of intelligence and political leadership. Tony Blair waged wars from Bosnia to Iraq, Sierra Leone to Afghanistan. Doing so required the support of Britain’s secret services. Ironically, his failure to understand intelligence, his determination to exercise personal control and the calamities that followed prompted a further reshaping of the way in which secret service connects with British foreign policy. Gordon Brown and David Cameron formally institutionalised their relationship with the intelligence community, the latter using an American-style National Security Council. For the first time, Cameron met with the three agency chiefs once a week, together with key decision-makers, in an environment that promotes action. Moreover, he announced himself as ‘minister for the intelligence services’.13

One of the things that frightens British prime ministers most is the ghost of secret service past. A special security squad of weeders and censors constantly patrols the boundaries of Britain’s official past in the hope of protecting Downing Street from embarrassment. The intention is that intelligence scandals will only emerge slowly and in a controlled fashion, as the result of papers being opened after an embargo of seventy-five or even a hundred years. Eventually, in the National Archives at Kew, amid crumbling paper and crumbling academics, the sensations of yesteryear can be safely examined, since any possible witnesses who might speak out of turn have long passed away. But occasionally, premiers have had to confront skeletons rattling in the secret service cupboard of their immediate predecessor. None was as noisy or as dangerous as the ‘Arms to Iraq’ episode that came within a whisker of ending John Major’s government.14

‘Scandals are the nastiest experiences in politics,’ noted Bernard Donoughue, senior policy adviser to both Wilson and Callaghan. In September 1977, reflecting on the latest press revelations about alleged attempts by the intelligence services to subvert or even overthrow the prime minister, the so-called ‘Wilson plot’, he added that these affairs brought together ‘scared politicians, hysterical and self–righteous civil servants and hypocritical lying journalists’.15 Intelligence scandals have long caused sleepless nights in the flat above 10 Downing Street. Almost as soon as he entered office, Attlee was confronted with revelations about the ‘atom spies’, Alan Nunn May and Klaus Fuchs, two wartime scientists employed by the British who had seemingly passed the secrets of the West’s new wonder weapon to Moscow. When Stalin detonated an atomic bomb ahead of the British in August 1949, there were awkward public questions in Parliament, made worse by the mysterious flight of Donald Maclean and Guy Burgess to the Soviet Union in 1951. Security scandals had an alarming habit of appearing out of a clear blue sky, as Anthony Eden discovered just a few years later. In 1956, he clumsily attempted to bat away questions about the mysterious death of the navy frogman ‘Buster’ Crabb, who during a state visit to Britain by the Soviet leadership had embarked on a hazardous secret operation that MI6 had failed to clear properly with the political authorities. The Crabb fiasco triggered a major review of prime ministerial clearance for clandestine operations and new mechanisms for assessing attendant political risk.

The 1963 Profumo affair was a defining moment for Downing Street. It not only helped prompt Macmillan to terminate his premiership early, it also heralded a new attitude by the press towards matters of secrecy. Hitherto, the long shadow of the Second World War had ensured a degree of circumspection and security-consciousness by journalists when addressing intelligence matters. But by the 1960s, propelled by a range of scandals around CIA special operations, the press was hungry for stories about espionage. The shooting down of Gary Powers’ U-2 spy plane in May 1960 reverberated personally for Macmillan, collapsing a Cold War summit with Khrushchev that he had worked hard to create. This was followed by the CIA’s disastrous Bay of Pigs escapade, which marred the first months of Kennedy’s presidency and raised questions about his personal judgement. Profumo too had an Anglo–American dimension, with anxious FBI officers arriving in London to probe the delicate question of whether Kennedy had met Christine Keeler. For Macmillan, always keen to project the persona of Edwardian stability, the increasing connections made by the press between premiers, politics and the secret world became deeply disconcerting. It was a wind of change he did not welcome.

Harold Wilson had enjoyed tormenting Macmillan over Profumo. As leader of the opposition in 1963, he recognised that this episode was about sex and high society as well as secrets – a gift in terms of media coverage. Entering Downing Street in 1964, he was determined to protect himself against the same fate, and noted that his predecessor, Alec Douglas-Home, had already established a Security Commission to which he could refer malodorous matters when they came before Parliament, giving the prime minister the welcome appearance of actually doing something. For Downing Street, the tactic of creating long-running inquiries into secret matters gradually became a central mechanism for containing toxic security issues. But Wilson also wanted his own ‘security enforcer’, and appointed his paymaster general, George Wigg, to sniff out potential scandals within government. Cabinet ministers and MI5 loathed the freewheeling security inquiries that Wigg made into the most sensitive parts of Whitehall. All this failed to protect Wilson from hideous embarrassment over the interception of telegrams during the ‘D-Notice affair’ in 1967, and then the public flaunting of MI6 secrets by Kim Philby in his waspish memoirs published in 1968.

Labour leaders faced a peculiar predicament. They often found themselves publicly defending domestic security services that they privately feared might be seeking to undermine them. Attlee faced the awkward position of being a socialist prime minister at the onset of the Cold War. The Labour Party and MI5 were not, at this point, natural bedfellows, and Attlee had to balance issues of positive vetting with backbench accusations of launching an anti-communist witch-hunt. Attlee was always conscious of the tension between intelligence, security and liberty. He agonised over investigation into the personal backgrounds of Whitehall officials, and introduced it only under the American threat of ceasing nuclear cooperation, passing this into law as almost the last act of his administration. By the 1970s, Labour prime ministers were inspecting MI5 files on their own MPs and wondering what level of risk was involved in appointing them to government. It was now known by Downing Street that some MPs – like John Stonehouse – had actually worked for Eastern bloc intelligence services. Indeed, one of the longest-serving MPs in the House of Commons, Labour’s Bob Edwards, who represented Wolverhampton South-East until 1987, was a fully-paid-up KGB agent. Other MPs had worked closely and enthusiastically with the CIA or Mossad.16

Jack Straw, one of the most prominent cabinet ministers of recent years, recalls his initial security vetting when he first joined the government. ‘A man in a mac, with a skin disease which meant he could not shake my hand … came to interview me … for three hours.’ Later the same man came back for another three hours, and in this second interview he suddenly leaned across the desk, looked his subject in the eye and asked, ‘Mr Straw, do you like men?’ This reflected the fact that historically, several people who had spied for the Soviets had been trapped by sexual blackmail. In 1974, when Straw was an adviser at the Department of Health and Social Security, his file was already two inches thick, and from their questions it was clear that MI5 had been collecting material on his family members since he was fifteen. Straw reflected on the scale of the surveillance operation that this implied. But, he recalls, this ‘neither surprised nor shocked me’. He saw it as part of everyday life on the strange planet that was Cold War Britain, where the KGB had to be kept at bay. Years later, when Straw became home secretary, MI5 was nervous that he might wish to see his own file. But he did not request this privilege, taking the view that he had no more right to see this secret material than any other citizen – and he gave the same response to Peter Mandelson, who was characteristically eager to peruse his own MI5 dossier.17

In the 1970s, Downing Street also lived in the shadow of Watergate, and was engulfed by growing paranoia about grand political conspiracy. Plots and bugging seemed to be almost normal. In March 1976, during the last days of the Wilson government, Tony Benn, then secretary of state for energy, attended a reception at the American embassy at which he chatted amiably to Cord Meyer, head of the CIA station in London. They reviewed the continuing fallout from Watergate, and Benn offered the opinion that Nixon was in fact quite charming, and that the media had been ‘unfair to him’. Meyer countered that Nixon was a ‘terrible man’, and had done a lot of damage to his service. But Benn took the wider view that given the catalogue of human error that went with the political experience, ‘bugging your opponent wasn’t so bad’.18 A year later, James Callaghan and the cabinet secretary were debating whether Benn himself could be trusted to see intercepts and ‘sigint’ material from GCHQ.19

Labour prime ministers also worried about plots. Ramsay MacDonald famously feared that MI5 was working against him. During the 1930s, Neville Chamberlain employed a former MI5 officer, Joseph Ball, to spy on both the Labour Party and his own rivals within the Conservative Party, using human agents and telephone taps. The Harold Wilson government rightly feared that a number of secret elements – both domestic and foreign – were seeking to destabilise his regime. For reasons yet unknown, Harold Macmillan had insisted that Downing Street be wired for sound to allow recording of conversations, much in the same style as the Kennedy White House. The extent to which this was used or abused during his time in office and subsequent administrations remains a mystery. The sensitivity of this subject was such that the Cabinet Office insisted that all references to it be cut out of what was otherwise a remarkably candid authorised history of MI5 published in 2009.

Harold Wilson was not the only senior figure who feared bugs. In 1973, in the final days of Edward Heath’s Conservative government, William Armstrong, the head of the home civil service, turned up in the Cabinet Office and demanded to speak to the cabinet secretary somewhere that was ‘not bugged’. Ushered into a suitably secure room, he took off his clothes, lay on the floor chain-smoking and talked ‘very wildly’ about the whole system collapsing and ‘the world coming to an end’. The next day he summoned a meeting of all Whitehall permanent secretaries and told them to prepare for ‘Armageddon’. ‘He was babbling incoherently’, and was ‘taken off to hospital for treatment’. He later spent a month recovering at Lord Rothschild’s private villa in Barbados. Although Wilson said almost nothing about the security services in his first volume of memoirs, penning a bizarre chapter of just two and a half pages on the subject, he later said much more to the press. Cabinet Office officials were by turns amused, embarrassed and then dismissive when these stories first appeared. But by 1979, evidence of interference by South African intelligence in London was mounting, and officials gradually came to accept that there was real substance to Wilson’s fears.20

Wilson’s public ramblings on intelligence required a new approach by Downing Street. Since the early 1960s, prime ministers had been forced to confront a new era of exposure. Now, a decade later, they had begun to manage their own gentle counter-offensive. Encouraged by the cabinet secretary, Burke Trend, with whom Wilson had enjoyed a good relationship, the intelligence agencies initiated a deliberate policy of emerging from the shadows. The Cabinet Office presided over the writing of the official history of wartime intelligence, and approved the release of the papers of Bletchley Park. This project was expressly about intelligence at the top, and traced the interaction between secrets and high strategy. Throughout the 1970s, British prime ministers were feeling their way towards a more public profile for the security agencies and their own engagement with them, pondering the possibility of public avowal of their existence and activities.

Margaret Thatcher hated this. Even as opposition leader in the late 1970s, she had repeatedly attempted to veto any public revelations about intelligence, however carefully controlled. Once she entered Downing Street, she was immediately confronted by the media frenzy surrounding the revelation that Anthony Blunt, Surveyor of the Queen’s Pictures, was the ‘Fourth Man’. Tasked with explaining the decision not to prosecute him, she went against her instincts and, rather than saying as little as possible, made a detailed statement to the House of Commons. She soon regretted it. Each morsel of detail was picked over, and seemed to draw out further press revelations. Now confirmed in her personal commitment to absolute secrecy, Thatcher’s later years were partially defined by the absurd battle with MI5’s supreme mole-hunter Peter Wright, whose Spycatcher memoir she sought to suppress. Her cabinet secretary endured public humiliation in the Australian courts in a futile attempt to hide what was already in the public domain.

By contrast, John Major found himself surrounded by modernisers. Not only were the intelligence chiefs of the 1990s happy to adopt an avowed legal identity, they were also keen to emerge from the shadows. In 1994 the new director-general of MI5, Stella Rimington, gave the BBC Dimbleby Lecture on ‘Security and Democracy’ – despite the intense unease of Home Office officials. MI6 opened an extraordinary new building at Vauxhall Cross, on the south bank of the Thames, that looked like something out of science fiction. Not to be outdone, GCHQ then commissioned its own new headquarters that looked like a flying saucer, and became the first British agency to have a presence on the internet. Yet the press still seemed determined to turn success into scandal. In 1999, when MI6 revealed the treasures of the Mitrokhin archive, compiled by a KGB archivist who had given his secrets to Britain, surely one of the most magnificent intelligence successes of the late Cold War, the press instead focused on the failure to prosecute some of the espionage ‘small fry’ this had revealed. Government spin doctors puzzled over how MI6 had managed to turn a golden story to ashes, and Duncan Wilson of the Cabinet Office agreed that the secret services now needed assistance from Downing Street in managing their public image.

Tony Blair exuded confidence in all areas of public affairs, including secret service. When asked about MI6 operations in Moscow he quipped to a waiting band of journalists, ‘We never comment on intelligence matters … except when we want to, obviously.’21 Even before 9/11, his public relations team were fascinated by the media operations of MI6 and the interface between openness and secrecy. After the attacks on the World Trade Center in New York, secret matters were on the front pages of the newspapers each week during a decade-long ‘War on Terror’. This raised important questions. To what extent should prime ministers place intelligence in the public domain to explain policy? And how should this be done? In two notorious Downing Street dossiers, Tony Blair and his press secretary Alastair Campbell did this badly, and paid a considerable price in terms of trust and public confidence. In the background, senior MI6 officers, some of them modernisers like Richard Dearlove and some old-school types like John Scarlett, argued over issues of public image and the proximity of their own service to Number 10. None of them had any idea how disastrously this episode would explode in their faces.

Yet David Cameron retraced Blair’s footsteps. In early 2013, faced with the issue of the use of chemical weapons against its own people by the government of Syria, Cameron released JIC material to the press, going even further than Blair in the public use of intelligence. He realised that prime ministers must balance intelligence’s inherent need for secrecy with their public duties leading the government. If this was an effort to reassert control and confidence, it surely failed. After Blair’s Iraq fiasco, the public were deeply sceptical about intelligence as a justification for pre-emption, and Parliament voted against military action in Syria. Moreover, Downing Street was about to discover that it did not have control over what became public in this realm. Even as it agonised over the release of a two-page letter from Jon Day, the chair of the JIC, to Cameron, an unknown figure called Edward Snowden was preparing to release a deluge of secret material that amounted to thousands of documents. Much of this was British, and each remarkable revelation was more eye-wateringly secret than the last.22

Cameron said almost nothing about Snowden. This was because much of the material shone a harsh light on the personal interaction between premiers and espionage. In a world in which diplomacy has become increasingly personal, characterised by G7 summits and mobile-phone calls, spies and statesmen rub shoulders with increasing frequency. For wealthy and powerful states, Snowden’s revelations were a story of hacked emails and rude words. GCHQ was specifically accused of hacking into the Belgian telecoms firm Belgacom, which includes EU institutions as clients. Cameron refused to answer questions about whether he had been able to reassure allies that British intelligence had not been involved in any bugging.23 In fact, this was hardly news. Generations of British cabinet ministers have been amazed by the scale of Britain’s surveillance of its European partners.24 But what Snowden, and previously Chelsea Manning, also revealed was the jostling of less powerful states, such as Chile and Mexico, which suffered not only stolen briefcases, but also bullying and bribery by the West. This rather raw business of personal espionage has now been exposed, and to the surprise of many, we have realised that James Bond often takes his orders in these delicate matters direct from the prime minister in Downing Street, rather than from ‘M’ in MI6 headquarters.

In the summer of 2007, the British embassy in Baghdad received five bloody index fingers through the post. They were claimed to be the body parts of five British citizens who had recently been kidnapped by a pro-Iranian offshoot of Hezbollah in Baghdad. On 29 May that year, Shia militants disguised as policemen had conducted a violent raid on the Iraqi Ministry of Finance. Their main target was Peter Moore, a British consultant who had been installing software designed to prevent fraud surrounding the billions of dollars of aid flowing into the new government’s accounts. Downing Street was determined to secure Moore’s release. SAS and MI6 representatives attended four separate cabinet-level security conferences to plan his rescue with ministers, and as a result special forces conducted more than two dozen house assaults seeking persons involved in the kidnap. Gordon Brown came within minutes of ordering a raid on the kidnappers, but the intelligence on their location was judged to be too thin. Eventually, in December 2009, after 946 days of captivity, Moore was swapped for Qais Khazali, a Shia militant leader, and his brother, who had been seized by the SAS on the streets of Basra at around the same time he was kidnapped. The negotiations were carried out by an MI6 officer operating in Baghdad. The other four Britons, who had served as his security guards, had all been executed the previous year.25

The dirtiest diplomacy is talking to terrorists, kidnappers and insurgents. This has to be deniable, since even if governments are willing to admit their part, terrorists frequently are not, and all parties ultimately fear being perceived as ‘weak’. This can place prime ministers in a difficult position, potentially forcing them to mislead the House of Commons. Harold Wilson kept his MI6 back channel with the IRA incredibly secret – many in his own cabinet did not know what was going on. Similarly, Margaret Thatcher publicly insisted that Britain did not talk to terrorists, and yet, as under her predecessors Wilson, Heath and Callaghan, various back channels remained open. In fact, Thatcher was personally involved in some exchanges. She made handwritten comments on one statement sent to the IRA as part of negotiations over the hunger strikers in 1981, and personally amended and approved Britain’s negotiating position.26 Her successor, John Major, faced a similar dilemma. Despite stating in the House of Commons that he did not negotiate with terrorists, he had approved precisely that, and his emissaries were secret service officers whom the IRA regarded as ‘untouchable’. But when the secret talks leaked, Major and the IRA descended into a welter of accusation and counter-accusation, with each side publicising its version of the hitherto secret communiqués.

Bizarrely, even as Thatcher and Major talked to terrorists, they were also their top targets. Both came within inches of being eliminated by the IRA, and one of the darker stories of intelligence, security and 10 Downing Street is the ever greater level of protection required to prevent assassination. Margaret Thatcher, characteristically, had just finished rehearsing a speech with her private secretary, Robin Butler, at ten to three in the morning when a bomb destroyed a large part of the Grand Hotel in Brighton during the 1984 Conservative Party Conference. One minister recalled the security shambles in the immediate aftermath, as injured politicians made their way out of the rubble with barely a policeman in sight. Two IRA gunmen could have ‘got the whole Government as they blearily emerged’, and made their getaway unimpeded. The IRA also purposely eliminated two of Thatcher’s closest advisers, with the assassinations of Airey Neave in 1979 and Ian Gow in 1990, bracketing her arrival and her departure from office.27

As a result, Downing Street was turned into a fortress. Large reinforced black gates prevented public access. Harold Wilson had resisted elaborate gates when they were suggested in 1974, but now they arrived, together with armed policemen.28 Several levels below Downing Street, technicians were putting the final touches to ‘Project Pindar’, a command bunker deep beneath the Ministry of Defence on Whitehall to which selected denizens of Downing Street could retreat in times of peril, at a cost of £126.3 million.29

By 2005, threats against the life of the prime minister had become an almost daily occurrence. The intelligence warnings of assassination attempts often landed on the desk of David Blunkett, the home secretary, who observed with delightful sangfroid that these plots did not worry him unduly – unless they related to an event at which he was likely to be sitting next to Tony Blair. Towards the end of Blair’s administration, simply moving outside the Whitehall government complex became a problem. Alastair Campbell gazed at the vast prime ministerial convoy of armoured vehicles proofed against nerve gas, the motorcycle outriders stopping the traffic amid a cacophony of wailing sirens, and wondered how many votes were lost every time this baroque parade of vehicles took the prime minister to the airport.

The personal threat to the prime minister is at its worst overseas. In October 2001, Blair set off on a trip to Russia, India, Pakistan, Saudi Arabia and finally Egypt. The BBC ignored security guidance and announced the prime minister’s destinations to the world, thereby increasing security concerns. As a result, Blair’s entourage had to be ‘surrounded by outriders with machine guns and tanks carrying anti-aircraft missiles’.30 On their return to the UK, Blair’s team told the BBC director of news that Number 10 was ‘exasperated by their continued reporting of his movements’.31 Blair remains a high-profile target. In 2014, MI5 planted a listening device in the car of one terrorism suspect and listened in on his conversations for two weeks after searching the vehicle and finding Blair’s home address on a scrap of paper folded inside a Versace glasses case.32 MI5 had previously established covert surveillance of Ishaq Kanmi, the self-proclaimed leader of al-Qaeda in Britain. His stated aims included ‘the elimination of political leaders and capitalists Blair and Brown’.33 In the twenty-first century, British prime ministers value their intelligence and security services partly because they keep them alive.

No less worrying are the threats to visiting heads of state. Each premier on a state visit to Downing Street, whether from Russia, Israel, Sri Lanka or Saudi Arabia, has brought in his wake an exotic trail of would-be assassins. The grim prelude to every visit is the backstairs diplomacy of death. As the leaders make their way around London, they are shadowed by ambulances carrying copious supplies of their blood group. The most vexed discussions concern the intelligence precautions involved in each visit, with every drain and culvert along the routes taken by visiting dignitaries being searched for explosives. Defensive weaponry is an issue, with each American president asking to bring with him an increasingly formidable array of automatic weapons and ground-to-air missiles. George W. Bush was denied permission to bring an SUV containing an M134D mini-gun in an armoured pop-up turret. MI5 routinely regard the US president’s secret service as a more dangerous threat to the British public than potential assassins.34

Death has hovered over Downing Street for more than a century. While attacks and plots have become steadily more serious in recent years, enterprising amateurs have always abounded, and earlier prime ministers were more accessible to the public. On 28 August 1939, panic swept through a crowd of protesters immediately outside the door of 10 Downing Street when a London clerk called Laurence Hislam opened a small suitcase and scattered its contents, which resembled the deadly devices beloved of bearded bomb-throwing anarchists. Mayhem ensued, until the crowd realised that the ‘bombs’ were actually large black rubber balls inscribed with the message ‘Peace Conference Now’. Hislam was in fact a pacifist protesting against the mounting international crisis and the spectre of another major war in Europe. The police led him away, and despite his defence that he acted ‘in the cause of peace’, the court sentenced him to six months’ hard labour.35

No prime minister illustrates this interface between premiers and personal hazard more than Churchill. Britain’s wartime leader accepted the advice of the Special Operations Executive that assassinating Hitler would be counter-productive, since his strategy was increasingly incompetent and damaging to Germany. However, in 1943 Churchill did approve an assassination attempt against Mussolini, with female agents being dropped into Italy, together with aggressive kill missions against Rommel and other senior German generals. Meanwhile, lesser fascists were earmarked for mere bribery, with an initial £100,000 personally approved by Churchill and then passed over in a large bag to members of Franco’s circle on a Spanish golf course as an inducement to keep Spain out of the Second World War.36 Eden was appalled by the operation, but when more money was required for Franco, Churchill eagerly minuted in red ink: ‘Yes Indeed. WSC.’37

Britain’s wartime leader was oddly relaxed about his own personal safety, despite more than a dozen serious attempts on his life. Hitler certainly ordered his multiple secret services to target Churchill, the oddest such operation being a plot to attack Allied leaders at the Tehran Conference in 1943 using a team of Nazi agents transported by camel.38 Much of Churchill’s remarkable ability to survive the attempts on his life must be attributed to good fortune and his ever-vigilant bodyguard, Detective Inspector Walter Thompson. Occasionally Churchill insisted on carrying his own revolver, but for the most part brazen and carefree with only a single bodyguard, he travelled over 200,000 miles across Europe, America and the Middle East in the course of the war. No British prime minister will ever do that again, so in many ways Churchill stands at the turning point of security and intelligence in Downing Street, representing both the first of a new wave of premiers who exploited intelligence properly, but also the last of a dying breed.

Twenty prime ministers have led Britain since 1909. From Herbert Asquith to Theresa May and from Ramsay MacDonald to Gordon Brown, these premiers have held diverging political views, possessed wildly different leadership styles, and have confronted the full spectrum of problems, threats and crises. This book examines each prime minister in turn. It traces their personal approaches to intelligence and uses each premiership as a vehicle to explore the most pressing national security issues of the day. It reveals that despite the vagaries of personality and politics, intelligence has become increasingly central to all prime ministers. This was not always the case. Back in the first decade of the twentieth century, the secret world was alien to Asquith. Churchill and Attlee addressed this problem together, and forged a quiet revolution. Now, as a result, the prime minister presides personally over an organised intelligence community operating at the heart of Whitehall. This book traces that secret service journey from the periphery to the centre of power.



PART ONE



CREATING SECRET SERVICE (#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)



1




Herbert Asquith, David Lloyd George and Andrew Bonar Law (1908–1923) (#u2edb29e4-9f5d-578c-8bf9-8979eb3f3d09)


A rumour spread next day in true war-time fashion that Lord Chetwynd had caught three German spies trying to signal the Zeppelin with lights, and had shot them out of hand.

David Lloyd George1

The British intelligence system was already immense by the dawn of the twentieth century. The entire British Empire, sprawling across more than half the globe, served as an intelligence machine – a veritable ‘empire of intelligence’.2 It depended on information of every kind to project British rule in remote places. Romanticised in the works of Rudyard Kipling, intelligence was about amateur imperial adventurers, revelling in deceit and subterfuge. Unlike today, espionage was conducted informally by local agents, eccentric travellers and scholars. Lawrence of Arabia and the legendary team of British archaeologist-spies at Carchemish, working across the Turkey­–Syria border, typified the way great-power rivalry in the Middle East and Asia mixed with academic debates about how archaeology might change understandings of the Bible. Importantly, scholarly research was not merely a cover for secret service work. Intelligence was considered to be every kind of information, including that obtained by peculiar scholars who spoke many languages, collected eggs, bulbs and butterflies, and mixed ‘comfortably and innocently’ with the local population. Indeed, at the turn of the twentieth century, British officials in Mesopotamia feared an archaeologist-gap and urged the India Office to contact learned societies which could send more scholar-spies to buttress British interests.3 India itself, the vast jewel of the empire, depended on spies too. It became an extraordinary ‘empire of information’, allowing just over a thousand British civil servants to superintend close to 280 million people.4

An empire of information, in some form, existed at home too. New public health initiatives and social programmes meant the state knew much more about its people than ever before. Meanwhile Irish nationalists and bomb-throwing anarchists from the Continent had forced the Metropolitan Police to develop the world’s first ‘Special Branch’ in 1883. Inevitably perhaps, by the first decade of the twentieth century, Special Branch had broadened its net beyond Fenians and anarchists to collect intelligence on possible foreign spies, anti-colonial agitators, suffragettes, union leaders, pacifists, and even those with radical views on sex.5

Nevertheless, these developments were more about keeping authoritarian surveillance at arm’s length from the British public. Mysterious battles with Russian spies in Central Asia were reassuringly remote, while the creation of a small Special Branch of intrepid detectives to counter terrorism was seen as a low-key alternative to the sort of harsh and repressive security legislation preferred in Europe. Accordingly, intelligence remained a matter for distant vice-consuls travelling to Samarkand, or detective sergeants in Whitechapel. It rarely resonated at the centre of British government. More rarely still did a prime minister take a personal interest in espionage.

All this began to change over the next decade. Bizarrely, it was literary fashion which drove the transformation of British intelligence, thrusting it towards the heart of government for the first time. A wave of popular Edwardian ‘invasion literature’ forced Herbert Asquith, an otherwise uninterested Liberal prime minister more focused on progressive domestic reforms, to take notice of foreign espionage. Acting only under pressure, Asquith set in train a course which would fundamentally alter the landscape of British intelligence forever. The intelligence revolution may have been forged by Churchill and Attlee, but the first sparks came through the unlikely Asquith. Nonetheless, despite the expansion of espionage during the First World War and greater interest on the part of Asquith’s successor David Lloyd George, it took time and endless trouble before successive prime ministers learned to use intelligence effectively.

Fiction paved the long pathway to the creation of a modern British intelligence service. During the nineteenth century, a stream of often sensational crime novels fed a growing public fascination with detection, police work and science. This generated cultural change, gradually eroding anxieties about government surveillance. Created by writers as diverse as Edgar Allan Poe and Arthur Conan Doyle, fictional detectives gradually became heroic figures to be worshipped, rather than bogeymen associated with distasteful and un-British authoritarianism.6 Journalists, who often exchanged information with real policemen, accelerated this transformation, helping to create real-life detectives who enjoyed a similar cult status.7 William Melville, who became head of Special Branch, was one example. He famously foiled several anarchist attacks, including the ‘Jubilee plot’ against Queen Victoria in 1887 and another dastardly scheme known as the ‘Walsall plot’, in which anarchists from the West Midlands sought to manufacture a bomb. Many now believe that he created the latter plot himself for mere self-glorification.8

Over three hundred spy novels went into print between 1901 and 1914, mostly focused on the ‘German Menace’. This new fiction effectively rebranded itself as a barely concealed form of ‘true crime’ writing, supposedly based on the patriotic leaking of government secrets. In 1903, Erskine Childers published The Riddle of the Sands, which narrated the summer sailing adventures of two young British men along the East Frisian coast who stumble upon a German plot to invade England with a flotilla of barges. Childers claimed to be offering the British people nothing less than a warning of what was to come, and Rudyard Kipling urged the public to support him in taking a firm stand against the ‘shameless Hun’.9 The story was improbable – the German admiralty had long written off the possibility of an invasion from East Frisia – but the hapless Royal Navy was forced to investigate the claims regardless.10

Members of Parliament from constituencies on the east coast, the closest part of Britain to Germany, bombarded the First Lord of the Admiralty, Lord Selborne, with difficult questions. In response, he ordered the Naval Intelligence Division to write a detailed report on the invasion plan outlined by Childers. After reconnaissance of the Frisian coast, the report concluded that the lack of railways and roads, together with the shallowness of the water and general lack of facilities, made a secret invasion from there impossible. ‘As a novel it is excellent; as a war plan it is rubbish,’ insisted Lord Louis Battenberg, the director of naval intelligence. To Childers’ barely disguised delight, the Kaiser banned the book in Germany. Childers also claimed that when he next went sailing in the Baltic, German spies dogged his every move.11

Spy fiction developed a darker side, shifting its focus closer to home, portraying immigrants and foreign visitors as the hidden hand of subversion. The new trope was Germans as a hidden fifth column already within Britain. Most active of all was a mischievous thriller-writer called William le Queux. He almost single-handedly created a fifth-column panic and then demanded the creation of a domestic security service to combat the undercover ‘German Menace’, with which the day of reckoning would surely come.12 Le Queux’s The Invasion of 1910 became the most influential of these books. Published in 1906, it told of German armies over-running the country with the help of spies and saboteurs. Le Queux admitted to a political purpose, explaining his intention to illustrate how poorly British defences would stand up to this sort of sneak attack. He also insisted that the content of his book was factually correct, and had been informed by conversations with ‘the authorities’.13

William le Queux posed as an international espionage expert, but was in fact nothing of the sort. Instead, he was a tireless and well-paid pulp-fiction writer who produced five novels a year until his death in 1927.14 The Invasion of 1910 sold more than a million copies, and publicists at the Daily Mail, which possessed serialisation rights, sent columns of men marching up Oxford Street dressed in Prussian uniforms, complete with bloodstained gloves, carrying sandwich boards that advertised the book.15 An inevitable flood of literary emulators hit the presses as le Queux’s royalties rolled in. Not to be outdone, le Queux responded in 1909 with Spies of the Kaiser, which insisted that no fewer than 5,000 German undercover operatives were at work in Britain. This was a new idea. A whole undercover army, not just a few spies and saboteurs, were apparently biding their time until the Fatherland told them to retrieve their weapons from a series of arms dumps in the British countryside. No less important, the novel also claimed to offer the inside story of intrepid British detectives working with agents to uncover these foreign networks.16

The British public were whipped into a frenzy. Politicians who wanted to expand Britain’s relatively small peacetime army jumped on the bandwagon. In 1908 Lord Roberts, Britain’s most distinguished soldier, claimed there were 80,000 trained undercover German soldiers in England ready to assist in the event of an invasion.17 Newspapers offered £10 to members of the public who reported sightings of suspicious activities that they could pass on to le Queux so he could ‘supplement his investigations’. Unsurprisingly, they were inundated with information, and soon it seemed a supposed German saboteur had been spotted in every town in the land,18 including some unfortunate Foreign Office clerical staff holidaying on the east coast.19 The government was annoyed by the obvious political scheming by advocates of increased arms spending. In 1906, Asquith’s predecessor as prime minister, Henry Campbell-Bannerman, rose to his feet in Parliament to denounce le Queux as a ‘pernicious scaremonger’ whose stories risked provoking an unnecessary war with Germany.20

Despite prime ministerial condemnation, several key figures in government worked hand in glove with le Queux. James Edmonds, head of a fledgling military intelligence unit called MO(5), maintained that Berlin had an extensive ring of operatives in Britain. Edmonds had long been nagging a dismissive Richard Haldane, secretary of state for war under both Campbell-Bannerman and Asquith, about the shortcomings of British counter-espionage. He therefore found le Queux’s activities more than welcome.21 Indeed, much of the evidence that he presented to his masters came from le Queux, who in turn said that he had received it from concerned members of the public. There had only been five cases of German espionage reported in 1907, but unsurprisingly by 1908 this had risen to forty-eight. Edmonds created a helpful map of agent sightings. Perhaps equally unsurprisingly, this was soon leaked to the press. He also recruited William Melville, the former head of Special Branch, who while a talented agent-runner, had a reputation for embellishing his stories.22

By 1909, nefarious German agents were apparently hiding behind almost every bush in Britain. Asquith, however, had other things on his mind. His overwhelming, and rather challenging, priority was to take on and reform the House of Lords, which had consistently blocked his progressive agenda. The time and energy he devoted to this issue only increased further when the Lords famously rejected his government’s budget in 1909. But with the public suffering from spy-fever, the prime minister now had to take note of intelligence matters. As chancellor of the exchequer and in his early months as prime minister, Asquith had already chaired a senior committee to consider the invasion threat in response to pressure from Roberts and le Queux. His report demolished their theories, and showed a surprise attack to be impossible.23 Nonetheless, still under immense public pressure, in 1909 Asquith asked the Committee of Imperial Defence to consider the danger of foreign agents operating in the UK. All this accelerated an important cultural change away from the idea that counter-espionage at home was authoritarian and un-British.24

Although flawed and bogus intelligence reports shaped its ultimate findings, Asquith swiftly sanctioned the committee’s recommendation to establish a new Secret Service Bureau. This top-secret decision – very few people knew about the bureau’s existence – fundamentally altered the landscape of British intelligence forever. British espionage was nothing new, but its formalisation and growing proximity to Downing Street marked the beginning of a more organised and centralised intelligence system. It was not yet, though, an intelligence community linked to Downing Street, and early prime ministers remained unable or unwilling to engage with the secret world particularly closely.

The Secret Service Bureau was comprised of two branches. MO5(g) was the domestic branch, responsible for counter-espionage, and would soon come to be known as ‘MI5’, or the security service. It inherited a number of army counter-intelligence officers, and was led by Captain Vernon Kell, deputy to James Edmonds at MO(5). Kell went on to serve continuously in the role for more than twenty years. Ever present around intelligence matters for nearly half a century, Winston Churchill, as home secretary, oversaw Kell’s appointment. Adding a symmetry to Kell’s long career as spymaster, Churchill, when prime minister, would remove him from office in 1940.25 The Secret Service Bureau also had a foreign branch. Initially called MI1c, it soon restyled itself MI6, and was headed by the remarkable figure of Sir Mansfield Cumming, a retired naval officer. Despite losing his leg in a traffic accident in France, Cumming continued to run MI6, speeding down the corridors of Whitehall by planting his wooden leg firmly on a modified child’s scooter. MI5 was a small organisation and MI6 even smaller, but a key change had occurred. Hitherto, individual government departments, especially the India Office, had gathered intelligence locally and conducted espionage for their own purposes. Now Whitehall had an interdepartmental intelligence machine at the centre, delivering a ‘service’ to all government departments and anointed with the cult of specialness.26

After 1909, Asquith’s government went further. Harassed by continued public concern about nefarious German activities, it introduced the trappings of a secret state that previous successive governments had resisted for a century. Between 1909 and 1911, Asquith not only created the Secret Service Bureau, but also passed a draconian Official Secrets Act and allowed for much wider mail interception, something a Liberal government had banned as a diabolical infringement of liberties some fifty years before.27 The new Official Secrets Act, encouraged by Edmonds of MO(5), also helped the government to crack down on the press.28 Asquith, a facilitator rather than a dictatorial prime minister, also set up a new committee under Winston Churchill to consider how Britain would tackle ‘Aliens in Time of War’. With foreigners and exiles at the heart of this scare, the government created a register of aliens living in Britain. By 1913, it would have 11,000 Germans on this list, and had already prepared internment legislation.29 Notwithstanding domestic spy-fever, on the eve of the First World War much British intelligence activity lay elsewhere. Intrepid consuls, attachés and military officers carried out most of the spying on German armament programmes, while MI6 relied on the collection of specialist journals by travellers, or open observations, rather than actual espionage. Despite a lack of coordinated assessment, this material gradually filtered up into the higher reaches of government and influenced Britain’s diplomatic and strategic behaviour.30

The most immediate physical threat to Asquith came not from swarms of German spies, but from other quarters, notably the suffragette movement. In September 1909, two women were busy improving their shooting skills at a rifle range at 92 Tottenham Court Road with the rather improbable name of ‘Fairyland’. They intended to assassinate the prime minister, who was a firm opponent of votes for women. The two would-be assassins planned to join a group of suffragettes who had been picketing the gates of Parliament for eight weeks. Asquith passed them frequently, and therefore presented a tempting close-range target. Fortunately for the prime minister, the police received a tip-off. The informant was a Mrs Moore, a member of the Women’s Freedom League, but also a close friend of Asquith’s sister-in-law. She was an advocate of peaceful protest, and spent a great deal of time trying to dissuade her fellow suffragettes from violent acts.

Moore produced a letter from one of the two women who had been practising with a revolver.31 She refused to name names, but the police made enquiries at the shooting range, whose owner, Henry Morley, told them that two suffragettes had indeed been practising with a Browning automatic pistol. Their alarm was increased by the knowledge that the same range, and the same type of pistol, had been used only months earlier by an assassin who had killed Sir William Curzon-Wylie, aide to the secretary of state for India. Although undercover officers hung about for some days afterwards, neither woman returned. This left Asquith’s government with a dilemma familiar to later administrations dealing with terrorist threats. They knew full well that there would be serious recriminations if they did nothing and the prime minister was assassinated. The police did not remove the protesters from outside Parliament, but increased the number of officers there instead. They did not wish to give prominence to the idea of assassination, fearing that publicity might ‘act on the minds of these half-insane women, and might suggest effectively the commission of the very act which we wish to prevent’. Moreover, the removal of the pickets would be looked on by the women as an act of violence and injustice, and would ‘make them furious and more ready to commit such a crime’. In addition, the government thought that if there was an assassin, it would be easier to stop her if police knew she would be amongst the picketers, rather than walking ‘up and down between the House of Parliament and Downing Street at the hour when the P.M. may be expected to drive down’. Thanks to Mrs Moore, the prime minister remained able to pass in and out of Parliament unscathed.32 Recent research shows that the suffragettes included some notably dangerous groups, who fire-bombed churches and later sent a letter-bomb to Lloyd George. Some of the more violent women would go on to become active supporters of the extreme right, including Oswald Mosley’s blackshirts.33 Yet, remarkably, Asquith and all his successors through to the Second World War remained largely unprotected.

It was an act of assassination that finally triggered the outbreak of war in August 1914. Intelligence now had a more crucial – and real – role to play. The new secret services quickly pounced upon the small German espionage network in London, and rounded up all twenty-two known agents. The authorities had been assiduously following this spy ring, run from a barber shop in London by a naturalised German, since 1911. In an early intelligence success story, close monitoring had prevented the ring from passing useful information on to Berlin. Several hundred people were placed under surveillance. Predictably, the biggest problem was public paranoia. In the first two weeks of the war, the Metropolitan Police were forced to investigate thousands of people, with little to show for it. The newspapers followed this eagerly, and noted with satisfaction that by the end of November 1914 there had been over 100,000 reports of espionage, with 6,000 homes entered and searched.

Popular enthusiasm for war, combined with paranoia about spies, forced the Asquith government to look tough. Eleven German spies were shot at the Tower of London, a location chosen for its sinister appearance and reputation. More people were executed there during the First World War than under the Tudors. The amateurish German spies were not difficult to capture. They used lemon juice and peppermint oil instead of ink to render their reports to Berlin invisible, but were often arrested in possession of pen nibs corroded by the acidic lemon juice.34 Such tales allowed le Queux to continue to pump out his pulp-fiction spy thrillers. He maintained his phoney reputation as a spymaster to the end, and even now some of his relatives insist that he was assassinated by Russian agents in 1927.35

No one was safe from the paranoid public. Not even Charles Rennie Mackintosh, the Scottish architect and designer, who dared to sketch in the Suffolk village of Walberswick, close to the sea; or the composer Ralph Vaughan Williams, who sat down with a notebook to write ‘The Lark Ascending’ on cliffs near Margate. Both attracted vigorous police attention. Any Continental connection became a form of contagion. A Polish girl, who was a friend of the Asquith family, was fired from her teaching job simply out of fear that she might be mistaken for a German spy.36 The Asquith government stepped up internment, rounding up some 60,000 Germans living in Britain.37 Under popular pressure, and perhaps against his better judgement, the prime minister personally emphasised that all non-naturalised adult males ‘should, for their own safety, and that of the community, be segregated and interned, or, if over military age, repatriated’.38

The First World War triggered Britain’s tangible intelligence changes. MI5 had only fifteen staff prior to the conflict, but it soon expanded. The Post Office also assumed an intelligence function. It grew into a Censor’s Office that employed over 2,000 officials, each steaming, scanning and resealing some 150 letters per day. Britain now boasted a serious domestic surveillance apparatus.39 By the last year of the war, censorship employed 4,871 people, a sizeable engine of surveillance.40 In the empire, MI5 worked closely with security agencies in Delhi to thwart German plots to promote revolts amongst imperial subjects. With good intelligence to hand, Asquith’s government allowed the German Foreign Ministry to continue its ludicrously ambitious plans to promote insurrection on the subcontinent, content that they were unlikely to succeed.41

Overseas, MI6 remained weak. The majority of important international intelligence instead came from a revival of codebreaking. For at least a decade before 1914, the War Office had plans to recreate a codebreaking centre if a military crisis occurred, and both the army and navy did so independently in August 1914. Although they initially cooperated, differences developed in both personality and approach, rendering any harmony short-lived. Nonetheless, they still managed to break German, French and American codes, alongside a host of other streams of high-level communications. Starting from scratch in 1914, this was an amazing feat. The Admiralty’s famous codebreaking unit, codenamed ‘Room 40’, was the more effective; directed by Reginald ‘Blinker’ Hall, it pioneered many of the scientific methods used by Bletchley Park two decades later.42

The First World War may have transformed British intelligence collection, but Asquith still took little interest. The prime minister was in fact deeply uninterested in war, strategy or intelligence, although he found time for bridge, lavish dinner parties and country weekends. He was not lacking in energy or application, but his focus was elsewhere, not least on his mistress Venetia Stanley, more than thirty years his junior. Asquith wrote to her over five hundred times during his period as war leader, sometimes as often as three times a day. The qualities that had made him a good peacetime prime minister were unhelpful in wartime. He was an affable chairman of the board, able to reconcile differences of opinion and find compromises. But he failed to appreciate the value of some of his partners in the wartime Liberal–Conservative coalition, and above all he failed to take hard decisions that were required for the vigorous prosecution of the war. He offered little guidance and support to the military, which was then led by Field Marshal Lord Kitchener.43

Intelligence proved important in the context of Ireland. Again, however, Asquith seemed broadly unaware of troubling developments, and instead engaged intermittently with particular incidents. The British had failed to properly penetrate the dissident movement, so human sources inside Ireland were few, and their reports fragmented and contradictory.44 Consequently, little warning of the 1916 Easter Rising came through these channels. Room 40 provided more solid intelligence. Decrypted secret German cables from America gave important intelligence on the international activities of Irish nationalists, including details relating to the Rising, during which Berlin assisted the exiled Irish nationalist Roger Casement in fomenting rebellion. Casement’s dealings were not news to the prime minister. Although the flow of intelligence to Downing Street was patchy, Asquith had enjoyed a stream of incriminating material on Casement.45 What appeared to be an intelligence bonanza turned out to have come from an untrustworthy source, Casement’s bisexual manservant and lover, who was ‘a liar, a blackmailer and a fantasist’. When Casement found out about his betrayal he publicly (but falsely) alleged a British plot to murder him. Although the incident embarrassed Asquith’s government, it was enough for MI5 to open a file on Casement and unearth more details of his nationalist scheming – and ultimately his German connections.46

Room 40 intercepted more than thirty cables dealing with German assistance to Ireland during the first two years of the war.47 The codebreakers not only gave full warning of the Easter Rising, but also revealed Germany’s plans to send weapons to Ireland in an attempt to divert British attention from the Western Front, allowing the Royal Navy to intercept a German U-boat carrying Casement to Ireland and the arms shipment to be captured. The signals intelligence, though, was only sent to a small military circle. It seemingly did not reach the politicians, even Asquith.48 Nor did it reach the authorities in Dublin. The sorry episode reflects the perennial problem of using signals intelligence: it is difficult to do so without compromising the source, thereby leading to a reluctance to share, even inside Westminster. More intriguingly, there is evidence that the British authorities deliberately allowed the Easter Rising to go ahead in order to justify repression of the Irish dissidents. Under interrogation, Casement offered to publicly call off the rebellion, but this was declined. Instead, he was told that ‘it’s a festering sore’, and it was ‘much better it should come to a head’.49 Either way, the Easter Rising failed.

Despite the work of Room 40, Asquith experienced the rebellion as ‘a real bolt from the blue’ – albeit one with a ‘comic side’.50 His wife Margot confessed in her diary that ‘none of us had any idea what had really happened’.51 Upon hearing the news of the Easter Rising, and in the midst of a conscription crisis, the prime minister simply said, ‘Well, that’s something,’ and went to bed. Intelligence seemingly had little impact in Number 10. Such nonchalance belies Asquith’s growing interest in Irish affairs, which had been a key issue in the months prior to war. He subsequently took on the office of Irish secretary himself, and headed off to Dublin to try unsuccessfully to sort things out.52 General John Maxwell, appointed by Asquith to force a military solution on a political problem, drew on Special Branch intelligence to persuade the prime minister that the case against every executed rebel leader had been overwhelming.53

They included Roger Casement. Partly because signals intelligence had thoroughly convinced the authorities of his treacherous links with Germany, Casement was hanged in Pentonville Prison in August 1916. To counter calls for clemency, the ‘Casement Diaries’, containing what were regarded as shocking descriptions of Casement’s homosexual exploits, were leaked by Blinker Hall to influence the trial. Previously, many Irish nationalists had mistakenly insisted that these diaries were forgeries.54 This episode underlines the long history of the selective use of intelligence to influence public opinion.

Meanwhile, the seemingly directionless war strategy left the cabinet unimpressed. Discontent also arose over the quality of information reaching them. Asquith had formed an ultimately unpopular coalition government, with Andrew Bonar Law as his Tory partner. In early September 1915, Bonar Law pressed the prime minister to make changes to the leadership of the war effort. He sought the resurrection of a General Staff at the War Office, with the hope that this would result in better strategic advice to cabinet. Nothing was done until 22 September, when Kitchener was conveniently absent. The Tories then took the lead and insisted on a smaller and more active War Council, together with the provision of better intelligence to cabinet by the General Staff. Asquith was finally forced to write to Kitchener, insisting on an improved flow of intelligence to the centre. He appointed General Archibald Murray as the new Chief of the Imperial General Staff, but beyond that none of the suggested reforms were implemented, and Asquith did not follow up on the cabinet’s requests for more intelligence.55

The Asquith coalition government disintegrated in late 1916, as a result of its own incompetence and disorder. Lacking personal authority, Asquith had spent much of his time assembling factions and alliances. There was little planning, and astonishingly, letters sent by the prime minister to the King after each meeting formed the only record of cabinet discussions. When Bonar Law joined the coalition in 1915 he had been amazed by the lack of any method or even agenda for cabinet meetings. The failure of the Gallipoli campaign at the start of 1916 accelerated the decline of the Asquith government. Mercifully for the war effort, in June 1916 Lord Kitchener, the aged secretary of state for war, died at sea off the Orkneys in mysterious circumstances, an event that many attributed to a bewildering mixture of German, Irish or Russian saboteurs. He was replaced by the energetic David Lloyd George. At the end of the year, however, both Asquith and Lloyd George resigned in short order, while Bonar Law declined to form a government. Lloyd George became head of a new coalition two days later, establishing a Supreme War Council. Neither Asquith nor Bonar Law was mentally equipped to handle the range of decisions required by modern war. The main challenge for Lloyd George, now and for the rest of the war, was to try to wrest strategic control of the conflict from the military chiefs, a task that he never quite completed.56

Asquith had been notably detached from the business of war. He may have presided over the creation of the Secret Service Bureau and the rapid expansion of every kind of intelligence after 1914, but it had interested him very little. By contrast, in December 1916, David Lloyd George became the first prime minister to embrace intelligence, albeit often in an amateurish manner. This was partly to do with his nature, for he was by temperament a man of enormous energy and sudden impulses. But his initial mistakes also reflected the fact that British intelligence lacked a central brain. No system existed for sifting and interpreting intelligence for top policymakers. Despite a quantum leap in the organisation of Downing Street, and the creation of the Cabinet Office in late 1916, intelligence was deliberately left out. As a result, Lloyd George lacked context and made emotional responses to the raw intelligence he received – with unhappy results.57

His previous interactions with intelligence had been in the context of the ongoing spy-mania. In May 1915, as minister of munitions, he sought to confront the problem of factory explosions. Such disasters were almost invariably the result of primitive manufacturing processes, running at maximum capacity, which did not privilege safety. Like many others, however, Lloyd George was obsessed with the danger of the German ‘hidden hand’, and blamed saboteurs. His staff were allowed to set up a counter-intelligence unit to ferret out these imaginary enemies. Given the name P.M.S.2, it failed to find any spies, and slowly shifted its attention to trade union activity in the munitions factories.58

Lloyd George later admitted that he and some of his friends had deliberately encouraged rumours of saboteurs within the British munitions programme. This included the vast shell-filling factory at Chilwell on the banks of the River Trent in Nottingham, the largest concentration of high explosives anywhere in Britain. In January 1916, a Zeppelin was reported to be hunting up and down the Trent, supposedly hoping to bomb the factory. The next day, rumours circulated that Lloyd George’s friend Lord Chetwynd, who ran the huge complex, had caught three German spies in the act of trying to guide the Zeppelin to its target with hand-held torches and had shot them. Chetwynd exploited the false rumour by asking a labourer to dig three graves on the hillside by night, placing an anonymous black post at the head of each. This, recalled Lloyd George, ‘turned the rumour into unquestioned history’ and discouraged the curious from prying around the factory. Predictably, when it suffered a catastrophic explosion later in the war, it was blamed on yet more spies.59

In late 1916, shortly before Lloyd George became prime minister, the Germans asked the American ambassador in Berlin to explain to President Woodrow Wilson that they were ‘anxious to make peace’. But they did not wish to appear weak, so they secretly asked the United States, which was then neutral, to make a ‘spontaneous’ offer of mediation. Unfortunately for Germany, Britain’s Room 40 had decrypted the American message. When Lloyd George read it, he wrongly assumed that it signified collaboration between America and Germany. With the cabinet in disarray, and lacking intelligence-assessment machinery, the impulsive Lloyd George decided to act alone. He warned the American press against interference by Washington, and asserted that the war must be a ‘fight to the finish’. In reality, President Wilson was immersed in an election campaign and had no interest in peace initiatives at this point. Either way, diplomacy was not Lloyd George’s responsibility. When rebuked by the foreign secretary for meddling, he used the decrypts to defend himself. Far worse, he also alluded to secret information when explaining his actions in Parliament. Even as he assumed office in Downing Street in December 1916, more decrypts crossed his desk which he wrongly – and amateurishly – assumed suggested that the Kaiser and Wilson were still working together. This was not an auspicious beginning, and pointed to a wider failure around the assessment of intelligence at the centre of government.60

Lloyd George brought his undoubted talents for planning and organisation to the highest level of government. The most important part of this reform was the creation of a professional secretariat by Maurice Hankey, a former Royal Marine officer who became the first cabinet secretary. His background was in intelligence – as a junior officer assigned to HMS Ramillies, the flagship of the Mediterranean Fleet, he had engaged in unofficial reconnaissance. By 1902, he had joined the staff of the Naval Intelligence Department in Whitehall. An outstanding officer who spoke many languages, he was the perfect administrator. In 1909, he had written a report for the Committee of Imperial Defence that proposed a Secret Service Bureau.61 Now, in the newly created Cabinet Office, he was joined by Thomas Jones. Once described as ‘a disguised Bolshevik whom Lloyd George had discovered somewhere in a Welsh coal pit’, Jones was nevertheless an equally formidable organiser. It is difficult to capture the chaos that surrounded cabinet affairs before their arrival, and it is no exaggeration to say that they invented modern cabinet government.62

Hankey’s reforms were a triumph. They became central to the development of a modern British interdepartmental coordination system, with its labyrinthine sub-committees and orderly minutes focused on Downing Street. Cabinet meetings were no longer rambling conversations amongst twenty-three people, with no agenda. Instead, they became businesslike discussions at which decisions were made and properly recorded. Yet the reforms were a tragedy for secret service. Hankey created a central mechanism for everything except intelligence. Jones, his deputy, recalled that he had been insistent that the new Cabinet Secretariat should not become ‘an Intelligence department’,63 and although the design of the war cabinet at first envisaged ‘a comprehensive and regular gathering of intelligence’, this never happened.64 The lack of a central clearing house for assessing intelligence had been a constant criticism of government for some time, so while Hankey is celebrated as a moderniser of the government machine, he simultaneously retarded the British intelligence community by twenty years. The idea of a central intelligence machine located alongside Downing Street had to await a further world war, and the arrival of Winston Churchill as premier.65

Lloyd George’s personal record as a user of decrypts did not improve during the war. He was often left to deduce the story from individual intercepts, or ‘flimsies’ as they were called, because of the thin paper on which they were recorded, that arrived without context or comment. He was also given little guidance on the need for security. Thus in February 1917, when the American ambassador, Walter Page, visited Downing Street to convey a message from President Wilson, the prime minister could not restrain himself. He boasted that he had already seen Wilson’s message, attributing this to a leak. Page thought it possible that the telegram had been obtained by a ‘British spy service’ from an unreliable American official. In any case, knowing Wilson’s hatred of leaks, he did not inform Washington. Indeed, the president was obsessively secretive, and actually insisted on deciphering his more sensitive telegrams himself, sometimes with the help of his wife. The realisation that Lloyd George was reading his every word would not have endeared London to him.66

Surprisingly, even as Lloyd George put their work in peril, British codebreakers delivered the greatest intelligence coup of the First World War. They had intercepted what would soon become famous as the ‘Zimmermann telegram’. In this amazing message, Germany’s foreign minister, Arthur Zimmermann, promised Mexico the reward of three of America’s southern states if she joined the German cause and declared war on her northern neighbour, the US. The message was one of the most secret of the war, and was supposed to have been taken by safe hand on a German submarine. But the vessel broke down before leaving port, forcing Berlin to trust the safety of its ciphers.

The Zimmermann telegram is a rare example of a single piece of intelligence changing the course of history. The way in which the British exposed it was elegant, but had nothing to do with Downing Street. Instead, it was a cooperative venture between Room 40 and the Foreign Office – and perhaps for that reason it was not bungled. Lloyd George, doubtless kept abreast given his strong interest in American orientations, was a mere observer. President Woodrow Wilson had won his recent election campaign on the slogan ‘He kept us out of war’. But, provoked by the Zimmermann telegram, alongside Berlin’s aggressive submarine policy, he declared war on Germany in April 1917.67 In his memoirs, Lloyd George records his gratitude to the codebreakers of Room 40 and their ‘uncanny efficiency in the unearthing of German secrets’.68

By the end of the war everyone seemed to be aware of the British secret service. The famous German philosopher Hannah Arendt, for example, was fascinated by the rise of Britain’s professional spies. She wrote that after the First World War, British secret services ‘began to attract England’s best sons, who preferred serving mysterious forces all over the world to serving the common good of their country’, adding that as a result ‘the stage seemed to be set for all possible horrors’. However, she noted that with the British, unlike the Russians and Germans, ‘a minimum of human rights was always safeguarded’.69 Bertolt Brecht wrote that Britain controlled detective fiction and also controlled the world, clearly feeling that these two things were connected in some subterranean way.70

Room 40 was created as a wartime emergency. Nevertheless, its product proved too valuable for it to disband once the guns fell silent, and in peacetime Britain continued to read the secret communications of many countries. As the armistice talks opened in France, President Wilson sent his trusted confidant Colonel Edward House to join the negotiations. Lloyd George was able to read everything sent between House and Wilson. Yet strangely he had not been bitten by the intelligence bug, and useful as he found it, was not an enthusiast. Intelligence spending dwindled dramatically after the war, and the prime minister was happy to leave the reorganisation of peacetime intelligence matters to his cabinet colleagues. Accordingly, although Lloyd George established a governmental committee to review secret service in 1919, he did not join it. Instead, Churchill, an avid intelligence enthusiast, was the leading light in this important reordering.71 Its most important decision would be to maintain the wartime codebreaking effort and focus all resources in one unit: the Government Code and Cypher School, or GC&CS.72

Nonetheless, in February 1920, Lloyd George was required to revisit intelligence matters. He sought to end the festering conflict with the Bolsheviks, viewing Britain’s support for the White Russians as an unhappy extension of the First World War, and therefore a chapter that should now be closed. Although reluctant to offer recognition to the revolutionaries, the prime minister offered Moscow trade agreements as a path to restoring relations. His cabinet colleagues Churchill and Curzon were horrified, not least because of mounting evidence of Bolshevik subversion against the British Empire. Indeed, although there was clear evidence of Soviet funds going directly to the increasingly communist-dominated Labour Research Department during the early 1920s, it was Moscow’s interference in areas such as India that really got the British cabinet excited.73 MI6 had been active in this clandestine conflict too, and many military intelligence officers who had been heavily involved in the Russian Civil War were also dismayed.74

Once more, Lloyd George had access to his opponents’ decrypts. Not for the last time, a British leader was able to read the derogatory terms in which his opposite numbers discussed him. Lenin denounced the prime minister as a deceiving ‘swine’ and a man without scruples, and urged the Soviet trade delegation in London to repay him with even greater levels of deception. This, of course, was difficult, given that every line of Lenin’s instructions was being decoded by the British. Lloyd George declared himself ‘unruffled by Bolshevik intrigues’, which he considered amateurish and unimportant. He was also prepared to turn a blind eye to the war between Russia and Poland that developed in late 1919. But Moscow was a highly political and divisive issue, and by early 1920, some senior military chiefs had begun to question Lloyd George’s motives. On 15 January General Henry Wilson, the Chief of the Imperial General Staff, wrote in his diary: ‘I keep wondering if L.G. is a traitor & a Bolshevist, & I will watch him very carefully.’ Wilson was especially paranoid about Bolshevik plots, and made several similar entries to the same effect over the next few months.75

The activities of Soviet negotiators in Britain were inflammatory. In August 1920 Leonid Krasin, a Soviet trade representative, had arrived for talks accompanied by Lev Kamenev, head of the Moscow Communist Party. Decrypts clearly showed that Kamenev was establishing secret contact with the embryonic British Communist Party, and subsidising the far-left newspaper the Daily Herald, using smuggled diamonds. Every move was visible to the codebreakers, and General Wilson was incredulous that Lloyd George had not immediately ejected the trade mission. On 18 August, Wilson confided his worries to Winston Churchill and the director of military intelligence, General Sir William Thwaites. Over the next few days he did the rounds of the security chiefs, including Lord Trenchard, who commanded the RAF, Sir Basil Thompson from the Home Office, and Rear Admiral Hugh ‘Quex’ Sinclair, director of naval intelligence, and received a sympathetic hearing.76 On 24 August he noted in his diary: ‘Trenchard with whom I discussed the matter later and to whom I showed … the intercepts thinks like Basil Thompson, that Lloyd George is a traitor.’77

On 2 September, with Lloyd George away in Lucerne, his coalition partner Bonar Law summoned a meeting at Downing Street that included Balfour, Churchill and Basil Thompson. Thompson circulated the latest material from the codebreakers. Thomas Jones, the deputy cabinet secretary, recalled that ‘Everyone felt that the last intercept from Lenin where he lays down propaganda as the business of the Russian Delegation put the lid on and that there was nothing for it but to clear them out as quickly as possible.’78

Hankey, who had accompanied Lloyd George to Lucerne, argued exactly the opposite. He insisted that Wilson was absurdly alarmist, and that the activities of the Soviets in London were silly and easy to counter. His main worry was that if they ejected the Soviets they would have to publish the decrypts to justify their actions, placing the prime minister in a very difficult position. Britain would then lose its ‘most valuable and trustworthy source of secret information’, as no matter what they did to try to disguise the fact, Moscow would probably realise its communications were being read. He continued: ‘This particular cypher is a very ingenious one which was discovered by great cleverness and hard work. The key of the cypher is changed daily and sometimes as often as three times in one message. Hence if it becomes known that we decoded the messages all the governments of the world will probably discover that no messages are safe.’79

Back in London, Lloyd George forced a showdown with his critics. He freely admitted that the Soviets were engaged in ‘perfidy’ and ‘trickery’, but argued that good intelligence could be obtained by keeping the trade mission in place. Although he thought their activities ineffective, he could see that political opinion in cabinet was turning against him, and probably regretted not having taken a closer interest in secret service matters, since the intelligence chiefs had been part of this pressure to act. An opportunity to do so arose in early September, when Kamenev decided to return to Moscow and came to Downing Street to pay his respects. He walked into a diplomatic ambush. Lloyd George met him accompanied by Hankey, Jones and Bonar Law. The prime minister opened with a tirade about ‘gross bad faith’ and interference in British internal affairs, including Soviet attempts to recruit labour leaders and secretly subsidise the Daily Herald. He also accused Kamenev of attempting to turn Poland into a client Soviet state – but did not mention the decrypts. There was obviously a double game going on here, with the prime minister trying to clear himself of suspicions of being overly sympathetic to Bolshevism.80 Perhaps for audience effect, he warned Kamenev that if he did not leave Britain he would be deported.81

Lloyd George’s hard line resulted in his also being criticised by the left, so he was eventually pushed into publishing eight of the intercepts. He used a rather thin cover story, claiming that they had been provided by a neutral country. Churchill, showing his characteristic impulsiveness and little nuanced appreciation of the value of intelligence, had led the charge demanding publication. Amazingly, blinded by their ideological hatred of Moscow, the intelligence chiefs had agreed. Quex Sinclair, now head of MI6, who had superintended the best wartime codebreakers, insisted that ‘even if the publication of the telegrams was to result in not another message being decoded, then the present situation would fully justify it’. Intelligence officials leaked further decrypts to newspapers three weeks later. Lloyd George fired Basil Thompson shortly afterwards, leading some to suspect that it was he who was responsible for the leak. His departure was a positive move, and ensured that the Foreign Office and MI6 extended full control over foreign intelligence.82

The prime minister maintained his policy regardless, and secured an Anglo–Soviet trade agreement in 1921. Although a further surge of Soviet subversive activity was discovered in 1922, Lloyd George was overtaken by political scandal before he could respond, accusations of selling seats in the House of Lords forcing him to resign in October. In the summer his colleagues, led by Bonar Law, had chosen to make more Soviet decrypts public. Moscow predictably changed its cipher system, and an important stream of high-grade intelligence disappeared.83 Despite the deliberate and foolish revelations of 1920, 1922 and 1923, GC&CS continued to read much high-level Soviet traffic.84

Astoundingly, Soviet incompetence was even greater than that of the British. As early as July 1920, Kamenev and his colleagues had requested a replacement for their ‘Marta’ cipher system, believing it to be insecure. But their superiors resisted this request as requiring too much effort. They not only ignored the revelations in The Times but also strident warnings from senior Red Army commanders that their most secret correspondence in Europe ‘is known word for word to the English, who have organised a network of stations designed particularly for listening to our radio’. By the end of 1920, Georgy Chicherin, the long-serving Soviet foreign minister, seemed to have got the message, and warned his mission in London that very sensitive material should be sent only by courier. But many secret communications continued to be intercepted by GC&CS.85

GC&CS therefore remained the star in Britain’s interwar intelligence firmament. Between 1920 and 1924, it issued over 13,000 intercepted signals, approximately 290 a month, including more than half of all French traffic. Yet little of this went to Downing Street. If the prime minister was not regularly in receipt of these gems, where did they go? The answer is to the Foreign Office, which aggressively clawed back control over foreign intelligence from the military following the end of the war. Intercepts informed the negotiation of complex post-war settlements and treaties that followed the First World War, such as those at Sèvres and Lausanne, often giving British diplomats the upper hand. One of the most important customers was the foreign secretary, Lord Curzon. By 1922, Curzon also enjoyed power over distribution, deciding what secrets should go to the prime minister or to members of the cabinet. Unfortunately, the decrypts often revealed the fact that Lloyd George was pursuing a separate and secret foreign policy, entirely undeclared to Curzon, and was sometimes backing the Greeks in treaty negotiations against his own foreign secretary. Curzon was an emotional individual, and knowledge of the ‘dirty’ activities of his friends and allies stirred apoplectic outbursts. In 1922, meeting with the French prime minister Raymond Poincaré, Curzon had to be led weeping from the room, and refused to return until Poincaré apologised for his behaviour.86

Curzon deliberately kept much intelligence away from Downing Street. Things were made worse by the lack of a system for synthesising intelligence material and presenting it to leaders in a way that would allow it to inform strategy. Instead, attention often focused on single documents. This was typified by the impact of intelligence on talks about the future of Britain’s alliance with Japan during the early 1920s, a decision that would cast a long shadow. Intelligence focused less on Japan’s intentions and capabilities than on plots and nefarious activities: Lloyd George told cabinet that other friendly powers did things that were ‘infinitely worse’ than the Japanese secret service. Curzon argued for a renewal of the alliance, despite the fact that he considered the Japanese ‘insidious and unscrupulous’. Churchill opposed a continued alliance with Tokyo, and to back up his argument showed his cabinet colleagues a secret Japanese map of Gibraltar that had come into the hands of MI5. Intelligence was often about alarms and incidents, and rarely informed national assessments.87

Meanwhile, the Irish problem had been rumbling on. The Easter Rising and the First World War were swiftly followed by the Irish War of Independence in 1919. Peace negotiations began in 1921, culminating in the formation of the Irish Free State the following year. This time Lloyd George lacked signals intelligence, but he did draw upon other forms of intelligence to aid the British position. Unfortunately, the material reaching him and his ministers came from military intelligence officers who opposed the truce. Consequently, they offered biased worst-case scenarios in which Sinn Féin and especially the IRA intended to play for time before resuming their offensive, including ‘fantastical reports’ of chemical weapons. Fortunately for the peace process, a more confident outlook emanated from the civilian authorities in Dublin, and the ‘two opposing interpretations of the Irish situation battled it out from July to December 1921’. Lloyd George fell into the optimistic camp, and was determined to reach peace, but the alarmist intelligence came perilously close to collapsing the negotiations altogether. By early December, the prime minister had had enough. He issued a dramatic ultimatum: accept the peace or resume war in three days. This was a gamble. Contradictory and inaccurate intelligence meant that he had no idea whether Sinn Féin would accept – and Britain was in no position to resume war so soon. However, the starkly pessimistic intelligence coming out of Ireland offered enough warning about IRA rearmament to convince Lloyd George to set a strict deadline. The negotiations hung in the balance, and there was ‘palpable relief’ when the Irish signed the deal.88

Prime ministers must celebrate when they can; success is often short-lived. In May 1922, Lloyd George was livid when he was shown the new Irish government’s draft constitution, despairing that it represented ‘a complete evasion of the treaty’ he had gambled on securing. Intelligence uncovered numerous plots, some more real than others, against Northern Ireland and the British mainland, in which the Dublin government was complicit. Frustrated, Lloyd George feared that the Irish ‘may have to face re-conquest’. When IRA men assassinated Field Marshal Henry Wilson in London the following month, the government found itself under pressure to wipe out the IRA headquarters in Dublin. A single piece of intelligence wrongly linked the murder to a Dublin conspiracy, and an attack on the IRA headquarters by British troops would have wrecked Britain’s Irish policy ‘at one stroke’. Nevertheless, led by Churchill, the cabinet approved the strike. Once more, Churchill failed to appreciate the nuances of raw intelligence and exhibited his famous impetuousness. All this frustrated the prime minister, but fortunately for Lloyd George and his Ireland policy, the army refused to obey the order.89 This marked Lloyd George’s final dealings with the Ireland problem, but Churchill would have to return to it during the Second World War. More ominously, it was merely a taste of the troubles to come for future prime ministers, from Harold Wilson onwards.

Bonar Law, who replaced Lloyd George in 1922, was the shortest-serving prime minister of the twentieth century, spending only 211 days in office. He died of a throat tumour shortly afterwards, and was buried in Westminster Abbey near the Tomb of the Unknown Soldier. During the funeral, Asquith described him as ‘the unknown prime minister’. Hankey noted in his diary: ‘Poor Bonar never had the nerve for the job of prime minister. The responsibility preyed on his mind and, I feel sure, hastened on his cancer.’ Turning to Bonar Law’s successor, he added, quite correctly, ‘Baldwin has the nerve but scant capacity and I fear will not last long.’ Stanley Baldwin’s first term in office indeed lasted only eight months, and he stepped down in January 1924. Alongside these figures, Lloyd George appeared a political giant, and it was under him that British intelligence took its most adventurous step forward.90

A connected British intelligence community was not created in 1909, but it had already begun to centralise and professionalise. Indeed, it has been suggested that Asquith’s government changed the very meaning of the word ‘intelligence’. At the turn of the century, intelligence was something that existed in the far-flung service of empire, and meant information of almost any kind, so long as it impacted upon policy or made colonial rule more efficient. Much of it was supplied by an army of enterprising amateurs serving on ‘special duties’, supplemented by eccentrics who divided their time between collecting rare beetles or tulip bulbs and sketching Turkish fortifications. By 1918, intelligence was about secret work, and incorporated a strong emphasis on counter-intelligence. Most importantly, it had also become increasingly militarised, and had embraced the science of codebreaking. Room 40 had produced astonishing intelligence in just four years, but as yet no one knew how to interpret it or to use it securely.91

Lloyd George, perhaps assisted by the wise counsel of Maurice Hankey, had begun to learn his trade. In contrast to his early years as prime minister, by 1920 he knew that context was everything in interpreting decrypts. Accordingly, Lenin’s hot language had not alarmed him. He also came to understand that access to decrypts was acquired with difficulty, and given away easily – a lesson quickly forgotten in Number 10. Therefore, although he eventually discussed codebreaking in his memoirs, he said no more than had already appeared in the public domain, and worked closely with Hankey on the agreed text.92

By contrast, his cabinet colleagues performed poorly – even those with more intelligence experience. Lord Curzon, foreign secretary between 1919 and 1924, should have been a master of intelligence, having presided over a sophisticated espionage system in his previous existence as viceroy of India. Yet personal insults from the French, revealed in all their glory by intercepts, literally drove him to tears of rage. Churchill’s performance was even worse, and despite boundless enthusiasm for intelligence he was impulsive in its use. Moreover, when he rushed out his own history of the First World War in 1923, he made many references to British codebreaking capabilities. The Germans were soon avidly reading his account, and it is no coincidence that shortly afterwards they began to take an interest in a new and effective cipher machine called Enigma. In the mid-1920s, however, Germany had not yet resurfaced as a problem. The First World War was over, and a young man named Adolf Hitler had only recently established a nascent Nazi Party. Instead, it was the Russians who attracted the attention of Britain’s secret service. An early cold war of subversion and subterfuge was emerging, in which incoming prime ministers would need to use intelligence subtly and wisely. Inexperienced in handling the secret world and lacking an integrated intelligence assessment community, this may have been asking too much.





Конец ознакомительного фрагмента. Получить полную версию книги.


Текст предоставлен ООО «ЛитРес».

Прочитайте эту книгу целиком, купив полную легальную версию (https://www.litres.ru/richard-aldrich/the-black-door-spies-secret-intelligence-and-british-prime/) на ЛитРес.

Безопасно оплатить книгу можно банковской картой Visa, MasterCard, Maestro, со счета мобильного телефона, с платежного терминала, в салоне МТС или Связной, через PayPal, WebMoney, Яндекс.Деньги, QIWI Кошелек, бонусными картами или другим удобным Вам способом.