Top

Published in:

2020 | OriginalPaper | Chapter

Hybrid Emerging Threats and Information Warfare: The Story of the Cyber-AI Deception Machine

Authors : Eleonore Pauwels, Sarah W. Deton

Published in: 21st Century Prometheus

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Artificial intelligence is converging with an extraordinary array of other emerging technologies, from cyber and biotechnologies, to affective computing and neurotechnologies, to robotics and additive manufacturing. Yet, this convergence is generating new hybrid threats, and opportunities, that can be leveraged by state, non-state actors, and average citizens alike.

In this paper, we focus on one new hybrid threat in particular – the cyber-AI deception machine. Borne out of the convergence of AI, affective computing, biometrics, neurotechnologies, and cybertechnologies, the deception machine is altering the global intelligence landscape by automating the generation and simulation of data, media, and strategic intelligence. Such fake intelligence has significant implications for the future of propaganda, deception, manipulation, and social-engineering.

By eroding the sense of truth and trust between citizens and the State, between States, and among societies, the cyber-AI deception machine epitomizes the importance of information superiority and its strategic potential for deception and subversion.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Neuroscience-Based Weapons

next chapter Artificial Intelligence and Warfare

“In states that were already authoritarian…governments have increasingly shed the thin façade of democratic practice that they established in previous decades, when international incentives and pressure for reform were stronger. More authoritarian powers are no banning opposition groups or jailing their leaders, dispensing with term limits, and tightening the screws on any independent media that remain. Meanwhile, many countries that democratized after the end of the Cold War have regressed in the face of rampant corruption, antiliberal populist movements, and breakdowns in the rule of law. Most troubling, even long-standing democracies have been shaken by populist political forces and target minorities for discriminatory treatment.” – Freedom House. 2019. Freedom in the World 2019: Democracy in Retreat.

In the 2018 World Economic Forum’s Global Risk Perception Survey, the second most frequently cited risk triggered by technological convergence is the combination of cyberattacks with the manipulation and corruption of critical information infrastructure. The Global Risks Report 2018: 13^th Edition. World Economic Forum, Geneva: Switzerland. http://www3.weforum.org/docs/WEF_GRR18_Report.pdf.

Refer to Dr. Seán ÓhÉigeartaigh’s panel discussion at the Governing Artificial Intelligence expert meeting held on June 22, 2018 at the UN University. See: Session I: Does the AI race threaten international peace and security? “Learning to Live with Artificial Intelligence: A Virtuous Circle or a Vicious One?” International Peace Institute; 22 June 2018. https://www.ipinst.org/2018/06/governing-artificial-intelligence#21.

Accenture website. n.d.. Available at https://www.accenture.com/us-en/service-open-to-disrupt.

Ahiataku, S. 2018. Engaging young innovators in Kumasi with innovation clinic. Global Lab Network; 3 March. https://glabghana.wordpress.com.

Alfifi, M., et al. 2018. Measuring the impact of ISIS social media strategy. http://snap.stanford.edu/mis2/files/MIS2_paper_23.pdf.

Applegate, S.D. 2013. The dawn of kinetic cyber. 5th International Conference on Cyber Conflict; K. Podins, J. Stinissen, M. Maybaum (Eds.). https://ieeexplore.ieee.org/document/6568376.

BBC. 2019. Heathrow airport drone sighting halts departures. BBC News; 8 January. https://www.bbc.com/news/uk-46803713. Also see “Gatwick and Heathrow buying anti-drone equipment.” BBC News; 4 January. https://www.bbc.com/news/uk-46754489.

Bellingcat. 2018. Chemical weapons and absurdity: The disinformation campaign against the white helmets. A joint report in collaboration with Newsy; 18 December.

Bing, C., and J. Schectman. 2019. Inside the UAE’s secret hacking team of American Mercenaries. Reuters; 30 January. https://www.reuters.com/investigates/special-report/usa-spying-raven/.

Bradshaw, S., and P.N. Howard. 2018. Challenging truth and trust: A global inventory of organized social media manipulation. Computational Propaganda Research Project. https://comprop.oii.ox.ac.uk/wp-content/uploads/sites/93/2018/07/ct2018.pdf.

Brundage, M., et al. 2018. The malicious use of artificial intelligence: Forecasting, prevention, and mitigation. University of Oxford. February: p. 44. https://arxiv.org/pdf/1802.07228.pdf; and, Press, G. 2018. The AI cybersecurity arms-race: The bad guys are way ahead. Forbes; 26 April. https://www.forbes.com/sites/gilpress/2018/04/26/the-ai-cybersecurity-arms-race-the-bad-guys-are-way-ahead/#3fc3ac28148e

Choudhary, V. 2019. Does international humanitarian law respond adequately to information warfare? Groningen Journal of International Law, Blog; 21 March. https://grojil.org/2019/03/21/the-truth-under-siege-does-international-humanitarian-law-respond-adequately-to-information-warfare/

Council of Europe. 2018. A.4. in Council of Europe, Committee on Legal Affairs and Human Rights. 2018. Legal challenges related to the hybrid war and human rights obligations. 14 March. http://website-pace.net/documents/19838/4246196/20180314-HybridWar-EN.pdf/3387f663-0e5d-407e-a90b-9e5880474589

DarkTrace. n.d. DarkTrace’s website: https://www.darktrace.com/technology/. “The Threat Visualizer is Darktrace’s real-time, 3D threat notification interface. As well as displaying threat alerts, the Threat Visualizer provides a graphical overview of the day-to-day activity of your network(s), which is easy to use, and accessible for both security specialists and business executives. Using cutting-edge visualization techniques, the Threat Visualizer user interface automatically alerts analysts to significant incidents and threats within their environments, enabling analysts to proactively investigate specific areas of the infrastructure.”

DiResta, R., et al. 2018. The disinformation report. New Knowledge and the U.S. Senate Intelligence Committee: p. 50. https://cdn2.hubspot.net/hubfs/4326998/ira-report-rebrand_FinalJ14.pdf.

Douek. 2018. Douek E. 2018. Facebook’s role in the genocide in Myanmar: New reporting complicates the narrative. Lawfare; 22 October. https://www.lawfareblog.com/facebooks-role-genocide-myanmar-new-reporting-complicates-narrative.

Dunlap, G., and E. Pauwels. 2017. The intelligent and connected Bio-Labs of the Future: Promise and Peril in the Fourth industrial revolution. Wilson Center Policy Briefs (October): pp. 4–6. https://www.wilsoncenter.org/sites/default/files/dunlap_pauwels_intelligent_connected_biolabs_of_future.pdf.

Dvorsky, G. 2017. Hackers have already started to weaponize artificial intelligence. Gizmodo 11 September. https://gizmodo.com/hackers-have-already-started-to-weaponize-artificial-in-1797688425.

E-ISAC. 2016. Analysis of the cyber attack on the Ukrainian Power Grid. Defense Use Case; 18 March. https://www.nerc.com/pa/CI/ESISAC/Documents/E-ISAC_SANS_Ukraine_DUC_18Mar2016.pdf.

Eubanks, N. 2017. The trust cost of cybercrime for business. Forbes; 13 July. https://www.forbes.com/sites/theyec/2017/07/13/the-true-cost-of-cybercrime-for-businesses/#38953fec4947.

Firestone, K. 2018. 2018 manufacturing outlook and 3D-printing’s impact. manufacturing.net; 16 January. https://www.manufacturing.net/blog/2018/01/2018-manufacturing-outlook-and-3d-printings-impact.

Fox, D. 2016. What sparked the Cambrian explosion? Nature; 16 February. https://www.nature.com/news/what-sparked-the-cambrian-explosion-1.19379.

Gavrilovic, A. 2018. [WebDebate summary] Algorithmic diplomacy: Better geopolitical analysis? Concerns about human rights? DiploFoundation; 12 June. https://www.diplomacy.edu/blog/webdebate-summary-algorithmic-diplomacy-better-geopolitical-analysis-concerns-about-human.

Granville, K. 2018. Facebook and Cambridge analytica: What you need to know as fallout widens. The New York Times; 19 March. https://www.nytimes.com/2018/03/19/technology/facebook-cambridge-analytica-explained.html.

Gleiser, M. 2018. Biometric data and the rise of digital dictatorship. NPR; 28 February. https://www.npr.org/sections/13.7/2018/02/28/589477976/biometric-data-and-the-rise-of-digital-dictatorship.

Gwynne, P., and G. Heebner. 2018. Laboratory technology trends: Lab automation and tobotics, the Brave New World of 24/7 Research. Science; 18 January. http://www.sciencemag.org/site/products/robotfinal.xhtml.

Hern, A. 2015. Anonymous ‘at war’ with ISIS, hacktivist group confirms. The Guardian; 7 November. https://www.theguardian.com/technology/2015/nov/17/anonymous-war-isis-hacktivist-group-confirms.

———. 2018. Cambridge Analytica: How did it turn clicks into votes? The Guardian; 6 May. https://www.theguardian.com/news/2018/may/06/cambridge-analytica-how-turn-clicks-into-votes-christopher-wylie.

HIC. 2018. U.S. house intelligence committee. https://investigaterussia.org/media/2018-04-27/house-intelligence-gop-releases-russia-report - https://intelligence.house.gov/uploadedfiles/hpsci_-_declassified_committee_report_redacted_final_redacted.pdf.

Human Rights Council. 2018. Report of the independent international fact-finding mission on Myanmar: p. 14. https://www.ohchr.org/Documents/HRBodies/HRCouncil/FFM-Myanmar/A_HRC_39_64.pdf.

ICRC. 2017a. International Committee of the Red Cross. 2017. Experts discuss new technologies in warfare and international humanitarian law. 22 December. https://www.icrc.org/en/document/experts-discuss-new-technologies-warfare-and-international-humanitarian-law.

———. 2017b. International Committee of the Red Cross. 2013. Cyber warfare and international humanitarian law: the ICRC’s position. p. 2. https://www.icrc.org/en/doc/assets/files/2013/130621-cyber-warfare-q-and-a-eng.pdf.

Ienca, M., and R. Andorno. 2017. Towards new human rights in the age of neuroscience and neurotechnology. Life Sciences, Society and Policy 13 (5). https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5447561/.

India Times. 2018. Soon WhatsApp will only let you forward 5 messages at once, as it tries to wrestle with rumours. India Times; 20 July. https://www.indiatimes.com/technology/news/whatsapp-will-only-let-you-forward-5-messages-in-india-as-a-way-to-restrict-spread-of-rumours-349697.html.

Iwanek K. 2018. WhatsApp, fake news? The internet and risks of misinformation in India. The Diplomat; 30 July. https://thediplomat.com/2018/07/whatsapp-fake-news-the-internet-and-risks-of-misinformation-in-india/.

Iyyer, M., et al. 2014. Political ideology detection using recursive neural netoworks. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: pp. 1113–1122. https://www.aclweb.org/anthology/P14-1105.

Kiseleva, M., and A. Coleman. 2018. Russian TV airs video game as Syria war footage. BBC News; 26 February. https://www.bbc.com/news/blogs-news-from-elsewhere-43198324.

Kleber, S. 2018. 3 ways AI is getting more emotional. Harvard Business Review; 31 July. https://hbr.org/2018/07/3-ways-ai-is-getting-more-emotional.

Lentzos, F. 2018. The Russian disinformation attack that poses a biological danger. The Bulletin of the Atomic Scientists; 19 November. https://thebulletin.org/2018/11/the-russian-disinformation-attack-that-poses-a-biological-danger/.

Maan, A. 2018. Narrative warfare. RealClear Defense; 27 February. https://www.realcleardefense.com/articles/2018/02/27/narrative_warfare_113118.html.

Marwick, A., and R. Lewis. 2017. Media manipulation and disinformation online. Data & Society. https://centerformediajustice.org/wp-content/uploads/2017/07/DataAndSociety_MediaManipulationAndDisinformationOnline.pdf. Also see: Polonski V. 2017. “Artificial Intelligence Has the Power to Destroy or Save Democracy.” Council on Foreign Relations; 7 August. https://www.cfr.org/blog/artificial-intelligence-has-power-destroy-or-save-democracy.

Mayer, M. 2018. Artificial intelligence and cyber power from a strategic perspective. IFS Insights; April. https://brage.bibsys.no/xmlui/bitstream/handle/11250/2497514/IFS%20Insights_4_2018_Mayer.pdf.

Miles, T. 2018. U.N. investigators cite Facebook role in Myanmar crisis. Reuters; 12 March.

Mindstrong website. n.d. Mindstrong health’s digital biomarkers, see Mindstrong’s website available at: https://mindstronghealth.com/science/.

Mozur, P. 2018. Mozur P. 2018. A genocide incited on Facebook, with posts from Myanmar’s military. The New York Times; 15 October. https://www.nytimes.com/2018/10/15/technology/myanmar-facebook-genocide.html?action=click&module=Top%20Stories&pgtype=Homepage.

Nicola, A.C. 2018. Taming the trolls: The Need for an international legal framework to regulate State Use of Disinformation on Social Media. The Georgetown Law Journal Online 107: 36–62. https://georgetownlawjournal.org/articles/296/taming-trolls-need-for/pdf.

Pauwels, E. 2018. China is pushing hard to overtake Silicon Valley and win the biotech race, and gain control of the world’s biological data, South China Morning Post, November 22, 2018.

P&S Market Research. 2017. Artificial Intelligence (AI) in cyber security market. https://www.psmarketresearch.com/market-analysis/artificial-intelligence-in-cyber-security-market.

Rai, S. 2018. How Facebook uses ‘WhatsApp phones’ to tap next emerging market. The Economic Times; 3 December. https://economictimes.indiatimes.com/news/international/world-news/how-facebook-uses-whatsapp-phones-to-tap-next-emerging-market/articleshow/66914406.cms.

Robertson, I. 2016). Kremlin falls for its own fake satellite imagery. The Daily Beast; 4 March. https://www.thedailybeast.com/kremlin-falls-for-its-own-fake-satellite-imagery. Pauwels, E. 2018. China pins its hopes on beating US in race for bio-intelligence supremacy, South China Morning Post; 27 November. https://www.scmp.com/news/china/science/article/2174815/china-pins-its-hopes-beating-us-race-bio-intelligence-supremacy.

Robinson, G., et al. 2019. Bots and the ballot box: Is Facebook prepared for Asia’s elections? Nikkei Asian Review; 30 January. https://asia.nikkei.com/Spotlight/Cover-Story/Bots-and-the-ballot-box-Is-Facebook-prepared-for-Asia-s-elections.

Shenzen Open Innovation Lab. n.d.. Available at: https://www.szoil.org.

Signe, L., and K. Signe 2018. Global cybercrimes and weak cybersecurity threaten businesses in Africa. Brookings Institute; 20 May. https://www.brookings.edu/blog/africa-in-focus/2018/05/30/global-cybercrimes-and-weak-cybersecurity-threaten-businesses-in-africa/.

Sputnik News. 2018. US, UK and France prepare new strike against Syria – Russian MoD. Sputnik News; 25 August. https://sputniknews.com/middleeast/201808251067461189-us-uk-france-syria-new-strike-russia/.

Stecklow, S. 2018. Why Facebook is losing the war on hate speech in Myanmar. Reuters; 15 August. https://www.reuters.com/investigates/special-report/myanmar-facebook-hate/.

Tallinn Manual. 2017a. Tallinn manual on the international law applicable to cyber warfare. Cambridge University Press, 2013. https://www.cambridge.org/core/books/tallinn-manual-on-the-international-law-applicable-to-cyber-warfare/50C5BFF166A7FED75B4EA643AC677DAE.

———. 2017b. Tallinn manual 2.0. Cambridge University Press, 2017. https://ccdcoe.org/research/tallinn-manual/.

The Economist. 2016. China’s digital dictatorship; Big data and government. 421(9020); 17 December. https://wrlc-gm.primo.exlibrisgroup.com/discovery/fulldisplay?docid=proquest1849561391&context=PC&vid=01WRLC_GML:01WRLC_GML&search_scope=MyInst_and_CI&tab=Everything&lang=en. Also see:

The Syria Campaign. 2017. The Syria Campaign. 2017. Killing the Truth. https://thesyriacampaign.org/wp-content/uploads/2017/12/KillingtheTruth.pdf.

Turgeman, A. 2018. Machine Learning and Behavioral Biometrics: A Match Made in Heaven.” Forbes; 18 January. https://www.forbes.com/sites/forbestechcouncil/2018/01/18/machine-learning-and-behavioral-biometrics-a-match-made-in-heaven/#3b5a038e3306.

UN Secretary General. 2018. UN Secretary General’s Address to the General Assembly, New York, 25 September 2018. https://www.un.org/sg/en/content/sg/statement/2018-09-25/secretary-generals-address-general-assembly-delivered-trilingual.

Villasenor, J. 2018. Artificial Intelligence and the future of geopolitics. Brookings Institute; 14 November. https://www.brookings.edu/blog/techtank/2018/11/14/artificial-intelligence-and-the-future-of-geopolitics/.

Volodzko, D. 2019. Is South Korea sliding toward digital dictatorship? Forbes; 25 February. https://www.forbes.com/sites/davidvolodzko/2019/02/25/is-south-korea-sliding-toward-digital-dictatorship/#61a2b37648e2.

Wagner, D. 2016. Expert commentary: The growing threat of cyber-attacks on critical infrastructure.” IRMI; 2016. https://www.irmi.com/articles/expert-commentary/cyber-attack-critical-infrastructure.

Walker, S. 2017. Russia’s ‘irrefutable evidence’ of US help for ISIS appears to be video game still. The Guardian; 14 November. https://www.theguardian.com/world/2017/nov/14/russia-us-isis-syria-video-game-still.

Ward, A. 2018. ISIS’s use of social media still poses a threat to stability in the Middle East and Africa. RAND; December. https://www.rand.org/blog/2018/12/isiss-use-of-social-media-still-poses-a-threat-to-stability.html.

Watson, B. 2017. The drones of ISIS. Defense One; 12 January.

Wei, H., et al. 2016. Beyond the words: Predicting user personality from heterogeneous information. Microsoft, Micrsoft Research, Tsinghua University; February. https://www.microsoft.com/en-us/research/wp-content/uploads/2017/01/WSDM_personality.pdf.

Wells II, L. 2017. Cognitive-emotional conflict: Adversary will and social resilience. Prism: National Defense University; No. 2. https://cco.ndu.edu/Portals/96/Documents/prism/prism_7-2/2-Cognitive-Emotional_Conflict.pdf?ver=2017-12-21-110638-877.

Wooley, S.C., and Howard, P.N. 2017. Computational propaganda worldwide: Executive summary. Computational Propaganda Research Project. https://comprop.oii.ox.ac.uk/research/working-papers/computational-propaganda-worldwide-executive-summary/.

Wrona, K. 2017. Cyber warfare in smart environments. In Defence future technologies: What we see on the horizon, Schweizerische Eidgenossenschaft: pp. 93–96. https://deftech.ch/What-We-See-On-The-Horizon/armasuisseW%2BT_Defence-Future-Technologies-What-We-See-On-The-Horizon-2017_HD.pdf.

Ziff, Benjamine (Deputy Assistant Secretary). 2015. Testimony before the SFRC Europe Subcommittee. U.S. Senate; 3 November. https://www.foreign.senate.gov/imo/media/doc/110315_Ziff_Testimony.pdf.

Title: Hybrid Emerging Threats and Information Warfare: The Story of the Cyber-AI Deception Machine
Authors: Eleonore Pauwels
Sarah W. Deton
Publisher: Springer International Publishing
Book: 21st Century Prometheus
Print ISBN: 978-3-030-28284-4

Electronic ISBN: 978-3-030-28285-1

Copyright Year: 2020
DOI: https://doi.org/10.1007/978-3-030-28285-1_6

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner