ブログ
/
AI
/
July 27, 2022

Self-Learning AI for Zero-Day and N-Day Attack Defense

Explore the differences between zero-day and n-day attacks on different customer servers to learn how Darktrace detects and prevents cyber threats effectively.
Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Written by
Lewis Morgan
Cyber Analyst
Default blog image
27
Jul 2022

Key Terms:

Zero-day | A recently discovered security vulnerability in computer software that has no currently available fix or patch. Its name come from the reality that vendors have “zero days” to act and respond.

N-day | A vulnerability that emerges in computer software in which a vendor is aware and may have already issued (or are currently working on) a patch or fix. Active exploits often already exist and await abuse by nefarious actors.

Traditional security solutions often apply signature-based-detection when identifying cyber threats, helping to defend against legacy attacks but consequently missing novel ones. Therefore, security teams often lend a lot of focus to ensuring that the risk of zero-day vulnerabilities is reduced [1]. As explored in this blog, however, organizations can face just as much of a risk from n-day attacks, since they invite the most attention from malicious actors [2]. This is due in part to the reduced complexity, cost and time invested in researching and finding new exploits compared with that found when attackers exploit zero-days. 

This blog will examine both a zero-day and n-day attack that two different Darktrace customers faced in the fall of 2021. This will include the activity Darktrace detected, along with the steps taken by Darktrace/Network to intervene. It will then compare the incidents, discuss the possible dangers of third-party integrations, and assess the deprecation of legacy security tools.

Revisiting zero-day attacks 

Zero-days are among the greatest concerns security teams face in the era of modern technology and networking. Defending critical systems from zero-day compromises is a task most legacy security solutions are often unable to handle. Due to the complexity of uncovering new security flaws and developing elaborate code that can exploit them, these attacks are often carried out by funded or experienced groups such as nation-state actors and APTs. One of history’s most prolific zero-days, ‘Stuxnet’, sent security teams worldwide into a global panic in 2010. This involved a widespread attack on Iranian nuclear infrastructure and was widely accepted to be a result of nation-state actors [3]. The Stuxnet worm took advantage of four zero-day exploits, compromising over 200,000 devices and physically damaging around 10% of the 9,000 critical centrifuges at the Natanz nuclear site. 

More recently, 2021 saw the emergence of several critical zero-day vulnerabilities within SonicWall’s product suite [4]. SonicWall is a security hardware manufacturer that provides hardware firewall devices, unified threat management, VPN gateways and network security solutions. Some of these vulnerabilities lie within their Secure Mobile Access (SMA) 100 series (for example, CVE-2019-7481, CVE-2021-20016 and CVE-2021-20038 to name a few). These directly affected VPN devices and often allowed attackers easy remote access to company devices. CVE-2021-20016 in particular incorporates an SQL-Injection vulnerability within SonicWall’s SSL VPN SMA 100 product line [5]. If exploited, this defect would allow an unauthenticated remote attacker to perform their own malicious SQL query in order to access usernames, passwords and other session related information. 

The N-day underdog

The shadow cast by zero-day attacks often shrouds that of n-day attacks. N-days, however, often pose an equal - if not greater - risk to the majority of organizations, particularly those in industrial sectors. Since these vulnerabilities have fixes available, all of the hard work around research is already done; malicious actors only need to view proof of concepts (POCs) or, if proficient in coding, reverse-engineer software to reveal code-changes (binary diffing) in order to exploit these security flaws in the wild. These vulnerabilities are typically attributed to opportunistic hackers and script-kiddies, where little research or heavy lifting is required.  

August 2021 gave rise to a critical vulnerability in Atlassian Confluence servers, namely CVE-2021-26084 [6]. Confluence is a widely used collaboration wiki tool and knowledge-sharing platform. As introduced and discussed a few months ago in a previous Darktrace blog (Explore Internet-Facing System Vulnerabilities), this vulnerability allows attackers to remotely execute code on internet-facing servers after exploiting injection vulnerabilities in Object-Graph Navigation Language (OGNL). Whilst Confluence had patches and fixes available to users, attackers still jumped on this opportunity and began scanning the internet for signs of critical devices serving this outdated software [7]. Once identified, they would  exploit the vulnerability, often installing crypto mining software onto the device. More recently, Darktrace explored a new vulnerability (CVE-2022-26134), disclosed midway through 2022, that affected Confluence servers and data centers using similar techniques to that found in CVE-2021-26084 [8]. 

SonicWall in the wild – 1. Zero-day attack

At the beginning of August 2021, Darktrace prevented an attack from taking place within a European automotive customer’s environment (Figure 1). The attack targeted a vulnerable internet-facing SonicWall VPN server, and while the attacker’s motive remains unclear, similar historic events suggest that they intended to perform ransomware encryption or data exfiltration. 

Figure 1: Timeline of the SonicWall attack 

Darktrace was unable to confirm the definite tactics, techniques and procedures (TTPs) used by the attacker to compromise the customer’s environment, as the device was compromised before Darktrace installation and coverage. However, from looking at recently disclosed SonicWall VPN vulnerabilities and patterns of behaviour, it is likely CVE-2021-20016 played a part. At some point after this initial infection, it is also believed the device was able to move laterally to a domain controller (DC) using administrative credentials; it was this server that then initiated the anomalous activity that Darktrace detected and alerted on. 

On August 5th 2021 , Darktrace observed this compromised domain controller engaging in unusual ICMP scanning - a protocol used to discover active devices within an environment and create a map of an organization’s network topology. Shortly after, the infected server began scanning devices for open RDP ports and enumerating SMB shares using unorthodox methods. SMB delete and HTTP requests (over port 445 and 80 respectively) were made for files named delete.me in the root directory of numerous network shares using the user agent Microsoft WebDAV. However, no such files appeared to exist within the environment. This may have been the result of an attacker probing devices in the network in an effort to see their responses and gather information on properties and vulnerabilities they could later exploit. 

Soon the infected DC began establishing RDP tunnels back to the VPN server and making requests to an internal DNS server for multiple endpoints relating to exploit kits, likely in an effort to strengthen the attacker’s foothold within the environment. Some of the endpoints requested relate to:

-       EternalBlue vulnerability 

-       Petit Potam NTLM hash attack tool

-       Unusual GitHub repositories

-       Unusual Python repositories  

The DC made outgoing NTLM requests to other internal devices, implying the successful installation of Petit Potam exploitation tools. The server then began performing NTLM reconnaissance, making over 1,000 successful logins under ‘Administrator’ to several other internal devices. Around the same time, the device was also seen making anonymous SMBv1 logins to numerous internal devices, (possibly symptomatic of the attacker probing machines for EternalBlue vulnerabilities). 

Interestingly, the device also made numerous failed authentication attempts using a spoofed credential for one of the organization’s security managers. This was likely in an attempt to hide themselves using ‘Living off the Land’ (LotL) techniques. However, whilst the attacker clearly did their research on the company, they failed to acknowledge the typical naming convention used for credentials within the environment. This ultimately backfired and made the compromise more obvious and unusual. 

In the morning of the following day, the initially compromised VPN server began conducting further reconnaissance, engaging in similar activity to that observed by the domain controller. Until now, the customer had set Darktrace RESPOND to run in human confirmation mode, meaning interventions were not made autonomously but required confirmation by a member of the internal security team. However, thanks to Proactive Threat Notifications (PTNs) delivered by Darktrace’s dedicated SOC team, the customer was made immediately aware of this unusual behaviour, allowing them to apply manual Darktrace RESPOND blocks to all outgoing connections (Figure 2). This gave the security team enough time to respond and remediate before serious damage could be done.

Figure 2: Darktrace RESPOND model breach showing the manually applied “Quarantine Device” action taken against the compromised VPN server. This screenshot displays the UI from Darktrace version 5.1

Confluence in the wild – 2. N-day attack

Towards the end of 2021, Darktrace saw a European broadcasting customer leave an Atlassian Confluence internet-facing server unpatched and vulnerable to crypto-mining malware using CVE-2021-26084. Thanks to Darktrace, this attack was entirely immobilized within only a few hours of the initial infection, protecting the organization from damage (Figure 3). 

Figure 3: Timeline of the Confluence attack

On midday on September 1st 2021, an unpatched Confluence server was seen receiving SSL connections over port 443 from a suspicious new endpoint, 178.238.226[.]127.  The connections were encrypted, meaning Darktrace was unable to view the contents and ascertain what requests were being made. However, with the disclosure of CVE-2021-26084 just 7 days prior to this activity, it is likely that the TTPs used involved injecting OGNL expressions to Confluence server memory; allowing the attacker to remotely execute code on the vulnerable server.

Immediately after successful exploitation of the Confluence server, the infected device was observed making outgoing HTTP GET requests to several external endpoints using a new user agent (curl/7.61.1). Curl was used to silently download and configure multiple suspicious files relating to XMRig cryptocurrency miner, including ld.sh, XMRig and config.json. Subsequent outgoing connections were then made to europe.randomx-hub.miningpoolhub[.]com · 172.105.210[.]117 using the JSON-RPC protocol, seen alongside the mining credential maillocal.confluence (Figure 4). Only 3 seconds after initial compromise, the infected device began attempting to mine cryptocurrency using the Minergate protocol but was instantly and autonomously blocked by Darktrace RESPOND. This prevented the server from abusing system resources and generating profits for the attacker.

Figure 4: A graph showing the frequency of external connections using the JSON-RPC protocol made by the breach device over a 48-hour window. The orange-red dots represent models that breached as a result of this activity, demonstrating the “waterfall” effect commonly seen when a device suffers a compromise. This screenshot displays the UI from Darktrace version 5.1

In the afternoon, the malware persisted with its infection. The compromised server began making successive HTTP GET requests to a new rare endpoint 195.19.192[.]28 using the same curl user agent (Figures 5 & 6). These requests were for executable and dynamic library files associated with Kinsing malware (but fortunately were also blocked by Darktrace RESPOND). Kinsing is a malware strain found in numerous attack campaigns which is often associated with crypto-jacking, and has appeared in previous Darktrace blogs [9].

Figure 5: Cyber AI Analyst summarising the unusual download of Kinsing software using the new curl user agent. This screenshot displays the UI from Darktrace version 5.1

The attacker then began making HTTP POST requests to an IP 185.154.53[.]140, using the same curl user agent; likely a method for the attacker to maintain persistence within the network and establish a foothold using its C2 infrastructure. The Confluence server was then again seen attempting to mine cryptocurrency using the Minergate protocol. It made outgoing JSON-RPC connections to a different new endpoint, 45.129.2[.]107, using the following mining credential: ‘42J8CF9sQoP9pMbvtcLgTxdA2KN4ZMUVWJk6HJDWzixDLmU2Ar47PUNS5XHv4Kmfdh8aA9fbZmKHwfmFo8Wup8YtS5Kdqh2’. This was once again blocked by Darktrace RESPOND (Figure 7). 

Figure 6: VirusTotal showing the unusualness of one of these external IPs [10]
Figure 7: Log data showing the action taken by Darktrace RESPOND in response to the device breaching the “Crypto Currency Mining Activity” model. This screenshot displays the UI from Darktrace version 5.1

The final activity seen from this device involved the download of additional shell scripts over HTTP associated with Kinsing, namely spre.sh and unk.sh, from 194.38.20[.]199 and 195.3.146[.]118 respectively (Figure 8). A new user agent (Wget/1.19.5 (linux-gnu)) was used when connecting to the latter endpoint, which also began concurrently initiating repeated connections indicative of C2 beaconing. These scripts help to spread the Kinsing malware laterally within the environment and may have been the attacker's last ditch efforts at furthering their compromise before Darktrace RESPOND blocked all connections from the infected Confluence server [11]. With Darktrace RESPOND's successful actions, the customer’s security team were then able to perform their own response and remediation. 

Figure 8: Cyber AI Analyst revealing the last ditch efforts made by the threat actor to download further malicious software. This screenshot displays the UI from Darktrace version 5.1

Darktrace Coverage: N- vs Zero-days

In the SonicWall case the attacker was unable to achieve their actions on objectives (thanks to Darktrace's intervention). However, this incident displayed tactics of a more stealthy and sophisticated attacker - they had an exploited machine but waited for the right moment to execute their malicious code and initiate a full compromise. Due to the lack of visibility over attacker motive, it is difficult to deduce what type of actor led to this intrusion. However, with the disclosure of a zero-day vulnerability (CVE-2021-20016) not long before this attack, along with a seemingly dormant initially compromised device, it is highly possible that it was carried out by a sophisticated cyber criminal or gang. 

On the other hand, the Confluence case engaged in a slightly more noisy approach; it dropped crypto mining malware on vulnerable devices in the hope that the target’s security team did not maintain visibility over their network or would merely turn a blind eye. The files downloaded and credentials observed alongside the mining activity heavily imply the use of Kinsing malware [11]. Since this vulnerability (CVE-2021-26084) emerged as an n-day attack with likely easily accessible POCs, as well as there being a lack of LotL techniques and the motive being long term monetary gain, it is possible this attack was conducted by a less sophisticated or amateur actor (script-kiddie); one that opportunistically exploits known vulnerabilities in internet-facing devices in order to make a quick profit [12].

Whilst Darktrace RESPOND was enabled in human confirmation mode only during the start of the SonicWall attack, Darktrace’s Cyber AI Analyst still offered invaluable insight into the unusual activity associated with the infected machines during both the Confluence and SonicWall compromises. SOC analysts were able to see these uncharacteristic behaviours and escalate the incident through Darktrace’s PTN and ATE services. Analysts then worked through these tickets with the customers, providing support and guidance and, in the SonicWall case, quickly helping to configure Darktrace RESPOND. In both scenarios, Darktrace RESPOND was able to block abnormal connections and enforce a device’s pattern of life, affording the security team enough time to isolate the infected machines and prevent further threats such as ransomware detonation or data exfiltration. 

Concluding thoughts and dangers of third-party integrations 

Organizations with internet-facing devices will inevitably suffer opportunistic zero-day and n-day attacks. While little can be done to remove the risk of zero-days entirely, ensuring that organizations keep their systems up to date will at the very least help prevent opportunistic and script-kiddies from exploiting n-day vulnerabilities.  

However, it is often not always possible for organizations to keep their systems up to date, especially for those who require continuous availability. This may also pose issues for organizations that rely on, and put their trust in, third party integrations such as those explored in this blog (Confluence and SonicWall), as enforcing secure software is almost entirely out of their hands. Moreover, with the rising prevalence of remote working, it is essential now more than ever that organizations ensure their VPN devices are shielded from external threats, guidance on which has been released by the NSA/CISA [13].

These two case studies have shown that whilst organizations can configure their networks and firewalls to help identify known indicators of compromise (IoC), this ‘rearview mirror’ approach will not account for, or protect against, any new and undisclosed IoCs. With the aid of Self-Learning AI and anomaly detection, Darktrace can detect the slightest deviation from a device’s normal pattern of life and respond autonomously without the need for rules and signatures. This allows for the disruption and prevention of known and novel attacks before irreparable damage is caused- reassuring security teams that their digital estates are secure. 

Thanks to Paul Jennings for his contributions to this blog.

Appendices: SonicWall (Zero-day)

Darktrace model detections

·      AIA / Suspicious Chain of Administrative Credentials

·      Anomalous Connection / Active Remote Desktop Tunnel

·      Anomalous Connection / SMB Enumeration

·      Anomalous Connection / Unusual Internal Remote Desktop

·      Compliance / High Priority Compliance Model Breach

·      Compliance / Outgoing NTLM Request from DC

·      Device / Anomalous RDP Followed By Multiple Model Breaches

·      Device / Anomalous SMB Followed By Multiple Model Breaches

·      Device / ICMP Address Scan

·      Device / Large Number of Model Breaches

·      Device / Large Number of Model Breaches from Critical Network Device

·      Device / Multiple Lateral Movement Model Breaches (PTN/Enhanced Monitoring model)

·      Device / Network Scan

·      Device / Possible SMB/NTLM Reconnaissance

·      Device / RDP Scan

·      Device / Reverse DNS Sweep

·      Device / SMB Session Bruteforce

·      Device / Suspicious Network Scan Activity (PTN/Enhanced Monitoring model)

·      Unusual Activity / Possible RPC Recon Activity

Darktrace RESPOND (Antigena) actions (as displayed in example)

·      Antigena / Network / Manual / Quarantine Device

MITRE ATT&CK Techniques Observed
IoCs

Appendices: Confluence (N-day)

Darktrace model detections

·      Anomalous Connection / New User Agent to IP Without Hostname

·      Anomalous Connection / Posting HTTP to IP Without Hostname

·      Anomalous File / EXE from Rare External Location

·      Anomalous File / Script from Rare Location

·      Compliance / Crypto Currency Mining Activity

·      Compromise / High Priority Crypto Currency Mining (PTN/Enhanced Monitoring model)

·      Device / Initial Breach Chain Compromise (PTN/Enhanced Monitoring model)

·      Device / Internet Facing Device with High Priority Alert

·      Device / New User Agent

Darktrace RESPOND (Antigena) actions (displayed in example)

·      Antigena / Network / Compliance / Antigena Crypto Currency Mining Block

·      Antigena / Network / External Threat / Antigena File then New Outbound Block

·      Antigena / Network / External Threat / Antigena Suspicious Activity Block

·      Antigena / Network / External Threat / Antigena Suspicious File Block

·      Antigena / Network / Significant Anomaly / Antigena Block Enhanced Monitoring

MITRE ATT&CK Techniques Observed
IOCs

References:

[1] https://securitybrief.asia/story/why-preventing-zero-day-attacks-is-crucial-for-businesses

[2] https://electricenergyonline.com/energy/magazine/1150/article/Security-Sessions-More-Dangerous-Than-Zero-Days-The-N-Day-Threat.htm

[3] https://www.wired.com/2014/11/countdown-to-zero-day-stuxnet/

[4] https://cve.mitre.org/cgi-bin/cvekey.cgi?keyword=SonicWall+2021 

[5] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-20016

[6] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-26084

[7] https://www.zdnet.com/article/us-cybercom-says-mass-exploitation-of-atlassian-confluence-vulnerability-ongoing-and-expected-to-accelerate/

[8] https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-26134

[9] https://attack.mitre.org/software/S0599/

[10] https://www.virustotal.com/gui/ip-address/195.19.192.28/detection 

[11] https://sysdig.com/blog/zoom-into-kinsing-kdevtmpfsi/

[12] https://github.com/alt3kx/CVE-2021-26084_PoC

[13] https://www.nsa.gov/Press-Room/Press-Releases-Statements/Press-Release-View/Article/2791320/nsa-cisa-release-guidance-on-selecting-and-hardening-remote-access-vpns/

Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Written by
Lewis Morgan
Cyber Analyst

More in this series

No items found.

Blog

/

AI

/

July 23, 2026

When AI Agents Go Off Script: What the OpenAI and Hugging Face Incident Means for Defenders

Default blog imageDefault blog image

The recent security incident disclosed jointly by OpenAI and Hugging Face is quickly becoming one of the most discussed AI security stories of the year; it's one that has generated great discussion amongst our researchers and technical teams here at Darktrace.

During an internal evaluation of advanced OpenAI models, an autonomous agent reportedly escaped its intended testing boundaries, obtained internet access, and compromised Hugging Face infrastructure while attempting to evaluate and benchmark the model's cyber capabilities. OpenAI has described it as an unprecedented cyber incident and is collaborating with Hugging Face to investigate and share its findings publicly to help defenders understand the implications and improve AI safety across the community.

What this means for organizations deploying AI agents

The most important takeaway for security leaders is not that the AI model is capable of complex and effective chained attacks. It's what this tells us about the guardrails and protections that need to be put in place to ensure these increasingly capable models are safely used within our businesses.

According to OpenAI's investigation, the models were not acting with malicious intent. They were attempting to achieve a legitimate assigned objective. In pursuing that objective, they identified a path that involved obtaining information from a third party's environment and followed it to completion. From the model's perspective, that appears to have been an effective solution to the problem it was given.

Many organizations still hold the assumption that giving an AI agent a legitimate goal will naturally result in legitimate behavior. Increasingly, that is not something defenders can safely assume.

A human who encounters a "permission denied" message generally understands the technical restriction as well as the social meaning behind it. An agent may interpret that message only as evidence that one method to achieve its objective has failed. What makes this incident notable is the agent’s ability to keep pursuing the objective, revise its plan, and combine many individually useful actions into an outcome its designers did not intend.

This is not an isolated challenge. Recent research from the UK's AI Security Institute found that frontier models often attempt to "cheat" evaluations by finding unintended shortcuts to success. More interestingly, that behavior is not always reflected in chain-of-thought outputs and is not always admitted when models are questioned about their actions. One lesson for defenders is that understanding what an AI system says it is doing is not always the same as understanding its behavior and what it is actually doing.

Why behavioral security is an essential security foundation

That's the principle behind Darktrace / SECURE AI and our broader approach to behavioral security. Understanding intent or putting in place static guardrails is not enough; security teams need visibility into how agents behave over time, what resources they interact with, how their behavior changes, and whether they begin pursuing objectives in unexpected ways. Research released by NIST earlier this summer reinforced that rules alone are not sufficient to defend against AI threats, with one conclusion being that "there will always be a way to prompt an AI system to disregard its rules - it's just a matter of finding it."

Another interesting lesson is that nothing described in OpenAI's preliminary findings appears fundamentally impossible for a skilled human attacker. But it does highlight the accessibility and scale that could be unlocked for attackers as increasingly capable models become more widely available. Resource constraints that attackers deal with will decrease as frontier models can help execute elements of those attack workflows autonomously, persist through failure, and iterate towards an objective. Capabilities that were once limited to skilled attackers can increasingly be supplemented with these systems, lowering the barrier to entry to conduct complex cyber operations.

It is incredibly positive to see OpenAI and Hugging Face investigating this incident collaboratively and sharing their findings publicly. Transparency and collaboration around incidents like these helps the entire security community better understand how rapidly AI capabilities are evolving and where we need to improve safeguards. It also reinforces why Darktrace is excited to be partnering with OpenAI through the Daybreak Cyber Partner Program: to explore how advanced AI can be used safely and responsibly in support of defenders while developing the visibility, governance, and security controls needed for increasingly autonomous systems.

This incident is an important reminder that capable AI systems will not always behave in the ways we expect. As organizations deploy AI agents across critical workflows, understanding behavior is an even more important foundation for effective security.

[related-resource]

Continue reading
About the author

Blog

/

AI

/

July 22, 2026

スタジアム運営を任されるAI。セキュリティチームはこれをどう保護すべきか?

Default blog imageDefault blog image

スタジアム運営に使われるAIをどう保護するべきか

主なポイント

  • AIはアクセス管理、群衆管理、チケット発行、設備管理、監視カメラ等、スタジアムの運営に重要な機能に導入されつつある。  
  • シャドーAIやサードパーティAIの利用はスタジアムのセキュリティチームの目の届かないところでリスクを生み出している。
  • セキュリティチームはどのようなAIシステムが存在しているかだけでなく、それらが何にアクセスし、どのようなアクションを実行できるかを理解できなければならない。
  • イベントのレジリエンスにはAI、IT、OT、アイデンティティ、サードパーティ全体に渡る継続的監視と対応が必要。

現代のスタジアムは、他に類を見ないインフラです。以前にも書いたことがありますが、イベント開催日には、スタジアムに生命が吹き込まれ、グッズや食べ物の販売、交通のハブ、広大な通信インフラ、そしてフィールド上のさまざまな技術など、これらが連携した1つの巨大なエコシステムとして機能します。その規模と複雑性により、スタジアムはサイバーセキュリティにとって最も過酷な環境の1つとなっています。その運営に今、AIを導入することで私たちは新たな次元のリスクを負おうとしています。

スタジアム運営にAIを導入することの利点は明らかです。スタジアム運営者はAIを使うことにより、混雑したゲートからファンを安全に誘導し、売店の需要を予測し、生体認証システムを管理し、不審な動きを監視カメラで見つけ、また空調や換気を制御することができます。上手く使えば、イベントをより安全に、迅速に、より効率的にすることができます。

ただし、AIはセキュリティモデルも変化させます。

ダークトレースが最近発表したスポーツを取り巻く脅威状況についての調査では、プロスポーツ組織のサイバーセキュリティプロフェッショナルを対象に、自組織の運用範囲の中でサイバー侵害が最も重大な影響を及ぼすのはどこかという質問をしました。調査対象のプロフェッショナルの最も多い34%が指摘した分野は、スタジアムの運営でした。それと同時に、35%は自組織がすでにスタジアムの運営にAIを使用している、あるいは今後12か月間に導入の予定があると回答しています。

セキュリティチームはもはや、スタジアムを中心とした従来型のITシステムだけを保護しているのではありません。スタジアムの基盤となる重要機能を動かしている、AIシステムの保護も求められるようになっているのです。

承認済みAIとシャドーAIの違い

スタジアムのセキュリティチームが知っているAIと、そうでないAIの間には明確な違いがあります。

承認済みAIとは、審査およびテストされ、施設の運用環境に統合されたAIです。こうしたAIは、監視カメラのアナリティクス、アクセス管理、設備管理、チケット発行、ロジスティクス、放送オペレーション、海賊版対策などに使われているかもしれません。それらのAIには、明確なオーナーシップ、アクセス制御、ログ記録、ベンダーレビュー、データ保護規則などがあるはずです。それによってリスクがなくなるわけではありませんが、セキュリティチームは適切なガバナンスを整備できます。

シャドーAIはそれとは違います。シャドーAIとは、従業員、請負業者、サプライヤーによる承認されていないAIの利用です。多くの場合それは善良な意図で始まります。たとえば、作業をもっと早く進めたいと思う人がいるかもしれません。あるいは、ブリーフィングの原稿を作るためにスタッフが内部情報をパブリックAIにペーストする、開発者がチケット発行プログラムのデバッグのためにAIアシスタントを使用する、サプライヤーがAIスケジューリングツールを配送ルートに接続する、デザイナーがモックアップ作成のために未公開の会場設計図やスポンサーの資料をAIにアップロードするなどの事です。

これらの行動はいずれも、それを行っている人からすればセキュリティ上の判断のようには感じられません。しかし、これらの行為は機密性の高い運営データを、スタジアムが管理していない環境に送出し、隠れたリスクを生みます。

承認済みAIスタックは、セキュリティチームから見えています。シャドーAIスタックは多くの場合そうではありません。

試合開催日に増幅するリスクと影響

通常のエンタープライズ環境であれば、不審なログイン、普段とは異なるデータ転送、予期しないサードパーティサービスへの接続をセキュリティチームが調査するための時間は数時間あるでしょう。スタジアムでは、インシデントが起こる可能性の高い瞬間は、チームに最も余力がなくインシデントが最も大きな影響を及ぼし得るタイミング、つまり試合開催日です。

群衆管理に使われているAIシステムが予期せぬ振る舞いをしたとき、その問題は単に技術上の問題ではありません。それは会場内の物理的な動きに影響を及ぼすかもしれません。

サプライヤーツールが運営データを承認されていないAIプラットフォームに送信すれば、それはデータガバナンスだけの問題ではありません。配送ルートやアクセス制限のスケジュール、スタッフ配備計画などが漏洩するかもしれません。

最も危険なシナリオは必ずしも派手な、劇的な攻撃とは限らず、外部ベンダーがソフトウェア更新でAI機能を追加した、あるいはスタッフのワークフローで未承認のツールが使用されているなど、誰も想定していなかった隠れた依存関係から発生することがあります。

イベントが始まると、これらの隠れたつながりが運営上のリスクになる可能性があります。

サプライチェーンはスタジアムのアタックサーフェス(攻撃対象領域)の一部

すべての大規模スポーツイベントは、さまざまなサプライチェーンとパートナーシップで構築されています。ケータリングサービスや輸送、放送システム、施設管理チームなど、あらゆるピースが必須であり、それぞれがセキュリティチャネルを作り出しています。サプライチェーン侵害のリスクはすでによく知られており私たちが目にしてきたいくつかの有名な侵害事例の原因となっています。マジソン・スクエア・ガーデンを所有するMSG Entertainment社のデータ侵害事例は3月に大きく報道されましたが、これはMSG Entertainment社のバックオフィスシステムで使用されていたOracleのE-Business Suiteから発生していました。また、2018年の平昌冬季オリンピックを標的としたOlympic Destroyer攻撃はこの大会のメインITサービスプロバイダーに対する侵害から始まったと言われています。そして、AIの導入によりこのリスクは増大しつつあります。

スタジアム自体は自社のAIシステムに厳しいルールを設けているかもしれませんが、ベンダーは別のツールを使っている場合があります。スタッフの配備や、配送のタイミング、在庫、顧客とのやり取りの管理にAIを使っている業者もあるでしょう。また、既に使用しているソフトウェアにAI機能が追加されていることに気が付いていないケースもあります。

スタジアムの運営でAIを保護する際の最も難しい問題の1つはこの点です。リスクはスタジアムが選択したツールから来るとは限らないのです。サプライヤーが選択したツールや、有効に設定されていることをサプライヤーが知らなかった機能からリスクが発生する可能性があります。

セキュリティチームは、ベンダーのアクセスを管理するのと同じようにベンダーのAIを扱う必要があります。サプライヤーが何に接続できるか、どのようなデータを見ることができるか、どのようなツールを使っているか、そしてこれらのツールがデータ露出や水平移動(ラテラルムーブメント)の新たな経路を作り出さないかを知る必要があるのです。

サードパーティAIツールがリスクを作り出すのに深いアクセス権は必要ありません。特定の情報が不適切なタイミングで露出するだけでリスクを招きます。

スタジアム運営におけるAIについてセキュリティチームが確認すべき4つの質問

AIがスタジアム運営の一部となるなかで、セキュリティチームは基本的な承認リストの先へ進む必要があります。次の4つの点を問う必要があります:

1.  AIはどこで使われているか?

すぐに思いつくのは、コンピュータービジョン、アクセス管理、チケット発行、ロジスティクス、設備管理等のツールです。しかし、SaaSプラットフォーム、ベンダーツール、ブラウザ拡張、開発者ワークフロー、スマートビルディングシステム、コラボレーションツールにも見えにくい形でAIが含まれています。

2. AIは何にアクセスできるか?

そのAIはインシデントログ、スタジアム設計図、チケット発行データ、ビデオ映像、建物管理、ファン情報、認証情報、サプライヤーシステムを見ることができるでしょうか?それは情報を分析するだけでしょうか、それともアクションを実行することもできるでしょうか?

3. AIは何を実行できるか?

AIエージェントは単なる受動的ツールではありません。APIを呼び出す、記録を更新する、命令を生成する、ワークフローをトリガーする、あるいはユーザーやサービスアカウントの権限を持って行動できるものもあります。スタジアムにおいて、その違いはきわめて重要な意味を持ちます。アクションを提案するAIシステムと、アクションを実行できるAIの間には大きな違いがあります。

4. 何が正常な状態か?

セキュリティアーキテクチャとしては、静的なルールだけでは不十分となるでしょう。AIの使用状況は急激に変化します:既存のプラットフォーム内にAIツールが出現し、ベンダーがAIを使った新しいサービスを追加し、多忙をきわめたスタッフはAIを使った回避策を見つけるかもしれません。セキュリティチームは、何かが変化したときにそれを発見できるよう、人、アイデンティティ、デバイス、ネットワーク、クラウドサービス、サプライヤー、AIツールのすべてにわたって正常な振る舞いを理解している必要があります。

このことは、わずかな異常が重大な意味をもつかもしれない、イベント開催中の環境において特に重要です。未承認のAIサービスへの接続は、ある状況では無害かもしれませんが別の文脈では深刻なものとなる可能性があります。そしてAIエージェントによるアクションの実行は、午前3時にセットアップを行っている状況では予期されたものかもしれませんが、試合開催中にそのアクションが発生した場合、疑わしいものかもしれません。あるアクティビティを意味のあるセキュリティ情報にするのはコンテキストです。また、迅速な対応を可能にするのもコンテキストであると言えます。組織内のAIベースセキュリティシステムが、アクションを実行する必要があることを知るためのリアルタイムのコンテキストを構築できれば、マシンスピードで脅威に対応できます。

AIはスタジアムの安全に貢献できる、ただしAIが安全であることが条件

AIにはスタジアム運営に貢献できる役割があります。観客の混雑をより早期に検知し、ボトルネックを解消し、施設をより効率的に管理し、ファン体験を向上させ、プレッシャーのかかる状況下でイベント運営チームをサポートすることができます。

問題への答えはすべてのAIの導入のペースを落とすことではありません。それが解決策ではありません。答えは、AIを可視化し、管理し、試合日の運営の一部となる前に安全にすることです。

スタジアムの運営チームやイベント主催者にとって、これはAIの使用を会場とサプライヤーエコシステム全体にわたってマッピングすることを意味します。また、各AIシステムが何にアクセスでき、どのようなアクションを実行できるかを理解することです。スタッフの判断で回避策を探すのに任せるのではなく、彼らのニーズを満たす承認済みのツールを提供することも重要です。ベンダーとの契約や監査にAIの利用について明記することも必要です。さらに、わかりやすい主なシステムだけではなく、環境全体で動作を監視することも大事です。スタジアムから見えないものを安全にすることはできません。

AIが、スタジアム内の人の移動、アクセスの制御、設備の管理、サプライヤーのサポート、メディアの権利保護の一部となるとき、それはもはや追加機能ではなく、イベントインフラの一部となるのです。

イベントインフラは、スタジアムのゲートが開く前に入念に準備され、安全でシームレスかつ信頼性の高いイベント体験を実現するのに必要な、オペレーショナルレジリエンスによって維持されなければなりません。

Darktraceはスタジアム運営のためのAIをどう保護できるか

ダークトレースは、10年以上にわたり構築してきたビヘイビアAIの専門技術を、複雑で曖昧な環境で機能するように設計された、組織全体をカバーするプラットフォームで提供しています。2022 FIFAワールドカップカタール大会からF1グランプリまで、Darktraceは世界のさまざまな会場や米国中のスタジアムにおいて運営を支える統合された大規模なITおよびOT環境を保護しています。

他のサイバーセキュリティ技術は、過去の攻撃に基づいて新しい攻撃を予測しようとします。しかし問題は、AIが人間のように動作することです。あらゆるアクションが新たな情報をもたらし、それによってAIの動作は変化するため、予測不可能です。過去に見られた攻撃の戦術はもはや方程式の小さな部分に過ぎません。その結果多くのベンダーは実証されていない技術を買収し、改修することによりAIの保護を行おうとしています。  

ダークトレースのアプローチは他とは根本的に異なります。ダークトレースの適応型AIは、人とAIの振る舞いを学習し続けることにより組織についての理解を構築するため、動作の逸脱が起こった時にそれを検知し自律的に対応することが可能です。ダークトレースの提供するビヘイビアベースの防御プラットフォームは、新たなワークフロー、エージェント、アプリケーションの導入に対応して組織内のAI、人、インフラを保護することにより、大規模なAI変革を可能にします。

AIによって変化する組織の潜在力。Darktraceは組織が自信を持って前へ進むのに役立ちます。ダークトレースはスタジアムインフラ内の人とテクノロジーを保護するセキュリティチームに対し、新たなテクノロジーの導入を保護するのに必要な理解、可視性、自律的アクションを提供し、AI時代を構築するための変革を後押しします。

[related-resource]

Continue reading
About the author
Karim Benslimane
VP, Field CISO
あなたのデータ × DarktraceのAI
唯一無二のDarktrace AIで、ネットワークセキュリティを次の次元へ