Blog
/
/
August 4, 2020

How to Prevent Spear Phishing Attacks Post Twitter Hack

Twitter confirmed spear phishing as the cause of last month's attack. Learn about the limits of current defenses against spear phishing and how AI can stop it.
Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Written by
Dan Fein
VP, Product
Default blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog imageDefault blog image
04
Aug 2020

Twitter has now confirmed that it was a “phone spear phishing attack” targeting a small number of their employees that allowed hackers to access 130 high-profile user accounts and fool thousands of people into giving away money via bitcoin.

Spear phishing involves targeted texts or emails aimed at individuals in an attempt to ‘hook’ them into opening an attachment or malicious link. This attack highlights the limitations in the security controls adopted by even some of the largest and most tech-savvy organizations out there, who continue to fall victim to this well-known attack technique.

The incident has been described by Twitter as a “coordinated social engineering attack” that “successfully targeted employees with access to internal systems and tools.”

Though the specific nature of the attack remains unclear, it likely followed a similar pattern to the series of threat finds detailed elsewhere on the Darktrace Blog: impersonating trusted colleagues or platforms, such as WeTransfer, Microsoft Teams or even Twitter itself, with an urgent message coaxing an employee into clicking on a disguised URL and inputting their credentials on a fake login page.

When an employee inputs their credentials, that data is recorded and beaconed back to the attacker, who will then use these login details to access internal systems — which, in this case, allowed them to subsequently take control of celebrities’ Twitter accounts and send out the damaging Tweets that left thousands out of pocket.

Training the workforce is not enough

Twitter says in a statement that this incident has forced them to “accelerate several of [their] pre-existing security workstreams.” But the suggestion that they will continue to organize “ongoing company-wide phishing exercises throughout the year” indicates an over-reliance on the ability of humans to identify these malicious email attacks that are getting more and more advanced, and harder to distinguish from genuine communication.

Cyber-criminals are now using AI to create fake profiles, personalize messages and replicate communication patterns, at a speed and scale that no human ever could. In this threat landscape, there can no longer be a reliance solely on educating the workforce, as the difference between a malicious email and legitimate communication becomes almost imperceptible. This has led to an acceptance that we must rely on technology to help us catch the subtle signs of attack, when humans alone fail to do so.

The legacy approach: no playbook for new attacks

The majority of communications security systems are not where they need to be, and this is particularly true for the email realm. Most tools in use today rely on static blacklists of rules and signatures that analyze emails in isolation, against known ‘bads’. Methods like looking for IP addresses or file hashes associated with phishing have had limited success in stopping attackers, who have devised simple techniques to bypass them.

As we have explored previously, attackers are constantly changing their approach, purchasing new domains en masse, experimenting with novel strains of malware, and manipulating headers to get around common validation checks. It is due to these developments that Secure Email Gateways (SEGs) become antiquated almost the moment they are updated.

The mean lifetime of an attack has reduced from 2.1 days in 2018 to 0.5 days in 2020. As soon as an SEG identifies a domain or a file hash as malicious, cyber-criminals change their attack infrastructure and launch a new wave of fresh attacks. Their fundamental means of operation renders legacy security tools incapable of evolving with the threat landscape, and it is for this reason that over 94% of cyber-attacks today start with an email.

How Cyber AI catches the threats others miss

However, one area where email security has seen great progress even in the last two years is the application of AI to spot the subtle features of advanced email attacks, even those that leverage novel malware. This approach allows security tools to move away from the binary decision-making that comes with asking “Is this email ‘bad’?” and moving to the far more useful question of “does this belong?”

This form of what we’re calling ‘layered AI’ combines supervised and unsupervised machine learning, enabling it to spot the subtle deviations from learned ‘patterns of life’ that are indicative of a cyber-threat.

Supervised machine learning models can be trained on millions of emails to find subtle patterns undetectable by humans and detect new variations of known threat types. These models are able to find the real-world intentions behind an email: by training on millions of spear phishing emails, for example, a system can find patterns associated with this type of email attack and accurately classify a future email as spear phishing.

In addition, unsupervised machine learning models can be trained on all available email data for an organization to find unknown variations of unknown threat types — that is, the ‘unknown unknowns,’ the combinations never before seen. Ultimately this is what enables a system to ask that critical question “does this belong?” and spot genuine anomalies that fall outside of the norm.

Layering both of these applications of AI allows us to make determinations such as: ‘this is a phishing email and it doesn’t belong’, dramatically improving the system’s accuracy and allowing it to interrupt only the malicious emails – since there could be phishy-looking emails that are legitimate! It also enables us to act in proportion to the threat identified: locking links and attachments in some cases, or holding back emails entirely in others.

This form of ‘layered AI’ requires an advanced understanding of mathematics and machine learning that takes years of research and development. With that experience, Cyber AI has proven itself capable of catching the full range of advanced attacks targeting the inbox, from spear phishing and impersonation attempts, to account takeovers and supply chain attacks. Once implemented, it takes only a week before any new organization can derive value, and thousands of customers now rely on Cyber AI to protect both their email realm and wider network.

Plenty more phish in the sea

This will not be the last time this year that a cyber-attack caused by spear phishing makes the headlines. Just this week, it was revealed that Russian-backed cyber-criminals stole sensitive documents on US-UK trade talks after successful spear phishing, and the technique may well have played a part in ongoing vaccine research espionage that surfaced in July.

With the US presidential race heating up, it was recently revealed that fewer than 3 out of 10 election administrators have basic controls to prevent phishing. This attack method may come to not only damage organizations and their reputation, but also to undermine the trust that serves as the bedrock of democracy. Now is the time to start recognizing the very real threat that email attackers represent, and to prepare our defenses accordingly.

Learn more about AI email security

Inside the SOC
Darktrace cyber analysts are world-class experts in threat intelligence, threat hunting and incident response, and provide 24/7 SOC support to thousands of Darktrace customers around the globe. Inside the SOC is exclusively authored by these experts, providing analysis of cyber incidents and threat trends, based on real-world experience in the field.
Written by
Dan Fein
VP, Product

More in this series

No items found.

Blog

/

Email

/

May 1, 2026

How email-delivered prompt injection attacks can target enterprise AI – and why it matters

Default blog imageDefault blog image

What are email-delivered prompt injection attacks?

As organizations rapidly adopt AI assistants to improve productivity, a new class of cyber risk is emerging alongside them: email-delivered AI prompt injection. Unlike traditional attacks that target software vulnerabilities or rely on social engineering, this is the act of embedding malicious or manipulative instructions into content that an AI system will process as part of its normal workflow. Because modern AI tools are designed to ingest and reason over large volumes of data, including emails, documents, and chat histories, they can unintentionally treat hidden attacker-controlled text as legitimate input.  

At Darktrace, our analysis has shown an increase of 90% in the number of customer deployments showing signals associated with potential prompt injection attempts since we began monitoring for this type of activity in late 2025. While it is not always possible to definitively attribute each instance, internal scoring systems designed to identify characteristics consistent with prompt injection have recorded a growing number of high-confidence matches. The upward trend suggests that attackers are actively experimenting with these techniques.

Recent examples of prompt injection attacks

Two early examples of this evolving threat are HashJack and ShadowLeak, which illustrate prompt injection in practice.

HashJack is a novel prompt injection technique discovered in November 2025 that exploits AI-powered web browsers and agentic AI browser assistants. By hiding malicious instructions within the URL fragment (after the # symbol) of a legitimate, trusted website, attackers can trick AI web assistants into performing malicious actions – potentially inserting phishing links, fake contact details, or misleading guidance directly into what appears to be a trusted AI-generated output.

ShadowLeak is a prompt injection method to exfiltrate PII identified in September 2025. This was a flaw in ChatGPT (now patched by OpenAI) which worked via an agent connected to email. If attackers sent the target an email containing a hidden prompt, the agent was tricked into leaking sensitive information to the attacker with no user action or visible UI.

What’s the risk of email-delivered prompt injection attacks?

Enterprise AI assistants often have complete visibility across emails, documents, and internal platforms. This means an attacker does not need to compromise credentials or move laterally through an environment. If successful, they can influence the AI to retrieve relevant information seamlessly, without the labor of compromise and privilege escalation.

The first risk is data exfiltration. In a prompt injection scenario, malicious instructions may be embedded within an ordinary email. As in the ShadowLeak attack, when AI processes that content as part of a legitimate task, it may interpret the hidden text as an instruction. This could result in the AI disclosing sensitive data, summarizing confidential communications, or exposing internal context that would otherwise require significant effort to obtain.

The second risk is agentic workflow poisoning. As AI systems take on more active roles, prompt injection can influence how they behave over time. An attacker could embed instructions that persist across interactions, such as causing the AI to include malicious links in responses or redirect users to untrusted resources. In this way, the attacker inserts themselves into the workflow, effectively acting as a man-in-the-middle within the AI system.

Why can’t other solutions catch email-delivered prompt injection attacks?

AI prompt injection challenges many of the assumptions that traditional email security is built on. It does not fit the usual patterns of phishing, where the goal is to trick a user into clicking a link or opening an attachment.  

Most security solutions are designed to detect signals associated with user engagement: suspicious links, unusual attachments, or social engineering cues. Prompt injection avoids these indicators entirely, meaning there are fewer obvious red flags.

In this case, the intention is actually the opposite of user solicitation. The objective is simply for the email to be delivered and remain in the inbox, appearing benign and unremarkable. The malicious element is not something the recipient is expected to engage with, or even notice.

Detection is further complicated by the nature of the prompts themselves. Unlike known malware signatures or consistent phishing patterns, injected prompts can vary widely in structure and wording. This makes simple pattern-matching approaches, such as regex, unreliable. A broad rule set risks generating large numbers of false positives, while a narrow one is unlikely to capture the diversity of possible injections.

How does Darktrace catch these types of attacks?

The Darktrace approach to email security more generally is to look beyond individual indicators and assess context, which also applies here.  

For example, our prompt density score identifies clusters of prompt-like language within an email rather than just single occurrences. Instead of treating the presence of a phrase as a blocking signal, the focus is on whether there is an unusual concentration of these patterns in a way that suggests injection. Additional weighting can be applied where there are signs of obfuscation. For example, text that is hidden from the user – such as white font or font size zero – but still readable by AI systems can indicate an attempt to conceal malicious prompts.

This is combined with broader behavioral signals. The same communication context used to detect other threats remains relevant, such as whether the content is unusual for the recipient or deviates from normal patterns.

Ask your email provider about email-delivered AI prompt injection

Prompt injection targets not just employees, but the AI systems they rely on, so security approaches need to account for both.

Though there are clear indications of emerging activity, it remains to be seen how popular prompt injection will be with attackers going forward. Still, considering the potential impact of this attack type, it’s worth checking if this risk has been considered by your email security provider.

Questions to ask your email security provider

  • What safeguards are in place to prevent emails from influencing AI‑driven workflows over time?
  • How do you assess email content that’s benign for a human reader, but may carry hidden instructions intended for AI systems?
  • If an email contains no links, no attachments, and no social engineering cues, what signals would your platform use to identify malicious intent?

Visit the Darktrace / EMAIL product hub to discover how we detect and respond to advanced communication threats.  

Learn more about securing AI in your enterprise.

Continue reading
About the author
Kiri Addison
Senior Director of Product

Blog

/

AI

/

April 30, 2026

Mythos vs Ethos: Defending in an Era of AI‑Accelerated Vulnerability Discovery

mythos vulnerability discoveryDefault blog imageDefault blog image

Anthropic’s Mythos and what it means for security teams

Recent attention on systems such as Anthropic Mythos highlights a notable problem for defenders. Namely that disclosure’s role in coordinating defensive action is eroding.

As AI systems gain stronger reasoning and coding capability, their usefulness in analyzing complex software environments and identifying weaknesses naturally increases. What has changed is not attacker motivation, but the conditions under which defenders learn about and organize around risk. Vulnerability discovery and exploitation increasingly unfold in ways that turn disclosure into a retrospective signal rather than a reliable starting point for defense.

Faster discovery was inevitable and is already visible

The acceleration of vulnerability discovery was already observable across the ecosystem. Publicly disclosed vulnerabilities (CVEs) have grown at double-digit rates for the past two years, including a 32% increase in 2024 according to NIST, driven in part by AI even prior to Anthropic’s Mythos model. Most notably XBOW topped the HackerOne US bug bounty leaderboard, marking the first time an autonomous penetration tester had done so.  

The technical frontier for AI capabilities has been described elsewhere as jagged, and the implication is that Mythos is exceptional but not unique in this capability. While Mythos appears to make significant progress in complex vulnerability analysis, many other models are already able to find and exploit weaknesses to varying degrees.  

What matters here is not which model performs best, but the fact that vulnerability discovery is no longer a scarce or tightly bounded capability.

The consequence of this shift is not simply earlier discovery. It is a change in the defender-attacker race condition. Disclosure once acted as a rough synchronization point. While attackers sometimes had earlier knowledge, disclosure generally marked the moment when risk became visible and defensive action could be broadly coordinated. Increasingly, that coordination will no longer exist. Exploitation may be underway well before a CVE is published, if it is published at all.

Why patch velocity alone is not the answer

The instinctive response to this shift is to focus on patching faster, but treating patch velocity as the primary solution misunderstands the problem. Most organizations are already constrained in how quickly they can remediate vulnerabilities. Asset sprawl, operational risk, testing requirements, uptime commitments, and unclear ownership all limit response speed, even when vulnerabilities are well understood.

If discovery and exploitation now routinely precede disclosure, then patching cannot be the first line of defense. It becomes one necessary control applied within a timeline that has already shifted. This does not imply that organizations should patch less. It means that patching cannot serve as the organizing principle for defense.

Defense needs a more stable anchor

If disclosure no longer defines when defense begins, then defense needs a reference point that does not depend on knowing the vulnerability in advance.  

Every digital environment has a behavioral character. Systems authenticate, communicate, execute processes, and access resources in relatively consistent ways over time. These patterns are not static rules or signatures. They are learned behaviors that reflect how an organization operates.

When exploitation occurs, even via previously unknown vulnerabilities, those behavioral patterns change.

Attackers may use novel techniques, but they still need to gain access, create processes, move laterally, and will ultimately interact with systems in ways that diverge from what is expected. That deviation is observable regardless of whether the underlying weakness has been formally named.

In an environment where disclosure can no longer be relied on for timing or coordination, behavioral understanding is no longer an optional enhancement; it becomes the only consistently available defensive signal.

Detecting risk before disclosure

Darktrace’s threat research has consistently shown that malicious activity often becomes visible before public disclosure.

In multiple cases, including exploitation of Ivanti, SAP NetWeaver, and Trimble Cityworks, Darktrace detected anomalous behavior days or weeks ahead of CVE publication. These detections did not rely on signatures, threat intelligence feeds, or awareness of the vulnerability itself. They emerged because systems began behaving in ways that did not align with their established patterns.

This reflects a defensive approach grounded in ‘Ethos’, in contrast to the unbounded exploration represented by ‘Mythos’. Here, Mythos describes continuous vulnerability discovery at speed and scale. Ethos reflects an understanding of what is normal and expected within a specific environment, grounded in observed behavior.

Revisiting assume breach

These conditions reinforce a principle long embedded in Zero Trust thinking: assume breach.

If exploitation can occur before disclosure, patching vulnerabilities can no longer act as the organizing principle for defense. Instead, effective defense must focus on monitoring for misuse and constraining attacker activity once access is achieved. Behavioral monitoring allows organizations to identify early‑stage compromise and respond while uncertainty remains, rather than waiting for formal verification.

AI plays a critical role here, not by predicting every exploit, but by continuously learning what normal looks like within a specific environment and identifying meaningful deviation at machine speed. Identifying that deviation enables defenders to respond by constraining activity back towards normal patterns of behavior.

Not an arms race, but an asymmetry

AI is often framed as fueling an arms race between attackers and defenders. In practice, the more important dynamic is asymmetry.

Attackers operate broadly, scanning many environments for opportunities. Defenders operate deeply within their own systems, and it’s this business context which is so significant. Behavioral understanding gives defenders a durable advantage. Attackers may automate discovery, but they cannot easily reproduce what belonging looks like inside a particular organization.

A changed defensive model

AI‑accelerated vulnerability discovery does not mean defenders have lost. It does mean that disclosure‑driven, patch‑centric models no longer provide a sufficient foundation for resilience.

As vulnerability volumes grow and exploitation timelines compress, effective defense increasingly depends on continuous behavioral understanding, detection that does not rely on prior disclosure, and rapid containment to limit impact. In this model, CVEs confirm risk rather than define when defense begins.

The industry has already seen this approach work in practice. As AI continues to reshape both offense and defense, behavioral detection will move from being complementary to being essential.

Continue reading
About the author
Andrew Hollister
Principal Solutions Engineer, Cyber Technician
Your data. Our AI.
Elevate your network security with Darktrace AI