Microsoft has unveiled a groundbreaking cybersecurity challenge aimed at advancing the security of artificial intelligence (AI) systems. Named the “LLMail-Inject: Adaptive Prompt Injection Challenge,” the initiative invites hackers and security researchers to test their skills against a simulated AI-powered email client, LLMail. Successful participants can earn rewards of up to $10,000 for uncovering exploitable vulnerabilities.
Focus on Prompt Injection Defenses
The competition centers around strengthening defenses against **prompt injection attacks** in AI-enhanced systems. LLMail, the simulated email service, relies on a large language model (LLM) to interpret and respond to user commands. Hackers play the role of adversaries, attempting to bypass security measures and manipulate the LLM into executing unauthorized tasks.
Participants face the challenge of creating malicious email prompts capable of deceiving the system into performing unintended actions without user consent.
LLMail System Components
LLMail consists of several key elements that competitors must navigate to exploit vulnerabilities:
- A simulated email database for storing messages.
- A retriever to fetch relevant emails based
[…]
Content was cut in order to protect the source.Please visit the source for the rest of the article.This article has been indexed from CySecurity News – Latest Information Security and Hacking IncidentsRead the original article: