The Security Challenges of Generative AI Tools: Can a Loose Prompt Sink Your Ship?

During WWII, the US Office of War Information created posters encouraging people to avoid careless talk. The message was, “Loose lips sink ships.” Fast forward to 2023, and this adage finds new meaning in the context of generative AI tools, like OpenAI ChatGPT, Google Bard, and Microsoft Copilot. Although these tools have been heralded as “productivity game changers,” there are concerns about the security implications.

What are generative AI tools?

First, a bit of background. These AI tools are based on Large Language Models (LLM). UK’s NCSC explains in a blog that an LLM is an algorithm trained on a large amount of text-based data, typically scraped from the open internet. The algorithm analyzes the relationships between different words and turns that into a probability model. It is then possible to give the algorithm a ‘prompt,’ which will provide an answer based on the relationships of the words in its model. Typically, the data in its model is static after initial training. However, it can be fine-tuned with training on additional data and ‘prompt augmentation’ by providing more context about the question.

The security risks of generative AI

In the wrong hands, generative AI tools could have disastrous consequences. While most people use them for fun or to make their lives easier, cybercriminals may use the technology to become more informed, efficient, or convincing.

Like the internet, we cannot police or limit access to these tools, so we can’t avoid it being used for nefarious purposes. These powerful AI-based tools are here to stay, and there will always be bad people who will exploit this technology to further their agendas.

According to a recent survey of Thales consumers, the security risks of generative AI tools concern 75% of the respondents. It’s reassuring to know that three-quarters of UK adults are already aware of the potential harm these tools may cause. However, that still leaves a significant proportion of the population unaware of this technology or not staying vigilant to more advanced cyber threats.

According to the same survey, the top security concerns identified a

[…]
Content was cut in order to protect the source.Please visit the source for the rest of the article.