Probably Secure: A Look at the Security Concerns of Deterministic vs Probabilistic Systems

Would you rather have determined that you are in fact secure, or are you willing to accept that you are “probably” doing things securely? This might seem like a silly question on the surface, after all, audits don’t work on probability; they work on documented facts. We are in an era of rapidly advancing artificial intelligence-driven applications across our organizations, covering a wide variety of use cases. We all love LLMs. There are numerous benefits to applying AI effectively, but like any technology, if we misapply it, we risk opening the door to new dangers.

As we further adopt these tools and apply AI in novel ways to our workflows across all departments, it is likely a good idea to take a step back and think through how these systems work, which boils down to most likely getting a correct answer versus repeatedly getting the same expected results based on the same specific inputs.