Key takeaways After Alibaba’s Qwen model tried a test upload to a server in Beijing during a Cohere experiment, we replayed that moment 64 times, and the model picked 52 different addresses. That points to an unpredictable model rather than a hidden backdoor, but an unpredictable agent with access to tools is still a risk that needs to be addressed. →The destination kept changing. Alibaba Cloud came up in six of 64 replays and Amazon Web Services in seven, while nearly a third pointed back to the machine itself or to an internal network →Small changes influence the behavior. A […]
This article has been indexed from Check Point Blog
Read the original article:
Backdoor or Confused Agent? What We Learned Replaying the Qwen Incident