Broken Bags: Disrupting Service Through the Contamination of Large Language Models With Misinformation
Yilin Mo, Maoyang Tang, Ruohan Lin +2 more
Large language models (LLMs) have progressively become essential production tools in contemporary society, owing to their formidable natural language generation and contextual reasoning skills. To facilitate the development of current responses by LLMs, individuals have used retrieval-augmented generation (RAG) technology, which extracts material from the corpus to assist large language models in producing relevant replies. The extensive utilization of huge language models necessitates urgent RAG security research. Conventional RAG attack techniques exhibit inadequate hiding and a substantial volume of harmful messages. Consequently, we have introduced an innovative attack mechanism termed "Broken Bags," which adeptly injects a minimal quantity of toxic text to mislead large language models. The attack is executed through a hybrid approach that incorporates artificial prompt templates…