The Mirage of LLM Guardrails: A Case Study in AI-Assisted Medical Note Manipulation

본문 미리보기

arXiv:2607.24859v1 Announce Type: new Abstract: The rapid deployment of large language models (LLMs) in healthcare settings makes the reliability of their built-in guardrails against malicious queries a question of urgent practical consequence. Yet the robustness of these mechanisms against deliberate misuse (in the healthcare context) remains poorly understood. In this paper, we investigate this question empirically, using AI-assisted medical note manipulation as a concrete case study. We make