Discover Model Leeching attack on Large Language Models (LLMs), achieving 73% similarity with ChatGPT-3.5-Turbo (from OpenAI) for just $50. Explore AI security implications in this research by the Mindgard team.
Model Leeching is a novel extraction attack targeting Large Language Models (LLMs), capable of distilling task-specific knowledge from a target LLM into a reduced parameter model.
We demonstrate the effectiveness of our attack by extracting task capability from ChatGPT-3.5-Turbo, achieving 73% Exact Match (EM) similarity, and SQuAD EM and F1 accuracy scores of 75% and 87%, respectively for only $50 in API cost.
We further demonstrate the feasibility of adversarial attack transferability from an extracted model extracted via Model Leeching to perform ML attack staging against a target LLM, resulting in an 11% increase to attack success rate when applied to ChatGPT-3.5-Turbo.
Access the complete insights into Model Leeching.
Next Steps
Thank you for reading our research about Model Leeching!
Test Our Free Platform: Experience how our Automated Red Teaming platform swiftly identifies and remediates AI security vulnerabilities. Start for free today!
Follow Mindgard: Stay updated by following us on LinkedIn and X, or join our AI Security community on Discord.
Get in Touch: Have questions or want to explore collaboration opportunities? Reach out to us, and let's secure your AI together.
Please, feel free to request a demo to learn about the full benefits of Mindgard Enterprise.
Explore the latest research on adversarial extraction attacks targeting Deep Learning models, including a new framework called PINCH. Learn how to...
Explore cutting-edge research on enhancing DL model attack robustness through tensor optimization. Learn about AML side-channel defense strategies...
Explore the vulnerabilities of Large Language Models (LLMs) and how to mitigate security risks with Mindgard's cutting-edge AI security solutions....