LeftoverLocals

Updates

• 2024-01-16: Preliminary launch

Description

Path of Bits is disclosing LeftoverLocals: a vulnerability that permits knowledge restoration from GPU reminiscence created by one other course of on Apple, Qualcomm, and AMD GPUs. LeftoverLocals impacts the safety posture of GPU purposes, with explicit significance to LLMs and ML fashions that run on impacted GPUs. By recovering native reminiscence – an optimized GPU reminiscence area – we constructed a PoC the place an attacker can pay attention into one other person’s interactive LLM session (e.g., llama.cpp) throughout course of or container boundaries.

Demo

See Also

Renovating your own home to be internet zero and off fossil fuels

Report

See the total report at our weblog here.