Faculty of Electrical Engineering and Computing, University of Zagreb AISy Lab

AI Security & Interpretability Lab

AISy Lab studies how modern AI systems work on the inside, how they can be attacked, and how to make them safer and more transparent.

Research

We work at the intersection of interpretability and security: understanding models well enough to find their failures, and building defenses grounded in that understanding.

Mechanistic Interpretability

Reverse-engineering the internal circuits and representations of neural networks to explain what they compute and why.

Adversarial Robustness

Understanding jailbreaks, prompt injection and adversarial inputs, and building models and defenses that hold up under attack.

Privacy & Data Leakage

Measuring what models memorize and reveal about their training data, and methods that limit that leakage.

Auditing & Evaluation

Benchmarks, red-teaming protocols and auditing tools that make claims about model safety testable.

Current projects

All projects →

Selected publications

All publications →
  1. NeuroStrike: Neuron-Level Attacks on Aligned LLMs

    Lichao Wu, Sasha Behrouzi, Mohamadreza Rostami, Maximilian Thang, Stjepan Picek, Ahmad-Reza Sadeghi

    Network and Distributed System Security Symposium (NDSS), 2026

  2. GateBreaker: Gate-Guided Attacks on Mixture-of-Expert LLMs

    Lichao Wu, Sasha Behrouzi, Mohamadreza Rostami, Stjepan Picek, Ahmad-Reza Sadeghi

    USENIX Security Symposium, 2026

  3. Towards Backdoor Stealthiness in Model Parameter Space

    Xiaoyun Xu, Zhuoran Liu, Stefanos Koffas, Stjepan Picek

    ACM Conference on Computer and Communications Security (CCS), pp. 2863–2876, 2025

  4. On the Vulnerability of Data Points Under Multiple Membership Inference Attacks and Target Models

    Mauro Conti, Jiaxin Li, Stjepan Picek

    IEEE Transactions on Dependable and Secure Computing 22(4), pp. 4022–4039, 2025