Activities per year
Project Details
Description
Cybercriminals and malicious actors are increasingly using AI to spread disinformation at scale – for example, by generating fake news articles and emails, or manipulating social media posts that deceive both people and systems.
AI:SECURITY combines advanced AI technologies (such as Natural Language Processing) with cutting-edge cybersecurity research to develop intelligent systems that can detect and prevent such threats. For instance, imagine an AI model that identifies a phishing email by analyzing both its content and context.
The project both aims to defend against attacks and ensure that AI systems themselves remain secure – e.g. by protecting LLMs from being hijacked or misused by malicious actors in societal applications, such as chat bots. This is a vital step toward building a safe and secure digital society.
The project funds four PhD students under the AAU AI:X initiative.
AI:SECURITY combines advanced AI technologies (such as Natural Language Processing) with cutting-edge cybersecurity research to develop intelligent systems that can detect and prevent such threats. For instance, imagine an AI model that identifies a phishing email by analyzing both its content and context.
The project both aims to defend against attacks and ensure that AI systems themselves remain secure – e.g. by protecting LLMs from being hijacked or misused by malicious actors in societal applications, such as chat bots. This is a vital step toward building a safe and secure digital society.
The project funds four PhD students under the AAU AI:X initiative.
| Status | Active |
|---|---|
| Effective start/end date | 01/08/2025 → 31/12/2029 |
Funding
- Aalborg University
Keywords
- NLP Security
- Cybersecurity
- Security
- Artificial Intelligence
- AI
- LLM
Fingerprint
Explore the research topics touched on by this project. These labels are generated based on the underlying awards/grants. Together they form a unique fingerprint.
Activities
- 1 Conference presentations
-
Shared Path: Unraveling Memorization in Multilingual LLMs through Language Similarities
Luo, X. (Speaker)
6 Nov 2025Activity: Talks and presentations › Conference presentations
Prizes
-
D3A Audience Award
Bakka, J. M. (Recipient), Wright, D. B. (Recipient) & Bjerva, J. (Recipient), 8 Oct 2026
Prize: Conference prizes
Projects
- 4 Active
-
TRUST: Building TRUST in Text: Linguistically Motivated Language Model Detection
Bjerva, J. (PI) & Lonke, D. (Project Participant)
Independent Research Fund Denmark | Sapere Aude
01/05/2026 → 30/04/2030
Project: Research
-
Formal Semantic Methods for AI Safety
Bjerva, J. (PI), Lackner, A. K. (Project Participant) & Baninajjar, A. (Project Participant)
01/05/2026 → 31/05/2028
Project: Research
-
-
A Hierarchical Evaluation Framework for LLM-driven Threat Modelling Tools
Bakka, J. M., Bøgedal, T. W., Brandhøj, A. K. & Bjerva, J., Jul 2026, Proceedings of the 23rd International Conference on Security and Cryptography. De Capitani Di Vimercati, S. & Samarati, P. (eds.). SciTePress, Vol. 1: SECRYPT. p. 689-700 12 p.Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review
Open Access -
Capable yet Parsimonious: Extracting and Characterizing Hidden Chain-of-Thought in Frontier Models
Luo, X., Ren, T., Yu, W., Li, X., Li, Q. & Bjerva, J., 22 Sept 2026, arXiv, 33 p.Research output: Working paper/Preprint › Preprint
Open AccessFile117 Downloads (Pure) -
Characterizing Memorization in Diffusion Language Models: Generalized Extraction and Sampling Effects
Luo, X., Yu, W., Li, Q. & Bjerva, J., 2 Mar 2026, arXiv, 21 p.Research output: Working paper/Preprint › Preprint
Open Access
Press/Media
-
AAU bygger sit AI-fyrtårn fra bunden: Giver forskertalenter som Johannes fire ph.d.-studerende og frie hænder
03/12/2025
1 item of Media coverage
Press/Media: Press / Media