A new open-source tool called the AI Assessment Sandbox Configurator, released by Luxembourg's AI Factory on June 10, 2026, enables any organization to build customized testing environments that verify whether AI systems are trustworthy and compliant with regulations like the EU AI Act. Developed by the Luxembourg Institute of Science and Technology (LIST) and the University of Luxembourg's Interdisciplinary Centre for Security, Reliability and Trust (SnT), the tool addresses a critical bottleneck: today, testing AI for regulatory compliance remains slow, costly, and largely manual.

Why Does AI Compliance Testing Matter Right Now?

As AI adoption accelerates across Europe's economy and public sector, regulators and organizations face mounting pressure to prove that AI systems can be trusted. The EU AI Act and other regulations now impose clear obligations on AI providers to demonstrate trustworthiness. However, converting policy requirements into concrete testing metrics, identifying relevant tests, integrating them, and preparing audit-ready reports has been a painstaking, largely manual process that slows down AI deployment.

Trust is not just a regulatory checkbox; it is essential for AI to deliver real value. If users doubt every output or avoid AI altogether, organizations never realize the expected gains from their AI investments. The AI Assessment Sandbox Configurator aims to remove these bottlenecks and enable rigorous AI testing at scale for the growing number of AI agents being deployed by organizations across Europe.

How Does the New Tool Work for Organizations?

• Customizable Testing Environments: Organizations can select from a curated and extensible catalogue of AI tests, controls, and datasets relevant to their specific use case, then generate a customized testing environment tailored to their needs.
• Flexible Deployment Options: The tool is open-source and can be deployed on premises, on private clouds, or on sovereign clouds, making it suitable for organizations with strict data residency or security requirements, such as financial firms.
• Audit-Ready Reporting: The Configurator includes a collaborative dashboard to visualize and assess results, a report generator, and tamper-proof evidence for auditing, streamlining the preparation process for regulatory reviews.

The tool is designed for any organization, large or small, that wants to deploy AI responsibly. This includes large enterprises, public institutions, start-ups, and small and medium-sized enterprises (SMEs) working in cooperation with Competent Authorities and notified bodies.

What Real-World Experience Shaped This Tool?

The AI Assessment Sandbox Configurator builds on nearly a decade of hands-on AI testing work by SnT and LIST. SnT has worked with major financial institutions including BGL BNP Paribas since 2017, as well as Spuerkeess, the Luxembourg Ministry of Digitalisation, and the European Stability Mechanism (ESM). The research team is also collaborating with the National Bank of Greece on a Horizon Europe project to assess selected AI systems.

"In our work with partners we experienced first-hand the challenge to integrate cutting-edge technology into business-critical operations. This enabled us to produce breakthrough scientific research and in doing so we realised we could use our expertise to contribute an open-source tool to ease AI adoption. AI adoption requires both speed and control, and the AI Assessment Sandbox Configurator enables organisations to integrate AI in their processes in a trustworthy manner, supporting them in their global competitiveness," said Maxime Cordy, Assistant Professor in Software Engineering for AI Systems and SnT's project lead.

Maxime Cordy, Assistant Professor in Software Engineering for AI Systems, University of Luxembourg's Interdisciplinary Centre for Security, Reliability and Trust

LIST has operated its own AI Sandbox for several years, a hands-on testing environment where organizations evaluate AI models for robustness, fairness, bias, and regulatory compliance. That Sandbox has been used by organizations including Banque Internationale à Luxembourg, the City of Luxembourg, and Mistral AI.

"With the LIST AI Sandbox, we showed that rigorous, independent AI testing is achievable in practice. The Configurator is the logical next step: it packages that expertise into an open tool so that any organisation, anywhere, can stand up its own assessment environment without starting from scratch," explained Francesco Ferrero, Leader of the Flagship Initiative on Artificial Intelligence and Head of the Human-Centred AI, Data and Software Research Unit at LIST.

Francesco Ferrero, Leader of the Flagship Initiative on Artificial Intelligence, Luxembourg Institute of Science and Technology

What Does This Mean for Europe's AI Governance?

Luxembourg AI Factory views the Configurator as the foundation for something larger: a shared European resource co-developed by regulators, researchers, certification bodies, and companies across EU Member States. The tool positions Luxembourg as a hub for international companies, particularly in sectors such as finance, that wish to deploy AI systems in Europe and need a trusted, sovereign environment in which to assess them.

Over time, the library of tests and controls is expected to expand into specialized offerings for industries such as healthcare, finance, and manufacturing. Several pilots are already underway across Europe, and the underlying research has been published in peer-reviewed scientific papers.

"AI adoption only delivers value when AI systems can be trusted. The AI Assessment Sandbox Configurator is a natural extension of the Luxembourg AI Factory service catalogue: while our services already guide companies from assessment through to deployment, this tool enables any organisation to map regulatory requirements to concrete assessment metrics and generate audit-ready reports on its own infrastructure. It allows us to better serve companies of all sizes, from SMEs to large enterprises, by making trustworthiness practical rather than theoretical. This is how Luxembourg is positioning itself at the forefront of AI in Europe: by treating trust not as a barrier, but as the enabler that helps AI innovation reach the market and its users," concluded Stefano Pozzi Mucelli, Head of Ecosystem Innovation Projects at Luxinnovation.

Stefano Pozzi Mucelli, Head of Ecosystem Innovation Projects, Luxinnovation

The AI Assessment Sandbox Configurator is now available on GitHub and at ai-uat.aifactory.lu/build-and-test/testing-the-solution/ai-sandbox-configurator, making it accessible to organizations across Europe and beyond that are working to align their AI systems with emerging regulatory frameworks.