28 January 2025 | University of Amsterdam
Norm Engineering converts legal language and regulations into structured data models. This standardized approach allows organizations to automate regulatory interpretation, making compliance systems more accurate in analyzing and monitoring legal requirements.
In collaboration with the University of Amsterdam, TNO, Deloitte, and Be Informed have launched a Norm Engineering programme. This initiative aims to create methods and tools for clear, unambiguous regulatory interpretation. The FLINT language, a key outcome, translates social, ethical, and legal norms into a format both humans and systems understand, enabling seamless automation.
This year’s conference will feature a remarkable lineup of speakers, including leading industry experts who will delve into cutting-edge topics across regulatory technology. Key discussions will explore the latest advancements in norm engineering, from AI-driven compliance tools to best practices in adapting to global regulatory frameworks.
09:15 am – 09:30 am
Reception
09:30 am – 09:45 am
Opening | Tom van Engers – TNO
09:45 am – 10:15 am
Keynote | Matthew Gracie – Deloitte
10:30 am – 11:00 am
Breakout | Thomas van Binsbergen – TNO
10:30 am – 11:00 am
Breakout | Robert van Doesburg – TNO
11:00 am – 11:30 am
Coffee break
11:30 am – 12:00 pm
Keynote | Tobias Schroeder
12:15 pm – 12:45 pm
Breakout | Leon Gommans – KLM Air France
12:15 pm – 12:45 pm
Breakout | Vincent van Dijk – Pharosius
12:45 pm – 14:00 pm
Lunch
14:00 pm – 14:30 pm
Breakout | Sander Klous – KPMG
14:00 pm – 14:30 pm
Breakout | Romy van Drie – TNO
14:45 pm – 15:15 pm
Breakout | Sofia Ali – Dutch Tax Administration
15:15 pm – 15:45 pm
Coffee break
15:45 pm – 16:15 pm
Keynote | Tomas Algotsson – Swedish Tax Administration
16:15 pm – 17:00 pm
Panel Discussion
17:00 pm – 17:15 pm
Closing | Tom van Engers – TNO
17:15 pm – 19:00 pm
Networking & dinner
Vincent van Dijk
Pharosius
Tom van Engers
TNO
Suresh Nair
Mphasis
Maaike de Boer
???
At Be Informed we specialize in transforming regulations, laws, and rules into automated day-to-day compliant systems, providing you with full control, scalability, traceability, and organizational agility.
Join us on social media
Norm Engineering is revolutionizing how governments manage regulations, fostering growth and prosperity by making them transparent, accessible, and easier to comply with. By converting complex legal texts into plain language using the FLINT methodology, it structures regulations into Acts, Facts, and Duties, reducing compliance burdens and simplifying processes.
The rise of Generative AI has made at-scale Norm Engineering possible, enabling governments to enhance regulation accessibility, streamline approvals, and attract investment. Research shows that Generative AI can outperform human rule-based approaches, making Norm Engineering a cost-effective solution for regulatory modernization.
An alliance between Deloitte and Be Informed supports the adoption of Norm Engineering, demonstrating its value in improving governance and competitiveness globally.
Matthew Gracie
Managing Director | Strategy+Analytics
Deloitte US
Tomas Algotsson
Tax Director and Strategist
Swedish Tax Agency
This study conducts a systematic inventory and comparative analysis of various languages designed to support regulatory and legislative processes. Formalization approaches such as OpenFisca, Catala, Symboleo, Stipula, eFLINT, Logical English, and RegelSpraak have been examined in the literature, highlighting components like formal semantics, transparency, and interoperability. However, these components are not consistently evaluated across all approaches, and existing frameworks often overlook the practical dimensions required for effective real-world application.
To address this gap, this study introduces a new evaluation framework that builds on practical insights from observing organizational implementations of executable rules. It explores criteria relevant to the operational viability and integration of formalization approaches, enhancing their functionality in organizational settings. A key aspect of this framework is the inclusion of external components essential for assessing a legal language’s viability within an organization.
Through systematic analysis, this study identifies strengths and weaknesses across languages and presents a practical assessment model. This model integrates both theoretical and applied perspectives, offering policymakers, IT developers, and legal professionals a valuable tool for selecting or designing rule-based languages for agile and reliable law execution within digital environments.
Sofia Ali
Business Rule Analyst Income Tax
Dutch Tax and Customs Administration
Sofia Ali recently started her PhD under the supervision of Prof. Tom van Engers and Dr. Giovanni Sileno. Her work currently involves systematically inventorying and comparing various approaches and initiatives in legal contexts.
She holds dual Master of Science degrees: one in Business Information Management from Erasmus University (2021) and another in Economics and Management of Innovation and Technology from Bocconi University (2020). Sofia began her career at the Dutch Tax and Customs Administration before transitioning in 2023 to a role as a business rule analyst.
In this position, she uses RegelSpraak, a controlled natural language, to convert legal texts into structured, machine-readable rules. This approach ensures transparent and accessible integration of legal frameworks into digital systems, facilitating the automation of tax legislation.
Access and usage control systems are effective in protecting data assets from unauthorized access and promoting accountability through logged activities. However, a gap exists between the policies enforced by these systems and the data governance rules outlined by regulations such as GDPR, consortium agreements, and data processing agreements. To enforce these governance rules, they must be interpreted and converted into actionable policies—a process prone to error and lacking transparency, potentially leading to non-compliance.
This presentation explores research on bridging the gap between legal interpretation and system-level authorizations in data processing systems. It highlights purpose-based access control, where authorizations are derived from lawful processing arguments according to GDPR. These arguments are automatically constructed using logical inference rules based on GDPR analysis and input from privacy analysts regarding processing purposes. By replacing conventional system-level policies with high-level legal statements, the approach minimizes errors and enhances transparency and accountability. The rules and statements remain accessible, enabling the recreation of lawfulness arguments when needed.
Thomas van Binsbergen
Assistant professor
University of Amsterdam
Thomas van Binsbergen is an assistant professor at the University of Amsterdam conducting research on the topic of data exchange systems, modular language specification and software language engineering. I teach programming languages (BSc Informatica) and Software Evolution (MSc Software Engineering). This website is up to date with regards to (recent) publications, preprints and presentations.
[1] Mikolov et al. (2013). Efficient Estimation of Word Representations in Vector Space.
[2] Devlin et al. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding.
[3] Brown et al. (2020). Language Models are Few-Shot Learners.
[4] Bakker et al. (2022). Extracting Structured Knowledge from Dutch Legal Texts: A Rule-based Approach.
[5] Bakker et al. (2022). Semantic Role Labelling for Dutch Law Texts.
[6] Van Drie et al. (2023). The Dutch Law as a Semantic Role Labeling Dataset.
[7] Redelaar et al. (2024). Attributed Question Answering for Preconditions in the Dutch Law.
Romy van Drie
Researcher
TNO Data Science
Romy van Drie is a researcher at TNO Data Science. She obtained her bachelor’s degree in Dutch and her master’s degree in Linguistics, with minors in AI from Utrecht University. Her work at TNO is focused on Responsible AI and Natural Language Processing (NLP). She is involved in applied research projects to study and give advice on the responsible use of AI in the public sector. In the AI Oversight Lab, she collaborates with public parties, including the Immigration and Naturalisation Service (IND), the Human Environment and Transport Inspectorate (ILT) and the Dutch State Supervision of Mines (SodM). She is also involved in early research projects such as Norm Engineering. In the Norm Engineering project, she works on NLP methods such as semantic role labelling and question answering. Her publications can be found via Google Scholar.
Prof.dr. Sander Klous
Professor in AI and Audit
University of Amsterdam
Engineering is about:
The practical problem we work on is to make and use norms and rules that can be used in practice by interpreting regulations. Robert van Doesburg focuses on making standardized interpretations of sources of norms and rules. He will present a short overview of the nature of norms and rules. What types of norms and rules can be distinguished, what they consist of, and why they must be derived from a source. He will present a generic model for the normative aspects of setting tasks and executing them (Calculemus), and a language for expressing norms and rules based on fundamental, or elementary concepts (Flint). In his presentation he will present a beta version of an open source tool for norm engineering and propose a standardization effort that is not for a specific solution or ontology, but serves as a platform for connecting different solutions for working with norms and rules, allowing for cooperation, comparing, solving disputes, and better understanding of rule-based systems.
Robert van Doesburg
Scientist
TNO
Prof. dr. Leon Gommans
Vice President at IDCA
Researcher at UvA
Science Liaison at KLM
“We founded Be Informed to help organizations navigate complex regulations efficiently. By interpreting regulations in a way understandable to both computers and humans, we can now help organizations build compliant applications and ensure that the right regulations are applied at the right time. Over the past twenty years, we’ve collaborated with leading customers, governments, and academia globally to develop this technology.”
Geert, our Chief Customer Success Officer, has held roles including Director of Business Development, COO, Managing Director of US Operations, and Director of Marketing and Sales. Previously at Logica, he served as Account Manager, Business Unit Manager, and Sales Director Public Sector. Geert holds an MSc in Economics from Tilburg and Uppsala Universities.