Publications by categories in reversed chronological order. generated by jekyll-scholar.


    A PSPACE Algorithm for Almost-Sure Rabin Objectives in Multi-Environment MDPs
    Marnix Suilen, Marck van der Vegt, and Sebastian Junges
    In CONCUR 2024
  2. IJCAI
    Imprecise Probabilities Meet Partial Observability: Game Semantics for Robust POMDPs
    Eline M. Bovy, Marnix Suilen, Sebastian Junges, and Nils Jansen
    In IJCAI 2024
  3. IJCAI
    Approximate Dec-POMDP Solving Using Multi-Agent A*
    Wietze Koops, Sebastian Junges, and Nils Jansen
    In IJCAI 2024
  4. ECC
    A Stability-Based Abstraction Framework for Reach-Avoid Control of Stochastic Dynamical Systems with Unknown Noise Distributions
    Thom Badings, Licio Romao, Alessandro Abate, and Nils Jansen
    In European Control Conference (ECC) 2024
  5. TACAS
    CTMCs with Imprecisely Timed Observations
    Thom S. Badings,¬†Matthias Volk,¬†Sebastian Junges,¬†Mari√ęlle Stoelinga,¬†and¬†Nils Jansen
    In TACAS (2) 2024
    A Supervised Learning Approach to Robust Reinforcement Learning for Job Shop Scheduling
    Christoph Schmidl, Thiago D. Simão, and Nils Jansen
    In Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART 2024
  7. AAAI
    Factored Online Planning in Many-Agent POMDPs
    Maris Galesloot, Thiago D. Simão, Sebastian Junges, and Nils Jansen
    In AAAI 2024
  8. AAAI
    Robust Active Measuring under Model Uncertainty
    Merlijn Krale, Thiago D. Simão, Jana Tumova, and Nils Jansen
    In AAAI 2024


  1. FMAS
    Correct-by-Construction Control for Stochastic and Uncertain Dynamical Models via Formal Abstractions
    Thom S. Badings, Nils Jansen, Licio Romao, and Alessandro Abate
    In FMAS@iFM 2023
  2. AAAI
    Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertainty
    Thom S. Badings, Licio Romano, Alessandro Abate, and Nils Jansen
    In AAAI 2023
  3. AAAI
    Safe Reinforcement Learning via Shielding under Partial Observability
    Steven Carr, Nils Jansen, Sebastian Junges, and Ufuk Topcu
    In AAAI 2023
  4. AAAI
    Safe Policy Improvement for POMDPs via Finite-State Controllers
    Thiago D. Simão, Marnix Suilen, and Nils Jansen
    In AAAI 2023
  5. ICML
    Scalable Safe Policy Improvement via Monte Carlo Tree Search
    Alberto Castellini, Federico Bianchi, Edoardo Zorzi, Thiago D. Simão, Alessandro Farinelli, and 1 more author
    In ICML 2023
  6. ICLR
    Safe Reinforcement Learning From Pixels Using a Stochastic Latent Representation
    Yannick Hogewind, Thiago D. Simão, Tal Kachman, and Nils Jansen
    In ICLR 2023
  7. IJCAI
    More for Less: Safe Policy Improvement with Stronger Performance Guarantees
    Patrick Wienhöft, Marnix Suilen, Thiago D. Simão, Clemens Dubslaff, Christel Baier, and 1 more author
    In IJCAI 2023
  8. IJCAI
    Recursive Small-Step Multi-Agent A* for Dec-POMDPs
    Wietze Koops, Nils Jansen, Sebastian Junges, and Thiago D. Simão
    In IJCAI 2023
  9. CAV
    Efficient Sensitivity Analysis for Parametric Robust Markov Chains
    Thom Badings, Sebastian Junges, Ahmadreza Marandi, Ufuk Topcu, and Nils Jansen
    In CAV 2023
  10. STTT
    Strong Simple Policies for POMDPs
    Leonore Winterer, Ralf Wimmer, Nils Jansen, and Bernd Becker
    Int. J. Softw. Tools Technol. Transf. 2023
  11. FMSD
    Parameter Synthesis for Markov Models Covering the Parameter Space
    Sebastian Junges,¬†Erika √Ābrah√°m,¬†Christian Hensel,¬†Nils Jansen,¬†Joost-Pieter Katoen, and 2 more authors
    Formal Methods in System Design 2023
  12. ECAI
    Reinforcement Learning by Guided Safe Exploration
    Qisong Yang, Thiago D. Simão, Nils Jansen, Simon H. Tindemans, and Matthijs T. J. Spaan
    In ECAI 2023
  13. QEST
    Formal Controller Synthesis for Markov Jump Linear Systems with Uncertain Dynamics
    Luke Rickard, Thom S. Badings, Licio Romao, and Alessandro Abate
    In QEST 2023
  14. Book
    Shared Control with Human Trust and Workload Models
    Murat Cubuktepe, Nils Jansen, and Ufuk Topcu
    Cyber-Physical-Human Systems: Fundamentals and Applications, 2023
  15. NCA
    A Maintenance Planning Framework using Online and Offline Deep Reinforcement Learning
    Zaharah Allah Bukhsh, Hajo Molegraaf, and Nils Jansen
    Neural Computing and Applications 2023
  16. UAI
    Risk-aware Curriculum Generation for Heavy-tailed Task Distributions
    Cevahir Koprulu, Thiago D. Simão, Nils Jansen, and Ufuk Topcu
    In UAI 2023
  17. QEST
    Quantitative Evaluation of Systems - 20th International Conference, QEST 2023, Antwerp, Belgium, September 20-22, 2023, Proceedings
    Nils Jansen, and Mirco Tribastone (editors)
  18. TACAS
    Robust Almost-Sure Reachability in Multi-Environment MDPs
    Marck van der Vegt, Nils Jansen, and Sebastian Junges
    In TACAS 2023
  19. ICAPS
    Act-Then-Measure: Reinforcement Learning for Partially Observable Environments with Active Measuring
    Merlijn Krale, Thiago D. Simão, and Nils Jansen
    In ICAPS 2023
  20. ICAPS
    Model Checking for Adversarial Multi-Agent Reinforcement Learning with Reactive Defense Methods
    Dennis Gross, Christoph Schmidl, Nils Jansen, and Guillermo A. Pérez
    In ICAPS 2023
  21. STTT
    Decision-making under uncertainty: beyond probabilities. Challenges and Perspectives
    Thom Badings, Thiago D. Simão, Marnix Suilen, and Nils Jansen
    STTT 2023
  22. LNCS
    Intelligent and Dependable Decision-Making Under Uncertainty
    Nils Jansen
    In FM 2023
  23. ICAART
    Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking
    Dennis Gross, Thiago D. Simão, Nils Jansen, and Guillermo A. Pérez
    In ICAART 2023
  24. ICAART
    Turn-based Multi-Agent Reinforcement Learning Model Checking
    Dennis Gross
    In ICAART 2023
  25. STTT
    Explanation Paradigms Leveraging Analytic Intuition (ExPLAIn)
    Nils Jansen, Gerrit Nolte, and Bernhard Steffen
    Int. J. Softw. Tools Technol. Transf. 2023


  1. JAIR
    Robust Control for Dynamical Systems with Non-Gaussian Noise via Formal Abstractions
    Thom S. Badings, Licio Romao, Alessandro Abate, David Parker, Hasan A. Poonawala, and 2 more authors
    J. Artif. Intell. Res. 2022
  2. NeurIPS
    Robust Anytime Learning of Markov Decision Processes
    Marnix Suilen, Thiago D. Simão, David Parker, and Nils Jansen
    In NeurIPS 2022
  3. AAAI
    Sampling-Based Robust Control of Autonomous Systems with Non-Gaussian Noise
    Thom S. Badings, Alessandro Abate, Nils Jansen, David Parker, Hasan A. Poonawala, and 1 more author
    In AAAI 2022
  4. LNCS
    Parameter Synthesis in Markov Models: A Gentle Survey
    Nils Jansen, Sebastian Junges, and Joost-Pieter Katoen
    In Principles of Systems Design 2022
  5. STTT
    Scenario-based verification of uncertain parametric MDPs
    Thom S. Badings, Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, and 1 more author
    Int. J. Softw. Tools Technol. Transf. 2022
    Convex Optimization for Parameter Synthesis in MDPs
    Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, and Ufuk Topcu
    IEEE Trans. Autom. Control. 2022
  7. CAV
    Sampling-Based Verification of CTMCs with Uncertain Rates
    Thom S. Badings,¬†Nils Jansen,¬†Sebastian Junges,¬†Mari√ęlle Stoelinga,¬†and¬†Matthias Volk
    In CAV (2) 2022
  8. LNCS
    A Journey from Process Algebra via Timed Automata to Model Learning - Essays Dedicated to Frits Vaandrager on the Occasion of His 60th Birthday
    Grouping of Maintenance Actions with Deep Reinforcement Learning and Graph Convolutional Networks
    David Kerkkamp, Zaharah Allah Bukhsh, Yingqian Zhang, and Nils Jansen
    In ICAART (2) 2022
  10. SETTA
    COOL-MC: A Comprehensive Tool for Reinforcement Learning and Model Checking
    Dennis Gross, Nils Jansen, Sebastian Junges, and Guillermo A. Pérez
    In SETTA 2022


  1. ACM
    Formalizing and guaranteeing human-robot interaction
    Hadas Kress-Gazit, Kerstin Eder, Guy Hoffman, Henny Admoni, Brenna Argall, and 10 more authors
    Commun. ACM 2021
  2. JAIR
    Task-Aware Verifiable RNN-Based Policies for Partially Observable Markov Decision Processes
    Steven Carr, Nils Jansen, and Ufuk Topcu
    J. Artif. Intell. Res. 2021
  3. AAAI
    Robust Finite-State Controllers for Uncertain POMDPs
    Murat Cubuktepe, Nils Jansen, Sebastian Junges, Ahmadreza Marandi, Marnix Suilen, and 1 more author
    In AAAI 2021
  4. AAMAS
    AlwaysSafe: Reinforcement Learning without Safety Constraint Violations during Training
    Thiago D. Simão, Nils Jansen, and Matthijs T. J. Spaan
    In AAMAS 2021
  5. RSS
    Safe Policies for Factored Partially Observable Stochastic Games
    Steven Carr, Nils Jansen, Sudarshanan Bharadwaj, Matthijs T. J. Spaan, and Ufuk Topcu
    In Robotics: Science and Systems 2021
  6. CAV
    Enforcing Almost-Sure Reachability in POMDPs
    Sebastian Junges, Nils Jansen, and Sanjit A. Seshia
    In CAV (2) 2021
  7. TAC
    Strategy Synthesis for POMDPs in Robot Planning via Game-Based Abstractions
    Leonore Winterer, Sebastian Junges, Ralf Wimmer, Nils Jansen, Ufuk Topcu, and 2 more authors
    IEEE Trans. Autom. Control. 2021
  8. TAC
    Synthesis of Provably Correct Autonomy Protocols for Shared Control
    Murat Cubuktepe, Nils Jansen, Mohammed Alshiekh, and Ufuk Topcu
    IEEE Trans. Autom. Control. 2021
  9. TAC
    Control Theory Meets POMDPs: A Hybrid Systems Approach
    Mohamadreza Ahmadi, Nils Jansen, Bo Wu, and Ufuk Topcu
    IEEE Trans. Autom. Control. 2021
  10. NeurCA
    Damage detection using in-domain and cross-domain transfer learning
    Zaharah Allah Bukhsh, Nils Jansen, and Aaqib Saeed
    Neural Comput. Appl. 2021
  11. ACC
    Adaptive Shielding under Uncertainty
    Stefan Pranger, Bettina Könighofer, Martin Tappler, Martin Deixelberger, Nils Jansen, and 1 more author
    In ACC 2021
  12. NFM
    Balancing Wind and Batteries: Towards Predictive Verification of Smart Grids
    Thom S. Badings, Arnd Hartmanns, Nils Jansen, and Marnix Suilen
    In NFM 2021


  1. ATVA
    Robustness Verification for Classifier Ensembles
    Dennis Gross, Nils Jansen, Guillermo A. Pérez, and Stephan Raaijmakers
    In ATVA 2020
    Safe Reinforcement Learning Using Probabilistic Shields (Invited Paper)
    Nils Jansen, Bettina Könighofer, Sebastian Junges, Alex Serban, and Roderick Bloem
    In CONCUR 2020
  3. IJCAI
    Robust Policy Synthesis for Uncertain POMDPs via Convex Optimization
    Marnix Suilen, Nils Jansen, Murat Cubuktepe, and Ufuk Topcu
    In IJCAI 2020
  4. IJCAI
    Verifiable RNN-Based Policies for POMDPs Under Temporal Logic Constraints
    Steven Carr, Nils Jansen, and Ufuk Topcu
    In IJCAI 2020
  5. ISoLa
    Shield Synthesis for Reinforcement Learning
    Bettina Könighofer, Florian Lorber, Nils Jansen, and Roderick Bloem
    In ISoLA (1) 2020
  6. NFM
    Neural Simplex Architecture
    Dung T. Phan, Radu Grosu, Nils Jansen, Nicola Paoletti, Scott A. Smolka, and 1 more author
    In NFM 2020
  7. NFM
    Strengthening Deterministic Policies for POMDPs
    Leonore Winterer, Ralf Wimmer, Nils Jansen, and Bernd Becker
    In NFM 2020
  8. TACAS
    Scenario-Based Verification of Uncertain MDPs
    Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, and Ufuk Topcu
    In TACAS (1) 2020
    Formal Modeling and Analysis of Timed Systems - 18th International Conference, FORMATS 2020, Vienna, Austria, September 1-3, 2020, Proceedings


  1. Model Repair Revamped - - On the Automated Synthesis of Markov Chains -
    Milan Ceska, Christian Dehnert, Nils Jansen, Sebastian Junges, and Joost-Pieter Katoen
    In From Reactive Systems to Cyber-Physical Systems 2019
  2. IJCAI
    Counterexample-Guided Strategy Improvement for POMDPs Using Recurrent Neural Networks
    Steven Carr, Nils Jansen, Ralf Wimmer, Alexandru Constantin Serban, Bernd Becker, and 1 more author
    In IJCAI 2019
  3. NFM
    Structured Synthesis for Probabilistic Systems
    Nils Jansen, Laura R. Humphrey, Jana Tumova, and Ufuk Topcu
    In NFM 2019
  4. SNR
    Correct-by-construction policies for POMDPs
    Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Tim Quatmann, Bernd Becker, and 2 more authors
    In SNR 2019
  5. TACAS
    Shepherding Hordes of Markov Chains
    Milan Ceska, Nils Jansen, Sebastian Junges, and Joost-Pieter Katoen
    In TACAS (2) 2019


  1. Conditioning in Probabilistic Programming
    Federico Olmedo, Friedrich Gretz, Nils Jansen, Benjamin Lucien Kaminski, Joost-Pieter Katoen, and 1 more author
    ACM Trans. Program. Lang. Syst. 2018
  2. Allerton
    Verification of Uncertain POMDPs Using Barrier Certificates
    Mohamadreza Ahmadi, Murat Cubuktepe, Nils Jansen, and Ufuk Topcu
    In Allerton 2018
  3. ACC
    Human-in-the-Loop Synthesis for Partially Observable Markov Decision Processes
    Steven Carr, Nils Jansen, Ralf Wimmer, Jie Fu, and Ufuk Topcu
    In ACC 2018
  4. ATVA
    Synthesis in pMDPs: A Tale of 1001 Parameters
    Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, and Ufuk Topcu
    In ATVA 2018
  5. MBMV
    Abstraktions-basierte Verifikation von POMDPs im Motion-Planning-Kontext
    Leonore Winterer, Sebastian Junges, Ralf Wimmer, Nils Jansen, Ufuk Topcu, and 2 more authors
    In MBMV 2018
  6. QEST
    Model Checking for Safe Navigation Among Humans
    Sebastian Junges, Nils Jansen, Joost-Pieter Katoen, Ufuk Topcu, Ruohan Zhang, and 1 more author
    In QEST 2018
  7. UAI
    Finite-State Controllers of POMDPs using Parameter Synthesis
    Sebastian Junges, Nils Jansen, Ralf Wimmer, Tim Quatmann, Leonore Winterer, and 2 more authors
    In UAI 2018
  8. Dagstuhl
    Machine Learning and Model Checking Join Forces (Dagstuhl Seminar 18121)
    Nils Jansen,¬†Joost-Pieter Katoen,¬†Pushmeet Kohli,¬†and¬†Jan KretńĪŐĀnsk√Ĺ
    Dagstuhl Reports 2018


  1. ACC
    Synthesis of shared control protocols with provable safety and performance guarantees
    Nils Jansen, Murat Cubuktepe, and Ufuk Topcu
    In ACC 2017
  2. CDC
    Motion planning under partial observability using game-based abstraction
    Leonore Winterer, Sebastian Junges, Ralf Wimmer, Nils Jansen, Ufuk Topcu, and 2 more authors
    In CDC 2017
  3. TACAS
    Sequential Convex Programming for the Efficient Verification of Parametric MDPs
    Murat Cubuktepe, Nils Jansen, Sebastian Junges, Joost-Pieter Katoen, Ivan Papusha, and 2 more authors
    In TACAS (2) 2017
  4. Book
    Synthesis and Verification of Self-aware Computing Systems
    Radu Calinescu, Marco Autili, Javier Cámara, Antinisca Di Marco, Simos Gerasimou, and 8 more authors
    Self-Aware Computing Systems 2017