Skip to content

Get Started

Quick Start
Core Concepts
- Labelling Function
- Cost Function
Basic Usage

Common API

Constraints
Wrappers
Metrics
- Logging
Linear Temporal Logic (LTL)
Probabilistic Computation Tree Logic (PCTL)

Environments

Multi Agent
- Gridworlds
  - Markov Stag Hunt
- Matrix Games
Single Agent

Algorithms

Algorithms Overview
Tabular Algorithms
- Q Learning
- Q Learning Lambda
- LCRL
- SEM
- RECREG
On-Policy Algorithms
Shielded Algorithms
- Parameterized PPO
- Parameterized PPO V2

Tutorials

Basics
Constraints
LTL-Safety
Wrappers
Environments
Algorithms

Misc

Probabilistic Shielding

Parameterized PPO¶

Source: masa/prob_shield/parameterized_ppo.py

Parameterized PPO V2

Shielded Algorithms

Copyright © 2025, Alexander Goodall, Omar Adalat, Edwin Hamel De Le Court, Francesco Belardinelli

Made with Sphinx and @pradyunsg's Furo