Reinforcement Learning Exercise

Implementations of various reinforcement learning algorithms including MDPs, Q-Learning, and Policy Gradients for custom environments.

RLRobotics
# features

Key Features

What the system does.

Markov Decision Processes (Lab 1)

Concepts: Fundamental Tabular Methods, MDPs, Value Functions, Value Iteration, and Model-Free RL (such as Tabular Q-Learning). Application: Agents learning to navigate grid worlds and play Pacman using basic tabular methods.

Function Approximation (Lab 2)

Concepts: Linear Function Approximation, LSTD, and Deep Q-Networks. Application: Scaling up RL to handle larger state spaces where tabular methods are no longer feasible by using neural networks or feature extractors.

Policy Gradients (Lab 3)

Concepts: Policy Gradient Methods, Actor-Critic Architectures, Natural Gradients, and Model-Based Exploration. Application: Training agents in environments with continuous action spaces (like controlling a pendulum).

POMDP and Multi-Agent RL (Lab 4)

Concepts: POMDPs, Belief MDPs, Deep RL for POMDPs, and Cooperative MARL algorithms. Application: Dealing with uncertainty when the environment is not fully observable and coordinating multiple agents.

# graphs

Performance Graphs

Visualisations of model performance and results across experiments.

Function Approximation img 1
Function Approximation img 10
Function Approximation img 2
Function Approximation img 3
Function Approximation img 4
Function Approximation img 5
Function Approximation img 6
Function Approximation img 7
Function Approximation img 8
Function Approximation img 9
lab3 output
Multi-Agent RL img 1
Multi-Agent RL img 2
Multi-Agent RL img 3
Multi-Agent RL img 4
Multi-Agent RL img 5
Multi-Agent RL img 6
Multi-Agent RL img 7
Multi-Agent RL img 8
POMDP img 1
POMDP img 2
POMDP img 3
POMDP img 4

Function Approximation img 1

Performance graph for Function Approximation img 1

# simulation

Live Simulation Output

Simulated console execution.

Outputs
Lab 1 Output
$_▋
# repositories

Source Code

GitHub repositories for this project.