AirSim is an open source simulator for drones and cars. In this article, we will introduce deep reinforcement learning using a single Windows machine instead of distributed, from the tutorial “Distributed Deep Reinforcement Learning for Autonomous Driving” using AirSim.