Acknowledgements
We gratefully acknowledge the contributions of the The Construct team in creating the openai_ros package. It provided us with a great template to build our new framework. Maybe in the future features found in the ROS Gazebo Gym framework can be backported into the openai_ros package or even better combined into a new package under the ros-simulation organization.