🌌 Vector Environments
Description
To support large-scale parallelization, we now support vector environments. Each environment is similar to our regular environment, but our simulator now can keep track of multiple environments simultaneously. We have implemented many vectorized operations to optimize the performance of these parallel environments. We are also actively working on further enhancements to make them faster. Some use cases for this include reinforcement learning, parallelized training with domain randomization, and parallelized policy evaluation.
Usage
Creating a minimal vector environment requires the definition of a config dictionary. This dictionary is copied across all environments: