Reinforcement learning (RL) agents are increasingly being deployed in complex 3D environments. These scenarios often present unique difficulties for RL techniques due to the increased dimensionality. Bandit4D, a cutting-edge new framework, aims to address these hurdles by providing a comprehensive platform for training RL agents in 3D scenarios. It