Loosely bound particle with nonzero orbital angular momentum in an electric or magnetic field