hard mid panel

I installed a hard mid panel, and it is rubbing my doors while the box is down. Is this common for you guys or is there something fitting wrong. I read a post that they someone was having the same issues and fixed it but couldn't remember what it was. Been through the installation manual...