As you correctly stated, the Visible property is used to determine whether the pane contents is visible - the header is always shown. To remove one completely, you can remove it completely from the Controls collection of the ExplorerBar. Another way of doing this is to set its parent:
explorerBarPane1.Parent = null;
And to put it back:
explorerBarPane1.Parent = explorerBar1;