In a parallel plate capacitor with plates joined with a conductor?

IN such a capacitor the plates will have the same voltage, thus capacitance becomes infinite. But won't this capacitor then act just as a conducting wire? Then how is its storage capacity infinite.