When I had the cast iron manifold I also had the same problem. I think mine was made worse because the downpipe was stainless and the flange was just too thin (6mm ?) that I could never get a seal. No matter what I tried, gaskets, exhaust cement, nothing worked for long.
In the end I removed the downpipe and brazed a "socket" inside both halves which protruded into the cast iron manifold, making a spigot & socket joint on both exits. That worked perfectly although no doubt impeded the exhaust gas to some small extent.
Brian