Yes gauges can fail, and they fail much, much more often than a solid brass plug. Worse, its position is perfect for spraying leaking fuel all over the engine compartment.
So, is it going to fail? Probably not. Could it fail? Maybe. Is fuel pressure something that needs to be monitored constantly? No.
Therefore best practice is to set up your pressure and then remove the gauge and fit a plug.