Thanks Brian! The noise is a bit like I have straight cut gears and as I say, only occurs when I let off the gas, not every time but most times. I haven't really sorted out any differences between when it happens and doesn't. So far, I wouldn't say that temperature has anything to do with it. It's not a "this is about to blow up" sound, but rather a "pay attention to me" sound. It reminds me of the sound a live axle car I had that I believed the rear end was going out on though I never took it apart to confirm that - there didn't seem to be any other explanation. So my first thought was this is happening again.
I have to estimate the mileage in the neighborhood of 10k miles on everything (could be less). Spax shocks, Banks twin link, U-joint and CV joins, adjustable lower links with rod ends. I don't remember the brand of U-joint I used nor do I remember if they can be greased. I haven't noticed that load plays a role as I generally don't push it hard.
As usual, I am trying to think about the situation before I get my hands dirty. I'll jack it up and see if I can find out more.