Whatever you have tried, try it the other way up!
When I bought my D3 many moons ago, I resigned myself to it being broken and missing a piece as I couldn't get it back on. I bought a new armrest, brand new, in black, still have it! Never fitted it, as when I saw it I realised the error of my ways and click the old one went back on and was fixed - for as long as I kept the car in any case!
It was a long time ago, but from memory, I had it upside down
That said, if you want a black armrest new in it's bag - let me know