Yep, it should stay down when its on but they are notorious for giving up the ghost and not staying down - the plastic inside the switch gets very brittle and tiny pieces break off so the main switch wont stay latched down.
We do sell a lot of the memory switches which I assume is because of this....
Give us a shout if you want a replacement
