The short answer is YES. The longer one is maybe. It all depends on what you actually do. If you just there work, go home, then go back to work and do not do any brain work-outs, then you’re bound to lose memory year in year out.
But, if you use that brain of yours and learn often something new, then you will make sure to keep your memories intact for longer times. The brain plasticity allows you to develop new neuron to neuron connections so that, even in old age, you can still build memories like its nobody’s business.