For everyone when sleep is lost, memories are harder to reappear precisely because sleep restores and improves connections between brain cells.
Particularly those who have already experienced the weakening of their memory are in absolute need of many hours of sleep that allows them to be able to connect with memories farther back in time.
Get enough sleep, exercise, no alcohol, and your memory will also be better.