Being the “one who remembers” comes with quiet losses — time, peace, connection. Here’s what you might be missing while holding it all together.