Yes, you can keep your old passport as a souvenir but you are not allowed to travel on it once a new passport has been issued to you.