Same problem here. When I go to “Navigate”, I see a list of recent destinations that cannot be removed by choosing the exclamation point. I can only remove favorite destinations (Navigate -> Favorites -> Exclamation mark on any destination). There should be an option to clear whole list of recent destinations (not favorites).