P2P: Handle P2P Device dedicated interface parent removal