Fix CONFIG_AP=y build after driver_ops set_key merge