For now, apply xmlsec flags to both builds.