In practical applications such as text-to-SQL parsing, we show in our upcoming ACL-24 paper that success in combining LLMs with search relies heavily on discriminator quality, pointing to the need for more research on improving discriminator quality before meaningful performance gains can be achieved.