基于模拟优化的语言模型预算内提示词集扩展与精炼

View PDF HTML (experimental)

Abstract:A prompt is an instruction or description provided by the user to guide a generative language model toward outputs that meet application requirements. When these requirements change, existing prompts may need to be adapted and improved. Evaluating candidate prompts requires time and computational resources. We therefore study how to expand and refine an initial set of prompts under a limited evaluation budget through simulation optimization, aiming to maximize a pre-defined task score for a fixed language model. Specifically, we propose a two-stage framework. In the first stage, we expand the initial set of prompts into a finite candidate set, where each prompt is represented by a moderate-dimensional vector. In the subsequent stage of evaluation and selection, we construct a surrogate model of the score for moderate-dimensional vectors representing the prompts. We propose sequentially selecting prompts for evaluation using the constructed surrogate model. We prove the consistency of the sequential evaluation procedure in our framework. We further introduce a refinement procedure that uses the collected scores to search beyond the initial candidate set. We also conduct numerical experiments to demonstrate the advantages of our method over baseline prompt selection methods, with higher prompt scores, especially when the budget for calling language models to evaluate prompts is limited.

Comments:	55 pages
Subjects:	Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:	arXiv:2404.08164 [stat.ML]
	(or arXiv:2404.08164v3 [stat.ML] for this version)
	https://doi.org/10.48550/arXiv.2404.08164 arXiv-issued DOI via DataCite

Submission history

From: Haoting Zhang [view email]
[v1] Fri, 12 Apr 2024 00:03:56 UTC (8,490 KB)
[v2] Mon, 20 May 2024 02:34:42 UTC (11,832 KB)
[v3] Sun, 25 Oct 2026 03:32:40 UTC (9,004 KB)