Menu
Publications
2026
2025
2024
2023
2022
2021
2020
2019
2018
2017
2016
2015
2014
2013
2012
2011
2010
2009
2008
2007
2006
2005
2004
2003
2002
2001
Editor-in-Chief
Nikiforov
Vladimir O.
D.Sc., Prof.
Partners
doi: 10.17586/2226-1494-2026-26-4-844-850
Automatic prompt optimization with prompt distillation
Read the full article
';
Article in English
For citation:
Abstract
For citation:
Zhuravlev V.N., Khairullin A.R., Dyagin E.A., Sitkina A.N., Kulin N.I. Automatic prompt optimization with prompt distillation. Scientific and Technical Journal of Information Technologies, Mechanics and Optics, 2026, vol. 26, no. 4, pp. 844–850. doi: 10.17586/2226-1494-2026-26-4-844-850
Abstract
Autoprompting is the process of automatically selecting optimized prompts for language models which is gaining popularity due to the rapid development of prompt engineering driven by extensive research in the field of Large Language Models. This paper presents DistillPrompt — a novel autoprompting method based on Large Language Models that employs a multi-stage integration of task-specific information into prompts using training data. DistillPrompt utilizes distillation, compression, and aggregation operations to explore the prompt space more thoroughly. The method was tested on different datasets for text classification and generation tasks using t-lite-instruct-2.1, gpt-3.5-turbo and gpt-4o-mini language models. The results demonstrate a significant average improvement in key metrics over existing methods in the field, establishing DistillPrompt as one of the most effective non-gradient approaches in autoprompting.
Keywords: LLM, autoprompting, prompt distillation, prompting, prompt engineering
