A Prompt tip to improve the ability to handle complex tasks on large models by 3%-20%

Written by
Iris Vance
Updated on:June-28th-2025
Recommendation

Master Step-Back Prompting to make your AI model handle complex tasks more accurately!
Core content:
1. The definition and working mechanism of Step-Back Prompting
2. The advantages compared with traditional prompting techniques
3. Application examples and effect improvement data display

Yang Fangxian
Founder of 53AI/Most Valuable Expert of Tencent Cloud (TVP)

Step-Back Prompting  is a prompting technique that improves the ability of large models to handle complex tasks.

It splits the one-step prompt into two steps: first, let the big model extract the abstract concepts and principles involved in the problem, and then let the big model deal with specific problems.

This approach helps prevent errors in the intermediate steps, thereby improving the accuracy of content generation. It has been tested on models such as PaLM-2L, GPT-4, and Llama2-70B, and significantly outperforms traditional methods such as chain thinking (CoT) prompts.

The method consists of two steps:

  1. Abstract : Ask about the concepts or principles involved in solving the problem;

  2. Reasoning : Provide the concepts and principles obtained in the previous step + the original problem to the large model for processing.

For example:

We want to write a storyline . If we ask the big model the question directly, we get the following feedback:

How to use Step-Back Prompting

We first let the big model refine the concepts and key points: "Referring to popular first-person shooter games, what are the 5 key points for writing a storyline for the first-person shooter game level?" The big model will return to the core elements of writing the level plot.

Then, we asked the big model to further process the original problem based on the five key points it extracted. It can be seen that the content produced by the new method has become more structured and targeted.

On many data sets, the use of step-back prompting techniques has brought significant improvements in results.

Abstract first, then concrete , this is the core idea of ​​Step-back prompting.

This technique is just like when we are coaching students to complete complex tasks. We first guide students to answer what concepts and methods are needed to solve specific problems, and then ask them to solve the problems based on the corresponding concepts and methods to improve accuracy.