Prompt Runs

​

Prompt Runs

​

What Is a Prompt Run?

A prompt run happens when Gauge sends one prompt to one AI model and saves the response. Throughout the Gauge platform, a prompt run is often called an answer. Each answer includes the full response, the brands it mentions, the order in which they appear, and the sources it cites.

​

How Often Does Gauge Run Each Prompt?

Gauge runs each prompt once per AI model per day. If you track one prompt across six models, Gauge collects six new answers for that prompt each day.

​

When Does Gauge Run Each Prompt?

Gauge starts its scheduled prompt runs first thing each morning. Gauge also runs a prompt when you add it to the platform for the first time.

​

What Happens When I Add a New Prompt?

Gauge tries to run a new prompt as soon as you add it. Results often appear within 30 seconds and should appear within 30 minutes. This applies whether you add one prompt, upload prompts in bulk, or use Gauge to generate prompts.

​

Is One Run Per Day Statistically Significant?

One answer is not enough to show a reliable pattern. AI models can give different answers to the same question, even when you ask it in the same way. Running each prompt every day builds a more reliable sample over time. In a study Gauge published with Graphite, we looked at answers collected through APIs and front-end scraping, including answers that used web search. We found that the results reached statistical significance within 20 responses. By default, Gauge shows results from a rolling 30-day window. This gives each prompt up to 30 recent answers per model. It provides a strong sample while still showing how your results change over time. The first week or two can give you a helpful sense of direction. After one month, you have a much stronger set of data. The window then keeps moving forward each day as new answers replace old ones.