> ## Documentation Index
> Fetch the complete documentation index at: https://arize-ax.mintlify.site/docs/llms.txt
> Use this file to discover all available pages before exploring further.

# Test prompts on datasets

> Experiment with your datasets in prompt playground

export const AskAlyx = ({children}) => {
  const gradientId = `askAlyxGradient-${Math.random().toString(36).slice(2)}`;
  return <div style={{
    display: "flex",
    alignItems: "flex-start",
    gap: "0.625rem",
    margin: "1rem 0",
    padding: "0.75rem 1rem",
    borderRadius: "10px",
    border: "1px solid rgba(120, 115, 245, 0.25)",
    background: "linear-gradient(135deg, rgba(255, 110, 196, 0.08), rgba(120, 115, 245, 0.08))"
  }}>
      <svg width="18" height="18" viewBox="0 0 21 17" xmlns="http://www.w3.org/2000/svg" style={{
    flexShrink: 0,
    marginTop: "0.2rem"
  }}>
        <defs>
          <linearGradient id={gradientId} x1="0%" y1="100%" x2="100%" y2="0%">
            <stop offset="0%" stopColor="#ff6ec4" />
            <stop offset="100%" stopColor="#7873f5" />
          </linearGradient>
        </defs>
        <path d="M6.28906 12.7223C6.28889 11.3831 5.24007 10.3385 3.98926 10.3385C2.73859 10.3387 1.68963 11.3832 1.68945 12.7223C1.68945 14.0616 2.73849 15.1059 3.98926 15.1061C5.24018 15.1061 6.28906 14.0617 6.28906 12.7223ZM7.81152 0.557254C9.70554 -0.563135 12.1081 0.0645388 13.2607 1.91468L13.3691 2.09827V2.09925L20.7266 15.402C20.8713 15.6637 20.8667 15.9823 20.7148 16.2399C20.5629 16.4975 20.2864 16.6559 19.9873 16.6559H14.5459C13.0953 16.6474 11.7648 15.848 11.0469 14.5748V14.5739L6.33301 6.19104C5.22656 4.2273 5.87813 1.706 7.80957 0.558231L7.81152 0.557254ZM11.8906 2.91761C11.2374 1.74047 9.78961 1.34962 8.67188 2.01038L8.67285 2.01136C7.61521 2.64 7.19477 3.99924 7.69336 5.13733L7.80566 5.36194V5.36292L12.5186 13.7448C12.9466 14.5038 13.7274 14.9616 14.5557 14.9664H18.5547L11.8906 2.91663V2.91761ZM7.97949 12.7223C7.97949 14.9527 6.21527 16.7965 3.98926 16.7965C1.7634 16.7963 0 14.9526 0 12.7223C0.000173728 10.4921 1.76351 8.64923 3.98926 8.64905C6.21516 8.64905 7.97932 10.492 7.97949 12.7223Z" fill={`url(#${gradientId})`} />
      </svg>
      <span>{children}</span>
    </div>;
};

When modifying a prompt in the playground, you can test your new prompt across a dataset of examples to validate that the model is **hill climbing** in terms of performance across challenging examples, without regressing on core business use cases.

<AskAlyx>**Ask Alyx** to do any of the following steps, or to do all of them at once!</AskAlyx>

<Frame>
  <video
    src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/arize-docs-images/load-dataset-playground-arize.mp4"
    width="100%"
    height="100%"
    style={{ 
  display: 'block',
  objectFit: 'fill',
  backgroundColor: 'transparent'
}}
    controls
    autoPlay
    muted
    loop
  />
</Frame>

# Step 1: Set a Dataset

<AskAlyx>**Ask Alyx** to attach a dataset to the playground for you.</AskAlyx>

1. Follow this guide to upload your dataset to Arize AX [Create a dataset](/docs/ax/develop/datasets/how-to-datasets)
2. Go back to the prompt playground, and choose your dataset from the **Select a Dataset** dropdown

# Step 2: Set your Prompt

<AskAlyx>**Ask Alyx** to load a prompt from Prompt Hub or write a new one for you.</AskAlyx>

1. Load your prompt from the Prompt Hub, using the **Select a template from prompt hub** dropdown
2. OR, fill in a new prompt (See more: [Create a Prompt](/docs/ax/prompts/prompt-hub/create-a-prompt))
3. Include variables from your dataset in the prompt, inside curly braces

<Frame>
  <img src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/Screenshot%202025-10-21%20at%2010.04.20%E2%80%AFAM.png" alt="Set prompt with variables from dataset" />
</Frame>

## Step 3: Add Evaluators

<AskAlyx>**Ask Alyx** to add evaluators to this experiment for you.</AskAlyx>

Select **Add Evaluator** to add evaluators to evaluate outputs generated by this experiment.

## Add a Code Eval

Write a programmatic evaluator if you'd like to use code to judge your experiment outputs.

Learn more here: [Code Evaluations](/docs/ax/evaluate/evaluators/code-evaluations)

## Add an LLM as Judge Evaluator

Use an LLM to judge your experiment outputs. Learn more: [LLM as a Judge](/docs/ax/evaluate/evaluators/llm-as-a-judge)

1. Select one our Arize eval templates
2. OR write your own. Make sure to embed variabes from the dataset, so that the evaluator has something to evaluate
3. Set your eval labels. These are the labels the evaluator will pick from, when judging the output
4. Set explanations on/off. Explanations are short reasoning blobs that the LLM will generate to explain its reasoning. Also set advanced options.
5. Click **Create Eval** once you are done.

<Frame>
  <img src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/Screenshot%202025-10-21%20at%2010.05.02%E2%80%AFAM.png" alt="Add evaluators to experiment" />
</Frame>

# Step 4: Run Experiment

<AskAlyx>**Ask Alyx** to run the experiment for you.</AskAlyx>

Once you hit **Run**, the experiment run will trigger.

Hit **View Experiment** to get a detailed view of your experiment run.

<Frame>
  <img src="https://storage.googleapis.com/arize-phoenix-assets/assets/images/Screenshot%202025-10-21%20at%2010.06.54%E2%80%AFAM.png" alt="View experiment results" />
</Frame>

Hover over the eval label to see the eval explanation.
