priors

Runs/circle

circle · sample · Sonnet 5 · low

circle-sample-claude-sonnet-5-low-3
n = 32 · claude-sonnet-5 · effort low · profile room · $0.52 total
prompt improve 0.html

seed
<!DOCTYPE html>
<html lang="en">
<head>
  <meta charset="UTF-8">
  <meta name="viewport" content="width=device-width, initial-scale=1.0">
  <title>ae683f770</title>
  <style>
    * {
      margin: 0;
      padding: 0;
    }
    body {
      width: 100vw;
      height: 100vh;
      display: flex;
      justify-content: center;
      align-items: center;
    }
    svg {
      width: 400px;
      height: 400px;
    }
  </style>
</head>
<body>
  <svg id="ae683f770" viewBox="0 0 400 400">
    <circle cx="200" cy="200" r="200"/>
  </svg>
</body>
</html>

The low level of the effort comparison: the first campaign’s run, run again 6 weeks later on the same CLI version. The system prompt the CLI served had changed in between.

What they did

feature count of share
shadow or glow 3 32 9%
animation 0 32 0%
radial gradient 2 32 6%
pulse 0 32 0%
the gradient 0 32 0%
recolored 18 32 56%
script 0 32 0%
calls Math.random or the clock 0 32 0%
same picture 14 32 44%
unchanged 14 32 44%
mentions a server 0 32 0%

median 34 lines · median $0.019 per trial · each share is good to about ±17 points at n = 32 (95%, worst case)

All 32 trials. Open one to see its source.