Numerical Optimization
Loss f(θ)
Parameter space θ
θ
current
∇ Gradient
"Move θ in this direction"
Text Optimization
Prompt / Code
x
7.2
4.1
8.5
Score: 6.6
Evaluator
f(x)
ASI
Stack traces
Profiler output
Rendered images
Constraint violations
Compiler errors
"Here's why it failed and how to fix it"
∇ Gradient
≈
ASI (Actionable Side Information)
—
both provide
direction
for improvement