Float Consistency Analysis
Objective
Evaluate how consistent float values (scores) are when the same image is submitted multiple times.
Approach
- Image submitted 5x using same prompt and model
- Values extracted from region scoring output
- Recorded float variance and mean deviation
Table: Region-wise Deviation (Sample Image)
| Region | L-StdDev | R-StdDev | Avg Float Drift |
|---|---|---|---|
| R1 | 0.013 | 0.015 | ±0.014 |
| R2 | 0.011 | 0.010 | ±0.0105 |
| R4 | 0.009 | 0.012 | ±0.0105 |
| … | … | … | … |
Recommendations
- Anchor float formats to fixed examples
- Use precision formatting (e.g., 0.56 → round(2))
- Avoid heavy compression on input images