A 2016 survey by Nature found that over 70% of researchers have tried and failed to reproduce another scientist’s experiments, and more than half have failed to reproduce their own. One significant challenge contributing to this crisis is the difficulty scientists face in understanding experimental parameters across studies. “The basic problem was massive amounts of…
Why o1-preview and o1-mini are like a STEM Rottweiler
In the past month, I’ve spent considerable time with OpenAI’s o1 models, and I’ve come to think of them as the Rottweilers of the genAI world: powerful, occasionally stubborn, and requiring special handling. When they work well, they can be capable underlings—but they require a firm hand and careful attention to detail. And they can…