Proposed CSA Scoring-Improvement Method Gets Thumbs Up
FMCSA’s Joe DeLorenzo speaking in Orlando. Photo: David Cullen
“>
FMCSA’s Joe DeLorenzo speaking in Orlando. Photo: David Cullen
“>
ORLANDO– Boiled down to its essence, the congressionally mandated review of the Compliance, Safety, Accountability program by the National Academies of Sciences found that the Federal Motor Carrier Safety Administration should move to a more scientific method to drive the Safety Measurement System that signals which motor carriers are at highest risk for future crashes, according to an FMSCA official.
“The National Academies said to FMCSA, ‘The model you have is pretty good, but it’s not based on a principled scientific approach. We would like to see a better statistical model behind SMS,’” FMCSA Director of Compliance and Enforcement Joe DeLorenzo, said on Oct. 22 during an educational session here at the American Trucking Associations’ annual Management Conference & Exhibition.
He said NAS recommended that FMSCA take about two years to study a more scientific modeling approach known as “Item Response Theory” and then consider implementing it to make the SMS function more accurately. “Our focus,” he told the audience, “remains focused on the prevention of crashes, not the prediction of crashes.”
DeLorenzo said the hope is that an IRT-based method would help develop “an estimate of the measure of ‘safety culture’ for each carrier and be used to monitor and identify carriers in need of intervention,” rather than just zero in on violations.
To accomplish all that may take digging into a variety of data points, such as driver pay, driver turnover, and miles travelled. He likened such an approach to the IRT-type scoring used in such standardized tests as the SAT (Scholastic Aptitude Test), familiar to generations of students applying for college admission, that weights answers not just on whether they are “right” or “wrong” but also on how they reflect a student’s depth of understanding.
“This is a long-term development,” DeLorenzo …Read the rest of this story
