Remember when America’s National Highway Traffic Safety Administration reported Tesla’s Autopilot reduced crashes by 40%? Two years later the small research and consulting firm Quality Control Systems (QCS) finally obtained the underlying data — and found flaws in the methodology “serious enough to completely discredit the 40 percent figure,” reports Ars Technica, “which Tesla has cited multiple times over the last two years.”

The majority of the vehicles in the Tesla data set suffered from missing data or other problems that made it impossible to say whether the activation of Autosteer increased or decreased the crash rate. But when QCS focused on 5,714 vehicles whose data didn’t suffer from these problems, it found that the activation of Autosteer actually increased crash rates by 59 percent…
NHTSA undertook its study of Autopilot safety in the wake of the fatal crash of Tesla owner Josh Brown in 2016. Autopilot — more specifically Tesla’s lane-keeping function called Autosteer — was active at the time of the crash, and Brown ignored multiple warnings to put his hands back on the wheel. Critics questioned whether Autopilot actually made Tesla owners less safe by encouraging them to pay less attention to the road. NHTSA’s 2017 finding that Autosteer reduced crash rates by 40 percent seemed to put that concern to rest. When another Tesla customer, Walter Huang, died in an Autosteer-related crash last March, Tesla cited NHTSA’s 40 percent figure in a blog post defending the technology. A few weeks later, Tesla CEO Elon Musk berated reporters for focusing on stories about crashes instead of touting the safety benefits of Autopilot….

[T]hese new findings are relevant to a larger debate about how the federal government oversees driver-assistance systems like Autopilot. By publishing that 40 percent figure, NHTSA conferred unwarranted legitimacy on Tesla’s Autopilot technology. NHTSA then fought to prevent the public release of data that could help the public independently evaluate these findings, allowing Tesla to continue citing the figure for another year…. NHTSA fought QCS’ FOIA request after Tesla indicated that the data was confidential and would cause Tesla competitive harm if it was released.

Last May the NHTSA finally clarified that their study “did not assess the effectiveness of this technology.” Ars Technica also points out that the data focused on version 1 of Autopilot, “which Tesla hasn’t sold since 2016.”

Share on Google+

of this story at Slashdot.

…read more

Source:: Slashdot