Led by former Wallabies coach Robbie Deans, the Barbarians were 17-10 ahead at half-time on Saturday thanks to tries from Kiwi pair Richie Mo'unga and George Bridge, as well as Australian Sam Carter.
Steve Hansen's men, missing a host of rested and injured regulars, remained in sight thanks to TJ Perenara and Vaea Fifita's scores.
For all their good early work, the Barbarians were blown away in the space of six second-half minutes, as Ngani Laumape, Sam Cane and Nathan Harris all crossed to turn the match on its head.