More work needs to be done to return inflation to 2 percent, according to several Federal Reserve officials.