While the housing market is currently a buyer’s market, ‘not many people can afford to buy,’ an economist said.