Middle-income buyers face the most severe housing shortage