Whether you're renting or buying, housing is somehow getting even less affordable in the area.