Affordability requirements and conversion costs make building residential in Midtown South difficult for developers.