Housing Affordability Begins to Slide

It is a double edged sword, no doubt. Rising home prices are necessary for the overall housing market to recover and for more borrowers to get back above water on their mortgages. Rising home prices, however, Homes are offered for sale in a Toll Brothers housing development. (Photo by Scott Olson/Getty …cut into the historic affordability that was bringing more buyers back to the market in the first place.

After rising steadily since 2006 (with a slight blip from the home buyer tax credit in 2010), housing affordability is now dropping on an index from the National Association of Realtors. Asking prices for homes also began rising faster than rents for the first time in November, according to Trulia.

"The era of increasing homeownership affordability in big cities is ending," researchers from Trulia wrote in a recent report. While the price recovery is choppy market-to-market, strong rental markets like Denver, Seattle and San Francisco are seeing home prices leap ahead of rents.

(Read More: Mortgage Crisis Presents a New Headache for Banks)

"The price recovery is strongest in the largest metros, and price gains have now surpassed rent gains in the largest 25 rental markets. However, price gains are starting to waver in smaller markets," notes Trulia's Jed Kolko.

Rising home prices are not the only factors hitting home affordability. Fees charged to lenders by Fannie Mae and Freddie Mac (known as "guarantee fees" for bundling and selling mortgages) began rising dramatically in the past month and are now at a high of 46 basis points, according to Capital Economics. These fees are passed on to borrowers in higher interest rates. This is one of the reasons why rates, still at historic lows, are not as low as the Federal Reserve had hoped when it announced another round of purchases of agency mortgage-backed securities.

(Read More: Housing Recovery Is Leaving Behind First-Time Buyers)

Congress raised guarantee fees in 2011 to pay for a payroll tax cut. There is yet another plan to raise fees further to fund immigration reform, although the bill is widely expected to fail.

"Dipping back into the housing piggybank to pay for unrelated policy items on the backs of America's homebuyers ends the wrong message at a time when the housing market is starting to show signs of recovery," wrote David Stevens, President and CEO of the Mortgage Bankers Association in a statement last month.

(Read More: Big Money Is Making Big Bets on a Housing Rebound)

Raising guarantee fees is another way for government to wind down the two mortgage giants it still backs, Fannie Mae and Freddie Mac, but that comes at a cost to borrowers who are already hampered by stricter underwriting standards.

"G-fees will continue to increase as a way to run down the GSEs' role in the mortgage market," writes Paul Diggle of Capital Economics. "Stronger mortgage demand suggests that would-be buyers are growing in confidence. Nevertheless, mortgage lending will continue to be held back by tight credit."

• New Nightmare for Home Builders: Not Enough Skilled Workers
  
• Housing Recovery Depends on Slashing Mortgage Debt
  
• Whirlpool CEO: Housing Rebound, Pent-Up Demand to Lift Sales