In a surprising move, mortgage rates have actually fallen in 2014. That has some wondering if the decline in refinancing activity that Wells Fargo (WFC -0.56%), JPMorgan Chase (JPM 0.49%), and other banks have seen will reverse itself, but there are good reasons why refinancing won't get popular again.

In the following video, Dan Caplinger, The Motley Fool's director of investment planning, explains why mortgage refinancing probably won't pick back up in the near future. Dan acknowledges that higher rates crushed refinancing activity and that lower rates generally encourage people to refinance their mortgages. But Dan notes that most people who could refinance already did so at much lower rates than are currently available. With low rates only helping those who bought their homes very recently, Dan concludes that Bank of America (BAC -0.13%), Citigroup (C -0.32%), and other mortgage lenders will have to rely on new-home financing for the time being.