Logo of jester cap with thought bubble.

Image source: The Motley Fool.

Hancock Whitney Corporation (HWC 0.35%)
Q4 2020 Earnings Call
Jan 20, 2021, 5:00 p.m. ET

Contents:

  • Prepared Remarks
  • Questions and Answers
  • Call Participants

Prepared Remarks:

Operator

Good day, ladies and gentlemen and welcome to Hancock Whitney Corporation's Fourth Quarter 2020 Earnings Conference Call. [Operator Instructions]

I would now like to introduce your host for today's conference, Trisha Carlson, Investor Relations Manager. You may begin.

10 stocks we like better than Hancock Whitney Corporation
When investing geniuses David and Tom Gardner have a stock tip, it can pay to listen. After all, the newsletter they have run for over a decade, Motley Fool Stock Advisor, has tripled the market.* 

David and Tom just revealed what they believe are the ten best stocks for investors to buy right now... and Hancock Whitney Corporation wasn't one of them! That's right -- they think these 10 stocks are even better buys.

See the 10 stocks

*Stock Advisor returns as of November 20, 2020

Trisha Voltz Carlson -- Executive Vice President and Investor Relations Manager

Thank you and good afternoon. During today's call, we may make forward-looking statements. We would like to remind everyone to carefully review the Safe Harbor language that was published with the earnings release and presentation in the Company's most recent 10-K and 10-Q, including the risks and uncertainties identified therein. You should keep in mind that any forward-looking statements made by Hancock Whitney speak only as of the date on which they were made. As everyone understands the current economic environment is rapidly evolving and changing.

Hancock Whitney's ability to accurately project results or predict the effects of future plans or strategies or predict market or economic developments is inherently limited. We believe that the expectations reflected or implied by any forward-looking statements are based on reasonable assumptions, but are not guarantees of performance or results, and our actual results and performance could differ materially from those set forth in our forward-looking statements. Hancock Whitney undertakes no obligation to update or revise any forward-looking statements, and you are cautioned not to place undue reliance on such forward-looking statements.

In addition, some of the remarks this afternoon contain non-GAAP financial measures. You can find reconciliations to the most comparable GAAP measures in our earnings release and financial tables. The presentation slides included in our 8-K are also posted with the conference call webcast link on the Investor Relations website. We will reference some of these slides in today's call. Participating in today's call are John Hairston, President and CEO; Mike Achary, CFO; and Chris Ziluca, Chief Credit Officer.

I will now turn the call over to John Hairston.

John M. Hairston -- President and Chief Executive Officer

Thanks, Trisha and good afternoon everyone. Thank you for joining us today. We are certainly pleased to begin 2021 with a broader horizon with 2020. The previous year was certainly eventful in many ways. We dealt with the pandemic and the result of broad economic impact executed a meaningful bulk loan sale. We were an active and meaningful participant in providing support to clients via the PPP program and rendered assistance to impacted markets in a very busy hurricane season.

I'm pleased to report fourth quarter 2020 results. There were strong finish to such an unprecedented and challenging year. That strong finish occurred due to the unwavering teamwork, commitment to service and strength under pressure of our 4,000 member team.

Moving on to the fourth quarter, EPS of $1.17 was notable with strong PPNR performance and some extra earnings via tax strategies researched and executed by the excellent work of our tax group. These tax strategies implemented at year end, net of a small tax credit for the quarter allowing us to recoup a portion of capital we spent earlier in the year and support of our de-risking strategy. This benefit which Mike will explain in more detail in a moment added $0.21 to our fourth quarter's results. Adjusting for a normalized tax rate of around 18%, we would have reported $0.96 per share of the quarter, a solid end to the year.

For the quarter PPNR increased just over $4 million, or 3% linked quarter as our NIM remained relatively stable, expenses were down and many fee income lines of business showed improvement. For the year, PPNR was up just over $3 million or almost 1%, as we achieved the same level of revenue year-over-year, despite two dramatically different operating environments. Overall, our asset quality metrics improved once again during the fourth quarter as criticized and non-performing loans declined 5% and 20% respectively linked quarter.

Slide 11 in our deck provides additional details on our sectors under focus. Also please note on this slide, there are no COVID related deferrals remaining in these focus segments, and only $13 million in deferrals remain in total. Net charge-offs in the quarter were related to energy, healthcare and various other commercial and consumer credits. The energy and healthcare-related credits were criticized prior to the pandemic, but due to COVID we're unable to show improvement.

During the fourth quarter, we reported a very slight reserve release, as net charge-offs exceeded the quarter's provision by $100,000. We believe maintaining a year in reserve at such a strong level is appropriate, given the continued uncertainty regarding the timing of vaccine deployment and subsequent impact in the economy. Given the strength of the reserve we expect net charge-offs could begin to exceed provision levels in 2021.

And finally, just a couple of balance sheet items before I turn the call over to Mike. Loan growth has been a challenge for the industry this year outside of PPP lending. However, I was pleased to see as noted on slide 9 that our regions reported net loan growth for the quarter. Unfortunately, the run-off in our amortizing energy and indirect portfolios, the sale of mortgage loans into the secondary market and the beginning round 1 PPP forgiveness contributed to reductions that overshadowed an otherwise decent quarter of core loan production. We expect this trend in our loan portfolio will continue into the first quarter and be partly offset by loans generated by new PPP lending.

On the other side of the balance sheet, deposits have ballooned over the last quarter and the last year, up almost $4 billion from year-end 2019. The growth was mainly related to PPP funding, individual stimulus payments, year-end seasonality as well as organic account acquisition. The increase in deposits and reduction in loans has added excess liquidity to our balance sheet with our loan to deposit ratio at 78.7% for year end. We hope to deploy this excess liquidity in loan growth during 2021. But until we can, we expect this will be a headwind as we begin the New Year. The timing of adding and then processing forgiveness for this next round of PPP is challenging to predict, which in part leads to our limits on guidance to the near term. We continued to rebuild our capital in the quarter and ended the year with TCE at 7.64% and common equity Tier 1 at 10.7%. TCE excluding PPP loans was 7.99%, again a solid end to a challenging year.

I will now turn the call over to Mike for further comments.

Michael M. Achary -- Chief Financial Officer

Thanks, John. Good afternoon, everyone. Earnings for the quarter were $104 million or $1.17 per share with $0.21 related to zero tax expense for the quarter, more on that shortly. For the year, we reported a net loss of $45 million or $0.54 per share. Our year-end tax strategies allowed us to benefit from a tax net operating loss carryback provision available in the CARES Act.

As noted on slide 7, we were able to realize $22 million of benefit by carrying the tax NOL back to years with a 35% tax rate. The NOL was due in part to the loss we took in the energy loan sale as well as tax lease investments and other various strategies employed to accelerate deductions and deferred revenue. We anticipate returning to a more normalized effective tax rate in the first quarter of '21.

Loans for the Company declined $450 million from September 30, in part due to $318 million and forgiven PPP loans. We expect the level of PPP forgiveness to grow significantly in the first quarter and could be as high as $1 billion or so.

As noted on slide 8 of our deck, the first round of PPP lending contributed between $0.15 and $0.17 in quarterly earnings during 2020. As you can see on the same table on slide 8, the new or extended round of PPP lending will allow us to partly offset the loans forgiven in the first round, keeping the impact to EPS flat. We currently expect to originate between $750 million and $1 billion in new PPP funding in the first quarter.

John mentioned our loan loss provision in his earlier comments that I'd like to expand on that a bit. So looking at slide 13 in our guidance for the first quarter. We do expect to step down our provision to a range between $10 million and $15 million or so next quarter and actually could come in lower. Factors that play into that include levels of non-PPP loan growth, vaccine rollout and macroeconomic forecasts. We also think it's likely that net charge-offs will exceed our provision in future quarters. As a reminder, our year-end ACL was strong at 2.42% of loans excluding PPP.

Turning to our NIM and consistent with our guidance last quarter of a stable NIM, our NIM was down only 1 basis point quarter-over-quarter. However, we did have another buildup of liquidity on our balance sheet, driven in part by EOP deposit inflows of nearly $700 million and over $300 million of PPP forgiveness. The result was a pronounced shift in our earning asset mix with securities up over $300 million and short-term investments up over $550 million. This dynamic compressed the NIM around 6 basis points. However, we were able to offset most of that compression by continuing to focus on lowering our cost of deposits.

As you can see on slide 18, our cost of deposits was 17 basis points in December, down another 3 basis points from September. We expect to continue that focus of pushing down our cost of deposits with that trend continuing into the first quarter and beyond. Slide 18 includes the drivers for our fourth quarter NIM and guidance what we expect in the first quarter. So the most impactful NIM driver in the first quarter will continue to be the level of excess liquidity on the balance sheet and the resulting impact on our earning asset mix. That excess liquidity should remain at current levels could compress the NIM as much as 10 basis points. With similar levels of PPP forgiveness and new loans, the net impact of all PPP activity could offset we believe.

Certainly the timing of forgiveness and new activity could impact our numbers. We will also continue to be proactive in reducing deposit costs and expect to end the first quarter with the cost of deposits around 13 basis points.

Switching now to fees and expenses. Fees were down slightly linked quarter as the growth in areas such as service charges and card fees was offset by declines in secondary mortgage and specialty income. Refi activity slowed in the quarter and we expect that to continue as we move into 2021. Specialty income, which includes areas like BOLI and derivative sales can be volatile quarter-to-quarter and will likely be down in the first quarter. Given these factors, we expect overall fees to be down in the first quarter.

For the quarter, expenses were down $2.7 million as declines in personnel expense related to recent cost initiatives were partly offset by higher non-recurring expenses, related to a very active hurricane season and recent financial center closures. To date, we have reduced FTE by 210 compared to June 30 via staff attrition and other initiatives. We closed 12 financial centers in October and announced the closure of an additional eight this quarter. Ongoing branch rationalization reviews are under way and we will announce additional closures as they occur.

As noted last quarter, we also closed our two trust offices in the Northeast. And has recently as yesterday, we have continued implementing cost saving measures by offering an early retirement package to select employees across the Company. We recognize that usually on our January call, we typically provide guidance for the year. With almost daily changes in the pandemic environment, the impacts to our regional economies, we determined it best to continue with quarterly guidance for now.

With that, I'll turn the call back over to John.

John M. Hairston -- President and Chief Executive Officer

Okay. Thank you, Mike. And operator, if you would please, let's open the call for questions.

Questions and Answers:

Operator

We will now begin the question-and-answer session. [Operator Instructions] Our first question today will come from Michael Rose with Raymond James.

Michael Rose -- Raymond James -- Analyst

Hey, good afternoon, everyone.

John M. Hairston -- President and Chief Executive Officer

Hey, Michael.

Michael Rose -- Raymond James -- Analyst

Maybe we could just -- hey, good afternoon. Maybe we could just start with the margin. I understand the commentary around the quarter, and I appreciate the color around the deposit cost, potentially falling to about 13 bps. Should we think about the impacts of PPP as the first quarter being kind of the low watermark? And then hopefully get some loan growth as we move through the year, and you can do some earning asset mix shift and you can actually grow the core margin from here, is that the right way we should be thinking about it?

Michael M. Achary -- Chief Financial Officer

Yeah. Hi, Michael. This is Mike. And yeah, I think that's right for the most part. As we mentioned in our comments, you can see in the deck that really the biggest driver of any compression in the first quarter is the excess liquidity that we have on the balance sheet, that really kind of built up again toward the end of the fourth quarter. So, to the extent that we are able to ramp up levels of organic growth, that is loan growth ex-PPP, then certainly that'll be very helpful in kind of hearing down the level of liquidity. So, lots of puts and takes there certainly as you think about the entire year. But I think your thesis is largely right.

Michael Rose -- Raymond James -- Analyst

Okay. And any plans with the securities book at this point, looking to add it all?

Michael M. Achary -- Chief Financial Officer

Yeah, I think that again with the level of excess liquidity, it really is kind of walking a bit of a balance between, keeping money at the better [Phonetic] and 10 basis points and pushing that into the bond portfolio. Right now earning anywhere from 125 basis points to 135 basis points, but then tied-up that money with a much longer duration asset on the balance sheet. So we're going to do a little bit of both. We're going to monitor obviously what goes on with our balance sheet, every single day, what happens with the level of PPP forgiveness as well as the new PPP activity. Again we'll kind of play into that equation, I think for the most part.

Michael Rose -- Raymond James -- Analyst

Okay, that's helpful. And maybe just one follow-up question. You guys have done a lot of work to derisk the balance sheet, including the energy loan portfolio sale. Reserves are really stout. You've kept them basically flat this quarter, where we've seen some others have some greater release. What's holding you guys back? Is it just uncertainty in your markets? Is it general caution? How should we think about the potential for reserve release as we move through the year? Thanks.

Michael M. Achary -- Chief Financial Officer

I'll start-off and then John can certainly add any color about the -- our regional economies and kind of what's going on there. But really our narrative [Phonetic] really has been for the third and fourth quarters that, what we plan to do was to kind of match-off our provision with charge-offs and hit to the end of the year with the reserve that we spent so much hard work, building inclusive of the energy loan sale kind of intact at year end.

And certainly, you can see from the guidance that we're giving for the first quarter, we certainly can see a scenario and probably, I think it's probably more likely to not that we'll have charge-offs exceed our levels of provision. And then we also guided to a provision level of $10 million to $15 million with again some room for that to be lower. So I think we're going to kind of begin that process of paring back that big reserve, but we're going to be very measured, with certainly a keen eye toward what's going on with our levels of criticized loans, NPLs and generally what's going on in our regional economies.

John M. Hairston -- President and Chief Executive Officer

Yeah, the only thing just -- the only thing I would add to that, Michael was, I think Mike's answer was exactly spot on. The only addition would be the vaccine deployment protocol has been a little less than I think, we would have all like to have seen, given the expectations that were announced in the fourth quarter. And in the fourth quarter, we talked about, what degree of deployment would we think cause us to adopt a mix of Moody's scenarios that would be a little bit more optimistic than the ones that we did. And the vaccine deployment pace just hasn't matched up with what we had hoped for.

So we might be a little conservative. If we're flawed, it's being overly conservative. But at this point in time, we'd like to see another quarter, a vaccine deployment actually happen. See if that increases to 2x or 3x across our footprint that we anticipate, and then matches with the new administration is suggesting that they would consider acceptable. And at that point in time, I think we talk again. But I would echo Mike's comments that likelihood of provision being under our net charge-offs in the future is highly likely.

Michael Rose -- Raymond James -- Analyst

Maybe if I just ask the question in another way, if I take first quarter actually the day one CECL reserve build. Is there any reason with a de-risk portfolio that you couldn't get back to that point assuming the data gets better and the economy continues to improve, etc.?

Michael M. Achary -- Chief Financial Officer

Yeah, that's a big question, Michael, and it's a good one. And the way we've kind of thought about that and kind of talked about that is somewhere much further down the road, we could end up at a place maybe just north of where we began when CECL was [Indecipherable].

Michael Rose -- Raymond James -- Analyst

Very helpful. Thanks for taking my questions.

John M. Hairston -- President and Chief Executive Officer

Okay. You bet. Thanks, Michael.

Operator

Our next question will come from Jennifer Demba with Truist Securities.

Jennifer Demba -- Truist Securities -- Analyst

Thank you. Good evening.

John M. Hairston -- President and Chief Executive Officer

Hi, Jennifer.

Jennifer Demba -- Truist Securities -- Analyst

Just curious if you could give us some color on what you're seeing in your hotel and restaurant book right now, in terms of trends and underlying revenue trends for those borrowers? Thanks.

John M. Hairston -- President and Chief Executive Officer

Okay. Thanks for the question. Chris, you want to talk about asset quality in the hotel or hospitality book and then if it's a redirect, I'll handle it.

Christopher S. Ziluca -- Chief Credit Officer

Sure. Yeah. So as it relates to our hospitality book, obviously there has been a lot of movement over the past quarter or several quarters with the changes in rules around occupancy levels in the various jurisdictions. So that's definitely had an influence. But overall, the hotel portfolio itself has held up pretty well. We've spent a lot -- inordinate amount of time, really just kind of wrapping around --arms around it, working with the customers and putting in place the structured solutions, as you can see the largest portion of structured solutions in the sectors under focus is in the hotel portfolio. The idea that, try to bridge through 2021 and get to a better place. From a performance standpoint, in the hotel portfolio in general, off of the bottoms that they were experiencing in the late spring time frame. They've come back quite a bit, certainly as it relates to our portion of hotel portfolio, not hotels necessarily in general in the markets.

Again, each market is a little bit different. You keep reminding people that although we do have a bit of a concentration to a degree in the New Orleans market, we do also have hotel exposure more spread out. And in those other markets, they've come back a bit more, not necessarily to kind of pre-COVID levels, but overall they've come back. And then the rest of the hospitality sector restaurant, for instance, limited service fast-food restaurants, a lot less worry. There is definitely higher cost to operate and things like that. But in general, they're performing adequately and well in some situations.

On the full service restaurant side of things, I think some of the bigger format restaurants are more challenged to kind of operate and fill the space, just based on the rules and guidance -- and guidelines as well as just attracting the larger groups that would normally go and visit those restaurants. But in some of the more smaller restaurants, the ones that also have the ability to be able to do outside dining and things like that, they have been able to try to manage it through smaller restaurants and if you need small menu choices, just controlling costs, and so they're just -- they're managing through it. And then overall, what I would say is, you can see [Indecipherable] metrics, although they're elevated relative to the overall bank, and hotel and restaurants, I think they are performing better than we would have expected, given what we started with back-end March-April time frame.

So I'll leave it and then, John, you can add to that. I know you have some thoughts.

John M. Hairston -- President and Chief Executive Officer

Yeah. Jennifer, in case you had another follow-up, I'll wait and then I'll give you some more color. Thanks.

Jennifer Demba -- Truist Securities -- Analyst

No, that's great. Thank you.

John M. Hairston -- President and Chief Executive Officer

Okay. The only thing I would add is on Page 11 of the deck, there is, I think, something from an investor perspective is appreciated transparency. It shows the criticized NPL and even the past watch, as well as the structured solution breakout across the sectors in focus. One of those is hotel. And then you see the overall breakdown of hospitality. And so that's intended to show what really has been surprisingly modest degradation quarter-over-quarter through what typically is a slow period anyway in the economy in those areas. So we're probably, as the quarters have gone by, have continued to become a little bit more optimistic over time. I think in terms of markets, Texas and Florida, I don't want to say they are back to normal, but they're closer to normal, pre-pandemic levels than they are the summer time, so they are early summer.

So those areas have recovered really terrific. And I'm not limiting that to just to hospitality. The Mississippi and Alabama footprint would be a notch slower but also in good recovery in posting more attractive numbers. And I don't think any of those four states would be doing that if it weren't for the fact that restrictions have been significantly eased, and so the occupancy percent and the ability for those are -- merchants to operate has been less impeded than it was prior to now in a more deeper shutdown mode.

Louisiana, particularly South Louisiana is slower than that. And really I think dominate some of the criticized percentage that you see there. And similar to the answer to the last question on the reserve, we'd like to see another quarter of vaccine deployment and see some success. The of state of Louisiana is actually doing a pretty good job in deployment, if you extrapolate their deployment pace to how many vaccines are necessary. They're doing quite well relative to other states of the Southeastern Corridor. And so if that can be improved, then I think we perhaps would see restrictions eased again in South Louisiana, which would be very helpful to the growth. So all of that is too early to tell with a lot of ifs and maybes in there. But we're more optimistic than we were before. We're maintaining the reserve because we want to see another quarter and clear the crystal ball a little bit in terms of revenue opportunity in those sectors.

Jennifer Demba -- Truist Securities -- Analyst

Thanks.

Operator

And our next question will come from Brett Rabatin with Hovde Group.

Brett Rabatin -- Hovde Group -- Analyst

Hi. Good afternoon, everyone.

John M. Hairston -- President and Chief Executive Officer

Hey, Brett.

Brett Rabatin -- Hovde Group -- Analyst

Wanted to just go back to the reserve topic for a second, and just make sure I understood. You had made the comment about COVID and just the rollout of the vaccine maybe wasn't quite as fast as you were hoping, and that may have had some impact on your decision around the provision in the fourth quarter. Can you talk about maybe any of the qualitative factor changes you might have made in the fourth quarter versus 3Q, and then how you think about that in '21?

Michael M. Achary -- Chief Financial Officer

Sure, Brett. This is Mike. I'll start there. So I think the biggest change was probably in the macroeconomic assumptions. So we use Moody's like most banks our size do. And we did move to a little bit more conservative mix of the scenarios in the fourth quarter. So on Slide 13 what we used in the fourth quarter is kind of listed out. And just real quick, that is 65% baseline, 25% S2 and 10% S3. If we go back to the third quarter we were weighted again 50% baseline, 25% S1 and then 25% S2. So we did get, I think a little bit more conservative in the fourth quarter, and certainly that helped inform, I think, where we ended up with our total reserve.

But again as I mentioned a little bit earlier, our narrative has been pretty steady through the second half of the year, in terms of wanting to match-off charge-offs with the provision for the third and fourth quarter, so that we could end the year basically where we started at the end of the second quarter, and that's where we are. So again, as we move into '21, we absolutely can see that our charge-offs will likely exceed our provision, and we'll begin the process of bringing that provision down and related reserve.

Brett Rabatin -- Hovde Group -- Analyst

Okay, that's good color there. And then I guess the other thing, I know people are kind of looking at the balance sheet and obviously, excess liquidity. And you've got challenges replacing the PPP portfolio as that runs down. Maybe too early and hard to give a firm guidance on it. But I guess one of the things that investors are going to want to see eventually is like the portfolio growing and seeing year-over-year improvement. How do you think about that and what loan segments gets you there and what does the pipeline look like at this point?

Michael M. Achary -- Chief Financial Officer

Well, I'll start off with just a comment on our PPP and then John can add color to [Technical Issues]. But on Slide 9, the page there is the guidance that we've given for the first quarter, including some pretty specific guidance around both PPP equipments, so what we're looking at estimating that number up to about $1 billion in the first quarter. And then we think that, that could largely be offset actually by new PPP activity. The estimate [Technical Issues] $1 billion.

And certainly with the portals open now, I think we've gotten off to a pretty good start in that regard. So that work is -- has just begun and will continue.

John M. Hairston -- President and Chief Executive Officer

And Mike, I would just add, that is John. With the understandable volatility of PPP, I'll just stay away from that and just focus on core. And there are number of puts and takes, and just looking at the first quarter and Slide 9 of the deck shares a fair amount of detail there. There's about a little less $200 million one-off [Indecipherable] first quarter with the amortization of the indirect work, which will be around for a while, yet. And then the mortgage activity enriched reduction in the mortgage portfolio and home equity products, both lines and loans.

So that's a $200 million out the back door due to the refi activity and the indirect amortization. That's what we have to cover just to swim straight and so we did cover some of that with the -- with better productivity in fourth quarter. First quarter is seasonally one of our lower production time just because of the nature of where we are in the types of business that we have. And so we gave guidance to that reduction and the general vicinity. As I think we said up to $250 million [Phonetic] and that's on Page 9, of the deck.

And we're not ready to until we get past the quarter and see all the impact of PPP and other items to talk about the rest of the year, but certainly we would think that the productivity improvements we saw in the regions we began to carry the day and become a more positive story as the year goes on. Frankly, a lot of that is tied to sentiment and the sentiment goes up with vaccine deployment and the elimination of some of the restrictions that impact our marketplace, and so.

While, 2021 looks bright. Quarter one loan growth might be a great story, unless PPP actually covers more than we think of the run-off, but I'm more optimistic or a little bit more [Technical Issues] for the rest of the year.

Brett Rabatin -- Hovde Group -- Analyst

Okay, great. Appreciate the color.

John M. Hairston -- President and Chief Executive Officer

Sure. Thank you.

Operator

Our next question comes from Kevin Fitzsimmons with D.A. Davidson.

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

Hey, good evening everyone.

John M. Hairston -- President and Chief Executive Officer

Hello.

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

Just have an add-on question on the margin. I just want to make sure I'm looking at this right. So, when I look at Page 8, you discuss layoff people holding an effect on the margin. And then on Slide 18, you talk about the outlook for the margin and related PPP, when you're talking about forgiveness net of funding or you're baking in the PPP, the acceleration of the fees, right? The origination fees, like I see the tailwinds just talk about the impact of new PPP loans, but is this -- is what's netted in here somewhere,the fees as well?

Michael M. Achary -- Chief Financial Officer

It is. Yeah Kevin, this is Mike and that's correct, is the fees are netted in and again on Slide 9, we kind of gave the guidance in a little bit more detail than usual around the level of new activity or funding. And then also the level of forgiveness. And we really think that there is a good chance, that we could match off pretty closely.

And if that actually happens in terms of the averages, then the overall impact of PPP quarter-to-quarter should net out to something closely insignificant. So, if that occurs in that manner, then really the biggest drivers in any compression in the first quarter of '21, we think will be how quickly will be able to offload the excess liquidity, that again kind of built up toward the end of the year.

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

So, like this quarter was basically the impact of the greater excess liquidity, offset by the fees coming in from forgiveness essentially with some other factors as well?

Michael M. Achary -- Chief Financial Officer

Yeah, that's largely correct -- That's correct. And as well as our ability to continue pushing down deposit costs, which again will continue in the first quarter and kind of beyond, as we mentioned.

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

And now all of this, we've been talking about the percentage net interest margin. But if we talk about dollars of net interest income, and throw all these different things out there in terms of looking at how you feel about first quarter and the shift in terms of what's happening in the balance sheet, how do you all feel about NII or you're comfortable saying?

Michael M. Achary -- Chief Financial Officer

Yeah, I'll give you a few thoughts related to that. So I think first and foremost, we absolutely see some pretty good growth in average earning assets in the first quarter. And one of the things that impacted the level of liquidity toward the end of the year was a pretty good level of deposit in for us. So deposits were up, EOP December to September nearly $700 million. And that will certainly help impact the averages not only in the bond portfolio, but also in our level of short-term investments. So we'll grow the base of earning assets we think pretty nicely in the first quarter. Probably the wildcard, as much as anything else is going to be the level of organic loan growth or not. So I know we guided to that number being ex-PPP as much as $250 million. So if we're able to overperform and have that number lower, then I think that speaks a little bit better to our ability to really grow NII in the first quarter. But again, there is lots of unknowns and the level of PPP net activity could swing the numbers depending on where that comes in.

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

Okay. Thanks, Mike. And just on the subject of expenses, you lay out a lot of great detail on the initiatives. And I'm just wondering, a lot of it is -- or things you've done to date or done in the past quarter. And I'm wondering, is there any kind of broader deep dive going on? I know you mentioned the ongoing branch rationalization, but any other -- not so much a named program per se, but is there more to come, I guess, is what I'm asking on that front.

Michael M. Achary -- Chief Financial Officer

Yeah, I think there is. I mean, certainly, we have a news that we shared inside the Company yesterday. And then with investors and analysts this afternoon about the early retirement program, that we're launching. And so that's something that depending on what the take rate is, could move into either certainly [Phonetic] on the expense side. But to answer your question directly, we don't know, our work is not done in terms of containing cost and our cost initiatives. We will talk a little bit more about those as we implement them along the way. And then certainly we'll be very proactive in disclosing the actual kind of results that we build from the early retirement program.

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

Okay. Thanks, Mike.

Michael M. Achary -- Chief Financial Officer

Okay. You bet.

Operator

Our next question comes from Ebrahim Poonawala with Bank of America.

Ebrahim Poonawala -- Bank of America -- Analyst

Hey, guys.

John M. Hairston -- President and Chief Executive Officer

Hey, Ebrahim [Phonetic].

Ebrahim Poonawala -- Bank of America -- Analyst

Just wanted to first follow-up. I'm sorry if you do this Mike, around the NII outlook. So I noticed in the figure, deposit growth versus average. Should we assume that your earning asset growth in first quarter should be of similar magnitude like $600 million, $700 million of growth or more in 1Q versus 4Q? And then what I'm trying to get to -- is trying to figure out whether we see NII moving higher or lower in the first quarter relative to 4Q levels, so if you could address that?

Michael M. Achary -- Chief Financial Officer

So our level of average earning asset growth, fourth quarter compared to third was just under $500 million. And certainly I can see us at that level and probably a little bit better in the first quarter. And again, a direct question about the level of NII is really as I mentioned depended upon really what happens to the net PPP activity, as well as the organic loan growth. I think those two factors are probably the biggest drivers around how much of an increase we actually have in NII in the first quarter.

John M. Hairston -- President and Chief Executive Officer

Ebrahim, this is John. Another factor that is impossible at this point in time to gauge is the impact of stimulus. And there is a data stimulus package in Q1, and if that includes the incoming administration's assertions, they'd like to see $1,400 per tax payer event, that's a few $100 million that arrives in an ACH file. So if that were to happen in second week of February, it's a different impact. And if it's the last week of March, and so we're not trying to be cornered, just some really big variables, that at this point in time are impossible to assess.

But I think all-in-all, what Mike answered it, is about as best as we can with those degree of variables. And that's not something unique to us. If you're carrying a fairly big consumer portfolio, which we are, then stimulus dollars can be impactful. And that was part of the excess liquidity that we had at the -- in the first round of stimulus.

Ebrahim Poonawala -- Bank of America -- Analyst

Thanks for adding that, John. And just in terms of the remaining PPP fees, so I see the $16.7 million PPNR impact that you call out for the first quarter. What's the total PPP fees that were left, that were outstanding at the end of the year? Or tied to the previous first program?

Michael M. Achary -- Chief Financial Officer

Can you repeat the question again, Ebrahim? [Speech Overlap].

Ebrahim Poonawala -- Bank of America -- Analyst

Yeah. What's the total outstanding PPP fees that were remaining outstanding at the end of the year?

Michael M. Achary -- Chief Financial Officer

Okay. So our total PPP fees from the first round on a gross basis were about $75 million and then $68 million, so on a net basis. And we still have somewhere in the $16 million, $17 million range or so, that will amortize between the first quarter, and then whatever the remaining duration is, of the loans from the first round.

John M. Hairston -- President and Chief Executive Officer

And then it starts over again with the incoming charge.

Michael M. Achary -- Chief Financial Officer

So at that point it begins to really kind of to go mingle.

Ebrahim Poonawala -- Bank of America -- Analyst

Understood. And just on terms of like the second round of PPP, John. Are the recipients for the second round going to be a significant overlap to the -- those who were helped out in the first quarter. I'm just trying to understand the level of visibility that you have in terms of funding in the second round is due -- is it the same borrower base that's going to be funded with round two?

John M. Hairston -- President and Chief Executive Officer

It's a good question. And the visibility we have now is what's happened so far. So we had a pretty big team of people that worked very hard, we have 57 people in shop over the holiday weekend. Saturday, Sunday and Monday working the queue that was already building up. And looking at that queue, the transactions that were first in the queue were largely second draws from previous PPP recipients. And then I think as the week is going on, it's become more distributed toward first-timers.

And so I think it's a little early to claim what that mix is going to be, because it's changing. And also typically the smaller borrowers come in a little lighter. And so -- so far the number of new to bank clients that are in that pipeline is a good bit larger than we had last time, but again it's pretty early to tell.

And that size and the timing of that PPP draws also one of the big variables, we have to grapple with. Last time when the PPP fund incurred, the bulk of those deposit side of the balance sheet for time until business could reopen to begin extending them. We would anticipate that run-off as fast at this time, because largely businesses are open. But just maybe not the same capacity they were pre-pandemic. So we have estimates of what that would be, that sort of the underlie the estimates that might gave you for the quarter. But they're just estimates, I think reality will help us shape it up as we get to the end of the quarter.

Ebrahim Poonawala -- Bank of America -- Analyst

Got it. Thanks for taking my questions.

John M. Hairston -- President and Chief Executive Officer

Sure. You bet.

Operator

Our next question comes from Catherine Mealor with KBW.

Catherine Mealor -- KBW -- Analyst

Thanks. Good evening.

John M. Hairston -- President and Chief Executive Officer

Hey, Catherine.

Catherine Mealor -- KBW -- Analyst

Wanted to follow up on asset quality and just going back to slide 11. Your classified loan or criticized loans as a percentage of your COVID at risk categories, only 4%, have just remained really low. And so I just wanted to get your thoughts on your expectations for how you think the flow of criticized loans will be kind of directionally throughout the year? Do you think there is an expectation that these will continue to increase as we move through the year before we peak? Or do you think this could be the peak, given what we're seeing with your efforts around structured solutions and the stimulus and PPP and all those variables? Thanks.

John M. Hairston -- President and Chief Executive Officer

Chris, you want to start with that?

Christopher S. Ziluca -- Chief Credit Officer

Yeah, sure. Again, I hate to evade the question. But really is kind of hard to call that. I guess, what I would say is that, we certainly put a lot of effort in the second half of 2020, to put those structured solutions in place, for mostly focused obviously on anybody, but certainly mostly focused on the hotel and restaurant portfolio, as you can just see by the numbers there.

And I think that, what we've done should help them for a reasonable period of time through 2021. So a lot of it will be as a result of just general challenges. There maybe some of the customers that didn't ask for a structured solution, we have to kind of reopen that discussion with them. I mean the good news is that, section 4013 of the CARES Act, allows for continued support for working with customers, without the concerns that previously would existed for TDRs, at least until the pandemic is declared behind us.

And not to say that we wouldn't work with those customers. But our approach to go has been to enhance our position while also working with those customers. And so I think, we feel good that the hospitality book is stabilized to a large degree. But again things can happen that you just haven't really anticipated. And then the rest of the portfolio, as you can see with retail being probably another sector that has a larger percentage. Again, it really just is a matter of the economy getting back a little bit, people feeling comfortable spending money, opening of restrictions to allow people to go out. And this is some of the locations and stores and purchase. But, it's hard to say that we're kind of at the peak, and that we're going to come off of it. Because I do believe that we're going to have some inflows and outflows. But right now, I don't really see a dramatic movement in either direction. We'll have some ins and outs.

John M. Hairston -- President and Chief Executive Officer

Yeah. This is John. I think it's hard to tell right now. But I think it'd be fair to say, retail and healthcare both improved markedly, in terms of criticized ratios quarter-to-quarter. Hospitality didn't. And I think the reason hospitality didn't is related heavily to restaurants. So, and that is heavily focused in New Orleans, where we still have the most restrictions, in terms of occupancy levels.

And so that's what I've said a couple of times on the call, the vaccine deployment pace matters a lot. And the second impact that could be extremely positive is how to structure of the coming stimulus package, is actually deliver. So if it's done prudently and those industries which have been the most harmed by the effects of the pandemic economy. If they are beneficiaries of funding sources that will help. Then, I think we'll see greater benefit. But it's -- unfortunately, we're right on the legislation in order to get a vote [Phonetic] unfortunately. So, but hopefully that will be considered.

Catherine Mealor -- KBW -- Analyst

And is there any kind of trigger specifically that would, with your underwriting that would push a loan to go under criticized or classified. We've heard different things from different companies, some are putting entire portfolios of at-risk asset classes on criticized just to watch it. Unite Communities said today that, if there is a credit that can make amortizing PMI payment off of current operations and it's downgraded immediately to criticize? Or any kind of color like that and you can give to help us what may trigger that movement?

Michael M. Achary -- Chief Financial Officer

Yeah. So we generally stick for the most part toward financial metrics that drive, classifying alone in the various categories of Pass-Watch, and then criticized or classified. To the extent that there are overriding factors around guarantor support and things like that, those have a way of enhancing our view of the risk rating or maybe detracting from that deal, the risk rating. So we do have a pretty structured approach toward evaluating our credits and putting them into the various categories. And we feel pretty good about where they are right now. From a classification perspective, I think what we're also doing is this category of sectors under focus to the extent that a loan is not already in watch or criticized.

We have a whole shadow watch process which basically looks at sectors and essentially overlays our watch and portfolio management process which is enhanced for watching worst rated credits, and includes those sector under focus credits, that aren't already in watch. So even though we don't formerly classify them as watch, we have a whole enhanced watch process, which I think helps us to have a much more robust view of credits, that might be on the margin, but still a pass.

Catherine Mealor -- KBW -- Analyst

Okay, that's very helpful. Thank you.

John M. Hairston -- President and Chief Executive Officer

You're welcome.

Operator

Our next question comes from Brad Milsaps with Piper Sandler.

Brad Milsaps -- Piper Sandler -- Analyst

Hey, good evening.

John M. Hairston -- President and Chief Executive Officer

Hey, Brad.

Brad Milsaps -- Piper Sandler -- Analyst

You guys have addressed mostly everything. Did want to follow up on Kevin Fitzsimmon's question, regarding expenses. Mike, as you sort of think through your list of initiatives, I mean it, can you maybe describe it sort of maybe versus what you've done thus far kind of what you -- in terms of kind of thinking through that other number of things that you might have to work through in '21? Just trying to get a sense of kind of the magnitude of what else could be coming down the pike, in terms of expense levers that you might have?

John M. Hairston -- President and Chief Executive Officer

Sure. We're glad to, Brad, certainly at the same time that are creating some kind of expectation. I'd say we're probably in the third and fourth, and somewhere around that in terms of the things that we have in mind to do, that maybe we haven't yet executed on. So certainly there is more to come. We mentioned that we certainly are continued to do branch rationalization studies. We continue to work on things like attrition. The early retirement program is something that, let's see in terms of what the take rate for that is and what the impact and then the depth what we kind of go from there, in terms of the other things that I think we'll be looking at.

Brad Milsaps -- Piper Sandler -- Analyst

Great. That's helpful. And then just kind of one housekeeping thing, the chart, the table that you guys include on slide 8, as it relates to the quarterly impact of PPP. But the PPNR numbers in that table, are those net of expenses? Or is that just the coupon and the fee that you recognize in the quarter? Just trying to get my arms around what that number means versus the 5 basis points of NIM impact? Just want to make sure I'm comparing apples-to-apples.

Michael M. Achary -- Chief Financial Officer

Yeah, sure. So obviously, net income is what we believe to be the after-tax earnings and the net translates into the EPS. The PPNR would be the net interest income or margin impact of the loans inclusive of any fees that we're amortizing after we net any direct expenses. So we do have some expenses that are netted against the fees and their expenses on a direct basis.

Brad Milsaps -- Piper Sandler -- Analyst

Great. Thank you very much.

Michael M. Achary -- Chief Financial Officer

You bet.

Operator

Our next question comes from Matt Olney with Stephens.

Matt Olney -- Stephens -- Analyst

Thanks. Just one quick follow up here. I want to ask about the fee revenues. And I probably appreciate -- you're just given guidance on a quarterly basis at this point. But any more general commentary you can provide us on your various fee lines for 2021, that we should keep in mind for our forecast? Thanks.

John M. Hairston -- President and Chief Executive Officer

This is John. We were -- we talked about first quarter, simply because of the amount of volatility coming at us. And I think the first quarter is what we said, I think we anticipate some lower fees. Now the reasons for that, our secondary mortgage expected to diminish. The number of applications and dollars were down about 10% in the fourth quarter over third quarter. So we anticipate that again. And the specialty income is hard to predict. And if we end up with more customer swaps and such or BOLI than we anticipate, and we might outperform that a little bit. But the bigger unknown really is as all of the additional liquidity comes in, the average account balances go up, which presses down on recurring service income which was a bright spot for the quarter.

So until we see the magnitude of stimulus and until we see the magnitude and placement of PPP, together with whatever non-cash stimulus ideas may come from the administration, it's really hard to project what the rest of the year looks like. So we're in a lack of modeling or confidence in those lines, doing well this year. In fact, we're bullish on them. It's certainly just some big puts and takes that we can't size here in January. So we're opting to stay close in the guidance.

Matt Olney -- Stephens -- Analyst

Got it. Understood. Thank you.

John M. Hairston -- President and Chief Executive Officer

You bet.

Operator

And our next question comes from Christopher Marinac with Janney Montgomery Scott.

Christopher Marinac -- Janney Montgomery Scott -- Analyst

Hey, thanks. Just a quick question on. If you were to -- if you would buy loans externally to deploy excess liquidity, which we do snicks again in this environment. Just curious kind of what the trade-off is between all organic versus doing the purchase route?

John M. Hairston -- President and Chief Executive Officer

Chris, you want to start and I'll wrap it up.

Christopher S. Ziluca -- Chief Credit Officer

Yeah.

John M. Hairston -- President and Chief Executive Officer

Yeah. You point in May [Indecipherable]. I think the answer is, we've invested an awful lot of time, in a more granular portfolio. And risk of purchasing someone else's problems, I think we've kind of had all of that we want. And so while we are in the business of syndications to a little lesser degree than we have been historically, we're still in them. But I don't really see us purchasing a loan portfolio of any magnitude that would be in a specialty line or largely in syndications especially leverage. You may add to that, Chris?

Christopher S. Ziluca -- Chief Credit Officer

Yeah, I mean, I guess what I would say is that, we've never been really focused on buying mix, just to kind of price mix. But if they're strategic, if they fit a sector that we're -- more active in. Or if it's part of a larger strategy to support and build and develop a customer relationship, sometimes we'll do that. So, you know, it's -- and also we have been focused on just building out our syndications capability in general. And we're doing it in a very measured fashion.

A lot of it is our own desire to manage risk. And so therefore, a lot of it is focused on the agent and selling down risk, so that we can manage our risk. But in that process, you obviously need to be active in both sides. And so therefore there are situations where we're working with existing sources, where we would sell syndications too, that we would also be in discussions around assisting and participating in syndications with them as well.

John M. Hairston -- President and Chief Executive Officer

And Chris, we didn't get the question about other methods. But we really did somewhat diminish hiring of bankers for a while, when there was not much of a chance of calling clients, right, because of the shutdown. We're back in that game now and have offensively hired people, and we'll continue doing that throughout the year, focused on the markets with the greatest growth opportunity. And so I would far rather organically generate relationships that we know something about from bankers that are going to be managing those hands on with those management teams, then to do a portfolio purchase. You never say never, but at this point in time, I look forward to do it organically, if that's available. It's tough sledding right now, but it won't be for the whole year and have a little bit more often to firepower on the payroll, I think will be of tailwind.

Christopher Marinac -- Janney Montgomery Scott -- Analyst

Great, John and Chris. Thank you very much. I appreciate it.

John M. Hairston -- President and Chief Executive Officer

You bet. Thanks for the questions.

Operator

That concludes our question-and-answer session. I'd like to turn the call back over to John Hairston for any closing remarks.

John M. Hairston -- President and Chief Executive Officer

Thanks, Ali for running the call. Thanks, everyone for your interest, and we look forward to seeing you on the road or the virtual road a little later this quarter. Take care.

Operator

[Operator Closing Remarks]

Duration: 54 minutes

Call participants:

Trisha Voltz Carlson -- Executive Vice President and Investor Relations Manager

John M. Hairston -- President and Chief Executive Officer

Michael M. Achary -- Chief Financial Officer

Christopher S. Ziluca -- Chief Credit Officer

Michael Rose -- Raymond James -- Analyst

Jennifer Demba -- Truist Securities -- Analyst

Brett Rabatin -- Hovde Group -- Analyst

Kevin Fitzsimmon -- D.A. Davidson -- Analyst

Ebrahim Poonawala -- Bank of America -- Analyst

Catherine Mealor -- KBW -- Analyst

Brad Milsaps -- Piper Sandler -- Analyst

Matt Olney -- Stephens -- Analyst

Christopher Marinac -- Janney Montgomery Scott -- Analyst

More HWC analysis

All earnings call transcripts

AlphaStreet Logo