Hank has no proof of anything. But he's inferred the rest (successfully I may add). And yes, he takes it personally.
Everything that's happened since Walk joined that ride-along with Hank can legitimately be blamed on Walt, at least indirectly, whether Hank has put it together yet or not. And much of was a slap in the face to Hank.
1. Emilio & Krazy 8 were killed directly by Walt.
2. No-doze was beaten to death because of Walt's meth.
3. Gonzo was killed while trying to dispose of No-Doze. Without Walt's meth, Gonzo wouldn't have been in that situation.
4. Walt had that call placed to Hank's phone about Marie's accident, causing him much emotional distress. That led to him beating up Jesse, which led to him losing his job, which led to him being unarmed when the twins attacked.
5. Hank tracked Jesse to Tuco's place in the desert where he killed Tuco. That led directly to the twins trying to kill Hank.
6. Hank's killing of Tuco led to his promotion to El Paso. That led to the Tortuga explosion, which coupled w/ the Tuco incident, screwed up Hank's brain.
7. Combo was killed selling drugs.
8. The twins killed 9 illegal aliens & the driver of the truck, the old lady for her wheel chair van, the deputy who discovered them, and a couple of innocent bystanders during the attack on Hank.
9. Tomas, the boy who killed Combo and was then killed by the gang-bangers.
10. The 2 gang-bangers who killed Tomas.
11. Gale & Victor
12. Victor.
13. Tio Salamanca, Gus, & Tyrus.
14. Walt also blew up a nursing home in the process.
15. Gus' henchmen during the coup.
16. All of Gus' guys who were assassinated in prison or otherwise.
17. The kid in the desert with the scorpion.
18. Mike.
Hank has already figured out Walt was probably involved with a lot of these things, but hasn't put 2 & 2 together on all of them. However, he has the info to figure all of these out in time.
Also, we cannot even begin to calculate the number of lives his meth has ruined throughout southwest USA and the Czech Republic.
This doesn't even include all the stuff Hank can't possibly know about such as Walt letting Jane die and how it led to the airplane crash that killed 167 people and caused millions of dollars worth of damage.
His presence also led to the war between Gus and the cartel which resulted in probably a few dozen deaths on both sides. Without Walt, that never would've happened.
With that said, there are also a lot of things that would affect Hank personally throughout all of this:
1. That walk-a-thon that Hank begged his coworkers to contribute to? It was total b.s.
2. Crashing the car into traffic to avoid seeing the laundry facility.
3. Interfering with the bust using Badger.
4. Informing for Gus to sabotage Hank's investigation.
5. Causing Hank's mental breakdown.
6. Causing Hank to go on forced leave from work after attacking Jesse.
7. The bogus phone call about Marie's accident.
8. Getting Hank attacked by trained assassins.
9. Causing Hank and their entire extended family to be put under protection from the cartel.
10. Putting everyone's lives in danger.
11. Lying, conning, and manipulating those he's supposed to love most at every turn.
I can't imagine why Hank might be a little bit upset.
