The USS Akron, USS Shenandoah, and USS Macon all failed due to bad weather. That's 3 of the US's 4 operational airships. (Another airship was constructed for the US, but was destroyed by poor handling before it was delivered to the US.)
Of the British experience with airships, R101 outright failed due to bad weather, and three more were scrapped after suffering accidents during bad weather, out of a total of 16 completed.
I don't feel like totting up the record of the Zeppelins, but the Wikipedia page does indicate that several of them failed due to weather incidents. One of the big lessons from the most notable airship failures is that airships don't really work in poor weather, and safety in such conditions means "don't even attempt to fly," which is a pretty different rule than the one for airplanes or other modes of transportation.
Aircraft are substantially more resistant to bad weather: you can fly an airplane into a hurricane.
Aircraft are also a lot faster -- it's unlikely that a thunderstorm will catch up with you (max speed of a storm is something like 50-80 mph) and trips are a lot shorter.
Airships are much closer to the storm speed and may need to stay aloft for several days. That makes it more likely that they'll hit unexpected weather and give them fewer options to avoid anything.
It's true that someone could do some shipping with airships and just eat the downtime due to weather. So far nobody has done that. And not for lack of trying: CargoLifter (mentioned elsewhere in this thread) went bankrupt on this idea.
The safety record of the Zepplin company in Germany is very impressive
They had many failures, no fatalities. Until the Hindenburg