Checkout bosun.org.  its the alerting system used/built by the people @stackexchange

Bosun
Bosun