How to automatically kill slow MySQL queries after N seconds?

check out pt-kill command from the percona toolkit.

and.. do start monitoring your system – munin, cacti with better cacti templates for mysql, anything so you get some idea what’s going on. logging mysql slow queries will be a good idea too.