Apache and mysql keeps crashing
Posted in Works on 10/07/2009 09:16 pm by adminToday is a terrible day. After many failed attempts to correct the server which kept crash and crash, we finally mediated the problem.
Symtoms:
- Apache crashed every 5 minutes. top command shows a high number of ilde httpd requests (negative priority)
- mySql kept saying too many connections
- Reboot server comes to file system failure. Use fsck to get it back online but problem persits.
Finally:
- Enable http_access log on httpd.conf to see where it is because of DOS attack. It turned out yes. The IP 79.125.40.218 which comes from Amazon data services send out a high number of GET request to our server.
- Ban the IP from httpd.conf : deny from 79.125.40.218. Voila, system is fine again.
We will consider using iptables to more effectively ban ips.
Thanks God. The server is up.