HTTP

I’ve finally decided to move out from cnftp as I can’t figure out when, what and why its configuration that can influence my site keeps changed from time to time. Everything pulled out, and the httpd configuration has been removed to reflect this without misleading people who has decent DNS records cached in their DNS mirrors.

Still don’t know why a simple upgrade will cause GB2312 to represent in UTF8 errornously. Maybe when I have time, but not now.

另一个部门的同事说他们那里的 mysql 总是会在凌晨0:00-1:00这段时间发生诡异的问题，即CPU占用迅速升高，并停止响应。

重起mysql无效，但到1:00之后，只要重起mysql，就可以恢复正常。

为此，今天我做了一次非常冒险的在线调试工作，并最终解决了问题。

以下是转贴：

作者：2f4f587a80c2dbbd870a46481b2b1882日期：2004.7.20

0、版权

本文遵从GPL协议，欢迎转载。

1、现象是什么？

大约从今年年初开始，很多人就发现，在浏览一些网站的时候，地址栏的url后面会被莫名其妙地加上"?curtime=xxxxxxxxxx"（x为数字），并且弹出广告窗口。很多人以为这是网站自己弹出的广告，也就没有在意。

我是属于很在意的那些人之一。

It’s so common to provide information feeds through RSS feed and today Ceri has committed FreeBSD’s RSS transform.

Some search engines has grabbed some of my links out (Primarily, MP3). So I put some limits there. This is because I don’t want FreeBSDChina to be a MP3 downloading site - It’s harmful for the server, and we don’t want it.

The code is the following, it’s simple and effective:

beastie# cat www-access.log.20040203 | grep googlebot
64.68.82.164 - - [03/Feb/2004:00:01:11 +0800] “GET /view/article_772.html HTTP/1.0” 200 32445 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.37 - - [03/Feb/2004:00:07:17 +0800] “GET /view/article_743.html HTTP/1.0” 200 9764 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.68 - - [03/Feb/2004:00:07:23 +0800] “GET /robots.txt HTTP/1.0” 200 - “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.68 - - [03/Feb/2004:00:07:24 +0800] “GET /view/article_770.html HTTP/1.0” 200 17389 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.68 - - [03/Feb/2004:00:13:01 +0800] “GET /view/article_736.html HTTP/1.0” 200 16292 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.55 - - [03/Feb/2004:00:13:01 +0800] “GET /view/article_777.html HTTP/1.0” 200 14202 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.37 - - [03/Feb/2004:00:16:07 +0800] “GET /view/article_819.html HTTP/1.0” 200 7515 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.136 - - [03/Feb/2004:00:16:08 +0800] “GET /view/article_790.html HTTP/1.0” 200 16910 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.181 - - [03/Feb/2004:00:18:07 +0800] “GET /view/article_769.html HTTP/1.0” 200 20162 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.37 - - [03/Feb/2004:00:18:09 +0800] “GET /view/article_771.html HTTP/1.0” 200 18290 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.55 - - [03/Feb/2004:00:19:08 +0800] “GET /view/article_554.html HTTP/1.0” 200 13881 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.37 - - [03/Feb/2004:00:20:57 +0800] “GET /view/article_741.html HTTP/1.0” 200 42974 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.79 - - [03/Feb/2004:00:25:15 +0800] “GET /view/article_779.html HTTP/1.0” 200 37964 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.135 - - [03/Feb/2004:00:28:34 +0800] “GET /view/article_830.html HTTP/1.0” 200 9338 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.37 - - [03/Feb/2004:00:32:16 +0800] “GET /view/article_656.html HTTP/1.0” 200 33950 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.164 - - [03/Feb/2004:00:33:05 +0800] “GET /view/article_754.html HTTP/1.0” 200 44973 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.55 - - [03/Feb/2004:00:33:36 +0800] “GET /view/article_740.html HTTP/1.0” 200 13074 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.164 - - [03/Feb/2004:00:33:45 +0800] “GET /view/article_800.html HTTP/1.0” 200 27723 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.178 - - [03/Feb/2004:00:33:52 +0800] “GET /view/article_707.html HTTP/1.0” 200 14763 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.181 - - [03/Feb/2004:00:34:12 +0800] “GET /view/article_711.html HTTP/1.0” 200 17980 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.159 - - [03/Feb/2004:00:34:12 +0800] “GET /view/article_803.html HTTP/1.0” 200 7039 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.37 - - [03/Feb/2004:00:34:26 +0800] “GET /view/article_757.html HTTP/1.0” 200 32888 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.54 - - [03/Feb/2004:00:34:28 +0800] “GET /view/article_710.html HTTP/1.0” 200 17788 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.159 - - [03/Feb/2004:00:34:42 +0800] “GET /view/article_797.html HTTP/1.0” 200 30979 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.46 - - [03/Feb/2004:00:34:47 +0800] “GET /view/article_806.html HTTP/1.0” 200 7727 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.164 - - [03/Feb/2004:00:34:51 +0800] “GET /view/article_727.html HTTP/1.0” 200 8025 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.79 - - [03/Feb/2004:00:59:15 +0800] “GET /view/article_742.html HTTP/1.0” 200 26076 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.208 - - [03/Feb/2004:00:59:24 +0800] “GET /view/article_737.html HTTP/1.0” 200 14338 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.27 - - [03/Feb/2004:00:59:28 +0800] “GET /view/article_702.html HTTP/1.0” 200 39867 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”
64.68.82.176 - - [03/Feb/2004:00:59:41 +0800] “GET /view/article_768.html HTTP/1.0” 200 13076 “-” “Googlebot/2.1 (+http://www.googlebot.com/bot.html)”

A discussion with junsu has finally result in my implementation of URL rewrite on the reverse proxy instead of IIS. He told me that there’s no official implementation of URL Rewrite and he have an ISAPI implementation several weeks ago.