きゃらりこ日誌

ネイバーさん、いくらなんでも……

技術, サイト管理, インターネット

ポケサテ！の昨日のアクセスログを見ていたんですが、妙なログを発見。
robots.txtに対するリクエスト不成功が、180件も発生していました。
何が起きたのかと、サーバログを分析したところ、大半はネイバーさんのクローラーが、存在しないrobots.txtに対してアクセスしていたためだと判明。
１回目は、約10分間にわたって、約6秒間隔でアクセス。
２回目は、約6分間にわたって、約2秒間隔でアクセス。
「404 Not Found」エラーが返っても、完璧無視してます。
そろそろネイバーさんのアクセス拒否を検討すべきですかね。

以下は、そのときのサーバログです
218.145.25.82 - - [28/Apr/2004:03:19:46 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:19:48 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:20:30 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:20:48 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:20:54 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:20:57 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:03:21:21 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:21:25 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:21:39 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:21:46 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:21:48 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:21:49 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:21:53 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:22:12 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:03:22:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:03:23:05 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:23:06 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:23:13 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:03:23:17 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:23:21 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:23:35 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:23:43 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:24:29 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:24:39 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:25:17 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:25:20 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:25:47 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:25:59 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:26:01 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:26:13 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:27:11 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:27:47 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:27:47 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:03:28:07 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:28:25 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.12 - - [28/Apr/2004:03:28:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:28:34 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:28:35 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:29:56 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:29:58 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:03:30:19 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:03:31:03 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:31:15 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:31:29 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:31:38 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:31:39 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:32:10 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:32:31 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:32:39 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:32:45 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:33:44 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:34:31 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:35:20 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:35:20 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:03:35:24 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:35:47 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:03:36:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:37:17 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:03:38:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:26 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.207 - - [28/Apr/2004:03:39:27 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:03:39:29 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.79 - - [28/Apr/2004:04:29:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"

218.145.25.119 - - [28/Apr/2004:12:27:09 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:27:10 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:11 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:11 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:11 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:12 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:12 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:13 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:13 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:14 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:14 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:15 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:15 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:15 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:17 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:17 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:19 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:24 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:25 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:28 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:29 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:30 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:30 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:31 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:32 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:32 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:32 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:32 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:32 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:27:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:33 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:34 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:34 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:34 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:35 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.12 - - [28/Apr/2004:12:27:36 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:38 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:38 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:38 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:38 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:39 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:40 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:40 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
220.73.165.12 - - [28/Apr/2004:12:27:41 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:44 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.119 - - [28/Apr/2004:12:27:46 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:49 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:50 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:27:50 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:52 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:27:53 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.18 - - [28/Apr/2004:12:27:53 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:27:58 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:28:04 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:28:13 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:28:16 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:28:18 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:28:20 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.82 - - [28/Apr/2004:12:28:32 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:28:45 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"
218.145.25.50 - - [28/Apr/2004:12:29:46 +0900] "GET /robots.txt HTTP/1.0" 404 1548 "-" "NaverBot-1.0 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)"

関連記事