Comments on: Convert Apache common logs to combined logs http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/ programming, web, music and life Sun, 14 Mar 2010 16:49:51 +0000 http://wordpress.org/?v=2.7.1 hourly 1 By: Joel http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-19820 Joel Sat, 14 Feb 2009 04:33:53 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-19820 Thanks for the great post. Did you still have constant traffic coming through while you were playing with the logs? I wonder how you might go about converting the log while traffic continues to flow in? If I were to change the apache setting to combined logging, then split the file, convert the first part to combined format, I would then have two parts which I could merge, however, all the while the original log file is still being written to. I am making sense? Any ideas? Thanks for the great post. Did you still have constant traffic coming through while you were playing with the logs? I wonder how you might go about converting the log while traffic continues to flow in?

If I were to change the apache setting to combined logging, then split the file, convert the first part to combined format, I would then have two parts which I could merge, however, all the while the original log file is still being written to.

I am making sense? Any ideas?

]]> By: Tristan http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-19283 Tristan Sat, 29 Dec 2007 18:54:26 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-19283 That's not actually what I meant, I was referring to the Linux/Unix version of the csplit command in which --prefix is used. Thanks for the Leopard tip, seems like the OSX version of csplit isn't directly compatible with the Linux version. Doesn't mean it's the correct one ;-) That’s not actually what I meant, I was referring to the Linux/Unix version of the csplit command in which –prefix is used.

Thanks for the Leopard tip, seems like the OSX version of csplit isn’t directly compatible with the Linux version. Doesn’t mean it’s the correct one ;-)

]]> By: jack http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-19282 jack Fri, 28 Dec 2007 08:31:34 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-19282 Did you mean: csplit -f access.log access.log 7611828 Your csplit gives an error in in terminal on Leopard. Did you mean:

csplit -f access.log access.log 7611828

Your csplit gives an error in in terminal on Leopard.

]]> By: BrnDmp » Blog Archive http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-19193 BrnDmp » Blog Archive Fri, 09 Nov 2007 10:09:34 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-19193 [...] process logs: awstats.pl -config=www.mysite.com -update (NOTE: logs should be in combined format -> set in httpd.conf. Cool post about converting common to combined log format) [...] [...] process logs: awstats.pl -config=www.mysite.com -update (NOTE: logs should be in combined format -> set in httpd.conf. Cool post about converting common to combined log format) [...]

]]> By: Geo http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-19042 Geo Mon, 10 Sep 2007 08:25:31 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-19042 great post ..tank you very much ! great post ..tank you very much !

]]> By: Dom http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-17796 Dom Wed, 14 Mar 2007 12:57:09 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-17796 Oh, thank goodness you wrote this. Super fantastically useful. Exactly what I was looking for. I had to sort my merged log first, because everything was out of order (happened when I last moved server and took the logs with me, I think). Sorting Apache logs by date is rather nasty. But once I had that done, this recipe saved my bacon. :-) Oh, thank goodness you wrote this. Super fantastically useful. Exactly what I was looking for.

I had to sort my merged log first, because everything was out of order (happened when I last moved server and took the logs with me, I think). Sorting Apache logs by date is rather nasty.

But once I had that done, this recipe saved my bacon. :-)

]]> By: Tristan http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-17370 Tristan Tue, 20 Feb 2007 07:20:02 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-17370 Thanks Chris, I've updated the article with your suggestion and fixed other minor errata. Glad I could help! I couldn't find any other articles about this anywhere, so I made sure to title my post in a Google-friendly manner :-) Seems like it worked! Thanks Chris, I’ve updated the article with your suggestion and fixed other minor errata.

Glad I could help! I couldn’t find any other articles about this anywhere, so I made sure to title my post in a Google-friendly manner :-) Seems like it worked!

]]> By: Chris http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/comment-page-1/#comment-17368 Chris Tue, 20 Feb 2007 03:56:31 +0000 http://www.trisweb.com/archives/2007/02/15/convert-apache-common-logs-to-combined-logs/#comment-17368 I just installed AWStats this evening and had the same dilemma as you, but found your excellent steps after a quick google search. You might want to mention that (depending on how you have AWStats configured), you may have to delete your existing stats in your DirData directory (probably /var/lib/awstats) and run it again for a full update so it doesn't skip lines it has already processed. Otherwise, thanks a lot for the help - I'm off to convert all my old logs! I just installed AWStats this evening and had the same dilemma as you, but found your excellent steps after a quick google search. You might want to mention that (depending on how you have AWStats configured), you may have to delete your existing stats in your DirData directory (probably /var/lib/awstats) and run it again for a full update so it doesn’t skip lines it has already processed. Otherwise, thanks a lot for the help - I’m off to convert all my old logs!

]]>