Error occured at: goaccess.c - render_screens - 239

[loganbest]

I'm trying to use goaccess on FreeBSD 9.1 and using a custom log format in my .goaccessrc. I used the package for installation pkg_add -r goaccess

here's my rc file:

date_format "%d/%b/%Y:%H:%M:%S %z"
log_format "%h %l %u %t \"%r\" %s %b \"%{Referer}i\" \"%{User-Agent}i\""

Here's the error I get when I run goaccess -f www.domain.com-access-psky.log -a:

An error has occurred
Error occured at: goaccess.c - render_screens - 239
Message: Nothing valid to process.

This also happens with using the normal "Combined" log format.

[loganbest]

I should also add that my access log is about 500mb with a 24hour rotation and a peak size of about 600-650mb

[allinurl]

@loganbest could you please post a couple of lines from your log? Thanks

[loganbest]

redacted IP's for x.x.x.x

x.x.x.x - - [25/Aug/2013:05:00:04 -0400] "GET /websites.php?rand=0.14329157 HTTP/1.0" 200 318 "-" "Mozilla/5.0 (Windows NT 6.1; rv:19.0) Gecko/20100101 Firefox/19.0"
x.x.x.x - - [25/Aug/2013:05:00:04 -0400] "GET /websites.php?rand=0.979402721 HTTP/1.0" 200 318 "-" "Mozilla/5.0 (Windows NT 6.1; rv:19.0) Gecko/20100101 Firefox/19.0"
x.x.x.x - - [25/Aug/2013:05:00:05 -0400] "GET /websites.php?rand=0.79689344 HTTP/1.0" 403 - "-" "Mozilla/5.0 (Windows NT 6.1; rv:19.0) Gecko/20100101 Firefox/19.0"
x.x.x.x - - [25/Aug/2013:05:00:05 -0400] "GET /websites.php?rand=0.763994039 HTTP/1.0" 403 - "-" "Mozilla/5.0 (Windows NT 6.1; rv:19.0) Gecko/20100101 Firefox/19.0"
x.x.x.x - - [25/Aug/2013:05:00:03 -0400] "GET /subyoutube.php?step=points&id=thuvienvideopromo&owner=458517&rand=0.6035824860289364 HTTP/1.1" 200 358 "http://www.domain.com/stats.php" "Mozilla/5.0 (Windows NT 6.2; WOW64; rv:23.0) Gecko/20100101 Firefox/23.0"
x.x.x.x - - [25/Aug/2013:05:00:05 -0400] "GET /images/ylhblue.png HTTP/1.1" 200 6685 "http://www.domain.com/newaddyoutube.php" "Mozilla/5.0 (PlayStation Vita 2.12) AppleWebKit/536.26 (KHTML, like Gecko) Silk/3.2"

[allinurl]

Using the NCSA Combined Log Format should do it. Try running goaccess with -c, or make sure you have the following in your .goaccessrc:

date_format %d/%b/%Y
log_format %h %^[%d:%^] "%r" %s %b "%R" "%u"

Please let me know how it goes.

[loganbest]

That seems to have worked. Only one issue that I'm seeing now:

Unique visitors per day
11941 100.00% 25/Aug/2013 7.03 GB

How is that possible? I know for a fact that 100% of my traffic today has not been unique.

[allinurl]

Glad that worked.

That's counting bots and actual visitors. Are you using some other tool to measure your traffic?

[loganbest]

I keep a log of every single action on my site in the database along with the IP and the user ID and run some stats on that by cron every hour. I keep the data for 30 days. Running some stats now I can see that there should be about 40% unique.

[allinurl]

So are you measuring unique visitors by unique IP and the %u part?

GoAccess will report 2 unique visitors in this case:

65.55.106.209 - - [20/Dec/2009:06:32:39 -0600] "GET / HTTP/1.0" 200 19440 "-" "msnbot/2.0b (+http://search.msn.com/msnbot.htm)"
65.55.106.209 - - [20/Dec/2009:06:32:39 -0600] "GET / HTTP/1.0" 200 19440 "-" "msnbot/1.0b (+http://search.msn.com/msnbot.htm)"

[loganbest]

I'm only measuring by unique IP as I'm not recording UA in the database

[loganbest]

Ah I think I get it now. Because this access log is rotated at midnight every night it's not spanning multiple days. So according to that each IP/UA combo is actually unique to that day.

[allinurl]

Okay to close? Feel free to open a new issue if you have any other questions.