Print Page - Does Endian have monthly bandwidth usage somewhere?

Title: Does Endian have monthly bandwidth usage somewhere?
Post by: maxim on Friday 09 October 2009, 04:47:43 am

I'm looking for what Smoothwall has in this image here:
http://smoothwall.org/images/promos/3.0/control_home_ethernet_profile.png

The monthly total bandwidth usage is my primary concern.

I found Traffic Monitoring using ntop, but haven't been able to find this exact output of information.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: crashd0g on Saturday 10 October 2009, 07:22:12 am

You can get to a graph page similar to what you saw in Smoothwall, by clicking on the daily graph. To get back, there is a link at the bottom of the page.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: maxim on Saturday 10 October 2009, 07:36:45 am

I believe what you're talking about is Status -> Traffic Graphs page, where I can click on the per Day graph for a given interface.

https://192.168.0.1:10443/cgi-bin/graphs.cgi?graph=RED_main

However, this page does not display the monthly bandwidth usage but an overview of the rate over a several periods of time, Day, Week, Month, Year. My concern is the Total usage for the month.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: maxim on Saturday 21 November 2009, 06:14:27 am

It seems no one is interesting in this feature other than me? Anyone have any ideas?

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: buggs1a on Sunday 29 November 2009, 02:19:10 pm

I'm veeeeery interested in this too and to be able to keep record of past months amount uploaded and downloaded.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: acecombat on Monday 30 November 2009, 08:47:01 pm

As am I

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: NavSol on Friday 04 December 2009, 10:35:01 pm

For us this would be most helpful. One of our clients using 2.3 allows their staff to access the net between 1 and 2 and we have been moaned at saying that it is not working on a numbr of occasions. We can show them a days worth at the moment but when they moan that they had a problem 7 days ago it would be very useful tlo be able track this.
8)

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: aaronr on Wednesday 09 December 2009, 11:01:43 am

It looked like ntop would hold this information, but unfortunately it seems to only hold data for a very short amount of time, and is by all accounts absolutely useless for this purpose.

I've used BandwidthD (http://bandwidthd.sourceforge.net/) before, and was considering installing it on my Endian box, but wasn't sure if it'd interfere with anything.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: turitopa on Thursday 25 February 2010, 10:31:39 am

Hi All,
So has anyone found a solution to this? I need to track my monthly broadband usage, and identify who.what is using it all.
If Endian cannot do it, please notify me of another software firewall which can....
(EFW 2.3 <for me>, content filter not working, no anti-virus, no broadband usage reports...I am seriously thinking of going back to IPCOP).

EDIT:
Okay looks like you will need to use SNMP, but its a pity SNMP on Endian (community) 2.3.1 does not work like it should!
I think Endian should advise that their FREE version is incomplete and buggy, if I knew I would never have switched over to Endian!
:thumbs down to Endian:
(unless off course they do provide a proper solution, i cannot find any solution to this issue ...)

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: turitopa on Thursday 18 March 2010, 11:42:59 am

Okay,

I may have found a work-around.

I DL'd an application called Wallwatcher.exe this I run on my workstation.

You can set the Endian Router IP and your external IP (WAN) in wallwatcher.
Ensure you have remote syslog enabled on Endian, and point the remote logging to the work station running wallwatcher.
If its all working you can get usage totals for each IP in your LAN/WAN

I hope this helps someone else. (I could not get SNMP enabled on endian 2.3.1 community version so am now using the syslog instead.)
Cheers ;)

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: Steve on Thursday 18 March 2010, 02:36:30 pm

Have you had a look at LightSquid: http://efwsupport.com/index.php?topic=1359.0

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: turitopa on Friday 19 March 2010, 11:25:48 am

Quote from: Steve on Thursday 18 March 2010, 02:36:30 pm

Have you had a look at LightSquid

thanks Steve, have implemented this now too

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: turitopa on Thursday 25 March 2010, 08:00:42 am

Steve does liteSquid only monitor my proxy port?

I need to watch my usage on the RED interface, can NTOP do this (NTOP analyses the GREEN interface by default) - how do you set up monitor of RED interface?
anyone?

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: maxim on Saturday 08 May 2010, 05:19:26 am

Indeed, lightsquid only applies for proxy usage statistics. When users are configured to use endian as a default gateway statistics are not shown.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: maxim on Tuesday 11 May 2010, 03:37:57 am

I was investigating this today and stumbled upon a of interesting things. First is, I have managed to add a field to the graphs on the Traffic Graphs page that represent Total Incoming/Outgoing Usage for that graph.

This is close to what i'm looking for, however, not exactly. This is because the graphs show a time period relative to the current time. So, one week back may include data from the previous month. The period of the past month would only be valid at 12:00 on the first day of the month.

If you would like to add these fields anyway as they may be of value to someone edit the file /usr/local/bin/makegraphs.pl
In the sub updateifgraph, at line 420 add the following:

Code:

                "VDEF:inctotal=incoming,TOTAL",
                "VDEF:outtotal=outgoing,TOTAL",

This will define the totals for the period as vnames and allow them to be printed.
Next add the lines to print at the end of the current statement. Find the lines that look like this:

Code:

                "GPRINT:outgoing:AVERAGE:%12.3lf %sBps",
                "GPRINT:outgoing:LAST:%12.3lf %sBps\\n");

Modify them by inserting the last two lines of the following text in between the double quote and the ");" The code should look like this afterwards:

Code:

                "GPRINT:outgoing:AVERAGE:%12.3lf %sBps",
                "GPRINT:outgoing:LAST:%12.3lf %sBps\\n",
                "GPRINT:inctotal:Total Incoming\\:%12.3lf %sB\\n",
                "GPRINT:outtotal:Total Outgoing\\:%12.3lf %sB\\n");

After that run

Code:

/etc/cron.cyclic/makegraphs

This job I think is run every 5 minutes or so, but that will update the graph images that appear on the graph pages. You should see the changes that were made.

Another thing that I found was the application called ipacsum. This is installed on endian by default and allows for summing of the IP traffic through iptables.

Run the following to get the IP accounting data from previous months:

Code:

ipacsum -t "the month 1 months ago"
ipacsum -t "the month 2 months ago"
ipacsum -t "the month 3 months ago"
ipacsum -t "the month 4 months ago"

The problem with this method is the results are different from what is being displayed on the Traffic Graphs. Over the course of a year or so the numbers are different by several hundred gigs. The results are different at a week's time. I have a feeling that these methods are looking at different data, or the same data differently.

Title: Re: Does Endian have monthly bandwidth usage somewhere?
Post by: maxim on Tuesday 11 May 2010, 05:00:28 am

Since I don't know perl at all, i've managed to convert the section that generates the graph into a bash script. The RRD package that the perl script uses has a command line tool called rrdtool and it can be used to generate the same PNG file.

Here is an example which will grab the data from last month:

Code:

rrdtool graph\
                /home/httpd/html/graphs/green-mtd.png\
                --start 20100401 --end 20100501 -aPNG -i -z\
                --alt-y-grid -w 600 -h 100\
                --color SHADEA#EAE9EE\
                --color SHADEB#EAE9EE\
                --color BACK#EAE9EE\
                -t "$titletraffic"\
                -v "$legend"\
                DEF:incoming=/var/log/rrd/GREEN.rrd:incoming:AVERAGE\
                DEF:outgoing=/var/log/rrd/GREEN.rrd:outgoing:AVERAGE\
                VDEF:inctotal=incoming,TOTAL\
                VDEF:outtotal=outgoing,TOTAL\
                \
                "COMMENT:\\s"\
                "COMMENT:  "\
                "COMMENT:                 Maximum"\
                "COMMENT:                 Average"\
                "COMMENT:                 Current"\
                "COMMENT:\\n"\
                \
                "AREA:incoming#00FF00:Incoming traffic"\
                "GPRINT:incoming:MAX:%12.3lf %sBps"\
                "GPRINT:incoming:AVERAGE:%12.3lf %sBps"\
                "GPRINT:incoming:LAST:%12.3lf %sBps\\n"\
                \
                "LINE1:outgoing#0000FF:Outgoing traffic"\
                "GPRINT:outgoing:MAX:%12.3lf %sBps"\
                "GPRINT:outgoing:AVERAGE:%12.3lf %sBps"\
                "GPRINT:outgoing:LAST:%12.3lf %sBps\\n"\
                "GPRINT:inctotal:Total Incoming\\:%12.3lf %sB\\n"\
                "GPRINT:outtotal:Total Outgoing\\:%12.3lf %sB\\n"

It doesn't look exactly the same due to spacing, the title, and the legend, but for the most part it's there. This type of graph could be incorporate into the WebUI if a user was so inclined to write the code to accomplish it. I'm not that person though, perl is not my forte.

Even so, if this was incorporated into the UI it doesn't include the address of who was using the bandwidth, it doesn't include the IP address of individual work stations.

EFW Support

Support => General Support => Topic started by: maxim on Friday 09 October 2009, 04:47:43 am