Welcome, Guest. Please login or register.
Did you miss your activation email?
Wednesday 11 December 2024, 08:44:37 am

Login with username, password and session length

CLICK HERE for the The official Endian Roadmap and Issue tracker
14261 Posts in 4377 Topics by 6517 Members
Latest Member: Sandro
Search:     Advanced search
+  EFW Support
|-+  Development
| |-+  Contribute Your Customisations & Modifications
| | |-+  Greater Blacklist
0 Members and 5 Guests are viewing this topic. « previous next »
Pages: [1] 2 Go Down Print
Author Topic: Greater Blacklist  (Read 162931 times)
finchwizard
Guest
« on: Wednesday 26 April 2006, 12:43:20 pm »

I'm still working on it, but here's a screenshot of what I have so far.

Hopefully I'll release a script, or at least manual instructions for it.

But the current Blacklist is very minimal and I personally need far more blacklists. So far mine is looking like this and seems to be working.



Will post back when I get it all working.
Logged
euser4life
Full Member
***
Offline Offline

Posts: 13


« Reply #1 on: Friday 31 August 2007, 06:55:00 am »

This is probably widely known but for some like myself it is good information.  You can easily update dansguardian blacklist within endian firewall with the newest list of sites / categories by downloading the list from:

<http://urlblacklist.com/?sec=download>

Then (for windows user's use 7-zip to decompress into a folder called blacklists) and use a SFTP client (such as WinSCP) to upload the list to the /etc/dansguardian/blacklists directory.  Once you refresh the page new categories will be there for you to choose from. 

I'm sure there are ways to automate (script) updates.  The first download is free, they don't block additional downloads but go off of the honor system since they are providing a service.  It works very well.
Logged
Hinze57
Jr. Member
*
Offline Offline

Posts: 8


« Reply #2 on: Wednesday 08 October 2008, 02:21:42 pm »

Can you post at least some raw instructions?

I can get the blacklists but am trying to figure out if I need to update the categories file. 

Thanks,
K
Logged
wharfratjoe
Full Member
***
Offline Offline

Posts: 17


« Reply #3 on: Monday 12 January 2009, 08:22:48 am »

Does this work on 2.2 RC3?
Logged
zman818
Jr. Member
*
Offline Offline

Posts: 4


« Reply #4 on: Sunday 18 January 2009, 10:44:24 am »

I second that question.  It seems that the categories file format is different between the current EFW and current blacklist files...    ?
Logged
khhkom
Jr. Member
*
Offline Offline

Posts: 1


« Reply #5 on: Friday 20 February 2009, 01:15:30 am »

any update on this? even after just replacing the domains/urls of some categories dansguardian is stuck with 100% cpu Sad
Logged
hinge
Full Member
***
Offline Offline

Posts: 93


« Reply #6 on: Monday 08 June 2009, 05:34:24 pm »

Itry this configuration to my content filter but my network cannot connect any website? they have any configuration i can do? i using 2.2 rc3.. thank you
Logged
davvidde
Full Member
***
Offline Offline

Gender: Male
Posts: 68


« Reply #7 on: Wednesday 17 June 2009, 01:31:59 am »

I confirm: the big blacklist from urlblacklist.com do not works because the CPU got 100% for over two hours on a VM (1024MB) on HP proliant QuadCore 2.50GHz  with VMWare ESXi 3.5 and at the end the dansguardian process do not start (terminated with segmentation fault). I try this on EFW 2.2rc3 and EFW2.2 final. I even substitute the /etc/dansguardian/blacklists/CATEGORIES provided by urlblacklist.com with the original provided by endian (the two formats are a bit different) but the problems seems to be the compilation of lists. I even notice the strange behaviour on my virtualbox VM installation: the compilation of the lists do not get over the eleventh. The lists processed are always 11 in total when the categories are 86. This appears on all my three VM on test.
May anyone post dansguardian detailed logs to compare?
Logged
maurelio
Jr. Member
*
Offline Offline

Posts: 4


« Reply #8 on: Thursday 18 June 2009, 11:49:11 am »

Hi,

I had the same problem in version 2.1.2, but found that the way that files are being provided by the URLBlacklist is incompatible with the Dansguardian.

These files are indexed alphabetically and Dansguardian to work with does not know this.

Just to give you rearrange the files to a random order.

I would like to know how to do this update in version 2.2 final, because the formats are different and the obstacles that exist by default are very old.

[]īs
Logged
davvidde
Full Member
***
Offline Offline

Gender: Male
Posts: 68


« Reply #9 on: Friday 19 June 2009, 04:58:18 pm »

I know of this "bad" implementation of Dansguardian which use a quicksort algorithm to sort an already sorted list but I don't understand how Dansguardian in Ubuntu 8.04 processes without problem, in less than a minute, the list provided by URLBLACKLIST.COM; so i decided to copy the already  sorted from Ubuntu to Endian and Dansguardian restart without problem in few seconds. By the way I tested this in EFW2.2 final but this release suffers, in my testing, of authentication problem with LDAP that EFW2.2rc3 does not have. See post http://efwsupport.com/index.php?topic=673.0
Windows authentication in EFW 2.2 also do not work with group policies but I don'k know if this is by design.
Logged
entourage
Full Member
***
Offline Offline

Posts: 48


« Reply #10 on: Thursday 09 July 2009, 05:27:56 am »

I ran into the same problem that you guys had with the URLBLACKLIST.COM killing my install.  I was wondering if Shalla's list http://www.shallalist.de/ would work any better.  It would be nice if wget were installed, so we could run the scripts.
I'm going to manually download the list and move the folders over via WinSCP.  Wish me luck!
Logged
entourage
Full Member
***
Offline Offline

Posts: 48


« Reply #11 on: Thursday 09 July 2009, 06:49:32 am »

Ok, I've downloaded and unzipped the Shalla list.
I removed all of the current folders in /etc/dansguardian/blacklists and copied over the new unzipped folders. 
I then modified the categories file to reflect the new folders.  I did it the quick and dirty way where they each have their own category:
Code:
Adv=adv
Agressive=agressive
Automobile=automobile
Chat=chat
CostTraps=costtraps
Downloads=downloads
etc...

I refreshed the Content Filter page and selected 10 or so categories to block.  Once I hit 'Save' I would say it took approximately 2 minutes to refresh, but it clocked my selected categories.  I noticed I missed a , so I selected about 5 more and hit 'Save' again.  This time it was nearly instant.

So as for manually up, this will work for me, but an automated script would be MUCH nicer!

Hope that helps someone.
Logged
Baggers
Jr. Member
*
Offline Offline

Posts: 4


« Reply #12 on: Saturday 01 August 2009, 11:24:55 pm »

Thanks, I've just automated this by firstly getting wget onto my box based on clues from here...

http://www.howtoforge.com/install-vmware-tools-on-endian-firewall-community-2.2-rc3-on-esxi-3.5

....and then writing the following script and sticking it in /etc/cron.weekly....

#!/bin/sh
wget -Y no http://www.shallalist.de/Downloads/shallalist.tar.gz -O /tmp/shallalist.tar.gz
cd /tmp
tar -xvzf shallalist.tar.gz
cp -r BL/* /etc/dansguardian/blacklists/
rm -r /etc/dansguardian/blacklists/COPYRIGHT
rm -r /etc/dansguardian/blacklists/global_usage
date > /etc/dansguardian/blacklists/updated
/etc/init.d/dansguardian restart
exit 0


... then I modified  /home/httpd/cgi-bin/dansguardian.cgi  so its displays when the blacklist has been updated in the proxy / content filter section by adding....

$output = `cat  /etc/dansguardian/blacklists/updated`;
$output = &cleanhtml($output,"y");
print "URL Blacklist Date : $output\n";



Hope someone finds this useful! Smiley

Baggers
Logged
hinge
Full Member
***
Offline Offline

Posts: 93


« Reply #13 on: Monday 03 August 2009, 06:05:35 pm »

hi! baggers.. this is work to EFW community 2.2? thank you..
Logged
Baggers
Jr. Member
*
Offline Offline

Posts: 4


« Reply #14 on: Tuesday 04 August 2009, 03:55:41 pm »

Yes. Thats the version i'm using.
Logged
Pages: [1] 2 Go Up Print 
« previous next »
Jump to:  

Page created in 0.188 seconds with 19 queries.
Powered by SMF 1.1 RC2 | SMF © 2001-2005, Lewis Media Design by 7dana.com