randyoo: Yes, you're right! It is missing nice, indeed. So I suppose I might be able to get it working if I use OPTIMISE="Y", since that looks like the only option using nice? Or is it possible to get a copy of 'nice' from somewhere and just put it in the /bin dir? Edit: The script works if I use this: OPTIMISE="N" USEHOSTS="Y" I now get a working /tmp/hosts. Thanks, randyoo
Since I upgraded to AdBlock 4.0 my log shows a problem after sorting no matter what sources I choose. Anybody else seeing this? I emptied the white-list back to the default "intel.com" so it's not a whilte-list issue. Apr 11 18:18:02 router user.notice root: ADBLOCK: 30164 entries Apr 11 18:18:02 router user.notice root: ADBLOCK: sorting hosts... Apr 11 18:18:02 router user.notice root: ADBLOCK: hosts sorted. Apr 11 18:18:02 router user.notice root: ADBLOCK: 0 entries
@randyoo: I also don't have nice on my router :-/ I will roolback to 3.9c @dkirk: isn't it the problem with nice ?
I am running Victek "RAF1.28.8900 MIPSR2_RAF K26 USB VPN" but did not see a NICE message in the log so I presumed that wasn't the problem.
I saw same thing here - root: ADBLOCK: 0 entries. Switched back to 3.9c and every thing back to normal.
What file do i have to check with vi if i want to be sure that it's working ? I'm using dns poisoning method
you can take a look in your log, adblock logs some messages. the file used as hosts file is /tmp/gen take an address from it and try to launch it in your browser.
I have a problem with pixelserv. I got the ads blocked using the script although I still see error messages in place of ads. I tried running v18 but I only see one line like this: I found the latest version here. I tried to copy it into my router and executing pixelserv and pixelserv.oldT just gives me the same output: My router is Tomato Firmware v1.27.0010 ND USB VPN. Here is my script and the IP is not assigned to any PC: I don't see pixelserv on TOP whenever I execute it. Does anybody know what's the problem?
I'm having the same problem as rEnr3n, running Tomato Firmware RAF1.28.121006 by Victek. The log contains this: user.notice root: ADBLOCK ERROR: cannot start pixelserv
Please check the log, pixelserv should leave a message. If you are using stock Tomato with .oldT you normally remove the .oldT suffix, you also must move the web gui off the normal http port 80, and the the old httpd listens on all router IP addresses - this is fixed in Tomatousb.
Hi i have a question, is it possible to add lists like these? They are from adblock plus from firefox https://easylist-downloads.adblockplus.org/easylistgermany.txt https://easylist-downloads.adblockplus.org/easylist.txt https://easylist-downloads.adblockplus.org/easyprivacy.txt http://easylist-msie.adblockplus.org/easyprivacy.tpl I added these in the script and the urls show up when loading but actually noting is loaded from these urls. I think it does need some kind of formating or something? i have no clue thank you very much in advance!
After rebooting my router, these are the pixelserv-related lines from the log, as far as I can see: Code: May 17 21:27:39 unknown daemon.info pixelserv[424]: /tmp/pixelserv V27 compiled: Dec 12 2010 22:57:42 from pixelserv27.c May 17 21:27:39 unknown daemon.err pixelserv[427]: Abort: Address already in use May 17 21:27:40 unknown user.notice root: ADBLOCK ERROR: cannot start pixelserv I tried running the oldT version for this. Ads are blocked, but with error message. Not too tech savvy, unfortunately, but please let me know if I can provide more information to sort this out!
@samsara00: no, it's not possible to add rules from adblock, because it doesn't use the same syntax. @TucknDar: do you know how to update the encoded part of the script ? if you can't, I can post an updated version for you if you want. AtTheAsylum found a problem and posted a fix, but you need to update the script. Take a look at this post. http://www.linksysinfo.org/forums/showpost.php?p=375158&postcount=196
I forgot to check the logs. My error is about "address already in use". So I changed the default http web gui port 80 to another. I also renamed pixelserv.oldT to pixelserv as suggested by mstombs. Pixelserv seems to be running fine now.
Ah, yes, I do remember actually checking that out previously... I changed it in ADBLOCK.sh, but I think that version must've been changed, so I lost this little change. I'm afraid I don't know how to update the encoded part (except editing ADBLOCK.sh, changes which may be lost I suppose), so would love it if you'd post an updated script
Hello I'm loving this script. However, I had a question. Is it possible to have the script work on all internal IPs except a specific one? What I mean is the script works a tad weird on my xbox 360 and I want to know if I can possibly exclude it somehow from the rules.
So, what are common cause of the script not working at all? DNS flushed repeatedly on the client. Tomato Firmware v1.27.9047 MIPSR2-beta16 K26 USB Ext on a Netgear WNR3500L/U/v2 Code: Jan 1 01:00:08 tomato syslog.info syslogd started: BusyBox v1.16.1 Jan 1 01:00:09 tomato user.notice kernel: klogd started: BusyBox v1.16.1 (2010-06-10 23:45:49 EDT) Jan 1 01:00:09 tomato user.notice kernel: Linux version 2.6.22.19 (root@tomato) (gcc version 4.2.4) #1 Fri Jun 11 00:29:28 EDT 2010 Jan 1 01:00:09 tomato user.warn kernel: CPU revision is: 00019740 Jan 1 01:00:09 tomato user.warn kernel: Found a 8MB ST compatible serial flash Jan 1 01:00:09 tomato user.warn kernel: Determined physical RAM map: Jan 1 01:00:09 tomato user.warn kernel: memory: 04000000 @ 00000000 (usable) Jan 1 01:00:09 tomato user.debug kernel: On node 0 totalpages: 16384 Jan 1 01:00:09 tomato user.debug kernel: Normal zone: 128 pages used for memmap Jan 1 01:00:09 tomato user.debug kernel: Normal zone: 0 pages reserved Jan 1 01:00:09 tomato user.debug kernel: Normal zone: 16256 pages, LIFO batch:3 Jan 1 01:00:09 tomato user.warn kernel: Built 1 zonelists. Total pages: 16256 Jan 1 01:00:09 tomato user.notice kernel: Kernel command line: root=/dev/mtdblock2 noinitrd console=ttyS0,115200 Jan 1 01:00:09 tomato user.warn kernel: Primary instruction cache 32kB, physically tagged, 4-way, linesize 32 bytes. Jan 1 01:00:09 tomato user.warn kernel: Primary data cache 32kB, 4-way, linesize 32 bytes. Jan 1 01:00:09 tomato user.info kernel: Synthesized TLB refill handler (20 instructions). Jan 1 01:00:09 tomato user.info kernel: Synthesized TLB load handler fastpath (32 instructions). Jan 1 01:00:09 tomato user.info kernel: Synthesized TLB store handler fastpath (32 instructions). Jan 1 01:00:09 tomato user.info kernel: Synthesized TLB modify handler fastpath (31 instructions). Jan 1 01:00:09 tomato user.warn kernel: PID hash table entries: 256 (order: 8, 1024 bytes) Jan 1 01:00:09 tomato user.warn kernel: CPU: BCM4716 rev 1 pkg 10 at 453 MHz Jan 1 01:00:09 tomato user.warn kernel: Using 226.500 MHz high precision timer. Jan 1 01:00:09 tomato user.warn kernel: Dentry cache hash table entries: 8192 (order: 3, 32768 bytes) Jan 1 01:00:09 tomato user.warn kernel: Inode-cache hash table entries: 4096 (order: 2, 16384 bytes) Jan 1 01:00:09 tomato user.info kernel: Memory: 62060k/65536k available (2063k kernel code, 3412k reserved, 442k data, 108k init, 0k highmem) Jan 1 01:00:09 tomato user.info kernel: SLUB: Genslabs=6, HWalign=32, Order=0-1, MinObjects=4, CPUs=1, Nodes=1 Jan 1 01:00:09 tomato user.debug kernel: Calibrating delay loop... 225.28 BogoMIPS (lpj=112640) Jan 1 01:00:09 tomato user.warn kernel: Mount-cache hash table entries: 512 Jan 1 01:00:09 tomato user.info kernel: NET: Registered protocol family 16 Jan 1 01:00:09 tomato user.warn kernel: PCI: Using membase 8000000 Jan 1 01:00:09 tomato user.warn kernel: PCI: Disabled Jan 1 01:00:09 tomato user.warn kernel: PCI: Fixing up bus 0 Jan 1 01:00:09 tomato user.warn kernel: PCI: Fixing up bus 1 Jan 1 01:00:09 tomato user.info kernel: Time: MIPS clocksource has been installed. Jan 1 01:00:09 tomato user.info kernel: NET: Registered protocol family 2 Jan 1 01:00:09 tomato user.warn kernel: IP route cache hash table entries: 1024 (order: 0, 4096 bytes) Jan 1 01:00:09 tomato user.warn kernel: TCP established hash table entries: 2048 (order: 2, 16384 bytes) Jan 1 01:00:09 tomato user.warn kernel: TCP bind hash table entries: 2048 (order: 1, 8192 bytes) Jan 1 01:00:09 tomato user.info kernel: TCP: Hash tables configured (established 2048 bind 2048) Jan 1 01:00:09 tomato user.info kernel: TCP reno registered Jan 1 01:00:09 tomato user.info kernel: squashfs: version 3.0 (2006/03/15) Phillip Lougher Jan 1 01:00:09 tomato user.info kernel: io scheduler noop registered (default) Jan 1 01:00:09 tomato user.info kernel: HDLC line discipline: version $Revision: 4.8 $, maxframe=4096 Jan 1 01:00:09 tomato user.info kernel: N_HDLC line discipline registered. Jan 1 01:00:09 tomato user.info kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing disabled Jan 1 01:00:09 tomato user.info kernel: serial8250: ttyS0 at MMIO 0x0 (irq = 8) is a 16550A Jan 1 01:00:09 tomato user.info kernel: PPP generic driver version 2.4.2 Jan 1 01:00:09 tomato user.info kernel: NET: Registered protocol family 24 Jan 1 01:00:09 tomato user.info kernel: PPPoL2TP kernel driver, V0.17 Jan 1 01:00:09 tomato user.info kernel: PPTP driver version 0.8.4 Jan 1 01:00:09 tomato user.err kernel: pflash: found no supported devices Jan 1 01:00:09 tomato user.notice kernel: Creating 6 MTD partitions on "sflash": Jan 1 01:00:09 tomato user.notice kernel: 0x00000000-0x00040000 : "pmon" Jan 1 01:00:09 tomato user.notice kernel: 0x00040000-0x007e0000 : "linux" Jan 1 01:00:09 tomato user.notice kernel: 0x00118400-0x00750000 : "rootfs" Jan 1 01:00:09 tomato user.notice kernel: 0x00750000-0x007e0000 : "jffs2" Jan 1 01:00:09 tomato user.notice kernel: 0x007f0000-0x00800000 : "nvram" Jan 1 01:00:09 tomato user.notice kernel: 0x007e0000-0x007f0000 : "board_data" Jan 1 01:00:09 tomato user.warn kernel: u32 classifier Jan 1 01:00:09 tomato user.warn kernel: OLD policer on Jan 1 01:00:09 tomato user.warn kernel: Netfilter messages via NETLINK v0.30. Jan 1 01:00:09 tomato user.warn kernel: nf_conntrack version 0.5.0 (512 buckets, 4096 max) Jan 1 01:00:09 tomato user.warn kernel: ip_tables: (C) 2000-2006 Netfilter Core Team Jan 1 01:00:09 tomato user.warn kernel: BCM fast NAT: INIT Jan 1 01:00:09 tomato user.info kernel: NET: Registered protocol family 1 Jan 1 01:00:09 tomato user.info kernel: NET: Registered protocol family 17 Jan 1 01:00:09 tomato user.info kernel: 802.1Q VLAN Support v1.8 Ben Greear <greearb@candelatech.com> Jan 1 01:00:09 tomato user.info kernel: All bugs added by David S. Miller <davem@redhat.com> Jan 1 01:00:09 tomato user.warn kernel: VFS: Mounted root (squashfs filesystem) readonly. Jan 1 01:00:09 tomato user.info kernel: Freeing unused kernel memory: 108k freed Jan 1 01:00:09 tomato user.warn kernel: Warning: unable to open an initial console. Jan 1 01:00:09 tomato user.warn kernel: et: module license 'unspecified' taints kernel. Jan 1 01:00:09 tomato user.debug kernel: PCI: Setting latency timer of device 0000:00:02.0 to 64 Jan 1 01:00:09 tomato user.warn kernel: eth0: Broadcom BCM47XX 10/100/1000 Mbps Ethernet Controller 5.10.56.46 Jan 1 01:00:09 tomato user.debug kernel: PCI: Setting latency timer of device 0000:00:01.0 to 64 Jan 1 01:00:09 tomato user.warn kernel: eth1: Broadcom BCM4329 802.11 Wireless Controller 5.10.56.46 Jan 1 01:00:09 tomato user.warn kernel: net/ipv4/netfilter/tomato_ct.c [Jun 11 2010 00:35:35] Jan 1 01:00:09 tomato user.warn kernel: Algorithmics/MIPS FPU Emulator v1.5 Jan 1 01:00:09 tomato user.warn kernel: nf_conntrack_rtsp v0.6.21 loading Jan 1 01:00:09 tomato user.warn kernel: nf_nat_rtsp v0.6.21 loading Jan 1 01:00:09 tomato user.info kernel: JFFS2 version 2.2. (NAND) © 2001-2006 Red Hat, Inc. Jan 1 01:00:10 tomato user.debug kernel: vlan1: add 01:00:5e:00:00:01 mcast address to master interface Jan 1 01:00:10 tomato user.info kernel: vlan1: dev_set_promiscuity(master, 1) Jan 1 01:00:10 tomato user.info kernel: device eth0 entered promiscuous mode Jan 1 01:00:10 tomato user.info kernel: device vlan1 entered promiscuous mode Jan 1 01:00:10 tomato user.info kernel: device eth1 entered promiscuous mode Jan 1 01:00:10 tomato user.info kernel: br0: port 2(eth1) entering learning state Jan 1 01:00:10 tomato user.info kernel: br0: port 1(vlan1) entering learning state Jan 1 01:00:10 tomato user.info kernel: br0: topology change detected, propagating Jan 1 01:00:10 tomato user.info kernel: br0: port 2(eth1) entering forwarding state Jan 1 01:00:10 tomato user.info kernel: br0: topology change detected, propagating Jan 1 01:00:10 tomato user.info kernel: br0: port 1(vlan1) entering forwarding state Jan 1 01:00:10 tomato user.warn kernel: vlan2: Setting MAC address to c0 3f 0e aa 91 9d. Jan 1 01:00:10 tomato user.debug kernel: vlan2: add 01:00:5e:00:00:01 mcast address to master interface Jan 1 01:00:10 tomato user.info redial[395]: Started. Time: 30 Jan 1 01:00:10 tomato daemon.info pppoe[398]: Starting Jan 1 01:00:10 tomato daemon.info pppoe[398]: Sending PADI. Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received PADO. Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending PADR. Jan 1 01:00:11 tomato cron.info crond[405]: crond: crond (busybox 1.16.1) started, log level 8 Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received PADS. SID: 0x1331 Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending LCP Configuration-Request Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received LCP Configuration-Request Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending LCP Configuration-Ack Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received LCP Configuration-Ack Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending PAP Authenticate-Request. Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: started, version 2.55 cachesize 150 Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: compile time options: no-IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP no-scripts TFTP Jan 1 01:00:11 tomato daemon.info dnsmasq-dhcp[419]: DHCP, IP range 10.0.0.2 -- 10.0.0.11, lease time 1d Jan 1 01:00:11 tomato daemon.warn dnsmasq[419]: failed to access /etc/resolv.dnsmasq: No such file or directory Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: read /etc/hosts - 2 addresses Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: read /etc/hosts.dnsmasq - 1 addresses Jan 1 01:00:11 tomato user.info init[1]: Tomato 1.27.9047 MIPSR2-beta16 K26 USB Ext Jan 1 01:00:11 tomato user.info init[1]: Netgear WNR3500L/U/v2 Jan 1 01:00:11 tomato daemon.info pppoe[398]: PAP authentication succeeded. Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending IPCP Configuration-Request Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received IPCP Configuration-Nak Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending IPCP Configuration-Request Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received IPCP Configuration-Ack Jan 1 01:00:11 tomato daemon.info pppoe[398]: Received IPCP Configuration-Request Jan 1 01:00:11 tomato daemon.info pppoe[398]: Sending IPCP Configuration-Ack Jan 1 01:00:11 tomato daemon.notice pppoe[398]: Connected. Jan 1 01:00:11 tomato daemon.notice pppoe[398]: IP Address: 85.164.113.173 Jan 1 01:00:11 tomato daemon.notice pppoe[398]: DNS Address: 130.67.15.198, 193.213.112.4 Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: reading /etc/resolv.dnsmasq Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: using nameserver 195.159.0.200#53 Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: using nameserver 81.175.0.66#53 Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: using nameserver 195.159.0.100#53 Jan 1 01:00:11 tomato daemon.info dnsmasq[419]: exiting on receipt of SIGTERM Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: started, version 2.55 cachesize 150 Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: compile time options: no-IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP no-scripts TFTP Jan 1 01:00:11 tomato daemon.info dnsmasq-dhcp[431]: DHCP, IP range 10.0.0.2 -- 10.0.0.11, lease time 1d Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: reading /etc/resolv.dnsmasq Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: using nameserver 195.159.0.200#53 Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: using nameserver 81.175.0.66#53 Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: using nameserver 195.159.0.100#53 Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: read /etc/hosts - 2 addresses Jan 1 01:00:11 tomato daemon.info dnsmasq[431]: read /etc/hosts.dnsmasq - 1 addresses Jan 1 01:00:13 tomato user.info rcheck[447]: Time not yet set. Only "all day, everyday" restrictions will be activated. Jan 1 01:00:13 tomato user.info kernel: TCP vegas registered May 31 19:21:47 tomato user.info ntpc[504]: Time Updated: Tue, 31 May 2011 19:21:47 +0200 [+1306862493s] May 31 19:21:49 tomato daemon.info dnsmasq-dhcp[431]: DHCPREQUEST(br0) 10.0.0.7 00:50:8d:ba:6c:79 May 31 19:21:49 tomato daemon.info dnsmasq-dhcp[431]: DHCPACK(br0) 10.0.0.7 00:50:8d:ba:6c:79 esben May 31 19:21:56 tomato daemon.info dnsmasq-dhcp[431]: DHCPDISCOVER(br0) 00:1e:e5:9c:9b:78 May 31 19:21:56 tomato daemon.info dnsmasq-dhcp[431]: DHCPOFFER(br0) 10.0.0.6 00:1e:e5:9c:9b:78 May 31 19:21:56 tomato daemon.info dnsmasq-dhcp[431]: DHCPREQUEST(br0) 10.0.0.6 00:1e:e5:9c:9b:78 May 31 19:21:56 tomato daemon.info dnsmasq-dhcp[431]: DHCPACK(br0) 10.0.0.6 00:1e:e5:9c:9b:78 otto May 31 19:22:04 tomato user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml May 31 19:22:05 tomato user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains May 31 19:22:07 tomato user.notice root: ADBLOCK: http://www.malwaredomainlist.com/hostslist/hosts.txt May 31 19:22:07 tomato user.notice root: ADBLOCK: http://www.mvps.org/winhelp2002/hosts.txt May 31 19:22:08 tomato user.notice root: ADBLOCK: 17522 entries May 31 19:22:08 tomato user.notice root: ADBLOCK: sorting hosts... May 31 19:22:26 tomato daemon.info dnsmasq-dhcp[431]: DHCPREQUEST(br0) 10.0.0.6 00:1e:e5:9c:9b:78 May 31 19:22:26 tomato daemon.info dnsmasq-dhcp[431]: DHCPACK(br0) 10.0.0.6 00:1e:e5:9c:9b:78 otto May 31 19:22:34 tomato cron.err crond[405]: time disparity of 21781042 minutes detected May 31 19:22:36 tomato daemon.info dnsmasq-dhcp[431]: DHCPREQUEST(br0) 10.0.0.8 00:1e:e5:29:f5:33 May 31 19:22:36 tomato daemon.info dnsmasq-dhcp[431]: DHCPACK(br0) 10.0.0.8 00:1e:e5:29:f5:33 Maggi May 31 19:22:52 tomato user.notice root: ADBLOCK: hosts sorted. May 31 19:22:52 tomato user.notice root: ADBLOCK: 16751 entries May 31 19:22:52 tomato daemon.info dnsmasq[431]: exiting on receipt of SIGTERM May 31 19:22:54 tomato daemon.info dnsmasq[910]: started, version 2.55 cachesize 150 May 31 19:22:54 tomato daemon.info dnsmasq[910]: compile time options: no-IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP no-scripts TFTP May 31 19:22:54 tomato daemon.info dnsmasq-dhcp[910]: DHCP, IP range 10.0.0.2 -- 10.0.0.11, lease time 1d May 31 19:22:54 tomato daemon.info dnsmasq[910]: reading /etc/resolv.dnsmasq May 31 19:22:54 tomato daemon.info dnsmasq[910]: using nameserver 195.159.0.200#53 May 31 19:22:54 tomato daemon.info dnsmasq[910]: using nameserver 81.175.0.66#53 May 31 19:22:54 tomato daemon.info dnsmasq[910]: using nameserver 195.159.0.100#53 May 31 19:22:54 tomato daemon.info dnsmasq[910]: read /etc/hosts - 2 addresses May 31 19:22:54 tomato daemon.info dnsmasq[910]: read /etc/hosts.dnsmasq - 1 addresses May 31 19:22:54 tomato user.notice root: ADBLOCK: dnsmasq is running
the log seems fine, did you try to enter a host from the blocklist? I also recommend you ADD_CONF="Y", because your dnsmasq is started with a cache of 150.
Went through 1, 2, 3 and 4 and tried random sites in IE(used maybe once before in the last year, so pretty much a clean install of IE). 90% of them went though(assuming the rest were down)
hi, this script already rocks and will make things easier for me. but is something like this possible on tomato, but for iptables, and to grab lists from iblocklist.org? i hear running iptables on small devices might clogg to much ram, i am using a wrn3500l with currently about 50mb ram left, and i am using a bunch of blocklists, will that even work? if it would, then i could keep my pc clean from security apps like adblock or peerblock and have my router do all the work... thx in advance~ aLGee
@Tordenflesk: sorry, I don't know why it doesn't work for you. Does your PC use your router as a DNS server, isn't it configured with a static DNS ? @algee: I tried once on my WRT54GL, it was slow to enter all the rules, and it couldn't go through completely, it crashed the router.
It does get it's DNS's from the router. Could it be as simple as my machine bypassing the router for DNS? I had always assumed that when setting a connection to "obtain DNS Server Address Automatically" it would use the router for DNS. Is there something I should select under "Advanced->DHCP/DNS"?. atm none are selected.
Try with following option: > Intercept DNS port (UDP 53) you can also enable: > Use internal DNS > Prevent DNS-rebind attack
pixelserv I'm trying to use the script again, on another router, and I'm running into the same problem again: pixelserv only works every other day. (because the script alternately runs and kills pixelserv each time it's executed) This has been confirmed by monitoring top (as well as the log) while executing script_wanup.sh. It's as if the -SIGUSR1 option doesn't do anything, and the process is killed, even though it isn't supposed to be. (maybe it was supposed to be -SIGHUP, which causes a line to be added to my log, but doesn't kill the process?)
Hi i just installed the ad-block script to the wan up section in tomatousb...i didnt understand the section about generateing the script using the second one....Am i running the ad-blocking script correctly if i simply added the first script and rebooted the router? Also if i wanted to run pixelserv...do i download the zip file and install the pixserve27 folder into the /tmp folder in optware? Anything else needed from there?
Ugh. I just re-downloaded the version referred to in your sig, and everything works correctly now. I don't really understand it, but I must have ended up with a different version of pixelserv somehow. Sorry to have wasted your time.
You don't have to worry about the second script; I didn't have to. You'll have to extract the zip and place the contents on a writable directory like /jffs so it would survive a reboot. You would have to enable jffs to use it. Change the pixelserv settings accordingly.
Yes, the main script is the first one, you only need to use this one. But inside there's an obfuscated part, it's the second script I posted, if people wants to read it and see there's nothing dangerous inside. There are 2 ways to run pixelserv. Do you have an usb HDD connected to your router? If not, you have to put pixelserv (from the zip) on a server and specify the URL so the router can download it.
OK i understand now why you posted the second script... Yes i have a HDD connected to my Asus RT-N16 and have optware installed...is this the optimal way? Whichever is easiest...for a noob.
You can copy pixelserv on your HDD and specify the path in PXL_EXE, the script will use it if it find it.
Can u explain further? Also could to tell me where i can put the pixelserv folder in opt? I prefer not to install it directly into the root directory...also running your script currently i have no issues with an error messages popping up because of blocked ads....would it still be necessary to run pixelserv?
nope, pixelserv replace the error message in the ad space. You get a blank instead of the error. Do you know how to access your HDD from your router ? Or maybe you can store pixelserv on a webserv or dropbox ?
yes i am able to access the hdd from my computer and am familiar with telnet'ing into my router...there is no pixelserv program in the list of optware packages...so i just want to know where can i store the pixelserve27 folder in my opt folder...
you download it from the URL in my sig, you put the right file inside the zip on you HDD, and you replace PXL_EXE with the path to the file from your router to your HDD.
I seem to be having trouble with getting this to work right now after it was working when I set it up 4 or 5 hours ago. It was working when all I did was paste the script into the WAN Up tab. I went to setup the pixelserv and it seems have broken the ad blocking and I can't even get it working like it was before. Here is my log file from when pixelserv starts up. Code: Jul 6 17:05:20 Skynet daemon.info pixelserv[675]: /tmp/pixelserv V27 compiled: Dec 12 2010 21:49:05 from pixelserv27.c Jul 6 17:05:20 Skynet daemon.notice pixelserv[677]: Listening on br0 192.168.1.3:80 Jul 6 17:05:24 Skynet user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml Jul 6 17:05:25 Skynet user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains Jul 6 17:05:26 Skynet user.notice root: ADBLOCK: http://www.malwaredomainlist.com/hostslist/hosts.txt Jul 6 17:05:29 Skynet user.notice root: ADBLOCK: http://www.mvps.org/winhelp2002/hosts.txt Jul 6 17:05:30 Skynet user.notice root: ADBLOCK: 31955 entries Jul 6 17:05:30 Skynet user.notice root: ADBLOCK: sorting hosts... Jul 6 17:05:46 Skynet daemon.info dnsmasq-dhcp[415]: DHCPREQUEST(br0) 192.168.1.111 a4:67:06:20:a6:2e Jul 6 17:05:46 Skynet daemon.info dnsmasq-dhcp[415]: DHCPACK(br0) 192.168.1.111 a4:67:06:20:a6:2e iPad Jul 6 17:05:57 Skynet cron.err crond[396]: time disparity of 21833105 minutes detected Jul 6 17:06:26 Skynet user.notice root: ADBLOCK: hosts sorted. Jul 6 17:06:26 Skynet user.notice root: ADBLOCK: 24565 entries Jul 6 17:06:27 Skynet daemon.info dnsmasq[415]: exiting on receipt of SIGTERM Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: started, version 2.55 cachesize 4096 Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP no-scripts TFTP Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: asynchronous logging enabled, queue limit is 5 messages Jul 6 17:06:27 Skynet daemon.info dnsmasq-dhcp[854]: DHCP, IP range 192.168.1.100 -- 192.168.1.149, lease time 1d Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: reading /etc/resolv.dnsmasq Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: using nameserver 172.27.35.1#53 Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: read /etc/hosts - 2 addresses Jul 6 17:06:27 Skynet daemon.info dnsmasq[854]: read /etc/hosts.dnsmasq - 8 addresses Jul 6 17:06:27 Skynet user.notice root: ADBLOCK: dnsmasq is running Jul 6 17:08:14 Skynet daemon.info dnsmasq[854]: exiting on receipt of SIGTERM Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: started, version 2.55 cachesize 4096 Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP no-scripts TFTP Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: asynchronous logging enabled, queue limit is 5 messages Jul 6 17:08:14 Skynet daemon.info dnsmasq-dhcp[892]: DHCP, IP range 192.168.1.100 -- 192.168.1.149, lease time 1d Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: reading /etc/resolv.dnsmasq Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: using nameserver 172.27.35.1#53 Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: read /etc/hosts - 2 addresses Jul 6 17:08:14 Skynet daemon.info dnsmasq[892]: read /etc/hosts.dnsmasq - 8 addresses Pixelserv is serving the image fine since if I open my browser to 192.168.1.3 it will show the 1 pixel gif image, but the ads are still there. Even when I disable the pixelserv and have it set how it was when it was working the ads are still showing up. I have tried deleting all the files in the /tmp/ directory that were created by the ad block, I have tried removing the script and pasting it back in, I have played around with a few settings to see if I could get it working but nothing seems to be doing the trick. I have restarted between all fix attempts. Any input would be great, as I seem to be at a loss. Been playing with this for the last hour or so with no luck.
You're script is badass (i mean in a good way). Thanks a lot for your kind contribution. I started using remote whitelist & pastebin dot com and it works damn well. Now I restart the router whenever I add an entry into whitelist. Is there an easier way to refresh whitelist in router's memory? I tried running /tmp/adblock.sh but log says 'no updates' - looks like it only checks sources S1..S7. edit: @srouquette: Okay now it works. : D
@gren238: try this: http://www.linksysinfo.org/forums/showpost.php?p=376709&postcount=229 @windozer: /tmp/ADBLOCK.sh --force
Ad Block Is anyone else having a problem with the cron job not restarting pixelserv? Jul 12 04:00:01 mainrouter syslog.info root: -- MARK -- Jul 12 04:00:02 mainrouter user.notice root: ADBLOCK ERROR: cannot start pixelserv Jul 12 04:00:23 mainrouter user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml Jul 12 04:00:24 mainrouter user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains Jul 12 04:00:35 mainrouter user.notice root: ADBLOCK: http://www.malwaredomainlist.com/hostslist/hosts.txt Jul 12 04:00:39 mainrouter user.notice root: ADBLOCK: http://www.mvps.org/winhelp2002/hosts.txt Jul 12 04:00:49 mainrouter user.notice root: ADBLOCK: http://hosts-file.net/hphosts-partial.asp Jul 12 04:00:51 mainrouter user.notice root: ADBLOCK: 82896 entries Jul 12 04:00:52 mainrouter user.notice root: ADBLOCK: sorting hosts... Jul 12 04:04:34 mainrouter user.notice root: ADBLOCK: hosts sorted. Jul 12 04:04:34 mainrouter user.notice root: ADBLOCK: 45317 entries Jul 12 04:04:36 mainrouter daemon.info dnsmasq[1599]: exiting on receipt of SIGTERM Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: started, version 2.57 cachesize 150 Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP TFTP no-IDN Jul 12 04:04:38 mainrouter daemon.info dnsmasq-dhcp[5079]: DHCP, IP range 192.168.1.100 -- 192.168.1.149, lease time 1d Jul 12 04:04:38 mainrouter user.notice root: ADBLOCK: dnsmasq is running Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: reading /etc/resolv.dnsmasq Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: using nameserver 68.87.77.134#53 Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: using nameserver 68.87.72.134#53 Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: read /etc/hosts - 2 addresses Jul 12 04:04:38 mainrouter daemon.info dnsmasq[5079]: read /etc/dnsmasq/hosts/hosts - 13 addresses Jul 12 04:04:38 mainrouter daemon.info dnsmasq-dhcp[5079]: read /etc/dnsmasq/dhcp/dhcp-hosts
my gen.last just got last-modified date log and my gen.md5 just got a checksum num. It is normal ? Why can't i check the adblock list somewhere ? Thanks.
@peyton: ah you're right, I delete the file at the end to free some space. edit ADBLOCK.sh and comment the last line (CLR). To do so: vi /tmp/ADBLOCK.sh (move to the last line) press i add # press escape then type :wq
Not essential info and don't ask for details but I tried this with stock Tomato 1.28 on a wrt54-GL 1.1 and it worked ok BUT everything wireless was gone. Some weird stuff like beacon field had no value was also a side effect. Broadcasting turning itself off another. Tried a Victec release, same result. Tried Kernel 2.4 (stable) NoUSB Std version from here http://tomatousb.org/download and wireless works! And still no problems with ad-blocking. I use both own black and white list from a ftp server on a NAS. No problems. Feel free to reproduce - there are quite a few of those routers still in action so why I post.
(Linksys WRT54G/GS/GL - Tomato Firmware RAF1.28.121006) Code: Jan 1 01:00:07 GateWatcher daemon.info dnsmasq[93]: read /etc/hosts - 0 addresses Jan 1 01:00:08 GateWatcher daemon.info dnsmasq[93]: read /etc/hosts.dnsmasq - 7 addresses Jan 1 01:00:08 GateWatcher daemon.info httpd[96]: Generating SSL certificate... Aug 23 04:46:32 GateWatcher user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml Aug 23 04:46:33 GateWatcher cron.err crond[88]: time disparity of 21901126 minutes detected Aug 23 04:46:36 GateWatcher user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains Aug 23 04:46:47 GateWatcher user.notice root: ADBLOCK: http://www.mvps.org/winhelp2002/hosts.txt Aug 23 04:47:45 GateWatcher user.notice root: ADBLOCK: http://hosts-file.net/hphosts-partial.asp Aug 23 04:47:52 GateWatcher user.notice root: ADBLOCK: 124888 entries Aug 23 04:47:52 GateWatcher user.notice root: ADBLOCK: sorting hosts... Aug 23 04:57:15 GateWatcher user.notice root: ADBLOCK: hosts sorted. Aug 23 04:57:15 GateWatcher user.notice root: ADBLOCK: 61690 entries Aug 23 04:57:23 GateWatcher daemon.info dnsmasq[93]: exiting on receipt of SIGTERM Aug 23 04:57:31 GateWatcher user.err kernel: Out of Memory: Killed process 494 (dnsmasq). Aug 23 04:57:31 GateWatcher user.notice kernel: VM: killing process dnsmasq Aug 23 04:57:31 GateWatcher user.notice root: ADBLOCK ERROR: restarting dnsmasq... Aug 23 04:57:31 GateWatcher daemon.info dnsmasq[501]: started, version 2.55 cachesize 150 Aug 23 04:57:31 GateWatcher daemon.info dnsmasq[501]: compile time options: no-IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP no-scripts no-TFTP Hello, i got this error: Aug 23 04:57:31 GateWatcher user.err kernel: Out of Memory: Killed process 494 (dnsmasq) What can i do? Thanks
Remove source no. 5 from GETS. That one is far too large for your router. Basic sources will give you around 25000 blocked hosts after optimization. 61690 is WAAAY too much for WRT series (except maybe for GS or G-TM series with 32 MB ram) Keep GETS on default value and post results GETS="1 2 3 4"
Thanks for this! I'm currently setting it up on my router with some modifications. I had written my own solution from scratch but I like the configurability of this one. Thoughts: Would be nice to have the hard-coded /tmp file paths in the pre-encoded script moved up to the config script so that I can have everything live on a CIFS mount where they won't eat up precious router RAM on my old WRT54G. I found that someone is working on a project called nullserv, which is inspired by pixelserv but serves up a plethora of file types: https://code.launchpad.net/~flexiondotorg/ junk/nullserv My own script used just the yoyo and mvps sources, which add up to something like 17000 domain names after uniques are removed. I haven't really seen any ads slip through, so I agree with QSxx's post above
With the newer pixelserv27 I couldn't specify -n br0 in the runline, so I removed that. Also I do not have the ability to do WAN Up script, so I added a quick fix at the top here to ensure traffic is flowing before run. In case someone might be interested in this modification I figured I'd post it: Administration->Scripts->Init Code: ## ALL-U-NEED Ad Blocking v3.9d ## http://goo.gl/mhykQ ## Original script by YAQUI ## Updated by ~nephelim~, Syl, jochen, groosh, ng12345, ray123, mstombs ## base64 decoder by Danny Chouinard's while ! ping -c1 -w1 4.2.2.5; do sleep 10 done ADB="/tmp/ADBLOCK.sh" { cat <<'ENDF' >$ADB #!/bin/sh OPTIMISE="Y" GETS="1 2 3 4" TRIM_BEGIN=3 S1="http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml" #44K S2="http://mirror1.malwaredomains.com/files/justdomains" #189K S3="http://www.malwaredomainlist.com/hostslist/hosts.txt" #97K S4="http://www.mvps.org/winhelp2002/hosts.txt" #620K S5="http://hosts-file.net/hphosts-partial.asp" #460K S6="http://hostsfile.mine.nu/Hosts" #2641K S7="http://support.it-mate.co.uk/downloads/hosts.txt" #3851K USEWHITELIST="N" # N/Y/R for remote WURL="http://example.com/whitelist.txt" WHITE="intel.com" BLACK="" USEPIXELSERV="Y" PXL_IP=192.168.0.253 PXL_EXE="/jffs/bin/pixelserv" PXL_URL="" UPLOAD="N" FTP_SERVER="example.com" FTP_USER="" FTP_PASS="" FTP_PORT=21 FTP_PATH="/gen" ADD_CONF="N" USEHOSTS="N" ROUTER="Y" NIP="0.0.0.0" ENDF } UPDATE="Y" AUP() { if [[ "$UPDATE" == "Y" ]] ; then if [[ "$(cru l | grep AdUpd | cut -d '#' -f2)" != "AdUpd" ]] ; then cru a AdUpd "0 4 * * * $ADB" fi fi } #### DO NOT EDIT BELOW #### b64="openssl enc -base64 -d" [[ "$(echo WQ==|$b64)" != "Y" ]] && b64="b64" b64(){ awk 'BEGIN{b64="ABCDEFGHIJKLMNOPQRSTUVWXYZabcdefghijklmnopqrstuvwxyz0123456789+/"} {for(i=1;i<=length($0);i++){c=index(b64,substr($0,i,1));if(c--) for(b=0;b<6;b++){o=o*2+int(c/32);c=(c*2)%64;if(++obc==8){if(o) {printf"%c",o}else{system("echo -en \"\\0\"")}obc=o=0}}}}';} { cat <<'ENDF'| $b64 |gunzip >>$ADB H4sICJBuWE4AA2lucHV0AK0Xa2/aSPC7f8V046shV2PINXcV1JEIj4BKAGFy6SkkFbUXWBVsajuP Xuh/v9lZGwwkbaReIGJ3dnber60OzhxbP9DOGl2bWfFiaU25z7TheT/ZxnyxZFqt120mADfwJ0xr 9Zyhk0BmQRRHTLtstjuNBHQ/EzFnGv6JCVxdgV5FPvDKhiJcX8NqJWFMzy0jWME05EswORimKWkb Kcjwg8+B983IM7BtYAxvViCecV8LF2BOQEeZCwvvOLudj6NYmwjJuNYZ5PLwmDlNl6hcupR6pWuS X/su7/Y/duiuEp7pF06j3/7Y6DiNwd9Kmn8y4iisV2A+gI43PzU+NjaH91Meg9nbnNDiYtDR3Nki 8OD3zSUpuJhIG4gpfA6L5aI6avfXguSWwgsmsBQPfB7x8G7PNjt82v0KRHOO1ixBBeQdgC9iPgfT aZ9dOIMS7JOsAMnxQobaPJhOeQjV+mmnV/sAjcGgNyiDO/b9IIYoHofx5rYmfzR+N54D67b7diIj k5rjl2zfrZHpL7r1RtMuapMgBAHClx4cOhXwAlAEbsO5zUa6owsGWr9k6znuzgLQEb6CiHtgRKub WRwvr6Lrw7JlXd1Y14ejnFU4HOX11ai0MvJa6+fXRjl1MY8X02tSpgcpUwmO4A8pkxaLBU9pYSyz VqNaRxeUoDUc9q1SoTQKR34LE6UMeos2tcD3uRuLwEdrzYOISyBbab4L5j0cSzR4V1yp7BDQwcg2 zwNPTAT3yqs4BNMDNgpZnnyFrpIiMJlj0jtJNHwO+fgLOdQLfL6NaW9hKnuXCFdZRGKdnFBa+fxe EVAUdEJGPb+iBVICO1lIhBR6Fpyia+d1aXtM3+h2sTleubcxKYYfc1LKA+Id7eChMPtoiWZIVSmG q6O1cjsxWgY/AHc29qc8gkj4LgcSTSr8BviDiIU/LWTLitRfwpM4XdxlTzKVhwJ4OGifUwjLaDIF FjYtskYHGD6Whaub0tFfo0KRvqUrGMXXhwRXywSnXM4ezQN3PJdVVp5aN7rlGaqKEb+6Q9z2E2Uv T6SVqB7JaJdFycRau4kkOCGqsFXWdAHmlOMBavXptHHW7m5qjYQBOdodx+ruyYkqtbsWlxxV9v+w XqTCaWnEKos6w1z+EUPheDsUdsMgETnTG2S3ef2a9MDbMjL0HMmanOdJmV8IEuwyFdolpY0yB1md rLtTWtc6l63hblO5bLWHjU7bGe43FenOCJsoeZTw0CBJSAGz0rIlUVaqbFmjgjXC/6mRtzym3EA2 5PPnWQ4yrWMTHpfYn56OD2qS8ExaUdefiyihkEore3uSALDOBEOBk2BWvXdLZ+UnOsj/guovibhd uVWWExemn3aqtQ8MUk5JWo58ZKZgiQ5p5JOze/1tX+O+fd52Gvt+3rVhFIQysoCGqkKhkA0XGrr2 ScgrYN6CGagcJDFI8/H9FzCbYBQMMCh3H3sDnNrY90c0dU7Y3WZFnBQrwjTzy1D4qL9gB6yi1gzb 0XdDJZpksVqTO9ghV/EARfoNyYpJTvgef8jpxTde/pVdyj96tl5MKOqmiRw1xZvW29xZgekiyx3Z q5ok/bFrKbIQ2Yt7hUxZXpuAPFHrKk8Me0MsHvfYXOfwns7z+0UKkYD7cSh4pG43h/2L/nbW9ju9 av25IZDpg97FsDF4Ip/j5fKW3KQj0U/ozQGYS7XpVx0HzH6y6Q2GaiWnTcRKUIatjGN993+jlxm9 mvWuc75bo54JOneZ1lmcVCRKMs/++fZtCsikP85UK0PHkQ+ne+OJ85LArlgo4qcE6263RiSVE2xJ Sk5iY88LeRTZ1mtLEV4Za31Uva01z16mC1D7snjsWp4fLcbR14Icwimj6YEgj9MNvH/f6DU1ZO+b FIH25g2kyRMS9nmCWRGr9fqukAj6JNk8IeQL9FCTNdK0SVaWnbcJitxp2F5r1DxLFPJm7tIc38az IBTxOBZ3Ugl3xs1I/Mvto+LbdzJdzHH0zXftY9J0benTzodk4AnvBDbKRGmc/oPlS8RO8dUD0JyI OVcKKPmfPM7asUkTEFlo86I0kmt770lI2e6mf8pHRBDe+j5W4R/1D4w++biRtTp1MlbrZLkWDecD +ZqUzxoc1OQkQ4OALEuySdAvFRntpxWEspPCOgkcMjwqTw9eyUjT/gOO2nBizw8AAA== ENDF } chmod 775 $ADB $ADB AUP
strange are you not using the lan interface 'br0'? - that's a zero by the way this forums fonts aren't clear! Code: 27452 nobody 496 S /jffs/pixelserv -n br0
Hi Been using this script for a while now, and everything works fine when I first reboot the router. But when my modem disconnects from the router wich seems to be more and more often now. I noticed the following in my log file :::: Router Ausu RT-N16 with Toastman v1.28.7483 MIPSR2-Toastman-RT K26 USB VPN Pixelserv 27 Addblock 3.9d Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: started, version 2.57 cachesize 1500 Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP TFTP no-IDN Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: asynchronous logging enabled, queue limit is 5 messages Sep 8 10:22:21 Beast-Net daemon.info dnsmasq-dhcp[5984]: DHCP, IP range 192.168.1.100 -- 192.168.1.149, lease time 1d Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: reading /etc/resolv.dnsmasq Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: using nameserver 151.164.8.201#53 Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: using nameserver 68.94.156.1#53 Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: read /etc/hosts - 2 addresses Sep 8 10:22:21 Beast-Net daemon.info dnsmasq[5984]: read /etc/dnsmasq/hosts/hosts - 6 addresses Sep 8 10:22:21 Beast-Net daemon.info dnsmasq-dhcp[5984]: read /etc/dnsmasq/dhcp/dhcp-hosts Sep 8 10:22:28 Beast-Net user.info syslog: SNet version started Sep 8 10:22:28 Beast-Net daemon.notice miniupnpd[6389]: HTTP listening on port 19067 Sep 8 10:22:28 Beast-Net daemon.notice miniupnpd[6389]: Listening for NAT-PMP traffic on port 5351 Sep 8 10:22:43 Beast-Net daemon.info pixelserv[1078]: 56 requests, 0 errors, 0 bad, 26 gif, 30 txt replies Sep 8 10:22:48 Beast-Net user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml Sep 8 10:22:49 Beast-Net user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains Sep 8 10:22:50 Beast-Net user.notice root: ADBLOCK: http://www.malwaredomainlist.com/hostslist/hosts.txt Sep 8 10:22:50 Beast-Net user.notice root: ADBLOCK: http://www.mvps.org/winhelp2002/hosts.txt Sep 8 10:22:50 Beast-Net user.notice root: ADBLOCK: 19683 entries Sep 8 10:22:50 Beast-Net user.notice root: ADBLOCK: 0 entries Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6548]: [Beast] OK LOGIN: Client "192.168.1.1" Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP response: Client "192.168.1.1", "230 Login successful." Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP command: Client "192.168.1.1", "TYPE I" Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP response: Client "192.168.1.1", "200 Switching to Binary mode." Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP command: Client "192.168.1.1", "PASV" Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP response: Client "192.168.1.1", "227 Entering Passive Mode (192,168,1,1,231,39)." Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP command: Client "192.168.1.1", "STOR /gen" Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP response: Client "192.168.1.1", "150 Ok to send data." Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] OK UPLOAD: Client "192.168.1.1", "/gen", 0.00Kbyte/sec Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP response: Client "192.168.1.1", "226 Transfer complete." Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP command: Client "192.168.1.1", "QUIT" Sep 8 10:22:50 Beast-Net ftp.info vsftpd[6550]: [Beast] FTP response: Client "192.168.1.1", "221 Goodbye." Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[5984]: exiting on receipt of SIGTERM Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: started, version 2.57 cachesize 2048 Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP TFTP no-IDN Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: asynchronous logging enabled, queue limit is 5 messages Sep 8 10:22:50 Beast-Net daemon.info dnsmasq-dhcp[6564]: DHCP, IP range 192.168.1.100 -- 192.168.1.149, lease time 1d Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: reading /etc/resolv.dnsmasq Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: using nameserver 151.164.8.201#53 Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: using nameserver 68.94.156.1#53 Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: read /etc/hosts - 2 addresses Sep 8 10:22:50 Beast-Net daemon.info dnsmasq[6564]: read /etc/dnsmasq/hosts/hosts - 6 addresses Sep 8 10:22:50 Beast-Net daemon.info dnsmasq-dhcp[6564]: read /etc/dnsmasq/dhcp/dhcp-hosts Sep 8 10:22:51 Beast-Net user.notice root: ADBLOCK: dnsmasq is running Notice the ADDBLOCK enteries after down loading the lists. Then the zero entries. Of course after this addblocking no longer works. No gen file to be found in tmp dir. But gen.last and gen.md5 are there. Whats happening is a bit over my head so any help would be welcomed. Thanks Beast
There lies your problem. You should have a solid connection during the process of downloading the list, otherwise Adblock wont be able to properly work and sort out the ad list. This happens to me in one of my routers connected to an 3G HSPA+ modem. I have to make sure that the router gets an IP first for the adblock to work. I usually do not turn on the router for a couple of minutes and let the 3G HSPA+ modem get a solid connection before I turn on the router. Then everything works as usual.
Code: Jan 1 08:00:57 Cisco user.info init[1]: Linksys E3000: Tomato 1.28.7480 MIPSR2-Toastman-RT K26 USB VPN-NOCAT Jan 1 08:01:01 Cisco daemon.info dnsmasq[550]: reading /etc/resolv.dnsmasq Jan 1 08:01:01 Cisco daemon.info dnsmasq[550]: using nameserver XXX.106.7.2#53 Jan 1 08:01:01 Cisco daemon.info dnsmasq[550]: using nameserver XXX.106.5.2#53 Jan 1 08:01:01 Cisco daemon.info dnsmasq[550]: exiting on receipt of SIGTERM Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: started, version 2.57 cachesize 1500 Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: compile time options: IPv6 GNU-getopt no-RTC no-DBus no-I18N DHCP TFTP no-IDN Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: asynchronous logging enabled, queue limit is 5 messages Jan 1 08:01:01 Cisco daemon.info dnsmasq-dhcp[575]: DHCP, IP range 192.168.1.2 -- 192.168.1.254, lease time 7d Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: reading /etc/resolv.dnsmasq Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: using nameserver XXX.106.7.2#53 Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: using nameserver XXX.106.5.2#53 Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: read /etc/hosts - 2 addresses Jan 1 08:01:01 Cisco daemon.info dnsmasq[575]: read /etc/dnsmasq/hosts/hosts - 28 addresses Jan 1 08:01:01 Cisco daemon.info dnsmasq-dhcp[575]: read /etc/dnsmasq/dhcp/dhcp-hosts Sep 16 18:34:29 Cisco user.info syslog: SNet version started Sep 16 18:34:29 Cisco daemon.notice miniupnpd[984]: HTTP listening on port 43217 Sep 16 18:34:29 Cisco daemon.notice miniupnpd[984]: Listening for NAT-PMP traffic on port 5351 Sep 16 18:34:42 Cisco daemon.info pixelserv[1033]: /tmp/pixelserv V27 compiled: Dec 12 2010 21:49:05 from pixelserv27.c Sep 16 18:34:42 Cisco daemon.notice pixelserv[1035]: Listening on br0 192.168.1.234:80 Sep 16 18:34:52 Cisco user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml Sep 16 18:35:02 Cisco user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains Sep 16 18:35:03 Cisco user.notice root: ADBLOCK: http://www.malwaredomainlist.com/hostslist/hosts.txt Sep 16 18:35:11 Cisco user.notice root: ADBLOCK: http://www.mvps.org/winhelp2002/hosts.txt Sep 16 18:35:13 Cisco user.notice root: ADBLOCK: whitelist [URL]http://db.tt/XXXXXX[/URL] Sep 16 18:35:22 Cisco cron.err crond[556]: time disparity of 21936154 minutes detected Sep 16 18:35:26 Cisco user.notice root: ADBLOCK: 34684 entries Sep 16 18:35:26 Cisco user.notice root: ADBLOCK: sorting hosts... Sep 16 18:36:01 Cisco user.notice root: ADBLOCK: hosts sorted. Sep 16 18:36:01 Cisco user.notice root: ADBLOCK: 0 entries I woke up today and found the adblock script no longer works when "Optimize" is enabled. When I disable "optimize" in the script, it works. - The whole time I have been enabling "Optimize" and was working, until today. Whitelist and pixelserv are both uploaded in dropbox.... Is anyone out there experiencing the Adblock v3.9d suddenly no longer works? I tried flashing from 4 different builds where the adblock script used to work, and on three different ISP's, with three different routers, ALL manifesting "0 entries" after sorting.....
I was able to fix this by transferring and saving each host's list (1-4 which I use) to a text file, omitting the header, space in-betweens, and uploading each to my ftp and editing the script where S1-S4 links is replaced by my ftp links... It appears there's something in one of those hosts ( I suspect the http://www.malwaredomainlist.com/hostslist/hosts.txt) that's messing with the "optimization" of the script....
Me also Actually, http://mirror1.malwaredomains.com/files/justdomains seems to be a bit of a mess at the moment. I've excluded it and the script works fine now.
...and now it's fixed and I'm back to including it in my AdBlock. Let me know if it's the same for you?
My suspicion is confirmed. Malwaredomains has hosting issues... Until the hosting issues are resolved, I'll stick to my saved hostfiles.... Source
Hmm - i also have a Problem with one of the Malwaredomain-Lists: www.malwaredomains.com/files/justdomains but it has nothing to do with their Hosting-Issues; The justdomains-List includes the Domain "92–168–1–1.info" which crashes dnsmasq on loading. If i remove that line manually from the "gen" the Crash is gone and AdBlocking works as usual ...
Yes same here. List #4 is (4o4). And yet just adding #5 still error out. Why ?????? ------------------------------------------------------------------------------- FS() { if ps | grep 'dnsmasq' | grep 'nobody' ; then logger ADBLOCK: dnsmasq is running else logger ADBLOCK ERROR: restarting dnsmasq... dnsmasq fi -------------------------------------------------------------------------------- Anyway to improve error reporting by ADDBLOCKER??? Beast
Also, please note that the address for list 4 has changed as noted here http://www.linksysinfo.org/index.php?threads/auto-dl-hosts-file-and-install.21378/page-6#post-172503 The new address is http://winhelp2002.mvps.org/hosts.txt
Changing the winhelp/mvps URL seemed to fix it for me for a few days, but the justdomains URL is definitely now causing the problem. I tried pulling it from their new second mirror and had the same problem, so there's definitely something changed about the format of that file that is breaking the adblock script.
Hmm looks like something is broken for sure. Sep 24 17:22:20 Beast-Net user.notice root: ADBLOCK: 35087 entries Sep 24 17:22:20 Beast-Net user.notice root: ADBLOCK: sorting hosts... Sep 24 17:22:55 Beast-Net user.notice root: ADBLOCK: hosts sorted. Sep 24 17:22:55 Beast-Net user.notice root: ADBLOCK: 23 entries My log from today. Beast
Also got 23 entries this morning. I think it's malwaredomains playing up. I bypassed it by changing the script to: GETS="1 3 4 5" TRIM_BEGIN=2 That got it 27396 entries. Also tried the newly set up mirror2.malwaredomains.com but that also got me only 23 entries.
ppsun: I don't think it will hurt anything in this case, but it appears that you won't want to change TRIM_BEGIN when you remove entries from the GETS list; I checked the script and TRIM_BEGIN maps to the number after the S (S1..S7) rather than a position in the GETS list.
I came to the same conclustion as HunterZ, changed to Gets="1 3 4 5" and no change to TRIM. Sep 24 22:04:24 Beast-Net user.notice root: ADBLOCK: 27398 entries I have the scrip upload a copy of the sorted list to my thumb dirve and it looked ok.
Yup. Trim=3 also yield 27396 entries. I will leave it at 3. Thanks. It's a pity malwaredomains list is not working. A few ads has crept in, after removing it. I think I had about 44k entries with it included (Was using GET 1 to 5).
There's probably a way to fix the script to parse the new format, but I haven't looked into it myself.
There's a problem with awk and the variable NF with the character "-", I'll try to figure that out...
Now they've redirected http://www.mvps.org/winhelp2002/hosts.txt to http://winhelp2002.mvps.org/hosts.txt so no need to change the scripts (except for tidiness maybe )
It seems the problem was caused by the empty line at the beginning of justdomains. It should be fixed now. I also updated the URL for S4. enjoy
Updated to 3.9e, lists are d/l and sorting ok now. I also increased the cache size and message limit on mine. BTW has anyone noticed when dnsmasq (v2.57) starts for the first time, that it reports cache size as 150 and must times as 1500? is the 1500 a print to log bug? I thought default was 150. Sep 25 05:34:53 Beast-Net user.notice root: ADBLOCK: http://pgl.yoyo.org/as/serverlist.php?hostformat=nohtml Sep 25 05:34:54 Beast-Net user.notice root: ADBLOCK: http://mirror1.malwaredomains.com/files/justdomains Sep 25 05:34:55 Beast-Net user.notice root: ADBLOCK: http://www.malwaredomainlist.com/hostslist/hosts.txt Sep 25 05:34:58 Beast-Net user.notice root: ADBLOCK: http://winhelp2002.mvps.org/hosts.txt Sep 25 05:35:10 Beast-Net user.notice root: ADBLOCK: http://hosts-file.net/hphosts-partial.asp Sep 25 05:35:10 Beast-Net user.notice root: ADBLOCK: 73198 entries Sep 25 05:35:10 Beast-Net user.notice root: ADBLOCK: sorting hosts... Sep 25 05:37:21 Beast-Net user.notice root: ADBLOCK: hosts sorted. Sep 25 05:37:22 Beast-Net user.notice root: ADBLOCK: 41205 entries FTP response: Client "192.168.1.1", "226 Transfer complete." Sep 25 05:37:24 Beast-Net daemon.info dnsmasq[1236]: started, version 2.57 cachesize 8192 Sep 25 05:37:24 Beast-Net daemon.info dnsmasq[1236]: asynchronous logging enabled, queue limit is 25 messages Sep 25 05:37:24 Beast-Net user.notice root: ADBLOCK: dnsmasq is running Thanks for the quick fix.
about the cache size, try to set ADD_CONF="Y", it will add this to the conf file: dhcp-authoritative cache-size=2048 log-async=5 or set it manually in advanced settings > DNS, I append the settings to adblock.
@srouquette - could you please explain a little further how to make this change. My memory is also down to 150 after using the latest script (3.9e). I am a linux noob. I get the part where you change the ADD_CONF="Y". The other part is where I need help. How do I add those entries to the conf file? Is the manual entry an easier choice? Just copy and past to the advanced settings > DNS? Thanks.
If you are happy with cache size 2048 and log-async=5 then the easy thing to do is set ADD_CONF="Y" This setting is part of the 39.e script look for the block that looks like this ADD_CONF="N" USEHOSTS="N" ROUTER="Y" I wanted more so I changed the values to 8192 and 25 in the compressed 64 section. But as he pointed out this can be done with the custom settings for dnsmasq under DHCP/DNS. You can simply copy and paste this into the custom section then save. dhcp-authoritative cache-size=8192 log-async=25 quiet-dhcp <----- I also like to add this one to the custom section so the log file does not get littered with all the devices connecting and reconnecting to the network. Just remmber to only do the settings in one or the other, other wise you will get errors about duplicate enteries.
Hi I have noticed in my syslog, that when AddBlock redown loads the lists, it never reports they are the same any more. (And it used to). I know any little change in the files such as a "space" or "period" will change the MD5 hash. For the last few days I have been having DSL modem disconnect problems which has been causing the router to redown load the lists every few minutes. Im useing Gets 1 2 3 4 5 Sep 26 20:05:44 Beast-Net daemon.info pixelserv[1079]: 786 requests, 0 errors, 0 bad, 432 gif, 354 txt replies Sep 26 20:06:11 Beast-Net user.notice root: ADBLOCK: 73327 entries Sep 26 20:06:11 Beast-Net user.notice root: ADBLOCK: sorting hosts... Sep 26 20:08:20 Beast-Net user.notice root: ADBLOCK: hosts sorted. Sep 26 20:08:20 Beast-Net user.notice root: ADBLOCK: 41312 entries Sep 26 20:09:24 Beast-Net daemon.info pixelserv[1079]: 786 requests, 0 errors, 0 bad, 432 gif, 354 txt replies Sep 26 20:10:00 Beast-Net user.notice root: ADBLOCK: 73327 entries Sep 26 20:10:00 Beast-Net user.notice root: ADBLOCK: sorting hosts... Sep 26 20:12:09 Beast-Net user.notice root: ADBLOCK: hosts sorted. Sep 26 20:12:09 Beast-Net user.notice root: ADBLOCK: 41312 entries I don't think anything has changed in that small amout of time. This is just one small section of my log. The disconnects are happening every few minutes with the same results????? Yes I have a trouble call in to AT&T.
The script uses the command "nc" to check if the file has been updated on the server, then it creates a MD5. Did you update your firmware recently?
Not at the time of that post. I checked tmp dir and both gen.last and gen.md5 where there. But at this time I am running v1.28.7485.1 MIPSR2-Toastman-RT-BETA K26 USB VPN. Updated early this morning. So going to let it run for some time and see what happens. I need to learn more about scripting for sure. Thanks for the prompt answer and info.
When I log into my router and run ADBLOCK.sh directly, I see a lot of nc timeout messages on stderr (more than one for each server I've set to get lists from I think). Could be that that part of the script needs some love. Also, I'm not sure about the other sites, but malwaredomains.com creates small files on their mirrors with datestamps and other metadata that can be used to see if an update has occurred since the last download.
Just wondering if anyone with RT-N16 is using all 7 gets. Will the router be able to handle all that data? Are there any risk running all 7 gets?
fubdap: I'm on a much older router (WRT54g) so I can't try that myself, but I believe that the worst that can happen is that the router might run out of RAM while either building the list or reloading dnsmasq. In this case, I would expect the router to either lock up, reboot, and/or restart dnsmasq without the adblock list. In any of these cases, the script takes long enough to run that you could always manually reboot and then log into the router (especially via ssh or telnet) fast enough to kill the script before it runs out of RAM again. Also, you can monitor the amount of free RAM on the web interface's Status->Overview page.
Thanks HunterZ. I checked and I have 109 mb (88%) of memory left. I will probably bump it up one at a time and let it run for a while to see if I will have any issues.
My WRT54g has only 16MB total RAM, so I use sources 1-4 and have just a couple MB free. Thinking of upgrading to a refurb E2000 or somesuch so I can use more sources.