Kitz Forum

Broadband Related => Router Monitoring Software => Topic started by: snadge on May 23, 2012, 04:27:36 PM

Title: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: snadge on May 23, 2012, 04:27:36 PM
Iam posting Bald_Eagle's xDSL graphing scripts here with instructions on how too use them ,for those that may want too...

credit to: Bald_Eagle also Asbokid and Burakkucat (i believe) as the original developers of these scripts, and anyone else I have missed out

NOTE: These are a work in progress, I will amend this post with a ChangeLog at the bottom as we change them - also, they have not been tested on ADSL2 connection, only ADSL2+ and ADSL (G.DMT) - we need someone with an ADSL2 connection who can aid in testing for us.

DOWNLOAD:
http://www.mediafire.com/?qwpvs43w9hqtd

WHAT DO THESE DO..?:
You can use these to log & graph your router stats and line characteristics, very usefull when trying to locate & resolve problems one may be having with your broadband connection, see bottom of post for example of graphs.

there are 2 main functions of these scripts,
1. Graphing a snapshot of the Line Characteristics (SNR, QLN, Hlog, Bit-Swapping) on demand of the user (it can also be scheduled to get snaphosts at set periods)
2. Log the Line Statistics (Sync, Noise Margin, Line Attenuation, Errors, Uptime etc etc) every 1 minute so that they can be graphed over any set period of time since the log began by the user (e.g. last 6 Hours, 24 hours, 3 days etc etc).

These scripts have been optimized and set too work out-of-the-box on Broadcom chipped Netgear routers such as 834Gv4 , 834GT , 834N , DGN2000 etc that use the default login of admin and password on the IP address 192.168.0.1  , if you have changed your routers login and/or IP Address then changes need to be made...see below, these scripts work on Stock Netgear Firmware and DGTeam Firmware.

If you need to adjust the scripts to work with your IP or Login details then follow the instructions below, other wise go to How Do I Use These below...

To adjust login details,
1. Install the ADSL_Stats folder into the root of your C:\ drive.
2. Find the LOGIN1.TXT and LOGIN2.TXT files in the Apps folder, open them and change the text in LOGIN1 to your username and LOGIN2 to your password and save them.
3. If you have change the IP address of your router then you need to find and replace all instances of 192.168.0.1 in all scripts and change & save them to whatever you use.

HOW DO I USE THESE..?:
1. If you haven't already done so, install the ADSL_Stats into the root of your drive.
2. To get the Line Characteristics just run GET CURRENT STATS.BAT in the Scripts folder, the graphs will be output in the Current_Stats Folder.
3. To start logging of your Line Stats (every 1 minute) run START_LOGGING_24-7.BAT , follow the instructions, this runs a silent task that retrieves your router logs every 1 minute and stores them , to stop & delete the task run STOP_LOGGING_24-7.BAT
4. To Graph your router stats from the log thats being built up simply run graphpdADSL.BAT and follow the instructions, for example: you would enter 10 m for 10 minutes, 10 h for hours or 10 d for 10 days.. or just pressing enter without entering anything defaults to last 24 hours, the resulting graphs are output in Ongoing_Stats folder

thats it!! :)

If you want to schedule the GET CURRENT STATS.BAT script for comparing SNR, QLN, Bit-Swapping etc over periods of time then open task scheduler and create a new task and set it at daily, recurr every 1 days, repeat task whatever periods you want (hourly etc) for duration of: Indefinitley , but MAKE SURE you offset the time by 30 seconds (so it starts at 30 seconds past the minute/hour) this is important because if you run both the LOGGING task and This task at same time (Like I do) then thay can clash when they meet on the hour, whereas off-setting it; one will run dead on :00 and the other run on :30, each only take about 10 seconds to complete, then, on ACTIONS, choose new, in program/script box type wscript.exe and in the add arguments box copy and paste the code below:
"C:\ADSL_Stats\Scripts\invisible.vbs" "C:\ADSL_Stats\Scripts\GET CURRENT STATS.bat"
then finalize the schedule and enable it.

thats it!!


Thanks to Bald_Eagle for all his hard work and support developing these scripts for us too use, and also thanks to Asbokid and B'kat who I believe also played huge part in developement,  credit to GrahamC from the Plusnet Community Forum for testing & amending the scripts for use with the Zoom router & to Aroberston545 from Kitz for his feedback & findings through the amending & testing process.
and thanks to everyone else for help and testing :)


CHANGELOG :

CHANGELOG - ROUTER STATS LOGGIN & GRAPHING SCRIPTS v 1.4

changes to ADSLGRAPH.bat + graphdADSL.bat
1. Now available for Zoom X7N Routers


CHANGELOG - ROUTER STATS LOGGIN & GRAPHING SCRIPTS v 1.3

changes to ADSLGRAPH.bat:
1. To multiplot Upstream Bit-loading in Green & Downstream Bit-loading in Red.
2. ADSL2+ Bit-loading and SNR is now plotted with "absolute" sized filled boxes as the original graphs were plotted with boxes touching each other, even when there should be a gap (no bits loaded at the given tone).


CHANGELOG - ROUTER STATS LOGGIN & GRAPHING SCRIPTS v 1.2

changes to getADSLstats.bat:
1. left in quite a lot of REM'ed comments & debugging code just in case a problem crops up that needs sorting out.
2. only report actual data collection errors in Error.log to keep the file down in size & to make it easier to spot errors.


CHANGELOG - ROUTER STATS LOGGIN & GRAPHING SCRIPTS v 1.1

changes to graphdADSL.bat:
1. change Error.log back to just recording errors.
2. US_RSCorr plotted in wrong colour...fixed.
3. US_RSCorr missing from montage...fixed.



EXAMPLES.......

(http://i.imgur.com/m5d3V.png)

(http://i.imgur.com/NlRp2.png)
Title: Re: xDSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: les-70 on May 23, 2012, 05:12:32 PM
  Thanks for doing this.  I was struggling through the history of its development trying to find the current version.  However your mediafire  link does not work for me.  Please can you check it.
Title: Re: xDSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: les-70 on May 23, 2012, 06:52:19 PM
  Yes it does work if you try a few times.  Thanks
Title: Re: xDSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on May 23, 2012, 08:09:41 PM
Hi les-70,

the link works for me? if others have trouble I will provide a few more links with other hosts, I may just do that for good measure
Title: Re: xDSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on May 23, 2012, 08:22:44 PM
the link works for me? if others have trouble I will provide a few more links with other hosts, I may just do that for good measure

It worked O.K. for me when I tested it too.

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on May 23, 2012, 08:27:28 PM
BA just sent you 2 emails  ;)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: kezzaman on May 26, 2012, 01:15:37 AM
I might have a luke at dis  :)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: kitz on June 01, 2012, 01:03:38 PM
Topic moved to the router section and stickied.   Thanks to all involved for doing this.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 01, 2012, 01:11:18 PM
thanks KITZ :)

they work a charm, I have just printed out before/after shots of QLN/SNR ... AND ... past 10 days Line Atten/ SNRM / SYNC so I can show the BT Broadband Engineer when he lands today... I can say LOOK, BEFORE , AFTER... AND MY SYNC AND UPSTREAM LINE ATTEN HAS BEEN ALL OVER THE SHOP, HERE ARE RESULTS FROM PAST 10 DAYS...

thanks guys :)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: geep on June 01, 2012, 07:02:11 PM
Hi,
I've arrived late at this party.The scripts look like they produce pretty neat graphs of the stats.
But on downloading them I was disappointed to find that they're Windows scripts..
If there's ever a rewrite in the future perhaps consider making them more portable by using a language like Perl or Python which would enable the scripts to be run on WIndows, Linux and Mac.

Cheers,
Peter
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: burakkucat on June 01, 2012, 07:45:27 PM
Peter,

Congratulations! You have just volunteered to re-write Bald_Eagle1's scripts in a Linux/Unix/W'doze-friendly scripting language!  :D
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 01, 2012, 07:59:51 PM
I think they are already available in Linux..?? not sure, I do know these were developed from Linux scripts anyway

are there no BAT-to (linux/Mac script) converters?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 01, 2012, 10:46:56 PM
@ snadge,


The next time you know you will be "messing about" with your connction, how would you fancy temporarily forcing an ADSL2 connection instead of ADSL2+, just to see if the scripts correctly detect the mode as ADSL2 & determine the correct number of tones for the X axis etc?

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 01, 2012, 10:57:46 PM
@ Bald_Eagle - Hi BA :) , I would but like I said some time ago (cant remember if it were on that other thread or email to you) that for SOME reason ADSL2 mode cant be forced on SKY SVBN , they do use it as far as Im aware, maybe they dont?  but when I try to force that mode in DMT or DGTeam it just constantly keeps trying to connect and fails..I think EVENTUALLY it comes on as ADSL1, but cant remember if that was just me sick of waiting and trying that mode

I will give it another bash... 2 minutes

...nope...doesnt work?  anyone else for ADSL2 on a sky LLu connection?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 01, 2012, 11:03:53 PM
I would but like I said some time ago (cant remember if it were on that other thread or email to you) that for SOME reason ADSL2 mode cant be forced on SKY SVBN

Ah, yes, I remember now.
Cheers anyway.

How did the engineer's visit go?
It was planned for today, wasn't it?

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 02, 2012, 12:05:50 AM
see here
http://forum.kitz.co.uk/index.php/topic,11218.msg217818.html#new

:(
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: burakkucat on June 02, 2012, 12:10:22 AM
I think they are already available in Linux..?? not sure, I do know these were developed from Linux scripts anyway

Asbokid put together the very first static graphing script (Linux based), then he and Little_Bird (from the ThinkBroadband fora) did some further development work. They then handed it over to a certain burakkucat to enhance and develop. Hence the original Linux static graphing script. (Version 2.2 is current.)

As I wanted to be able to plot graphs of the DS/US SNRM and Sync Speed for my 2Wire modem/router and I did not want to have to run the W'doze environment provided by the Linux service Wine, so to be able to use John Owen's Routerstats, I developed my own Linux scripts to perform the requirements. On showing my scripts to Bald_Eagle1, he saw their potential to be adapted for W'doze and the Huawei HG612 modem, once unlocked. The rest you know . . .  :P

Quote
are there no BAT-to (linux/Mac script) converters?

Yes. They are called human beings and I think Peter, above, will do a very fine job.

It is no use anyone looking to me, for I am a felis domesticus with no knowledge of Perl or Python. (Though I did watch "Python, Monty; Circus, Flying, for the use of" when it was first transmitted in the 1960s!)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: geep on June 02, 2012, 12:15:37 AM
Peter,

Congratulations! You have just volunteered to re-write Bald_Eagle1's scripts in a Linux/Unix/W'doze-friendly scripting language!  :D

I did think about that for a few seconds. I've already written my own monitoring for DG834, ST546 and 2Wire (deceased). http://pgg999.co.uk/stats/
It started in Perl and ran on both Linux and Windows, but then it gained some bash scripts, and chunks of sed and grep, and Povray, and gnuplot, and, and, and... It just kept growing. It works, but it's nearly impossible to maintain. I've now got a Netgear DGN1000 which has virtually no monitor capability. Am debating whether to return to the ST546, or maybe get a more sophisticated Netgear which I can monitor and do a clean rewrite of my scripts - maybe based on Bald Eagle scripts. But have just taken delivery of a Raspberry Pi, and it will take priority, as I want it to power an online weather sation.

Cheers,
Peter
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 02, 2012, 12:27:53 AM
@ B'Kat - ahh thanks for clarifying that for me.. I knew you and asbokid where the original creators but didnt know the full story, cheers

Raspberry Pi, thats another great Idea I heard about (B'Kat & someone else's, sorry cant remember the name lol) - turning one of those into a 24-7 stats monitoring unit that plugs into router so you dont have to leave PC on :) - that would be cool , Bald_Eagle told me about it when I confronted him with my idea of turning an old router into a Line Tester / Monitor / Stats Logger that could pull and save stats from the main router for graphing later and even perform latency and speed tests with weekly reports, also passive wifi monitoring that could 'suggest' a better channel if your using same as neighbouring networks etc... perform a mass of functions such as I talk about on this (http://forum.kitz.co.uk/index.php/topic,11204.msg217480.html#msg217480) post ... I asked Bald_Eagle if it were possible and thats when he told me about your Raspberry Pi idea... or was it asbokid that told me..?? bah.. cant remember.. old age!! lol - I would love such a device

I wonder... would it be possible to execute these scripts over a network?  say if I wanted to graph my friends router stats without even visiting his home?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: burakkucat on June 02, 2012, 12:46:31 AM
Quote
I wonder... would it be possible to execute these scripts over a network?  say if I wanted to graph my friends router stats without even visiting his home?

With a R-Pi, the innards of a HG612, power supply and some other bits-n-bobs it could be made into a Mark II Walter's Wheelbarrow, remote monitoring capable. Such an entity was discussed at the theoretical level by Walter, Asbokid, Bald_Eagle1 and myself, earlier this year.

Baldy_Bird has had some success in the remote monitoring of THCN FTTC lines via Walter's existing wheelbarrow -- which uses a laptop computer. (Very inefficient use of the resource.)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 02, 2012, 01:56:54 AM
hehee  - whats Walter's Wheelbarrow? ive heard of it a couple o times now, does Walter have a wheelbarrow full of BT tools or summit that he trunches around the village mending everyones line problems..??? hehehe  ...I want one!!!  :-[

but yeah there are the possibilities of making such a great device..for us broadband/networking fanboys  ;D  I would love to have something that could test and send me stats/graphs of all my friends/customers broadband connections...one could start his own Network Monitoring business & charge a yearly fee... I just turn up at the door tools in hand if there are any problems, he he he,   ... I WISH  ::)

hey wonder if I could design an app for PC that runs in background running tests and lets me know when a PC needs looking at , notifys me via email and I just turn up "computers running a bit slow is it? ...yeah.. it said it was" hehe , charge a yearly fee   :)   24-7 COMPUTER & BROADBAND MONITORING SERVICE... DONT CALL US, WE'LL CALL YOU!!! hehehehehehe - its late...im off to bed  :P
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 02, 2012, 10:45:13 AM
Am debating whether to return to the ST546, or maybe get a more sophisticated Netgear which I can monitor and do a clean rewrite of my scripts - maybe based on Bald Eagle scripts.

Maybe worth a look here:-

http://drlforum.co.uk/showthread.php?tid=211

The guy named Alex has sort of converted my Windows VDSL2 scripts back to Linux & as I created the Windows Netgear ADSL scripts from my Windows VDSL2 scripts it should be an "easy" task for you ;)

Maybe this is a start:-

http://csdprojects.co.uk/HG612/graph/


Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: geep on June 02, 2012, 11:04:58 AM
Quote
Maybe this is a start:-
http://csdprojects.co.uk/HG612/graph/
graph.sh looks straightforward for Perl. Never heard of expect! Will look further sometime in the future...

Cheers,
Peter
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 09, 2012, 11:00:30 PM
Just an update from me, the graphs are working perfectly and I am not having any problems. The great thing about the graphs is that one can get an accurate indication about exactly about what is going on with one's line over a number of days or just there and then.

Attatched is a QLN graph to show just one of the many graphs that one can make. Any opinions?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 09, 2012, 11:19:58 PM

Attatched is a QLN graph to show just one of the many graphs that one can make. Any opinions?


It's a bit hard to judge in isolation.

Unlike Bit-loading & SNR, QLN & Hlog data only updates at each resync.
Have they changed much over the last few resyncs?

I would imagine QLN to look worse from an "noisy" evening resync than from a "quiet" daytime resync.

It might be handy to see portrait format montages for both your snapshot & ongoing stats (ongoing for as long a continuously logged period as possible).

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: burakkucat on June 10, 2012, 01:52:52 AM
Quote
Attatched is a QLN graph to show just one of the many graphs that one can make. Any opinions?

By eye, we could say that the "baseline" QLN at system sync was a respectable -132 dB, nothing more, nothing less.  ::)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 10, 2012, 12:18:30 PM
I'm having a problem now. Every time I plot "ongoing" data, I get "empy y range [0:01], adjusting to [0:1]". I know I have enough data so it isn't that. Any ideas?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: asbokid on June 10, 2012, 01:05:50 PM
(http://www2.picturepush.com/photo/a/8459205/img/arobertson545/arobertson-qln-annot-small.png) (http://picturepush.com/public/8459213)

(http://www5.picturepush.com/photo/a/8459208/img/arobertson545/arobertson-small.png) (http://picturepush.com/public/8459212)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 10, 2012, 02:28:15 PM
@ AR545 - does the graph not work though? I get errors like that soemtimes during the job in the cmd window but it still comes out ok, i think its just setting the axis to your data...

@ ASBOKID
- so he lives somewhere around LONDON .. i bet you could get a closer range by working out the signal strength of the transmitters and checking them against the strength of interference, nice to see BBC RADIO 5 LIVE keeping up appearances as the biggest culprit...as it is with mine up north :)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 10, 2012, 04:11:42 PM
@ AR545 - does the graph not work though? I get errors like that soemtimes during the job in the cmd window but it still comes out ok, i think its just setting the axis to your data...

The graphs work fine but I never used to get this error. BE, any suggestions?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 10, 2012, 04:14:49 PM
like I say its just over-riding the set axis to match that so it can fit your data into it
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 10, 2012, 04:23:01 PM

The graphs work fine but I never used to get this error. BE, any suggestions?


It's not really an error, more of a warning.
I can't turn those messages off though.

It usually means that one or more of the graphs have no data.
That quite often happens when Interleaving is turned on/off. From that point onward some of the graphs may or may not be relevant, so no data will be present.

Could that fit with the issue/warning messages you are seeing?

A lack of data is usually a GOOD sign?  ;D

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 10, 2012, 04:25:42 PM
@ BE - isnt it just adjusting the axis too fit the data he has? i notice it on mine sometimes..yet the graphs are fine (as are his)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 10, 2012, 04:31:28 PM
I would have to see example montages & possibly log files to be 100% certain, but I do think they are messages that can basically be ignored.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: snadge on June 10, 2012, 09:29:05 PM
UPDATED:


CHANGELOG - ROUTER STATS LOGGIN & GRAPHING SCRIPTS v 1.3

changes to ADSLGRAPH.bat:
1. To multiplot Upstream Bit-loading in Green & Downstream Bit-loading in Red.
2. ADSL2+ Bit-loading and SNR is now plotted with "absolute" sized filled boxes as the original graphs were plotted with boxes touching each other, even when there should be a gap (no bits loaded at the given tone).
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: c6em on June 11, 2012, 06:41:09 PM
Merely speculating here- as I don't have a netgear etc.

I wonder if you could use/adapt this tool so that rather than plot the overall SNR margin you could instead plot the SNR margin of one particular tone.
Say your SNR is being affected by RFI (REIN) from somewhere.  Although this will affect the overall SNR to varying degrees it may be that the main culprits are just a small number of tones being quite severely cut back.
One could find these by looking once at the spectrum plot when the RFI was 'on' and 'off' to identify the tones.  Then you could long term plot the SNRmargin or SNR of just one of the affected tone and would hence see very dramatically exactly when the interference was on and off on a daily basis.

Oh, and then the hard work would start with be the small matter of finding it -which is probably much harder!
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: burakkucat on June 11, 2012, 08:28:24 PM
Yes, that could be do-able.  :)

(Mrs Eagle will not be too pleased if you distract Baldy_Bird away from the provision of her new utility room and the refurbishment of her kitchen -- which was supposed to be be finished by last Christmas!  :-X  )
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 11, 2012, 08:37:22 PM
(Mrs Eagle will not be too pleased if you distract Baldy_Bird away from the provision of her new utility room and the refurbishment of her kitchen -- which was supposed to be be finished by last Christmas!  :-X  )

Yes, I'm having to watch my Ps & Qs at the moment, especially as the engineer turning up unexpectedly, the day after the visit had been booked assisted me to "forget" our wedding anniversary.

She might start talking to me again in another month or so.  :-X
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 12, 2012, 07:30:08 PM
Hi, did you remove a line of code that prevents an image being made of the error seconds, etc in "Current Stats"? It was useful for me!
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 12, 2012, 08:08:49 PM
Error seconds data is in the current stats Plink.log & ongoing stats modem_stats.log.

Error seconds graphs have only ever been in the ongoing stats plots though.
(Unless you mean the image of the text data).

Which do you mean and/or could you post an example of when it was there & now that it isn't?

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 12, 2012, 08:31:24 PM
(Unless you mean the image of the text data).

The image of the text data is what I mean.

By the way, I have just adapted the scripts for routers with different layouts in the telnet data (e.g. the sync speeds are in different places) for routers like the NETGEAR DGND3700 and the Zoom X7N. Most routers using the newer generation Broadcom chipsets like the 6328, 6358 and 6368.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 12, 2012, 08:42:55 PM

The image of the text data is what I mean.


Can you attach an example of what you are now getting and/or email a Plink log to me so I can test things at my end?

Quote
By the way, I have just adapted the scripts for routers with different layouts in the telnet data (e.g. the sync speeds are in different places) for routers like the NETGEAR DGND3700 and the Zoom X7N. Most routers using the newer generation Broadcom chipsets like the 6328, 6358 and 6368.

Does one new script work for all those?

Another guy has also been editing the scripts to suit a Zoom X7N here:-

http://community.plus.net/forum/index.php/topic,105398.msg899071.html#msg899071

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 12, 2012, 08:54:06 PM
Does one new script work for all those?

Forget that, the graphing scripts stopped working :( . A quick question, where is the DSL sync info obtained from the Huawei HG612 found in the "getstats" file? I can see "DSLCfg". Where is that?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 12, 2012, 09:02:03 PM

The image of the text data is what I mean.


Can you attach an example of what you are now getting and/or email a Plink log to me so I can test things at my end?

Quote
By the way, I have just adapted the scripts for routers with different layouts in the telnet data (e.g. the sync speeds are in different places) for routers like the NETGEAR DGND3700 and the Zoom X7N. Most routers using the newer generation Broadcom chipsets like the 6328, 6358 and 6368.

Does one new script work for all those?

Another guy has also been editing the scripts to suit a Zoom X7N here:-

http://community.plus.net/forum/index.php/topic,105398.msg899071.html#msg899071 (http://community.plus.net/forum/index.php/topic,105398.msg899071.html#msg899071)



Saw your post there, I am "Gigabit" on the Plusnet forum (ex-Plusnet member) - Hello :). I messaged him and he said they were your work and not his so he isn't releasing them just yet. I am really sorry to ask again, but would you mind sending them to me?

Thank you so much for everything.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 12, 2012, 09:15:58 PM

Saw your post there, I am "Gigabit" on the Plusnet forum (ex-Plusnet member) - Hello :). I messaged him and he said they were your work and not his so he isn't releasing them just yet. I am really sorry to ask again, but would you mind sending them to me?


Haha.

I saw a post from Gigabit & wondered if it was you  :lol:

GrahamC is fully "thrashing" the Ongoing Stats script for a few hours & then he'll email his amended scripts to me with details of what he has changed etc.
I ain't got them yet.

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 12, 2012, 09:20:00 PM

Saw your post there, I am "Gigabit" on the Plusnet forum (ex-Plusnet member) - Hello :). I messaged him and he said they were your work and not his so he isn't releasing them just yet. I am really sorry to ask again, but would you mind sending them to me?


Haha.

I saw a post from Gigabit & wondered if it was you  :lol:

GrahamC is fully "thrashing" the Ongoing Stats script for a few hours & then he'll email his amended scripts to me with details of what he has changed etc.
I ain't got them yet.



Okay. Thank you for updating me.

:)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 12, 2012, 09:28:02 PM
Does one new script work for all those?

Forget that, the graphing scripts stopped working :( . A quick question, where is the DSL sync info obtained from the Huawei HG612 found in the "getstats" file? I can see "DSLCfg". Where is that?

That particular part comes from

rem ********** Set the URL for obtaining the stats **********
set URL=http://192.168.1.1/html/status/xdslStatus.asp

Then later on it is "curl'd" :-

rem ********** Get the raw data from the modem's GUI scripts **********
curl -s %URL% >> %WORKING_FOLDER%\data$$

It is the raw data for the modem's GUI page

It could also be obtained from xdslcmd info --stats & a few other places, but I kept curl in my VDSL2 script anyway.

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 13, 2012, 08:03:02 PM
Thank you. How do the scripts work out the uptime of the connection?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 13, 2012, 08:18:57 PM
Thank you. How do the scripts work out the uptime of the connection?

Seconds divided by 3600 = hours.


They obtain & calculate data slightly differently, here & there.

As you mentioned DSLCfg, I presume you mean the VDSL2 scripts. Is that a correct presumption?

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 13, 2012, 08:25:22 PM
Thank you. How do the scripts work out the uptime of the connection?

Seconds divided by 3600 = hours.

  • Are you referring to the VDSL2 or ADSL scripts for the HG612?

They obtain & calculate data slightly differently, here & there.

As you mentioned DSLCfg, I presume you mean the VDSL2 scripts. Is that a correct presumption?



Sorry, the ADSL scripts.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 13, 2012, 08:27:45 PM
I am wondering because I am adapting the scripts to another router, but the "DSL Uptime" graph is not showing anything. Any ideas?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: Bald_Eagle1 on June 13, 2012, 08:47:59 PM
I am wondering because I am adapting the scripts to another router, but the "DSL Uptime" graph is not showing anything. Any ideas?

Which router are you adapting the scripts for?

Exactly what obtained data are you working with? & what do you already have in the log files and/or telnet data?
 
I just need a bit more detailed info from you before I can make any (hopefully) meaningful suggestions.


EDIT:

Considering the title of this thread (DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use), do you think it may be wise for you to start a separate thread for your current queries?

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears - Download & How To Use
Post by: GigabitEthernet on June 13, 2012, 08:55:06 PM
Sorry snadge, I have made a new thread.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: snadge on June 19, 2012, 02:30:48 PM
updated:

new version added for Zoom X7N routers:

credit to GrahamC from the Plusnet Community Forum for testing & amending the scripts for use with the Zoom router & to Aroberston545 from Kitz for his feedback & findings through the amending & testing process.


sorry ive not been able to help guys... im snowed under with jobs to do..my inbox had over 100 emails in it other day!! just sifting through them too, i had to sort my sisters laptop and my dads PC bust so im currently installing all his stuff on that (FSX + all addons and tweaks) then ive got Drs App today, Hospital and WP app on Thursday and helping my dad move on friday and i have another laptop (for lass i walk dogs with) too sort during all this lol....  busy busy busy
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: GigabitEthernet on July 06, 2012, 03:27:24 PM
snadge, do the 1.4 scripts work with the NETGEAR routers as they seem to be tailored to the Zoom X7N, e.g. the "modem_stats.txt" is missing sync speed data when used with a NETGEAR router because it is presented differently on the Zoom X7N.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: rhohne on July 06, 2012, 03:56:49 PM
Detection of ATTAINABLE_RATE and SYNC are geared towards the zoom in v1.4. It's just of matter of replaceing the relevant lines of code from v1.3 or trying out the code below, which I believe should work with both (only tested with DG834GT).

Code: [Select]
rem ********** Set the Attainable Rate **********
rem Netgear
rem Max(Kbps):      14916           1148
for /f "delims=" %%a in ('gawk "/Max/ {if (NF<10) print $2,$3 }" %WORKING_FOLDER%\data$$') do @set ATTAINABLE_RATE=%%a
rem Billion 7800 & Zoom X7N
rem Max:    Upstream rate = 1048 Kbps, Downstream rate = 7776 Kbps
for /f "delims=" %%a in ('gawk "/Max/ {if (NF>10) print $10, $5 }" %WORKING_FOLDER%\data$$') do @set ATTAINABLE_RATE=%%a


rem ******************************************************************************
rem ******************************************************************************
rem ********** Set the Sync values **********
rem Netgear
rem Rate (Kbps):    12479           1147
rem for /f "delims=" %%a in ('gawk "/Rate / { print $3, $4 }" %WORKING_FOLDER%\data$$') do @set SYNC=%%a

rem ***** Or for routers that report Sync speeds against "Bearer" *****
rem Zoom X7N
rem Bearer: 0, Upstream rate = 1163 Kbps, Downstream rate = 20531 Kbps
for /f "delims=" %%a in ('gawk "/Bearer:/ { print $11, $6 }" %WORKING_FOLDER%\data$$') do @set SYNC=%%a

rem rem ***** if SYNC is not reported against "Bearer" it must be reported against Path/Channel *****
if NOT DEFINED SYNC (
rem ***** Or for routers that report Sync speeds against "Path" *****
rem Billion 7800
rem Path:   0, Upstream rate = 443 Kbps, Downstream rate = 10527 Kbps
for /f "delims=" %%a in ('gawk "/Path:/ { print $11, $6 }" %WORKING_FOLDER%\data$$') do @set SYNC=%%a
)

if NOT DEFINED SYNC (
rem rem ***** For routers that report Sync speeds against "Channel" *****
rem rem ********** Set the Sync values **********
rem Zoom X7N
rem Channel:        INTR, Upstream rate = 448 Kbps, Downstream rate = 7232 Kbps
rem Netgear has 2 channel entries
rem 1) Channel: FAST, Upstream rate = 1147 Kbps, Downstream rate = 12479 Kbps
rem 2) Channel:                Fast
rem for /f "delims=" %%a in ('gawk "/Channel:/ { print $11, $6 }" %WORKING_FOLDER%\data$$') do @set SYNC=%%a
rem for /f "delims=" %%a in ('gawk "/Channel:/ {if (NF>10) print $11, $6}" %WORKING_FOLDER%\data$$') do @set SYNC=%%a
for /f "delims=" %%a in ('gawk -F " " "/Channel:/ { print $11, $6; exit }" %WORKING_FOLDER%\data$$') do @set SYNC=%%a
)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: GigabitEthernet on July 06, 2012, 04:14:30 PM
Detection of ATTAINABLE_RATE and SYNC are geared towards the zoom in v1.4. It's just of matter of replaceing the relevant lines of code from v1.3 or trying out the code below, which I

And changing the IP address to 192.168.0.1 :).
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: rhohne on July 06, 2012, 04:51:29 PM
All depends if you use the default address.

Personally I would like to see all the bits to edit right at the top of the file, in that way they only have to be changed once and are easier to find i.e.

Code: [Select]
rem rdh... Edit variables accordinly
SET IPADDRESS=192.168.1.1
rem SET ADSL_CMD=adslctl
SET ADSL_CMD=adsl
SET SPECIAL_LOGIN=
rem SET SPECIAL_LOGIN=1

....

IF DEFINED SPECIAL_LOGIN (
rem rdh I don't use this as it causes existing telnet sessions to be terminated
wget -q httP://admin:password@%IPADDRESS%/setup.cgi?todo=debug
wget -q httP://admin:password@%IPADDRESS%/setup.cgi?todo=debug
)


rem ***** This one USES LOGIN FILES - needed if DGTeam firmware is installed *****

(echo *1>CON & sleep 1^
 & type %LOGIN_FOLDER%\LOGIN1.TXT & echo **2>CON & sleep 1^
 & type %LOGIN_FOLDER%\LOGIN2.TXT & echo ***3>CON & sleep 1^
 & echo %ADSL_CMD% info --stats & echo ****4>CON & sleep 1 & echo exit & echo *****5>CON & sleep 1^
 & echo ******6>CON  & sleep 2 & echo *******7>CON ) ^| Plink -telnet -P 23 %IPADDRESS% >> %WORKING_FOLDER%\data$$




rem ***** Quietly Logout of Telnet access                *****
rem ***** This is also run twice to ensure logout        *****
IF DEFINED SPECIAL_LOGIN (
wget -q httP://admin:password@%IPADDRESS%/setup.cgi?todo=logout
wget -q httP://admin:password@%IPADDRESS%/setup.cgi?todo=logout


rem ***** remove any of the enabling and disabling output files

del setup.cgi*.*
)


Also there are a few minor tweaks on some of the upstream graphs where the key says "DS" instead of "US" (US_HEC_errors, US_SF, US_SFErr, US_RS)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: snadge on July 06, 2012, 08:15:45 PM
sorry I was under the opinion they worked on both? I will amend
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: GigabitEthernet on October 07, 2012, 08:10:03 PM
Snadge, are the scripts still being developed? Will you develop the scripts to work with the Huawei HG612 on ADSL?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: Bald_Eagle1 on October 07, 2012, 08:26:41 PM
Script versions already developed (attached).
EXE version still being developed - no further development planned for the script versions (apart from any bug fixing).

If you have any problems, post a modem_stats.log & ERROR.LOG for further investigation.

The editable scripts assume the default modem IP address of 192.168.1.1 & file locations starting at C:\ADSL_Stats\

Just to confirm, the scripts need the original Apps folder to be set up as per the original ADSL Netgear scripts.
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: snadge on October 07, 2012, 09:59:10 PM
damn!!!!!!!!!!!!!!!!!!!!!

I just typed a long message and its been removed because I tried to up a RAR instead of ZIP... had to 'go back' and message was gone...dont you just HATE it when that happens..lol

anyway I changed router login and logout username/password to match too, such as:

Code: [Select]
rem wget -q httP://admin:admin@192.168.1.1/setup.cgi?todo=debug
rem wget -q httP://admin:admin@192.168.1.1/setup.cgi?todo=debug

I also removed pause commands at the end of the get-current-stats and adsl-graph bat files so whole process would run without intervention..

we also have a script that changes SNR, Iam busy working on a version that asks for user to choose or type a value. find script attached that sets 50% SNRM
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: Bald_Eagle1 on October 07, 2012, 10:42:20 PM

anyway I changed router login and logout username/password to match too, such as:

Code: [Select]
rem wget -q httP://admin:admin@192.168.1.1/setup.cgi?todo=debug
rem wget -q httP://admin:admin@192.168.1.1/setup.cgi?todo=debug


Those are not required & are not used for the HG612 anyway (hence the "rem" at the start of the line).
They had already been completely deleted from the versions I attached earlier on.

Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: snadge on October 07, 2012, 11:52:01 PM
doh! I should have noticed the rem...lol...

anyway - here is our first version of the SNR Tweak that asks for user input and sets the margin as so :) I have tested and works great, gunna make a new post for it.

I plan to try and create a self-packed version that carries the files it needs in same the folder (or working folder carried in the tweaks folder itself) meaning users dont already need the apps etc and it can be run from where it is...well thats the plan anyway..

im buzzin that ive made my first router script...with help from you of course mr. Eagle.. :)
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: GigabitEthernet on October 09, 2012, 05:38:18 PM
BE,the ongoing scripts don't seem to be there?
Title: Re: DSL Stats Logging & Graphing Scripts for Netgears & Zoom X7N
Post by: Bald_Eagle1 on October 09, 2012, 08:37:41 PM
BE,the ongoing scripts don't seem to be there?

If you mean for the HG612, they are all in the zip file.