Kitz Forum
Broadband Related => Broadband Technology => Topic started by: snadge on May 13, 2012, 08:00:05 PM
-
after seeing asbokid's graphs with my line stats i wondered if there is a program that I can use to do that myself
does anyone know of any that will plot graphs with my stats such as QLN, SNR, Hlog etc
thanks in advance
-
We use gnuplot.
It plots graphs from the raw data obtained via xdslcmd or other similar commands.
Windows and Linux versions can be dowloaded (free of charge).
Simple scripts/batch files to automate the plotting can be written.
Assuming you are a Windows user, I might be able to assist with setting up the scripts for your system.
This is the version I use in my batch files for graphing the stats from the Huawei HG612 modem:-
G N U P L O T
Version 4.4 patchlevel 4
last modified November 2011
System: MS-Windows 32 bit
Copyright (C) 1986-1993, 1998, 2004, 2007-2011
Thomas Williams, Colin Kelley and many others
I use the 32 bit version even though my Windows 7 system is 64 bit.
-
Hello,
I have a quick question (sorry for the slight hijack). I have a DG834GT that I can access via telnet and the commands are very similar to the Huawei HG612. The only difference is that the commands are "adslctl" instead of "xdslcmd". So would it be possible for you to perhaps assist me with setting up some graphs?
I'll open a new thread if necessary.
Once again, sorry for the slight hijack.
-
If the output from the ADSL equivalent of these commands is combined into a single file & posted here, I'll have a look at it.
xdslcmd info --pbParams
xdslcmd info --Bits
xdslcmd info --linediag
xdslcmd info --show
xdslcmd info --stats
PuTTy is an excellent free terminal program for outputting data to a log file (it includes date & time etc).
-
I'll put them in a single file later, but these are the commands:
adslctl info --pbParams - Doesn't work: "too many options"
adslctl info --Bits - Works
adslctl info --linediag - Works
adslctl info --show - Works
adslctl info --stats - Works
Thank you.
-
adslctl info --pbParams - Doesn't work: "too many options"
pbParams is case sensitive. I have seen the "too many options" when I forgot to use upper case for the 2nd P.
"adslctl --help" might give you a full list of the available commands.
-
@ Bald_Eagle - thanks for the offer of help, I would appreciate it - just you are aware of my troubles and Iam going to 3 other SKY customers houses and with my 834GT Iam going to pull stats from them and thought it would be best to use some sort of plotter as asbokid did.
I do use windows, ive installed GNUplot ...what next?
thanks in advance
-
I do use windows, ive installed GNUplot ...what next?
Next is to gather the relevant stats, ideally into a single file.
That can probably be auotomated, but for now we need Bits, Hlog, SNR & QLN data.
I have attached an example data log & an example of the graphs plotted from that data.
If you or arobertson545 could attach the data from these commands, I could test my ADSL graphing scripts & assuming everything works O.K. I could package all the parts needed for you to run the scripts whenever you wish (for manually obtained data):-
adslctl info --pbParams - Doesn't work: "too many options"
adslctl info --Bits - Works
adslctl info --linediag - Works
adslctl info --show - Works
adslctl info --stats - Works
If info --linediag doesn't provide sufficient data, thise should do it:-
adslctl info --Bits
adslctl info --SNR
adslctl info --QLN
adslctl info --Hlog
Assuming it all works with manually obtained data, we could then move on to automatically obtaining the data & plotting it all from one double-click of the mouse.
-
Attatched is the log file :).
-
Attatched is the log file :).
& attached is the first attempt at plotting the data.
I'm not very well up on these matters but I presume this means ADSL1 :-
"Mode: G.DMT" , along with the fact that only 256 tones were harvested ?
What indications would we get for ADSL2 & ADSL2+ modes?
I'm not sure what this means though:-
G.dmt framing
K: 197(0) 15
R: 14 16
S: 1 8
D: 16 2
ADSL2 framing
MSGc: 1 1
B: 197 15
M: 1 8
T: 1 1
R: 14 16
S: 1.0707 9.0000
L: 1584 128
D: 16 2
I notice that QLN data is 0.0000 for all 256 tones.
Also, I see that linediag already gives us:-
SNR
QLN (albeit all zeros)
Hlog
So, we don't also need to collect them separately.
We do however need to collect Bits separately.
We also get this :-
# adslctl info --show
adslctl: ADSL driver and PHY status
Status: ShowtimeRetrain Reason: 0
Channel: INTR, Upstream rate = 448 Kbps, Downstream rate = 6272 Kbps
Link Power State: L0
Mode: G.DMT
Channel: Interleave
Trellis: OFF
Line Status: No Defect
Training Status: Showtime
Down Up
SNR (dB): 6.8 23.0
Attn(dB): 41.0 26.0
Pwr(dBm): 19.7 11.9
Max(Kbps): 6784 1088
Rate (Kbps): 6272 448
G.dmt framing
K: 197(0) 15
R: 14 16
S: 1 8
D: 16 2
ADSL2 framing
MSGc: 1 1
B: 197 15
M: 1 8
T: 1 1
R: 14 16
S: 1.0707 9.0000
L: 1584 128
D: 16 2
Counters
SF: 2410208 2410210
SFErr: 67 76
RS: 163894190 20485782
RSCorr: 51667 179
RSUnCorr: 432 0
HEC: 55 46
OCD: 0 0
LCD: 0 0
Total Cells: 606099260 0
Data Cells: 9135712 0
Drop Cells: 0
Bit Errors: 0 0
ES: 50 0
SES: 0 0
UAS: 129 0
AS: 40973
INP: 0.56 1.00
PER: 1.87 1.96
delay: 4.28 4.50
OR: 29.88 28.44
Bitswap: 0 0
& we also get this :-
# adslctl info --stats
adslctl: ADSL driver and PHY status
Status: ShowtimeRetrain Reason: 0
Channel: INTR, Upstream rate = 448 Kbps, Downstream rate = 6272 Kbps
Link Power State: L0
Mode: G.DMT
Channel: Interleave
Trellis: OFF
Line Status: No Defect
Training Status: Showtime
Down Up
SNR (dB): 6.8 23.0
Attn(dB): 41.0 26.0
Pwr(dBm): 19.7 11.9
Max(Kbps): 6784 1088
Rate (Kbps): 6272 448
G.dmt framing
K: 197(0) 15
R: 14 16
S: 1 8
D: 16 2
ADSL2 framing
MSGc: 1 1
B: 197 15
M: 1 8
T: 1 1
R: 14 16
S: 1.0707 9.0000
L: 1584 128
D: 16 2
Counters
SF: 2410385 2410328
SFErr: 67 76
RS: 163906226 20487788
RSCorr: 51667 179
RSUnCorr: 432 0
HEC: 55 46
OCD: 0 0
LCD: 0 0
Total Cells: 606143771 0
Data Cells: 9135712 0
Drop Cells: 0
Bit Errors: 0 0
ES: 50 0
SES: 0 0
UAS: 129 0
AS: 40977
INP: 0.56 1.00
PER: 1.87 1.96
delay: 4.28 4.50
OR: 29.88 28.44
Bitswap: 0 0
Total time = 11 hours 27 min 17 sec
SF = 2410385
CRC = 67
LOS = 0
LOF = 0
ES = 50
Latest 1 day time = 11 hours 27 min 17 sec
SF = 2410385
CRC = 67
LOS = 0
LOF = 0
ES = 50
Latest 15 minutes time = 12 min 17 sec
SF = 43306
CRC = 3
LOS = 0
LOF = 0
ES = 3
Previous 15 minutes time = 15 min 0 sec
SF = 52923
CRC = 3
LOS = 0
LOF = 0
ES = 3
Previous 1 day time = 0 sec
SF = 0
CRC = 0
LOS = 0
LOF = 0
ES = 0
15 minutes interval [-30 min to -15 min] time = 15 min 0 sec
SF = 52982
CRC = 1
LOS = 0
LOF = 0
ES = 1
15 minutes interval [-45 min to -30 min] time = 15 min 0 sec
SF = 52982
CRC = 4
LOS = 0
LOF = 0
ES = 2
15 minutes interval [-60 min to -45 min] time = 15 min 0 sec
SF = 52923
CRC = 4
LOS = 0
LOF = 0
ES = 3
Showtime Drop Reason: 0
Last Retrain Reason: 0
I take it that nothing is forthcoming from pbParams?
-
Try this one, the QLN is populated this time.
-
I'm not very well up on these matters but I presume this means ADSL1 :-
"Mode: G.DMT" , along with the fact that only 256 tones were harvested ?
Yes it does and I am on ADSL1. I don't know why ADSL 2 framing shows up but we can ignore it. Nothing is forthcoming with "adslctl info --pbParams" :( .
-
Try this one, the QLN is populated this time.
Here it is.
Any idea why QLN wasn't populated earlier?
-
Any idea why QLN wasn't populated earlier?
Nope :). How easy will it be to modify the scripts so I can do it at a click of a button?
-
It would take a while, especially as I can't directly test the data harvesting.
The automation uses Plink command line terminal instead of PuTTy.
The IP Address & login name & password of the modem are used to gather the stats for my VDSL2 connection:-
rem ***** This uses PERMANENT LOGIN FILES in the Apps folder *****
(echo *1>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN1.TXT & echo **2>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN2.TXT & echo ***3>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN3.TXT^
& echo ****4>CON & sleep 1 & echo xdslcmd info --pbParams & echo *****5>CON & sleep 1 & echo xdslcmd info --Bits & echo ******6>CON^
& sleep 1 & echo xdslcmd info --linediag & echo *******7>CON & sleep 2 & echo xdslcmd info --show & echo ********8>CON & sleep 1^
& echo xdslcmd info --stats & echo ********8a>CON & sleep 1 & echo exit & echo *********9>CON & sleep 1 & echo exit^
& echo **********10>CON & sleep 2 & echo ***********11>CON ) ^| Plink -telnet -P 23 192.168.1.1 >> %SUBFOLDER%%LOGFILENAME%
It's not very elegant, but it does work reliably.
LOGIN1.TXT just contains the username "admin" - without the quotes
LOGIN2.TXT just contains the password "admin" - without the quotes
LOGIN3.TXT just contains "sh" - without the quotes (the command to get to the busybox shell).
If you gave me those details I could amend my VDSL script for you to try out.
My scripts also use a few Windows versions of Unix utilities.
Once everything works O.K. I could package it all into a zip file for you to unzip at your end.
My scripts use specific folders for the utilities & also creates dated subfolders each time the stats are graphed.
e.g. %LOGIN_FOLDER% mentioned above uses C:\HG612_Modem_Stats\Apps
I could set things up to use default folders that you could edit in a few seconds at your end.
Which modem/router are you using?
I might have to consider different ones that use different commands to obtain the stats.
-
I am using a NETGEAR DG834GT. As far as I know, most of the routers with access to these stats use either "adsl info" or "adslctl info" on NETGEAR routers.
Is there anything I can modify on my end so I can test it here and if needs be get some help from you? I presume I just need to modify the login details and the commands because all other data is pretty similar. Or, is it more complicated than that?
-
If I remember correctly, the mode field is populated thus G.DMT/ADSL2/ADSL2+. Don't think PbParams works with adslctl, at least, I don't remember using it !!
As an aside, the upstream of 448kbps would indicate an IPStream product. If you wished to write generic scripts Paul it should be relatively easy to check for this value for IPStream. Anything higher than this would indicate an LLU product. That said, I do not know what BT's standard upstream is, merely the upstream of an IPStream reseller and an LLU line (24000/1024 - max rates).
-
I am using a NETGEAR DG834GT. As far as I know, most of the routers with access to these stats use either "adsl info" or "adslctl info" on NETGEAR routers.
Is there anything I can modify on my end so I can test it here and if needs be get some help from you? I presume I just need to modify the login details and the commands because all other data is pretty similar. Or, is it more complicated than that?
You could try this:-
Create a folder C:\ADSL_Stats
Move to that folder & create a subfolder named Apps
Create another subfolder of ADSL_Stats named Scripts
Create another subfolder of ADSL_Stats named Current_Stats
From the attached zip file:-
Extract Sleep.EXE & Plink.EXE into C:\ADSL_Stats\Apps
Extract LOGIN1.TXT, LOGIN2.TXT & LOGIN3.TXT into C:\ADSL_Stats\Apps
Edit these to suit your modem/router login details for a telnet (Plink) session
Extract Basic_ADSLStats.BAT into C:\ADSL_Stats\Scripts
Edit the line in Basic_ADSLStats.BAT that contains Plink -telnet -P 23 192.168.1.1 to match the IP address of your modem/router.
Double-click Basic_ADSLStats.BAT & let me know exactly what error messages you see.
It's all been a bit rushed, so I don't expect it to work first time.
Once we confirm this part works, I can forward the actual graphing script along with the other utilities.
EDIT: Zip file actually attached now
-
If I remember correctly, the mode field is populated thus G.DMT/ADSL2/ADSL2+. Don't think PbParams works with adslctl, at least, I don't remember using it !!
As an aside, the upstream of 448kbps would indicate an IPStream product. If you wished to write generic scripts Paul it should be relatively easy to check for this value for IPStream. Anything higher than this would indicate an LLU product. That said, I do not know what BT's standard upstream is, merely the upstream of an IPStream reseller and an LLU line (24000/1024 - max rates).
Wouldn't LLU also be G.DMT/ADSL2/ADSL2+?
If so, Mode from adslctl info --stats & adslctl info --show would report the relevant connection type wouldn't it?
It appears that G.DMT uses only 256 tones.
Do ADSL2 & ADSL2+ both use 512 tones?
-
Wouldn't LLU also be G.DMT/ADSL2/ADSL2+?
If so, Mode from adslctl info --stats & adslctl info --show would report the relevant connection type wouldn't it?
It appears that G.DMT uses only 256 tones.
Do ADSL2 & ADSL2+ both use 512 tones?
Yes they do. LLU can also be any mode BUT the upstream figure is higher for LLU than IPStream (576 vs 448 on G.dmt) I think.
-
What do you reckon this one would be?
I don't actually have the Mode information.
adslctl: ADSL driver and PHY status
Status: ShowtimeRetrain Reason: 0
Channel: FAST, Upstream rate = 1799 Kbps, Downstream rate = 18503 Kbps
-
Upstream rate = 1799 Kbps, Downstream rate = 18503 Kbps
That has to be ADSL2+.
Edited to attach two images, for Baldy_Bird's education. :P They show the current status of my line at The Cattery. It is an LLU'd ADSL2+ line from TalkTalk, with a DS cap of 8 Mbps applied. My modem/router (a 2Wire 2700HGV) automagically syncs in ADSL2 mode and you will note that I have just (today) requested that interleaving be turned on. (Note the FECs.)
-
Thank you b*cat.
All this ADSL technical stuff is new territory for me.
None of it really mattered to me when I could only achieve "up to" 1 Mb on my old ADSL connection with DS attenuation of 63.5 dB (probably higher in reality due to my DG834GT apparently not actually reporting anything higher than that).
-
You are welcome. And, having realised that you are just an experienced novice, I have attached two screenshots and a note to my previous post. :-X
-
Wouldn't LLU also be G.DMT/ADSL2/ADSL2+?
If so, Mode from adslctl info --stats & adslctl info --show would report the relevant connection type wouldn't it?
It appears that G.DMT uses only 256 tones.
Do ADSL2 & ADSL2+ both use 512 tones?
Yes they do. LLU can also be any mode BUT the upstream figure is higher for LLU than IPStream (576 vs 448 on G.dmt) I think.
That's not quite right. ADSL and ADSL2 use frequencies up to 1.1 MHz (256 tones), but ADSL2+ uses frequencies up to 2.2 MHz (512 tones).
-
That's not quite right. ADSL and ADSL2 use frequencies up to 1.1 MHz (256 tones), but ADSL2+ uses frequencies up to 2.2 MHz (512 tones).
Ah, Eric has spotted the "mishap" (that I missed. :-[ ) At least I can say that the tone range for ADSL2 is shown in my second screenshot, above.
-
That's not quite right. ADSL and ADSL2 use frequencies up to 1.1 MHz (256 tones), but ADSL2+ uses frequencies up to 2.2 MHz (512 tones).
So, for your ADSL2+ line, have you chosen to use ADSL2 mode, or has the 2Wire/DLM determined that is the best you can have?
-
Sorry, I forgot to mention the DLM. With a TalkTalk LLU'd line, one can request that the DLM be turned off. Which is what I have done.
The selection of ADSL2 mode, rather than ADSL2+ mode, was a decision made by the 2Wire 2700HGV. If you look at my Screenshot-1, above, you will see that the modem tested the line in ADSL2+ mode and found it lacking. So it "dropped back" to the previous standard and tried again -- with success. (If ADSL2 also proved to unworkable, it would have dropped right back to ADSL mode.)
The far right-hand side of Screenshot-2 is attached below, as Screenshot-3. That shows what the modem reports, whilst it is attempting to sync.
-
Just playing about, I have added a bit of "useful" raw text data in the attached Portrait & Landscape montages
-
thanks for your help BA, really appreciate it ..
find attached a zip file containing the 4 TXT files, 1 for each one of stats you asked for
thanks again :)
-
Hi snadge,
Could you try out the harvesting of the stats as per this message:-
http://forum.kitz.co.uk/index.php/topic,11163.msg216825.html#msg216825
Onve I know that works properly at your end, I can package everything to work on a double-click for you (I can't test it myself as I don't have access to an ADSL connection).
Paul.
-
Hi Paul,
I have done that thanks, however, how do I format the login data in the login1,2,3 text files? - two had admin text and one had sh , i changed all too:
admin
password
as thats the login, I ran the BAT file and it just flicked up for fraction of a second? im assuming the formatting of those text files are incorrect?
thanks again,
Paul
-
Hi Paul,
I have done that thanks, however, how do I format the login data in the login1,2,3 text files? - two had admin text and one had sh , i changed all too:
admin
password
as thats the login, I ran the BAT file and it just flicked up for fraction of a second? im assuming the formatting of those text files are incorrect?
thanks again,
Paul
The sh login command is used on the Huawei HG612 to switch from the default shell it telnets into to the busybox shell. I do not believe that you will need this command for your router as you should be at a busybox prompt once logged in.
-
The sh login command is used on the Huawei HG612 to switch from the default shell it telnets into to the busybox shell. I do not believe that you will need this command for your router as you should be at a busybox prompt once logged in.
In that case,
LOGIN1.TXT should just contain admin
LOGIN2.TXT should just contain password
LOGIN3.TXT can just be ignored.
I have edited the batch file (in the attached zip file) to remove the requirement to "type" LOGIN3.TXT
I have also added a few pause commands so that you can hopefully see how far the batch file got before it crashed out.
-
SUBFOLDER = C:\ADSL_Stats\Current_Stats\Current_Stats_20120515-1615
SUBFOLDER does not exist, so creating it
then after pressing any key it disapears?
-
Has it created the folder C:\ADSL_Stats\Current_Stats\Current_Stats_20120515-1615?
-
nope?
thanks
-
this is where i get too, then i press any key and something appears in the window (two lines perhaps) but it closes
Gathering statistics from the modem
Please wait a few seconds.........................
LOGDATE =2012.05.15
LOGTIME =16:23:06
FILEDATE =20120515-1623
Press any key to continue . . .
MAIN_FOLDER =C:\ADSL_Stats
C:\ADSL_Stats DOES exist
Press any key to continue . . .
SUBFOLDER = C:\ADSL_Stats\Current_Stats\Current_Stats_20120515-1623
SUBFOLDER does not exist, so creating it
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.15 16:23:06 =~=~=~=~=~=~=~=~=~=~=~=
Press any key to continue . . .
-
To get that far, the folders should have been created & at least have started to create the Plink log (even before attempting to login to the modem).
-
@ snadge,
PM sent to you.
-
@ BA
I have emailed you with logs.. it was my bad, the root folder name was ADSL_Stas not ADSL_Stats ..oops :(
-
Seems to work.
-
With the modified "BASIC_ADSLStats" batch file.
-
It doesn't seem to get the stats however. It seems to be an issue how it enters the username and password. See below:
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.15 20:44:04 =~=~=~=~=~=~=~=~=~=~=~=
Login: admin
Password:
*****Login incorrect
Login: adslctl info --Bits
Password:
adslctl info --linediag
Login incorrect
Login: Password:
adslctl info --show
adslctl info --stats
exit
Login incorrect
-
Just found this..............
To allow Telnet access on a Netgear in the first place, does something like this have to be entered in a browser:-
http://192.168.0.1/setup.cgi?todo=debug
Maybe doing that first will then allow the script to work?
If that is a necessary step, is there any other way to enable debug mode i.e. via a batch file?
-
Just found this..............
To allow Telnet access on a Netgear in the first place, does something like this have to be entered in a browser:-
http://192.168.0.1/setup.cgi?todo=debug
Maybe doing that first will then allow the script to work?
If that is a necessary step, is there any other way to enable debug mode i.e. via a batch file?
Not necessary as I am using a firmware that has telnet enabled by default. It is actually successfully connecting to the router, but it is either too slow or too quick in entering the password.
-
To slow it down (probably more likely than speeding it up) you could try increasing the sleep timings by whole number increments in this part of the batch file:-
rem ***** This one USEs PERMANENT LOGIN FILES in the Apps folder *****
(echo *1>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN1.TXT & echo **2>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN2.TXT & echo ***3>CON & sleep 1^
& echo ****4>CON & sleep 1 & echo *****5>CON & sleep 1 & echo adslctl info --Bits & echo ******6>CON^
& sleep 1 & echo adslctl info --linediag & echo *******7>CON & sleep 2 & echo adslctl info --show & echo ********8>CON & sleep 1^
& echo adslctl info --stats & echo ********8a>CON & sleep 1 & echo exit & echo *********9>CON & sleep 1 & echo exit^
& echo **********10>CON & sleep 2 & echo ***********11>CON ) ^| Plink -telnet -P 23 192.168.1.1 >> %SUBFOLDER%%LOGFILENAME%
Or maybe even add "& sleep 1" (without the quotes) immediately after LOGIN1.TXT and LOGIN2.TXT
It seems too close to give up just yet.
-
I think I've found out what is happening: after the batch script has entered "admin" and pushed "enter", it appears to push "enter" again and then type the password, whereas what needs to happen is for it to enter "admin", push "enter, enter the password and then push "enter".
This can be seen in this example:
Login: admin
Password: <-- The password needs to be entered here (it is not shown when it is typed, I don't know if that makes any difference?)
**** <-- Not here which is what appears to be happening.
Any ideas?
-
try changing the asterisks in the batch file to something else to prove what is being entered e.g.
Original:-
& type %LOGIN_FOLDER%\LOGIN1.TXT & echo **2>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN2.TXT & echo ***3>CON & sleep 1^
& echo ****4>CON & sleep 1 & echo *****5>CON & sleep 1
New:-
& type %LOGIN_FOLDER%\LOGIN1.TXT & echo xx2>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN2.TXT & echo xxx3>CON & sleep 1^
& echo xxxx4>CON & sleep 1 & echo xxxxx5>CON & sleep 1
The asterisks aren't actually needed for anything, they just showed that something was happening on a very, very, very old & slow XP system that I tested the HG612 scripts on.
-
In my version (HG612), Password shows in the Plink log as a single character:-
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.15 21:28:57 =~=~=~=~=~=~=~=~=~=~=~=
Welcome Visiting Huawei Home Gateway
Copyright by Huawei Technologies Co., Ltd.
Login:admin
Password:
The next bit is specific to the HG612 though
ATP>sh
BusyBox v1.9.1 (2010-10-15 17:59:06 CST) built-in shell (ash)
Enter 'help' for a list of built-in commands.
-
Sorry, the asterisks were just to show that I had removed my password! Or, did you mean something else?
-
The example above was taken from the plink log. I still don't get why it doesn't work.
-
i get same results after enabling debug, im running DGteam anyway so I think thats disabled.
-
Using this:-
http://192.168.0.1/setup.cgi?todo=debug
It seems that any other logging in is not required.
I have just tried it with my old DG834GT & the amended batch file (attached) & got this:-
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.15 23:15:06 =~=~=~=~=~=~=~=~=~=~=~=
BusyBox v1.00 (2005.07.29-07:22+0000) Built-in shell (ash)
Enter 'help' for a list of built-in commands.
# adslctl info --Bits
adslctl: too many options
#
# adslctl info --linediag
adslctl: ADSL driver and PHY status
Status: Idle
Loop Attenuation (LATN) = 0.0 dB
Signal Attenuation (SATN) = 0.0 dB
SNR Margin (SNRM) = 0.0 dB
Attanable Data Rate (ATTNDR) = 0 Kbps
Transmit Power(ACTATP) = 0.0 dBm
Tone number SNR
0 0.0000
1 0.0000
2 0.0000
3 0.0000
4 0.0000
[All the rest snipped out]
I don't know why, but Bits are not harvested.
They weren't harvested when I used DMT tool when I had an ADSL connection either.
-
thanks
get same results as before though? - it must be the DGteam 1018 firmware do you think? , saying that, DMT Tool has no problems accessing line stats for me via telnet?
I think it needs flashing back to Netgear FW
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.15 23:34:20 =~=~=~=~=~=~=~=~=~=~=~=
Login: adslctl info --Bits
Password:
adslctl info --linediag
Login incorrect
Login: Password:
adslctl info --show
adslctl info --stats
exit
Login incorrect
Login: Password:
Login incorrect
-
get same results as before though? - it must be the DGteam 1018 firmware do you think? , saying that, DMT Tool has no problems accessing line stats for me via telnet?
I think it needs flashing back to Netgear FW
I don't know.
Mine doesn't have DGTeam firmware on it.
Did you use the amended batch file that I attached to my last message?
I have removed the logging in details from it.
-
yep that was the one I used, the new one, I see you amended the IP address for us :)
Iam going to fire up XP on the laptop and install latest Netgear Firmware for it, give me 10 mins
-
it worked with Netgear FW.... wierd... I wonder if it just needed a proper flash because last few FW i installed was via the WUI, I will flash it back tomorrow and see if still the same...
find log attached :)
-
Nearly time to give you the actual graphing scripts then.
We are gathering too much redundant data. It seems like info --show isn't needed.
I'll try to remember to edit the harvesting script again to remove that.
Grpahs attached.
-
thanks again :)
-
This does actually ring a bell. I am pretty sure that there is a quirk in the DGTeam Busybox login that requires a couple of seconds wait and it is difficult to get around. I don't belive the official firmware requires a username and password however. Would I need to remove the password line in that case?
-
All working on the original firmware. It's annoying that it doesn't work on the DGTeam firmware because it is much more customisable!
-
This does actually ring a bell. I am pretty sure that there is a quirk in the DGTeam Busybox login that requires a couple of seconds wait and it is difficult to get around. I don't belive the official firmware requires a username and password however. Would I need to remove the password line in that case?
Not sure what you are saying there.
If you are reverting to Netgear firmware, the latest batch file appears to work.
If you are sticking with DGTeam firmware it doesn't appear to work, even though Login & Password have been removed.
The attached version also has the redundant adsctl info --show removed.
If you do get it working, please post a log for me to test with the graphing script.
Yours is G.DMT & snadge's is ADSL2+, so all I will then need is a log from an ADSL2 connection for a full test.
-
All working on the original firmware. It's annoying that it doesn't work on the DGTeam firmware because it is much more customisable!
Graphs attached.
I see QLN is all zero data again.
I wonder if, for whatever reason, you need to run the script twice to make sure all the data is obtained?
I could build in a "dummy run" if needed.
-
All working on the original firmware. It's annoying that it doesn't work on the DGTeam firmware because it is much more customisable!
What do you wish to customise?
It could possibly/probably be done via a series of very small batch files e.g. increasing/lowering SNR, forcing a particular DSL mode etc.
If you provided a list of all the available adslctl commands I could have a go at creating one or two of them as a starting point.
-
is there no way to add a pause after logging in before querying the stats..? i think thats what arobertson545 means , something up with the DGteam fw that requires a slight pause after logging in (perhaps) before asking for the stats, doing it too quick means it fails at login or something?? thats what it sounds like to me
find attached my log files from new BAT file
and...thanks very much for doing all this...really apperciate it :)
-
is there no way to add a pause after logging in before querying the stats..? i think thats what arobertson545 means , something up with the DGteam fw that requires a slight pause after logging in (perhaps) before asking for the stats, doing it too quick means it fails at login or something?? thats what it sounds like to me
Assuming DGTeam does the actual logging in, there are some places to increase "waiting" time before any attempt is made to grab any stats.
From the latest batch file:-
rem ***** This one does NOT use any LOGIN FILES *****
(echo *1>CON & sleep 1^
& echo **2>CON & sleep 1 & echo ***3>CON & sleep 1 & echo adslctl info --Bits & echo ****4>CON^
& sleep 1 & echo adslctl info --linediag & echo *****5>CON & sleep 2^
& echo adslctl info --stats & echo ******6>CON & sleep 1 & echo exit & echo *******7>CON & sleep 1^
& echo ********8>CON & sleep 2 & echo *********9>CON ) ^| Plink -telnet -P 23 192.168.0.1 >> %SUBFOLDER%%LOGFILENAME%
It might just need one long sleep right at the start, so you could try changing (echo *1>CON to (sleep 5 & echo *1>CON
Maybe try different values than 5 (whole numbers only) until it works (or doesn't work)
If that works, SOME of the other sleep commands can be removed, (but NOT all of them).
find attached my log files from new BAT file
Graphs attached again.
I see increases in speed & bit-loading & a decrease in SNR.
Have you forced that, or has DLM done it?
and...thanks very much for doing all this...really apperciate it :)
No problem. It has been "interesting" for me.
Can your email client accept executable files (within zip files)?
If so, I could simply email the graphing script to you, along with the "other" utilities to make them work, along with a simple instruction of where to extract them.
As these utilities just use the absolutely necessary parts of gnuplot, Imagemagick etc. any full versions of them could be uninstalled (unless they were useful for other things too).
If there is demand for it, I could (eventually - maybe) create a little setting up batch file for the above (just like I did for the HG612 on VDSL2 connections).
With quite a bit of effort, my other HG612 batch files (used for every minute 24/7 automated logging) could also be edited to suit ADSL connections for generating "ongoing" graphs - a bit similar to RouterStats.
-
yeah just email in a zip file if its easier :)
I will flash the GT back to DGteam 10180 23o and try it with the sleep 5 command and let you know if it works
thanks again
edit: oh and yes I changed the SNR Margin last night ...there was even more noise on my line late last night that caused a drop in speed by almost 1Mb :( bloody sick of this sky connection now like... ggrrrrrrr!!
edit2: is it possible to make the HLOG and QLN charts non-inverted of the SNR and BIT-LOADING..? i.e. red+white instead of White+red so they all match?, be great if possible? :)
-
It may take a bit of trial & error to get things working with the DGTeam firmware.
Problem is, I can't actually try anything to fix my errors :P
See the attached for how I currently display my own VDSL2 QLN & Hlog data. Would that format be any use to you?
-
Same data, plotted with "lines" instead of "boxes"
-
ok I stuck in my 834N as its on DGteam1018 firmware using the pause 5 command and results were the same (login error)...so looks like Netgear FW only... I dont mind as my GT is now a spare and Iam using it as a "LINE TESTER" at customers houses hehe I can use DMT Tool to fire any advanced commands to it anyway.. so im happy enough, at least DMT Tool works with DGteam firmware and that will give me an idea if any of my line stats have changed on my 834N and then I can run GNUplot myself if there has been with the GT or 834N with Netgear firmware, or if I can manually copy & paste results into log files from DMT Tool telnet command results then even better..means I can still get results with my 834N on DGteam :)
I like them with the stats at the side and using lines instead of boxes :) (would of been better if they matched the SNR & BIT LOADING with red filled as values and white space above that, as before it was reverse of the what the SNR & BL was (white as the values and red as space above them))
-
The infill of the colour was actually correct as BE initially showed it. ::) Why?
Here's my hint -- Take a look at the y-axis of those two graphs and the sign of the values being plotted. ;)
-
The infill of the colour was actually correct as BE initially showed it. ::) Why?
Here's my hint -- Take a look at the y-axis of those two graphs and the sign of the values being plotted. ;)
ahh yes I see hehe, thanks for pointing that out..still...woud be nice if the fill colours could reversed on those two to make it easier to compare
-
I think what you are really saying is that it would be nice if the two graphs could be rotated through 180 degrees around the x-axis! ;D
-
Are you ready to let us make the graphs at our end yet?
-
@ B-Kat - I know what you mean, but I like them they way they are as you can see the noise (QLN) as 'raised' spikes and the Hlog can be compared to your SNR to see just what kind of slope you would have on noise free line, so you can see how affected your SNR is by the QLN , maybe the QLN tipped upside down 180' ...but, naahh im happy with that ...thanks very much Bald_Eagle :)
@ arobertson545 - pm me your email and I will send you the files that BA sent to me, he asked me to forward them to you as one is a 12Mb zip file, it works a charm
heres mine (im getting extra noise on line late at night causing as much as 1Mb loss in speed)
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fimg443.imageshack.us%2Fimg443%2F6034%2Flinestatsl201205162156.png&hash=7f110608635935dcafaef8a7d13ac373cbc4472b)
-
maybe the QLN tipped upside down 180' ...
Like this?
Hmmm.........
-
now that I see it....nahh!!! hehe...
think its fine way it is :)
-
now that I see it....nahh!!! hehe...
think its fine way it is :)
Agree with you entirely. It is logical to have increasing positive values in a "northerly direction" and increasing negative values in a "southerly direction". The "oddness" appears, at a first glance, when the solid colour in-fill rather than a line plot is used. :-X
-
Everything is working fine. Now, I think the next thing we need to do is setup SNRM monitoring like RouterStats does. If that is possible I would really appreciate it.
Thank you very much for all your help so far!
-
Everything is working fine. Now, I think the next thing we need to do is setup SNRM monitoring like RouterStats does. If that is possible I would really appreciate it.
If it's only SNRM & Sync speed monitoring, that shouldn't take too long.
If you mean all the other stuff, that would take quite a while as everything has been written specifically for the HG612 & VDSL2 connections.
If you are comfortable with editing batch files, you could have a go at converting the HG612 batch files for use on ADSL connections.
The principles would be roughly the same.
The relevant files are getstats.BAT & graphpd.BAT plus a couple of others for setting up the harvesting schedule via Windows Task Scheduler.
-
It's just the SNRM and sync speed. But if possible, could that be done quite soon as that is what I mainly want to do.
Sorry to sound a bit aggressive.
-
It's just the SNRM and sync speed. But if possible, could that be done quite soon as that is what I mainly want to do.
Before attempting to graph SNRM & Sync etc, I need to know if harvesting the stats, sorting them into a suitable format & logging to an ongoing file works properly.
I can't test this myself as I don't have access to a live ADSL connection.
Please try out the batch file included in the attached zip file.
It should create a new subfolder named Ongoing_Stats.
In that folder a file named modem_stats.log should be created & a new row of data should be added every time the batch file is run & it should look something like this:-
17/05/2012 19:47 10866 1142 7.3 7.8 19.1 12.3 13456 1172 ADSL2+ 26.5 8.4
17/05/2012 19:48 10866 1142 7.3 7.8 19.1 12.3 13456 1172 ADSL2+ 26.5 8.4
17/05/2012 19:49 10866 1142 7.3 7.8 19.1 12.3 13456 1172 ADSL2+ 26.5 8.4
17/05/2012 19:50 10866 1142 7.3 7.8 19.1 12.3 13456 1172 ADSL2+ 26.5 8.4
17/05/2012 19:51 10866 1142 7.3 7.8 19.1 12.3 13456 1172 ADSL2+ 26.5 8.4
Try to run the script a few times, ideally crossing over from one minute to the next & then let me know how you get on, reporting any error messages etc.
If things go quite wrong, an Error log may also be appended in the Ongoing_Stats folder.
If manually running the script works, email the resulting modem_stats.log to me, or post it here & I will add some graphing & set up the harvesting to auto-run on a 1 minute schedule until you decide to stop it.
-
Running perfectly with no errors apart from "Couls Not Find C:\ADSL_Stats\Ongoing_Stats\temp2". Here is the log:
17/05/2012 21:30 6976 448 4.1 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
17/05/2012 21:31 6976 448 3.8 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
17/05/2012 21:32 6976 448 3.8 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
17/05/2012 21:33 6976 448 3.8 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
17/05/2012 21:34 6976 448 4.1 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
17/05/2012 21:36 6976 448 3.9 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
-
A few more batch files are included in the attached zip file for you to play with.
These SHOULD start & stop the 24/7 data logging, but they are again untested at my end.
Again, please let me know how you get on with them (or not)
-
There were no errors when starting "START_LOGGING_24-7". The data is successfully being added every minute, automatically to "modem_stats"
-
For example:
18/05/2012 07:06 6976 448 4.6 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
18/05/2012 07:07 6976 448 4.6 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
18/05/2012 07:08 6976 448 4.6 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
18/05/2012 07:09 6976 448 4.4 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
18/05/2012 07:10 6976 448 4.8 23.0 19.7 11.9 7520 1088 G.DMT 42.0 26.0
-
There were no errors when starting "START_LOGGING_24-7". The data is successfully being added every minute, automatically to "modem_stats"
Could you send the whole modem_stats.log to me or post it here?
-
Here you go.
-
I'll have to do something to the scripts to show that you weren't logging between 21_36 last night & 07:06 this morning.
2 graph sets attached, one with last night's data included & the other with just this morning's data.
A full 24 hours (ideally much more) of continuous logging may identify issues at certain times of day/night.
-
The script for graphing the Ongoing stats from modem_stats.log is attached.
Again, extract it to the Scripts folder & just double-click it.
You will be given the chance to specify how much to graph & the output will be stored in dated subfolders of Ongoing_Stats.
Compatible logs can also be dragged & dropped onto it, if required.
It is pretty much a test version, with lots of it disabled at the moment (needs quite a bit of rewriting to suit ADSL connections).
However, it will generate the 4 graphs I attached earlier.
-
There were no errors when starting "START_LOGGING_24-7". The data is successfully being added every minute, automatically to "modem_stats"
Just for curiosity, did you need to refer to the instructions for setting up 24/7 logging that I emailed to you, or did you find it self-explanatory anyway?
Also, which version of Windows are you using?
-
I downloaded that file and installed it into the scripts folder, when i run it I get the following with no output, iam using windows 7 64-bit
.Please Enter the period to plot ===> 5 m
About to start plotting etc........
The graphs will be plotted using 5 samples covering the latest 5 minutes
Usage: graphpdADSL raw_data_file
log does NOT exist
Press any key to continue . . .
Completed!
Press any key to continue . . .
-
Sounds like you don't have modem_stats.log gradually being updated in the Ongoing_Stats folder.
Have you actually started the logging via START_LOGGING_24-7.BAT?
-
sorry, i didnt see previous posts on previous page... I have acquired and installed the files,
ive sussed it just by playing with it :)
it seems to work, the LOG24-7 bat file installs and activates a task schedule which retrieves the data every 1 minute , the GraphdADSL.Bat will create a graph of X mins/hours from that data...yes ..? if so, say it has 10 hours of data and I enter 1 hour to be graphed...is it the first hour or last hour thats graphed? how does that work exactly?
edit: i see it works back over.. so if i say 1 hour it will show the last one hour in a graph..
I like this better than Router Stats because its silent and the graphing is better - if it was say 10 days worth of stats would they still appear in one graph? or are multiple graphs output? (one for each day) - I would rather one graph
thanks
-
I like this better than Router Stats because its silent and the graphing is better - if it was say 10 days worth of stats would they still appear in one graph? or are multiple graphs output? (one for each day) - I would rather one graph
Yep, all in one set of graphs.
e.g. 84 days of my connection attached (not an especially pretty sight).
-
works a charm ;)
almost 2 hours in and no debug problems yet :)
-
ok ive found a problem with it hehe
it does not close the cmd.exe or conhost.exe processes after its done
- i have 183 open processes lol...
-
Didn't have any problem getting the scripts to work with DGTEAM, just needed to set the login.txt files to have unix style EOL.
Was wondering is there a copy of ADSLGRAPH.BAT available?
-
Didn't have any problem getting the scripts to work with DGTEAM, just needed to set the login.txt files to have unix style EOL.
How do you do that?
I had to put them into text files for my VDSL2 scripts.
Maybe for ADSL they could be simply echoed directly to the Plink terminal & not actually stored in txt files at all?
e.g. (echo "admin" & sleep 1 & echo "admin" & sleep 1 & echo adslctl info --stats.................) ^| Plink -telnet -P 23 192.168.0.1 >> %SUBFOLDER%%LOGFILENAME% & so on?
Was wondering is there a copy of ADSLGRAPH.BAT available?
The full set so far are now included in the attached zip file.
They may well be amended/updated at some stage to include some more "useful" data collection & graphs such as error counts etc.
The basics are more or less all still in the batch files just "remarked" out to disable them from the conversion from the VDSL2 scripts.
Some variable names would need changing such as my VDSL2 scripts has OHF & OHFErr whereas the ADSL equivalents are SF & SFErr etc.
Maybe someone could spend an hour or two finding & replacing & testing on a live connection etc??????????
-
ok ive found a problem with it hehe
it does not close the cmd.exe or conhost.exe processes after its done
- i have 183 open processes lol...
It opens them & closes them using my VDSL2 scripts. (CMD.EXE 2 instances & CONHOST.EXE 1 instance)
The harvesting process does take quite a few seconds though (a lot of the time it is sleeping, so doing nothing).
Have you watched Task Manager for a full minute to see if they do close at some stage during the minute?
They should do.
Are you convinced it is these scripts that are leaving them open, or is it posssible you have something else running at the same time?
-
Some variable names would need changing such as my VDSL2 scripts has OHF & OHFErr whereas the ADSL equivalents are SF & SFErr etc.
Maybe someone could spend an hour or two finding & replacing & testing on a live connection etc??????????
I did actually have a go yesterday but I kept getting errors so I gave up. Could you give me a hand via TeamViewer or something similar?
-
i will have to get back to you as tea is ready.. but its only started since running that task scheduler
arobertson545 - do you have multiples of conhost and cmd running? my process list is up to 188 with about 130 of those cmd.exe and conhost.exe , i have now disabled the task
be ace if we get scripts running on DGteam , im having to leave my 834GT in to run these as I want DGteam on the 834N
-
The full set so far are now included in the attached zip file.
Thanks for the file.
How do you do that?
Notepad++ or a Dos2Unix utility are capable of converting the files from DOS to UNIX.
It was the CRLF verses LF problem. Remember I had to do a similar thing with my perl scripts as a CRLF EOL gave an additional blank line after displaying the results of the command. The CR would terminate the login name, however the remaining LF would be taken to be the password. Found that the EOL for the login sequence could be either CR or LF but not CRLF.
Attached are a copy of my stats
-
I did actually have a go yesterday but I kept getting errors so I gave up. Could you give me a hand via TeamViewer or something similar?
Most of the relevant info is already harvested & stored in temporary variables already (just not added to modem_stats.log yet):-
rem ********** Info just for testing **********
echo.
echo.
echo URL = %URL%
echo DTSTAMP = %DTSTAMP%
echo.
echo Mode = %MODE%
echo Channel = %CHANNEL%
echo Trellis = %TRELLIS%
echo Line Status = %LINE_STATUS%
echo Training Status = %TRAINING_STATUS%
echo INTERLEAVING = %INTERLEAVING%
echo.
echo SNRM = %SNRM%
echo Attn = %ATTN%
echo OUTPUT_POWER = %OUTPUT_POWER%
echo Attainable Rate = %ATTAINABLE_RATE%
echo SYNC = %SYNC%
echo.
echo AS = %AS% (seconds)
echo UAS = %UAS% (seconds)
echo.
echo.
echo SF = %SF%
echo SFErr = %SFErr%
echo RS = %RS%
echo RSCorr = %RSCorr%
echo RSUnCorr = %RSUnCorr%
echo HEC Errors = %HEC_ERRORS%
So, it's just a matter working out what has changed from one minute to the next for cumulative values such as RSUncorr.
The way my not partially disbled scripts work is that cumulative values are stored in the ongoing log file (modem_stats.log).
The next minute, the newly harvested cumulative value is compared against the cumulative value from the log file, any changes calculated, the new cumulative value is added to the log file & so is the value of the change.
e.g. if cumulative value last stored for RSUncorr was 1000, the new cumulative value is 1020, the increase is 20.
The new row being added to the log file would therefore include 1020 as cumulative & also 20 as error count in the last minute.
One minute intervals is the best that can be obtained with Task Scheduler.
It could all be done a completely different way, but personally I have no inclination to do that.
The downside is that within a one minute period anything could happen & my scripts might miss exactly when it happened.
My VDSL2 scripts do all that calculating etc. but as I'm not a programmer (far from it), it may not be the most efficient and/or elegant way to do it.
It works though & that's all I was interested in when I wrote the scripts.
What do you want to know & how can I try to help?
I presume TeamViewer is something similar to LogMeIn that I have used to monitor VDSL2 connections, where I could remotely see and/or operate the remote computer in real time?
-
What do you want to know & how can I try to help?
I presume TeamViewer is something similar to LogMeIn that I have used to monitor VDSL2 connections, where I could remotely see and/or operate the remote computer in real time?
Basically, if I edited it whilst you saw the screen, we could check it and then you could fix any errors. It also breaks down the time between me getting some data and you seeing it.
TeamViewer is just like LogMeIn. All you need to do is download it and enter some info that I will PM you and you can see my screen. Does that sound okay?
-
Notepad++ or a Dos2Unix utility are capable of converting the files from DOS to UNIX.
Ahah. I use Textpad which can do that.
Attached are a copy of my stats
QLN looks quite "interesting" & its effect can be clearly seen.
Can you actually hear any of that on your phone as crackles etc?
-
so this DOS to UNIX thing.. thats not for windows right?
-
ok..after about 8 minutes of the Task Scheduler running I have 13 cmd.exe's and 12 conhost.exe's open ??? they appear every minute, looks like 2 open and 1 closes
-
so this DOS to UNIX thing.. thats not for windows right?
It shouldn't be a problem.
We can sort that, when I can get round to it, unless rhohne fancies posting some "converted" login files to try out?
-
ok..after about 8 minutes of the Task Scheduler running I have 13 cmd.exe's and 12 conhost.exe's open ??? they appear every minute, looks like 2 open and 1 closes
With the task stopped, do you still see any CMD.EXE & CONHOST.EXEs running?
I can't see why that is happening at the moment.
Let's wait & see if arobertson545 has the same issue.
If not.........????
It could just be that I cut the script short to get "something" graphable & need to sort that out properly.
-
ive got notepad++ - is it saveas .sh file? (Unix Script File)
gunna give it a bash and report back :)
yeah with the task stopped I dont get any cmd.exe/conhost.exe opening and running every 1 minute, iam using windows 7 64-bit...dunno what arobertson545 is using
-
with unix style login text files the following is achieved
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.18 15:16:33 =~=~=~=~=~=~=~=~=~=~=~=
Login: admin
Password:
BusyBox v1.16.1 (2010-05-15 15:58:54 CEST) built-in shell (ash)
Enter 'help' for a list of built-in commands.
# adslctl info --Bits
....
the only mod I did to the scripts was to add back in the telnet login sequence ie.
(echo *1>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN1.TXT & echo **2>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN2.TXT & echo ***3>CON & sleep 1^
& echo adslctl info --stats & echo ****4>CON & sleep 1 & echo exit & echo *****5>CON & sleep 1^
& echo ******6>CON & sleep 2 & echo *******7>CON ) ^| Plink -telnet -P 23 192.168.1.1 >> %WORKING_FOLDER%\data$$
In notepad++ a file may be saved in unix format using the Edit->EOL Conversion->UNIX Format menu
-
thanks...
now I just need to add the login back in then :-X that code snippet , is that for the ADSLStats.BAT file for 'current' stats graphing..? or is it out of the new ones for 'Ongoing' graphs...?
thanks
-
i got so many bat files now im starting to forget which is for what lol...
ADSLstats.BAT is whats used to gather current stats, isnt it?...so i need the login put back in that, can anyone help?
-
yeah with the task stopped I dont get any cmd.exe/conhost.exe opening and running every 1 minute, iam using windows 7 64-bit...dunno what arobertson545 is using
Look at the end of this code in getADSLstats.BAT
rem ********** Info just for testing **********
echo.
echo.
echo URL = %URL%
echo DTSTAMP = %DTSTAMP%
echo.
echo Mode = %MODE%
echo Channel = %CHANNEL%
echo Trellis = %TRELLIS%
echo Line Status = %LINE_STATUS%
echo Training Status = %TRAINING_STATUS%
echo INTERLEAVING = %INTERLEAVING%
echo.
echo SNRM = %SNRM%
echo Attn = %ATTN%
echo OUTPUT_POWER = %OUTPUT_POWER%
echo Attainable Rate = %ATTAINABLE_RATE%
echo SYNC = %SYNC%
echo.
echo AS = %AS% (seconds)
echo UAS = %UAS% (seconds)
echo.
echo.
echo SF = %SF%
echo SFErr = %SFErr%
echo RS = %RS%
echo RSCorr = %RSCorr%
echo RSUnCorr = %RSUnCorr%
echo HEC Errors = %HEC_ERRORS%
echo.
rem ********** FOR TESTING ONLY, APPEND SOME OF THE DATA TO THE LOGFILE & THEN EXIT.**********
rem ********** Append the formatted data to the log file **********
echo %DTSTAMP% %SYNC% %SNRM% %OUTPUT_POWER% %ATTAINABLE_RATE% %MODE% %ATTN% >> %LOGFILE%
del %WORKING_FOLDER%\TEMP
rem del %WORKING_FOLDER%\temp2
del %WORKING_FOLDER%\data$$
pause
exit
If pause is still there, either change it to rem pause or just delete pause.
Because it now runs silently, I hadn't noticed that I had forgotten to remove the need for a key press :-[ :-[
I think that should sort it.
-
i got so many bat files now im starting to forget which is for what lol...
ADSLstats.BAT is whats used to gather current stats, isnt it?...so i need the login put back in that, can anyone help?
Yep,
You will probably also need to put it back into the similar part of getADSLstats.BAT too.
Maybe the batch file names need changing to something more in line with what they actually do.
CurrentStats.BAT might be a suitable name?
-
As for the crackles I haven't noticed any.
Attached is one of my QLN snapshots I took last year.
@snadge
its just a matter of adding back in the type commands, the example given was for my getADSLstats.bat
ie changing
& echo **2>CON & sleep 1 & echo ***3>CON & sleep 1^
to
& type %LOGIN_FOLDER%\LOGIN1.TXT & echo **2>CON & sleep 1^
& type %LOGIN_FOLDER%\LOGIN2.TXT & echo ***3>CON & sleep 1^
Forgot that I also changed detection of AS & SFErr as they were blank, but think this is just a change in format of DGTEAM
result
rem ********** Set the SFErr values **********
rem for /f "delims=" %%a in ('gawk "/SFErr:/ { print $2, $3 }" %WORKING_FOLDER%\data$$') do @set SFErr=%%a
for /f "delims=" %%a in ('gawk "/SFErr\(CRCErr\):/ { print $2, $3 }" %WORKING_FOLDER%\data$$') do @set SFErr=%%a
rem ********** Set AS (AS) **********
rem for /f "delims=" %%a in ('gawk "/^AS:/ { print $2 }" %WORKING_FOLDER%\data$$') do @set /A AS=%%a
for /f "delims=" %%a in ('gawk "/^AS\(Uptime\):/ { print $2 }" %WORKING_FOLDER%\data$$') do @set /A AS=%%a
-
yeah changed name,
im struggling inserting the code though, I jst replaced the 2 lines of login code from the snippet above on rhones snippet but it says specified file could not be found? think its the location... %LOGIN FOLDER%
i thought same about his QLN stats :o
-
yeah changed name,
im struggling inserting the code though, I jst replaced the 2 lines of login code from the snippet above on rhones snippet but it says specified file could not be found? think its the location... %LOGIN FOLDER%
i thought same about his QLN stats :o
I've lost track of what I've sent out now.
Near the top of ADSLStats.BAT, now renamed to CurrentStats.BAT, remove rem from the "rem SET LOGIN_FOLDER=C:\ADSL_Stats\Apps" row
rem ********** Set the LOGIN folder **********
rem SET LOGIN_FOLDER=C:\ADSL_Stats\Apps
-
Just musing . . . With a "distinctive" QLN graph as that of rhohne, I wonder if Asbokid will apply his skills and tell us rhohne's location within the UK? :P
-
Just musing . . . With a "distinctive" QLN graph as that of rhohne, I wonder if Asbokid will apply his skills and tell us rhohne's location within the UK? :P
he he he
-
ok got it working on DGteam on my 834N :) :)
I entered
C:\ADSL_Stats\Apps
directly into the code instead of using %LOGIN_FOLDER% which didnt work with our without the code that set LOGIN_FOLDER as C:\ADSL_Stats\Apps
find my stats attached
thanks rhone , i now need to amend the other one
(I wonder if this was the problem all along? - gunna retry with non unix files)
answer: no, but thought it was gunna cos it got further ..ah well, at least we know how to get it working on DGTeam thanks to rhone
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.18 20:49:35 =~=~=~=~=~=~=~=~=~=~=~=
Login: adminpasswordadslctl info --Bits
Password:
adslctl info --linediag
-
ok ive amended the getADSLstats.BAT to have the same login data and it works....but its only been running 5 minutes , if I enter anything a bit longer than its been running then I get fuzzy text where the time is - it did not do this before?
e.g. attached is graph when choosing 1 hour , if I leave it blank for 24 hours its fine?
other than that it works brilliantly - thanks again to Bald_Eagle and Rhone , now the scripts work on DGteam firmware which is great :) now I can leave my 834N in with DGTeam firmware installed and pull stats at click of a button...brilliant...if I had money I would donate!!
-
ok got it working on DGteam on my 834N :) :)
I entered
C:\ADSL_Stats\Apps
directly into the code instead of using %LOGIN_FOLDER% which didnt work with our without the code that set LOGIN_FOLDER as C:\ADSL_Stats\Apps
find my stats attached
thanks rhone , i now need to amend the other one
(I wonder if this was the problem all along? - gunna retry with non unix files)
answer: no, but thought it was gunna cos it got further ..ah well, at least we know how to get it working on DGTeam thanks to rhone
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.18 20:49:35 =~=~=~=~=~=~=~=~=~=~=~=
Login: adminpasswordadslctl info --Bits
Password:
adslctl info --linediag
To make it easier for me, could you post the code that I need to change, or even better a new batch file?
Thank you.
-
okily dokily do :)
find attached the files zipped
they have been set so that the new login files are in C:\ADSL_Stats\Apps so you must have in same C;\ drive and folder names and your setup is installed how Bald_Eagle explained (which it should be or it wouldnt work anyway) ;D
1. in GET CURRENT STATS is the BAT file we used to graph the current stats, it was called ADSLStats.BAT but I changed it to GET CURRENT STATS.BAT just to make it easier to kow which one it was as I had 7 or 8 I think...
2. getADSLstats.BAT is the one that log the ongoing stats
3. in the apps.zip file are the new amended logins in UNIX format with admin/password as default logins, you must put these in the apps folder overwriting the ones there...assuming you use the default username & pass..
these work a charm on DGTeam fw :)
-
ok ive amended the getADSLstats.BAT to have the same login data and it works....but its only been running 5 minutes , if I enter anything a bit longer than its been running then I get fuzzy text where the time is - it did not do this before?
e.g. attached is graph when choosing 1 hour , if I leave it blank for 24 hours its fine?
If you would like to post or email your modem_stats.log, I'll have a look at what you mention.
-
thanks BA
find it attached :)
-
can I delete the contents of that log to start afresh if I wanted?
it seems to work ok now, think it just needed time to run continuing on from previous stats.. I will leave it running now :)
I wished I had some money to donate for your hard work... but Iam skint :( cant say how much I appreciate your efforts -THANK YOU!! and big thanks to rhone for sussing the DGTeam bit :)
-
Not working :(. I think it is because I use different login details than the defaults. What do I need to change?
-
can I delete the contents of that log to start afresh if I wanted?
it seems to work ok now, think it just needed time to run continuing on from previous stats.. I will leave it running now :)
I wished I had some money to donate for your hard work... but Iam skint :( cant say how much I appreciate your efforts -THANK YOU!! and big thanks to rhone for sussing the DGTeam bit :)
At the time you were trying to run 1 hour graphs (60 1 minute samples) you had a few hours gap in the log.
I think this caused the problem.
Yes deleting older data would work, or letting it run long enough to graph a suitable period as you have found will work.
-
This is the contents of my log:
=~=~=~=~=~=~=~=~=~=~=~= Plink log 2012.05.18 22:09:46 =~=~=~=~=~=~=~=~=~=~=~=
login: adminPASSWORDBLANKEDOUTadslctl info --Bits
^@
Password:
adslctl info --linediag
^@
Login incorrect
login: Password:
adslctl info --stats
^@
exit
^@
Login incorrect
login: Password:
Login incorrect
-
Not working :(. I think it is because I use different login details than the defaults. What do I need to change?
The login1.txt and login2txt files I have sent you, change the login1.txt to your login username and login2.txt to login password and CTRL+S to save, then put them in APPS folder overwriting ones in there, you must change the ones I sent you as they are UNIX versions which work with DGTeam fw... just to be sure, I have tried editing them ones in windows notepad then opening in notepad++ to check and they stay as UNIX versions :) so will still work (I thought that perhaps saving them in windows notepad would revert them back to DOS but doesnt appear too)
-
Just musing . . . With a "distinctive" QLN graph as that of rhohne, I wonder if Asbokid will apply his skills and tell us rhohne's location within the UK? :P
BBC Radio 5 AM is the worst offender (in every sense). There's a Downing Street petition to have it shut down for its vile noise pollution.
Some 10 years ago, I was staying at my parents' house in the Black Country heartlands.
It was around 1am when a tremendous guttural rumbling came from the very bowels of the earth. The walls literally shook. Books were falling from their shelves. All the cats were howling manically. And my mother, still in her hair curlers, was stamping on the floor upstairs and bellowing down to me: "Wor am yam dewin kid?" (local dialect for STFU).
After much head scratching, it dawned on me that we were in the epicentre of an earthquake!
I flicked on the radio for urgent Government advice. Hush! The familiar voice of Edwina Currie soon came belching across the airwaves from the Pebble Mill studios in Brum. Back then, Currie was tucked safely into the graveyard slot at Radio 5 to ensure that no one sane had to listen to her.
Currie's impassioned words to her anxious audience were "My goodness! Did the earth move for you, too?!"
*shudder!*
Ten years later, an horrific image still haunts me: Edwina Currie and boring John Major working late into the night on their Top Secret "earth-moving" exercises.
-
Working perfectly now. Thanks snadge :) . Attatched are some sample graphs and stats. I am using the NETGEAR DGN2000 now and it shows QLN data.
-
Just musing . . . With a "distinctive" QLN graph as that of rhohne, I wonder if Asbokid will apply his skills and tell us rhohne's location within the UK? :P
Sorry, sergeant, can't triangulate on this one...
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww5.picturepush.com%2Fphoto%2Fa%2F8288388%2Foimg%2FAnonymous%2Frhohne-qln2.png&hash=2c3cfec360d083c5563017c41ee729096930dbdd) (http://picturepush.com/public/8288388)
That noise looks suspicious like the EMF spew from a switched-mode power supply..
The noise peaks caused by PSU equipment tend to be at the switching frequency of the regulator in the PSU, and at the harmonics of that frequency... [1]
Analysing the distance between those harmonics (their periodicity) can be used to discover the fundamental frequency of the switching regulator.
[1] http://forum.kitz.co.uk/index.php/topic,10769.msg211846.html#msg211846
-
I would just like to say a massive thank you to Bald_Eagle1 for all of his help. He really has been excellent. Now that everything is working, I guess the only thing left to do is setup error monitoring? But that isn't very urgent.
-
Hello asbokid,
Is there anything irregular about my QLN graph?
-
Working perfectly now. Thanks snadge :) . Attatched are some sample graphs and stats. I am using the NETGEAR DGN2000 now and it shows QLN data.
no probs :) chuffed to bits now its working on DGTeam :)
I got the Ongoing Graphs (1 minute sampling) running on it too :)
@ ASBOKID - hahaha Edwina Currie .... ive never expereinced an Earthquake yet (or chances are I have but not been aware of it) , so theres a petition eh? it hasnt got my signature...where is it!!!
-
I would just like to say a massive thank you to Bald_Eagle1 for all of his help. He really has been excellent. Now that everything is working, I guess the only thing left to do is setup error monitoring? But that isn't very urgent.
I second that!!! :)
he has been great!! those graphs are just what I wanted :) :)
-
Hello asbokid,
Is there anything irregular about my QLN graph?
Hello arobertson545,
The QLN graph doesn't look very pretty. Some nasty noise spikes on there, presumably from RFI ingress. The noise doesn't take on the same appearance as interference from a PSU. It looks like AM broadcast radio interference.
If you want to publish the raw data that you used to sketch the graphs, we can try to triangulate you using it! [1].
Incidentally, are you plotting enough subcarriers? The graphs stop at DMT#256. Should they be plotted up to DMT#512 for ADSL2+?
cheers, a
[1] http://en.wikipedia.org/wiki/Triangulation
-
look forward to this asbokid :) , he is on ADSL1 so his graphs ok...
thanks to these graphs I have been able to show the noise increase on my line from about 9pm onwards, see my post here (http://forum.kitz.co.uk/index.php?topic=11176.msg217171#new)
-
If you want to publish the raw data that you used to sketch the graphs, we can try to triangulate you using it! [1].
That sounds a bit scary. Will you be able to find out my address, etc or just the overall area?
-
Could you fellas either post here or email me an example Plink log as gathered with DGTeam f/w installed AND an example Plink log as gathered with original Netgear f/w installed, for comparison purposes?
G.DMT, ADSL2 & ADSL2+ logs would be ideal.
-
If you want to publish the raw data that you used to sketch the graphs, we can try to triangulate you using it! [1].
That sounds a bit scary. Will you be able to find out my address, etc or just the overall area?
just the area hehe, he was able to get within a few miles of my location..
-
@ BA - find attached a P-Link log with DGTeam fw (ADSL2+)
-
@ BA - find attached a P-Link log with DGTeam fw (ADSL2+)
I THINK I have now updated getADSLstats.BAT to populate modem_stats.log with more data (error counts etc.), to work with either DGTeam firmware or Netgear firmware.
The names for some of the data items are different depending which firmware is installed.
I'm not sure though if the login details work for both firmware types.
All being well, it should at least work with DGTeam firmware installed.
Anyway, could you try the attached version out?
If it works, email or post a modem_stats.log with say at least 30 minutes worth of the additional data.
The additional data should just be added to your ongoing modem_stats.log so there should be no need to start logging from the beginning again.
You should still be able to plot the same graphs that you are able to plot at the moment.
With this additional data, extra graphs should be able to be generated.
I need to test the output though before I post an updated graphing script. Hence the need for a modem_stats.log with the additional data included.
-
Attatched is the QLN data.
-
I don't know if this was supposed to happen, but "START_LOGGING_24-7" errors now. Do I have to use the "getADSLstats" batch file manually?
-
I don't know if this was supposed to happen, but "START_LOGGING_24-7" errors now. Do I have to use the "getADSLstats" batch file manually?
No, it should still be scheduled.
Problem is, I can't actually test things at my end :(
Any error messages to report?
Are you using DGTeam or Netgear firmware?
Were you using this batch file name previously (getADSLstats.BAT)?
It should run silently via Task Scheduler.
It might be worth trying to run it manually to see how far it gets.
Various things should be echoded to screen while your run it manually.
-
I am using the NETGEAR firmware. Right now, the stats aren't being automatically added to the modem_stats file.
Attatched is the log file (manually obtained data) and the error file.
-
It actually works fine when the data is manually obtained. Which leads to a problem with the "START_LOGGING_24-7" batch file.
-
My fault,
I added some pause commands for trying to test at my end & again forgot to remove them.
This attached version might work.
-
My fault,
I added some pause commands for trying to test at my end & again forgot to remove them.
This attached version might work.
That's working perfectly now!
-
My fault,
I added some pause commands for trying to test at my end & again forgot to remove them.
This attached version might work.
That's working perfectly now!
Phew!
It's really difficult to debug when I can't actually test it myself.
Otherwise I would have noticed that problem.
As you are using the Netgear firmware, have you left in the logging in from Login1.TXT & Login2.TXT?
In other words, has it worked without needing to visit the Telnet enabling URL, or have you perhaps not rebooted the router since you last enabled Telnet access via the URL?
The data you obtained manually was obviously not much to work with, but so far, it seems to graph O.K.
The attached is the graph set from your manually obtained data.
It shows a connection of around 16 hours.
Does that seem about right?
-
As you are using the Netgear firmware, have you left in the logging in from Login1.TXT & Login2.TXT?
In other words, has it worked without needing to visit the Telnet enabling URL, or have you perhaps not rebooted the router since you last enabled Telnet access via the URL?
I haven't rebooted the router since using the telnet access URL. As RouterStats can automatically enable telnet without loading a webpage, I presume it can't be that difficult to add a command that does it for one?
It shows a connection of around 16 hours.
Does that seem about right?
Bang on.
-
Since it is working, can you provide me the graphing scripts with the new data to test how it works at my end?
-
hi guys...
so this new getADSLstats.bat file will gather errors..? ES & HEC.. what is HEC..? is that CRC..? for errors I monitor CRC and RS (and ES but ot as much as other two) , i monitor just how much of the RS codewords are being corrected, at normal 6-7db SNRM its usually about 0.1% of all traffic, at 3db SNRM its about 2-5% of all traffic thats being corrected
early days (and offtopic) but i think the SesDrop option in DGteam makes a difference to my CRC count when I have a low SNRM (less CRC's)..like I say early days yet, i wonder if it uses more CPU...last night I could not connect to the router and had to reboot...sorry for dwindling offtopic
-
Since it is working, can you provide me the graphing scripts with the new data to test how it works at my end?
Script attached.
Until there is sufficient additional data, you may need to experiment with graphing periods, using different muinutes/hours etc.
My earlier example from your stats was for just 9 minutes.
Please post or email your modem_stats.log at intervals so I can also check things at my end.
Although I have for now mainly concentrated on DS data, US data is also harvested.
I haven't got round to adding much US graphing yet, until everything all looks O.K. over a period of time.
-
Once again, thank you for everything.
-
Attached is another log file with more data.
-
The graphing script is also working perfectly. Attached are some graphs I just generated.
-
I am having a problem now. The logging gets a bit stuck and when I stop the logging, I am unable to delete the "date$$" file. Here is the error log:
19/05/2012 15:03:01.73 ***** It looks as though Plink had some sort of problem*****
login: adslctl info --stats
^@
Password:
exit
^@
Login incorrect
login: Password:
Login incorrect
login:
Login timed out after 60 seconds.
Let's see what is still running that might have caused the problem
19/05/2012 15:03:01.73 - Is curl running?
INFO: No tasks are running which match the specified criteria.
19/05/2012 15:03:01.73 - Curl wasn't killed - Maybe it wasn't running
19/05/2012 15:03:01.73 - Is plink running?
INFO: No tasks are running which match the specified criteria.
19/05/2012 15:03:01.73 - Plink wasn't killed - Maybe it wasn't running
19/05/2012 15:03:01.73 - Is sleep running?
INFO: No tasks are running which match the specified criteria.
19/05/2012 15:03:01.73 - Sleep wasn't killed - Maybe it wasn't running
19/05/2012 15:03:03.03 ***** Start of getstats.BAT data collection ERRORS **************************************
*** ATTEMPT #2 --- ERROR_COUNT = 0 ***
19/05/2012 15:03:03.03 - ERROR - First check - data$$ exists - IT SHOULD NOT EXIST
19/05/2012 15:03:03.03 - File Size of data$$ at first check = 157
19/05/2012 15:03:03.04 - data$$ successfully deleted
-
Forget that, the login files mysteriously disappeared! But, if there are errors in the collection, how can I delete the "data$$" file since it always says it is being used by a telnet program (I presume that is plog). Using the task manager closes the program, but it opens again a couple of seconds later.
-
I am having a problem now. The logging gets a bit stuck and when I stop the logging, I am unable to delete the "date$$" file. Here is the error log:
Occasionally it does get "stuck" at login stage (at least it does on my VDSL2 connection).
It should keep trying until eventually it can log in again.
Usually error count gets to 2 or 3 & attempts the same.
Very rarely, these get to 100 or so, but they are that quick that usually it is all resolved within the 1 minute sample period.
-
I have one more request (sorry :) ). Is it possible to combine the two graphing files so they graph all of the graphs at the same time? E.g. errors and SNR (not SNRM) together?
-
I have one more request (sorry :) ). Is it possible to combine the two graphing files so they graph all of the graphs at the same time? E.g. errors and SNR (not SNRM) together?
Firstly, is it logging & deleting temporary files properly again?
I had some remains of deleting login files in the earlier script which may explain what happened to your login files.
Slightly amended version attached.
When it's all eventually working properly, I'll remove all the redundant stuff.
Secondly, I'm not sure what you mean by combining the two graphing files.
Could you bit a bit more explicit?
-
Secondly, I'm not sure what you mean by combining the two graphing files.
Could you bit a bit more explicit?
Don't worry about that :).
-
Hello again,
On the uptime graphs, is it possible for it to be one line rather than lots of lines? I think it might look better that way. E.g. one line going across the no. of hours, not one line going across, then down, then another going up. Do you get what I mean?
-
Don't worry about that :).
No problem, I won't :lol:
More importantly, is it logging & deleting properly again?
-
More importantly, is it logging & deleting properly again?
Yes it is :).
-
On the uptime graphs, is it possible for it to be one line rather than lots of lines? I think it might look better that way. E.g. one line going across the no. of hours, not one line going across, then down, then another going up. Do you get what I mean?
When you have some more data, it will look more like my attachment, clearly showing the start & end of each connection up period.
-
More importantly, is it logging & deleting properly again?
Yes it is :).
Did it "fix itself" in the end?
If so, how many errors did you end up with & how many minutes did it take to fix it?
-
Did it "fix itself" in the end?
If so, how many errors did you end up with & how many minutes did it take to fix it?
Actually, before you sent it to me, I managed to delete all the files in the "Ongoing_Stats" folder. But, the issue hasn't reoccurred so that is hopefully a good sign.
-
When you have some more data, it will look more like my attachment, clearly showing the start & end of each connection up period.
I see :).
Thank you.
-
If you want to try it with lines instead of the boxes you could swap the red lines around:-
:DSL_UP_TIME_gnp
echo set terminal pbm color > dsl_up_time.gnp
echo set multiplot >> dsl_up_time.gnp
echo set title '%MODE% - Connection Up Time (FROM --stats) - (%DAYS% day period - 1 minute sampling)' >> dsl_up_time.gnp
echo set timestamp 'Graphed data begins %DTBEGIN% Graph created %%d/%%m/%%y %%H:%%M' 5,-1 >> dsl_up_time.gnp
echo set xlabel 'Time' >> dsl_up_time.gnp
echo set ylabel 'VDSL2 Up Time (HOURS)' >> dsl_up_time.gnp
echo set xdata time >> dsl_up_time.gnp
echo set timefmt "%%d/%%m/%%Y %%H:%%M" >> dsl_up_time.gnp
echo set xrange ["%DTBEGIN%":"%DTEND%"] >> dsl_up_time.gnp
echo set xtics %XTICS% nomirror rotate format "%%a-%%d %%H:%%M" >> dsl_up_time.gnp
echo set yrange [0:] >> dsl_up_time.gnp
echo set grid xtics back >> dsl_up_time.gnp
echo set grid ytics back >> dsl_up_time.gnp
echo set key top left noautotitle >> dsl_up_time.gnp
echo plot 'GDATA$$' using 1:49 linecolor 17 w boxes >> dsl_up_time.gnp
rem echo plot 'GDATA$$' using 1:49 linecolor 17 w lines >> dsl_up_time.gnp
echo unset multiplot >> dsl_up_time.gnp
goto :eof
EDIT:
Or you could fill the boxes with colour:-
echo plot 'GDATA$$' using 1:49 linecolor 17 w boxes fs solid >> dsl_up_time.gnp
-
Forgot that I also changed detection of AS & SFErr as they were blank, but think this is just a change in format of DGTEAM
rem ********** Set the SFErr values **********
rem for /f "delims=" %%a in ('gawk "/SFErr:/ { print $2, $3 }" %WORKING_FOLDER%\data$$') do @set SFErr=%%a
for /f "delims=" %%a in ('gawk "/SFErr\(CRCErr\):/ { print $2, $3 }" %WORKING_FOLDER%\data$$') do @set SFErr=%%a
rem ********** Set AS (AS) **********
rem for /f "delims=" %%a in ('gawk "/^AS:/ { print $2 }" %WORKING_FOLDER%\data$$') do @set /A AS=%%a
for /f "delims=" %%a in ('gawk "/^AS\(Uptime\):/ { print $2 }" %WORKING_FOLDER%\data$$') do @set /A AS=%%a
FWIW, these below now seem to work for both the official Netgear & DGTeam firmware versions:-
rem ********** Set the SFErr values **********
for /f "delims=" %%a in ('gawk "/SFErr/ { print $2, $3 }" %WORKING_FOLDER%\data$$') do @set SFErr=%%a
rem ********** Set AS (AS) **********
for /f "delims=" %%a in ('gawk "/AS/ { print $2 }" %WORKING_FOLDER%\data$$') do @set AS=%%a
-
Would you mind uploading an updated batch file for me to test.
-
Here's the full set so far...............
-
I am still getting issues. Despite it saying it has deleted the file, it hasn't and it keeps coming back, even though 24/7 logging is disabled.
-
A quick restart sorted it. No idea why it happened though.
-
I am still getting issues. Despite it saying it has deleted the file, it hasn't and it keeps coming back, even though 24/7 logging is disabled.
Is that the whole error log?
It starts off:-
19/05/2012 18:35:10.01 ***** It looks as though Plink had some sort of problem*****
& ends:-
19/05/2012 18:35:14.02 - data$$ successfully deleted
That is only 4 seconds later.
Has 24/7 logging been disabled via my batch file, or directly via Task Scheduler?
Can you see data$$ appearing & disappearing in the Ongoing_Stats folder?
If so, does it do it for the full minute, or just a few seconds?
Does it have this issue right from the start, or only after running for a while?
Is modem_stats.log still being updated each minute during these issues?
-
A quick restart sorted it. No idea why it happened though.
Was that a restart of the PC or the router?
-
A quick restart sorted it. No idea why it happened though.
Was that a restart of the PC or the router?
PC.
-
Anyone got a modem_stats.log with a few hours worth of the additional data in it?
I'd like to test these graphs with more than the 45 minutes or so of data that I have at the moment.
-
I'm trying the scripts with another router (NETGEAR DGND3700) and I am not having much luck. I think it is to do with how the DGND3700 presents its data through telnet, but I can't be 100% sure. Attatched are some of the graphs.
EDIT: The current stats graphs work fine.
-
sorry I aint been keeping up guys... been typing long worded replies and messages to sky :shoot:sky:comp::thumbdown:
which post has the latest scripts? I still only have the 4-way graphs at moment
ive noticed that my current graph scripts dont work when DMT is open...which is wierd? as far as im aware its not a constant live connection on DMT Tool (which would block the scripts)
EDIT: my current stats has stopped working... tried to write a none existent pipe on each attempt
EDIT2: rebooted pc and worked again...wierd
-
sorry I aint been keeping up guys... been typing long worded replies and messages to sky :shoot:sky:comp::thumbdown:
which post has the latest scripts? I still only have the 4-way graphs at moment
ive noticed that my current graph scripts dont work when DMT is open...which is wierd? as far as im aware its not a constant live connection on DMT Tool (which would block the scripts)
EDIT: my current stats has stopped working... tried to write a none existent pipe on each attempt
EDIT2: rebooted pc and worked again...wierd
Latest scripts (http://forum.kitz.co.uk/index.php/topic,11163.msg217230.html#msg217230) (Reply #178)
The non existant pipe message tends to show when there is an issue with logging in, or if by coincidence you try to get the current stats just at the same time as the every minute harvesting is in mid flow.
To avoid the second cause, I just grab my current stats (VDSL2) 20 seconds or so after the ongoing stats have been harvested (quick check against the taskbar clock or the desktop clock "gadget")
-
FWIW, it seems like I have found a way to enable Telnet access on the DG834GT that is still using official Netgear firmware.
A small free utility (wget) can silently do the same thing as entering 192.168.0.1/setup.cgi?todo=debug in your browser
It could be copied to the Apps folder & a few lines of code added to the current batch files to make it run before each data harvesting.
This may then ensure that telnet access is definitely enable for each time the stats are being harvested.
I can't test this on the one minure schedule 24/7 without an ADSL connection.
Anyone want to give it a try?
wget is available here:-
wget download (https://docs.google.com/open?id=0B7Kcea04kkOEZkNhVXA2TmlQTUU)
A test TelnetEnable batch file that just uses wget to enable Telnet & logs out again is also attached.
If you want to see what it does, just remove the '-q' at the start of each wget command.
Anyone got a modem_stats.log with a few hours of data in it yet?
-
I may be wrong here, but from memory, once telnet access has been enabled, it stays enabled until the router is rebooted. Of course it will do no harm to trigger the url each time but I think you actually only need to do it the once.
-
I may be wrong here, but from memory, once telnet access has been enabled, it stays enabled until the router is rebooted. Of course it will do no harm to trigger the url each time but I think you actually only need to do it the once.
I thought that too, but it seems that some users run other programs such as DMT Tool & so on that maight "grab control" of Telnet access, so this was an effort to find a way round that.
Also, it seemed the quickest way to automate things & not need to bother with checking for reboots etc.
FWIW, I have this running 24/7 on another PC, using DGTeam firmware.
As it isn't a live connection, not much is actually gathered in the way of stats, but it seems O.K.
I have also tried it with official Netgear firmware in another DG834GT.
Once Telnet is enabled, the Netgear firmware doesn't need additional login & password details, but they don't need removing from the batch file(s) as they are simply ignored.
rem *************************************************************
rem ***** This is the real code to use on a live connection *****
rem *************************************************************
rem ***** Quietly enable Telnet access *****
rem ***** Seems to need running twice to ensure login *****
wget -q httP://admin:password@192.168.0.1/setup.cgi?todo=debug
wget -q httP://admin:password@192.168.0.1/setup.cgi?todo=debug
rem ***** This one USES LOGIN FILES - needed if DGTeam firmware is installed *****
(echo *1>CON & sleep 1^
& type C:\ADSL_Stats\Apps\LOGIN1.TXT & echo **2>CON & sleep 1^
& type C:\ADSL_Stats\Apps\LOGIN2.TXT & echo ***3>CON & sleep 1^
& echo adslctl info --stats & echo ****4>CON & sleep 1 & echo exit & echo *****5>CON & sleep 1^
& echo ******6>CON & sleep 2 & echo *******7>CON ) ^| Plink -telnet -P 23 192.168.0.1 >> %WORKING_FOLDER%\data$$
rem ***** Quietly Logout of Telnet access *****
rem ***** THis is also run twice to ensure logout *****
wget -q httP://admin:password@192.168.0.1/setup.cgi?todo=logout
wget -q httP://admin:password@192.168.0.1/setup.cgi?todo=logout
rem ***** remove any of the enabling and disabling output files
del setup.cgi*.*
rem ************************************************************************
rem ***** This is the end of the real code to use on a live connection *****
rem ************************************************************************
-
Umm, yeah, forgot about possible other open telnet sessions so it makes sense to enable it each time 'just in case'.
BE wonders when upstream graphing will be available for his HG612 ;)
Also Paul, I dunno if you have considered this (http://www.f2ko.de/programs.php?lang=en&pid=b2e) or an equivalent.
-
BE wonders when upstream graphing will be available for his HG612 ;)
Funny you should mention that.
I have just started to do something about that this afternoon :)
Also Paul, I dunno if you have considered this (http://www.f2ko.de/programs.php?lang=en&pid=b2e) or an equivalent.
I can't remember if I tried that specific one, but I did try a few when I first started my scripts & found that some of the converters have some difficulty with environment variables & "non-standard" ways of doing things.
Once it's all finished, someone else can convert it all to a nice pretty Windows GUI anyway, can't they?
-
ok ive enabled logging for you and will check it in few hours and send you the log
following some instructions off a web page ive removed the PAUSE command on ADSLGRAPH.BAT and run a 1 hour schedule using a VBS script that runs CurrentStats.BAT silently (invisible) -brilliant!! - works too... now I can also have CURRENT STATS gathered every hour so I can compare my QLN and SNR stats graphs every hour and see the QLN increase over time on my line ..brilliant... thanks again for help..
Attached is the invisible.vbs script and amended ADSLGRAPH.BAT file which removes "press any key to continue...." from the end of it... :)
the task schedule was
launch program: wscript.exe
with argument:
"C:\ADSL_Stats\Scripts\invisible.vbs" "C:\ADSL_Stats\Scripts\GET CURRENT STATS.bat"
on every hour on daily basis.
:) all a learning experience this for me... making my own VBS script and editing BAT files , creating schedules...lol... i feel like a real pro haha
-
:) all a learning experience this for me... making my own VBS script and editing BAT files , creating schedules...lol... i feel like a real pro haha
Well done that man :thumbs: :clap:
& If you really wanted to, you could set up a spare router at someone's house & have it email the stats to you, either as log files to graph from the comfort of your own armchair, or already graphed for you 8).
EDIT:
Just a thought.
To avoid any potential clashes with 2 scripts trying to access the modem at the same time (Non-existant pipe error messages), in Windows 7 the schedules can be staggered by say 30 seconds or so or you could put say a 30 second wait (i.e. sleep 30) in Get Current Stats.BAT (before it accesses the modem via the Plink telnet session).
-
& If you really wanted to, you could set up a spare router at someone's house & have it email the stats to you, either as log files to graph from the comfort of your own armchair, or already graphed for you 8).
hey didnt know I could do that... :) (snadge's brain starts working overtime hehe)
EDIT:
Just a thought.
To avoid any potential clashes with 2 scripts trying to access the modem at the same time (Non-existant pipe error messages), in Windows 7 the schedules can be staggered by say 30 seconds or so or you could put say a 30 second wait (i.e. sleep 30) in Get Current Stats.BAT (before it accesses the modem via the Plink telnet session).
I thought about that... I think it easier if I stagger them in TS
Iam busy trying to convince my partner to ditch sky completely for TV , Phone & Broadband and get a Freesat+ PVR box and sign up wit Virgin Cable 100Mbps mmmm.....
edit: if i started the hourly schedule at 17:30:40 ..will the task start at 40 seconds past each time? or will it just start on the :00 ..? if so I will have to sleep the current stats for 30 secs like you say...thing is that means I have to wait 30 secs for it to run manually too...unless I create a second bat file for manual running
-
edit: if i started the hourly schedule at 17:30:40 ..will the task start at 40 seconds past each time? or will it just start on the :00 ..? if so I will have to sleep the current stats for 30 secs like you say...thing is that means I have to wait 30 secs for it to run manually too...unless I create a second bat file for manual running
You could watch the sytem clock to see what time the temp files are created and/or modem_stats.log is updated, but yes, it should start the task based on the time set in TS.
You can change the schedule timing via TS.
My own PC now runs my VDSL2 stats harvesting batch file at 30 seconds past every minute (Windows 7).
That was so I could test my scripts on a XP machine where I could only set the schedule to run on the minute.
I have remotely monitored other connections, emailing raw log files to me at various times of day/night.
I use 2 scripts on the remote PC - one for manual running (no waiting) & the other with a sleep 30 command for automated Plink logging to avoid clashing with the 24/7 modem_stats logging that again was on a XP machine so could only run exactly on the minute.
-
3 hours of logs are attatched with some graphs that I have made.
-
few hours of my logs too :)
also, i checked TS and next run time or my new task is 20:30:30 :) so i dont need to do anything, this gives ongoing_stats 30 seconds to extract the logs
-
3 hours of logs are attatched with some graphs that I have made.
It looked like that log contained a few "spurious" results.
I have removed those results & using the latest graphing script (v 3.0), I have plotted the last 178 minutes from your log.
-
few hours of my logs too :)
also, i checked TS and next run time or my new task is 20:30:30 :) so i dont need to do anything, this gives ongoing_stats 30 seconds to extract the logs
I have plotted the latest 77 samples from your log using the latest graphing script (v 3.0)
Did you manage to keep it running overnight?
I know from your other posts you are getting rather fed up with this whole Sky situation now.
But, just to put a positive slant on it, you wouldn't have had the chance to play about with scripting, scheduling & graphing if your connection had behaved itself ;)
-
15 hours worth of graphs attatched. I am pleased to report that everything is working perfectly.
-
Latest version 3.0 scripts attached.
These are likely to be the last versions updated directly by me, although I will be happy to provide some assistance to anyone else wishing to continue with this.
wget.exe, required for auto-enabling Telnet access is too large to attach here.
I believe snadge may be uploading all the files to a download site for which he will provide the link.
EDIT:
zip file deleted as it contained an incorrect version of CurrentStats.BAT.
See later message #204 for the correct version
-
I will once we have them working perfectly... I cant get the new currentstats.bat to work, in log it says login incorrect, but it seems to fail at the graphing stage?
here is the log from the CMD window (the files dont exist either as ive checked)
I think its the wget and debug link, Iam using DGteam so doesnt need debugging im sure...? I will test it tomoz with my GT on Netgear fw ...if it works then we could just upload 2 kits... one for DGTeam fw and one for Stock firmware
%1 = C:\ADSL_Stats\Current_Stats\Current_Stats_20120522-0050\Plink_20120522-00
0.log
****************************************************************************
Creating ADSL Connection Statistics Graphs - Version 3.0
Using Data from:-
C:\ADSL_Stats\Current_Stats\Current_Stats_20120522-0050\Plink_20120522-0050.l
g
Data obtained 22/05/12 00:50
****************************************************************************
************************************************************************
* The ADSL Mode could not be determined from "adslctl info --stats" *
* The data is either not present, or is unreadable *
************************************************************************
Defaulting to produce graphs scaled for G.DMT Mode (256 Tones)
The ADSL MODE was determined to be G.DMT
Creating Bits-20120522-0050.png
gnuplot> plot 'Bits.txt' w boxes fs solid
^
line 0: warning: Skipping data file with no valid points
Creating SNR-20120522-0050.jpg
gnuplot> plot 'SNR.txt' w boxes fs solid
^
line 0: warning: Skipping data file with no valid points
Creating QLN-20120522-0050.jpg
gnuplot> plot 'QLN.txt' w lines
^
line 0: warning: Skipping data file with no valid points
gnuplot> plot 'QLN.txt' w lines
^
line 0: all points y value undefined!
convert.exe: no decode delegate for this image format `C:/Users/Junior/AppData/
ocal/Temp/magick-HkxpOmFh' @ error/constitute.c/ReadImage/532.
convert.exe: missing an image filename `QLN-20120522-0050.png' @ error/convert.
/ConvertImageCommand/3016.
Creating Hlog-20120522-0050.jpg
gnuplot> plot 'Hlog.txt' w lines
^
line 0: warning: Skipping data file with no valid points
convert.exe: missing an image filename `stats-20120522-0050.jpg' @ error/conver
.c/ConvertImageCommand/3016.
convert.exe: missing an image filename `Counters-20120522-0050.jpg' @ error/con
ert.c/ConvertImageCommand/3016.
Creating Montage of:-
Bits-20120522-0050.png
SNR-20120522-0050.png
QLN-20120522-0050.png
Hlog-20120522-0050.png
montage.exe: unable to open image `stats-20120522-0050.jpg': No such file or di
ectory @ error/blob.c/OpenBlob/2589.
montage.exe: unable to open image `Counters-20120522-0050.jpg': No such file or
directory @ error/blob.c/OpenBlob/2589.
montage.exe: unable to open image `QLN-20120522-0050.png': No such file or dire
tory @ error/blob.c/OpenBlob/2589.
montage.exe: unable to open file `QLN-20120522-0050.png' @ error/png.c/ReadPNGI
age/3639.
montage.exe: unable to open image `stats-20120522-0050.jpg': No such file or di
ectory @ error/blob.c/OpenBlob/2589.
montage.exe: unable to open image `QLN-20120522-0050.png': No such file or dire
tory @ error/blob.c/OpenBlob/2589.
montage.exe: unable to open file `QLN-20120522-0050.png' @ error/png.c/ReadPNGI
age/3639.
montage.exe: unable to open image `Counters-20120522-0050.jpg': No such file or
directory @ error/blob.c/OpenBlob/2589.
Press any key to continue . . .
-
I will once we have them working perfectly... I cant get the new currentstats.bat to work, in log it says login incorrect, but it seems to fail at the graphing stage?
Oops! I had included the wrong version in the zip :-[
That version had the logging in files part omitted.
It would probably have worked with ordinary Netgear firmware, but not the DGTeam firmware.
Correct (I hope) versions now attached to this message.
It should now work with both firmware versions via just the one CurrentStats.BAT, the logging in bit being simply ignored when using Netgear firmware.
-
YEP That one works a charm :)
Ive noticed SRA is not upping my sync rate once noise is lower, Im having to reboot to get it back, 11:45am and I can get it past 10.5Mb because of the noise, it seems to me like its SLOWLY getting worse :( ...sorry for bleeding my problems over into this topic :(
-
YEP That one works a charm :)
Glad to hear that :)
Ive noticed SRA is not upping my sync rate once noise is lower, Im having to reboot to get it back, 11:45am and I can get it past 10.5Mb because of the noise, it seems to me like its SLOWLY getting worse :( ...sorry for bleeding my problems over into this topic :(
I for one would love see how that looks graphically.
Without SRA, I would normally expect to see fairly substantial changes in SNRM (upward when noise reduces & downward as noise increases).
The frequency & quantity of various error types would also usually change depending on noise levels/SNRM etc.
e.g. I tend to see a lot of RSCorr errors when my SNRM drops to low levels (3dB & lower), but SRA is not active on my VDSL2 connection, rather the connection just re-syncs when DLM thinks it has seen enough "problems".
(see the attached graphs)
This can be quite a problem when trying to work from home using online systems as data is "lost" & it takes for ever to log the various sytems back in again.
I am not working from home today.
Typically today is the day when my "disconnections when using the phone during warm dry weather" issue has started again.
Just when I'm not around to do any physical checking >:( >:(.
I can access my PC from work though (using LogMeIn - a great program).
I have also zoomed in to the 80 minutes or so (graphs attached) from when things were playing up this morning.
I might try remotely rebooting the modem to try to get a higher speed than the current 15Mb & see if that brings back the issue.
I actually heard the phone crackling this morning I have mentioned this to Plusnet in advance of this Friday's engineer visit.
Anyway, I digress...................