Kitz Forum

Broadband Related => Router Monitoring Software => Topic started by: roseway on August 05, 2014, 10:36:51 AM

Title: DSLstats pre-release version 5.0.2
Post by: roseway on August 05, 2014, 10:36:51 AM
This is work in progress, but I'm making it available now because (a) it might fix those strange errors which a small number of users have reported, and (b) it incorporates the new agreed scaling for the QLN and HLog graphs which was recently discussed.

Full list of changes since v5.0.1:

- all text pages now have "Copy to clipboard" buttons
- all graphs now have legends and "Hide legend" checkboxes
- all graphs with "Tone number" on the X axis now have a timestamp under the graph at the left
- changed the vertical scaling of the QLN and HLog graphs to better reflect the range of
  possible values
- fixed bug whereby resyncs weren't being detected (for alerts and for the resync count)
- fixed a small cosmetic error with snapshots on Linux systems
- fixed exception which resulted when manually editing the traffic monitoring "Model" box
- added option to take auto snapshots of the traffic graphs
- made some changes which may resolve issues with "List index (0) out of bounds" and
  "Division by zero" errors seen by some users

http://www.s446074245.websitehome.co.uk/downloads.html (http://www.s446074245.websitehome.co.uk/downloads.html)
Title: Re: DSLstats pre-release version 5.0.2
Post by: Ducky on August 05, 2014, 12:27:05 PM
Sweet, cheers for the update, I've been having a couple of issues with the program crashing.  Will try this version and see how it goes!  :)
Title: Re: DSLstats pre-release version 5.0.2
Post by: burakkucat on August 05, 2014, 12:50:32 PM
V5.0.2 has been downloaded to The Cattery.  :)

Testing is now in progress . . .  :angel:

Unfortunately my testing did not take very long . . . I attach three screen-scrapes to show what I observed.
Title: Re: DSLstats pre-release version 5.0.2
Post by: burakkucat on August 05, 2014, 01:16:06 PM
After deleting the configuration directory (~/.dslstats/) and then re-configuring the utility I now have it executing. So please ignore the third screen-scrape, above.  :)

Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on August 05, 2014, 02:52:03 PM
Thanks for the information.

Concerning the other two screenshots, this is another of those manual editing issues. That box isn't supposed to be manually edited, and I confirm that if you do, an access violation results. It will be fixed (and I'll have a good look to see if there are any others :) ).
Title: Re: DSLstats pre-release version 5.0.2
Post by: burakkucat on August 05, 2014, 03:48:05 PM
Quote from: roseway on August 05, 2014, 02:52:03 PM
That box isn't supposed to be manually edited, and I confirm that if you do, an access violation results. It will be fixed (and I'll have a good look to see if there are any others :) ).

I deliberately tried to perform a manual edit as a result of seeing the following line in your opening post --

Quote
- fixed exception which resulted when manually editing the traffic monitoring "Model" box

  ;)
Title: Re: DSLstats pre-release version 5.0.2
Post by: kitz on August 05, 2014, 04:29:44 PM
Good work eric - thank you.




-------
PS
Ive not been giving feedback of late because I've been testing some vdsl routers which have lantiq chipsets so unfortunately arent compatible with dslstats.
I will continue to report when I have a BCM modem/router back on.
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on August 05, 2014, 04:39:25 PM
Quote from: burakkucat on August 05, 2014, 03:48:05 PM
Quote from: roseway on August 05, 2014, 02:52:03 PM
That box isn't supposed to be manually edited, and I confirm that if you do, an access violation results. It will be fixed (and I'll have a good look to see if there are any others :) ).

I deliberately tried to perform a manual edit as a result of seeing the following line in your opening post --

Quote
- fixed exception which resulted when manually editing the traffic monitoring "Model" box

  ;)

I must be having a brainstorm. You raised this issue before, and I know I fixed it at the time, but somehow the fix got lost. I really will fix it next time. :-[
Title: Re: DSLstats pre-release version 5.0.2
Post by: burakkucat on August 05, 2014, 04:58:35 PM
Please don't worry too much over it . . . After all this is a pre-release package that we are all trying, deliberately, to break!  :D
Title: Re: DSLstats pre-release version 5.0.2
Post by: NewtronStar on August 05, 2014, 08:31:52 PM
I want to congratulate eric for DSLstats has become my number one lightning detector once i see the errored seconds rising and look at uk lightning graphs it confirms there are strorms 25 miles away.

will be downloading 5.0.2 once I get the washing off the line  ;D
Title: Re: DSLstats pre-release version 5.0.2
Post by: NewtronStar on August 05, 2014, 10:26:45 PM
Version DSLstats 5.0.2 running well on my system HG612 modem V3 with BT HH3 type A
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on August 05, 2014, 10:46:03 PM
Thanks NS. Perhaps I should produce a special commercial version of it and advertise it as a lightning detector. ;D
Title: Re: DSLstats pre-release version 5.0.2
Post by: krypton on August 06, 2014, 03:07:23 PM
Yes, it works well for this purpose especially with my overhead cable. Long time before the storm arrives the FEC error counter begins to increase.

click to enlarge
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fabload.de%2Fthumb%2Ffeczrjf4.png&hash=a48193be6603c4e86a80d1d9d60c24d8588663e6) (http://abload.de/img/feczrjf4.png)
Title: Re: DSLstats pre-release version 5.0.2
Post by: kitz on August 18, 2014, 06:13:01 PM
Just put the Zyxel back on and I happen to notice this

Quote
Stats recorded 18 Aug 2014 18:08:38

DSLAM/MSAN type:           IFTN:0xb203 / v0xb203
Modem/router firmware:     AnnexA version - A2pv6F039i.d24e
DSL mode:                  VDSL2
Status:                    Showtime
Uptime:                    49 min 5 sec
Resyncs:                   0 (since 18 Aug 2014 18:00:11)
         
            Downstream   Upstream
Line attenuation (dB):           
Signal attenuation (dB):   Not monitored      
Connection speed (kbps):   79987      20000
SNR margin (dB):           8.1      12.7
Power (dBm):               14.3      5.7
Interleave depth:          1      1
INP:                       0      0


The box is ticked in the settings and Im getting the following errors

Code: [Select]
18 Aug 2014 18:02:38 Error processing signal attenuation
18 Aug 2014 18:03:38 Error processing signal attenuation
18 Aug 2014 18:04:38 Error processing signal attenuation
18 Aug 2014 18:05:38 Error processing signal attenuation
18 Aug 2014 18:06:38 Error processing signal attenuation
18 Aug 2014 18:07:38 Error processing signal attenuation
18 Aug 2014 18:08:38 Error processing signal attenuation
18 Aug 2014 18:09:38 Error processing signal attenuation

These are the details via telnet

Code: [Select]
Discovery Phase (Initial) Band Plan
US: (6,31) (882,1193) (1984,2770)
DS: (33,857) (1218,1959) (2795,4083)
Medley Phase (Final) Band Plan
US: (6,31) (882,1193) (1984,2770)
DS: (41,857) (1218,1959) (2795,4083)
                  VDSL Port Details               Upstream                Downstream
Attainable Net Data Rate:           30854 kbps              88778 kbps
Actual Aggregate Tx Power:             5.7 dBm               14.3 dBm
====================================================================================
  VDSL Band Status U0 U1 U2 U3 U4 D1 D2 D3
  Line Attenuation(dB): 0.6 18.0 27.5 N/A N/A 10.8 24.0 37.8
Signal Attenuation(dB): 0.5 17.9 27.5 N/A N/A 10.6 23.9 37.8
        SNR Margin(dB): 14.4 13.0 12.6 N/A N/A 8.2 8.1 8.1
         TX Power(dBm): -6.0 -26.5 5.4 N/A N/A 11.9 7.4 7.4
 >
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on August 18, 2014, 06:39:41 PM
The line and signal attenuation shown in the stats summary are the overall values reported in adsl info --linediag and should show as not available or not reported on VDSL2 connections. The per-band values aren't currently shown in the summary. I need to check how this is handled in the stats summary and improve the wording.
Title: Re: DSLstats pre-release version 5.0.2
Post by: scotsmist on August 30, 2014, 03:03:50 PM
I extracted 5.0.2 to a new directory, deleted /.dslstats but when I executed dslstats the error appeared immediately. I clicked ok hoping it was a glitch but 24 hours later I get the error again "List index (0) out of bounds". Thinking out loud it appears to coincide with when average error rates over a 24 hour period, resets. I am going to click the Reset button on that one page now and see if when the error reappears tomorrow it coincides with the new time.
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on August 30, 2014, 03:44:38 PM
Sorry about this issue. I'll give it some more attention.
Title: Re: DSLstats pre-release version 5.0.2
Post by: scotsmist on September 11, 2014, 03:54:41 PM
Perhaps the following may help.

Just now when I clicked on the Check Now button under Program updates in the Misc tab of Configuration I get the "List index (0) out of bounds" error, immediately. A few moments ago I disabled Automatically check for updates to see if that is the issue, but I won't know until around 1 PM tomorrow.
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on September 11, 2014, 04:46:11 PM
It will be interesting, certainly. This one is a bit of a devil, because I can't reproduce it.
Title: Re: DSLstats pre-release version 5.0.2
Post by: AArdvark on September 11, 2014, 06:36:45 PM
Hi Roseway(Eric),

I am have been trying your DSLstats which works wonderfully but I cannot get the e-mail alerts to work.

When I push the test button something goes 'busy' the DSLstats GUI stops responding to any input/mouse click and I have to forcefully kill DSLstats via Task Manager.

The e-mail details are as per my mail prog 'Thunderbird' and I am using tls/ssl port 465 to yahoo's smtp server (See attached screen cap).

Is there something I need to enable or check permissions of to get this to work ?

Is there a log I can check to see what is hanging?

TIA


 
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on September 11, 2014, 10:56:25 PM
For the Windows version of DSLstats there are two DLLs which are included in the downloaded archive - libeay32.dll and ssleay32.dll. Make sure that these are there in the same folder as dslstats.exe. If they are there, you might try temporarily moving them to a different location (or renaming them). This will cause DSLstats to use the installed versions of these DLLs if they exist. If none of this works I'll have to think again.

The reason I think that the problem lies with one of these DLLs is that they are required for TLS emails to work, and this seems to be the most likely reason for the function hanging.
Title: Re: DSLstats pre-release version 5.0.2
Post by: AArdvark on September 12, 2014, 03:00:24 AM
Quote from: roseway on September 11, 2014, 10:56:25 PM
For the Windows version of DSLstats there are two DLLs which are included in the downloaded archive - libeay32.dll and ssleay32.dll. Make sure that these are there in the same folder as dslstats.exe. If they are there, you might try temporarily moving them to a different location (or renaming them). This will cause DSLstats to use the installed versions of these DLLs if they exist. If none of this works I'll have to think again.

The reason I think that the problem lies with one of these DLLs is that they are required for TLS emails to work, and this seems to be the most likely reason for the function hanging.

Thanks for the quick reply  it sparked the idea which solved the problem  ;D ;D
I tried deleting the old 'libeay32.dll and ssleay32.dll' I had in C:\Windows (would be picked up in the PATH for the user) and it did not work.

Solved, Yahoo have two alternative port numbers you can use to access mail (port 587 or 465) if your ISP does not allow port 25.
I use/used port 465 as my old ISP used to filter out port 25 & 587.
Port 465 is now being used by 'Thunderbird' my e-mail program as I have forgotten to change it, everything works OK.
If I use port 465 in DSLstats it does not work and hangs the GUI as reported.
If I change it to port 587 DSLstats works and the test email is sent.

Their appears to be some problem using port 465 when SSL/TLS is selected in DSLstats.

Hope the clue helps you to track the problem.

Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on September 12, 2014, 07:42:50 AM
Thanks for that information. I see that I use port 587 as well for my emails using 1&1. So there does seem to be a problem there, although I've currently got no idea where the problem is.
Title: Re: DSLstats pre-release version 5.0.2
Post by: ryant704 on September 12, 2014, 01:49:51 PM
Will check this out and give some feedback!
Title: Re: DSLstats pre-release version 5.0.2
Post by: scotsmist on September 12, 2014, 02:13:44 PM
Quote from: scotsmist on September 11, 2014, 03:54:41 PM
Perhaps the following may help.

Just now when I clicked on the Check Now button under Program updates in the Misc tab of Configuration I get the "List index (0) out of bounds" error, immediately. A few moments ago I disabled Automatically check for updates to see if that is the issue, but I won't know until around 1 PM tomorrow.

Deep joy, no error today.
Title: Re: DSLstats pre-release version 5.0.2
Post by: les-70 on September 14, 2014, 10:06:03 AM
    Given my inclination to use standby a lot I have not been raising my odd problems with reported error averages.  The router modem uptime values are the most predictable but when a resync occurs with no power on/off my values become averages over modem up times with values taken from since link time.  i.e. they can be very small rates if the router has been on a long while.  The 24 hour per hour rates sometimes work OK but often stick at zero.

 Might it be possible to have an option which just uses the modem reported values?  i.e. 24 hours averages to be based on " Latest 1 day time" in "info --stats" and up times averages to be since link time and based on "Since Link time".  The latest day could ideally be a proportional average of the latest day and previous day whenever the since link is more than 24 hours.

  Sorry to bother again on this!

 
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on September 14, 2014, 10:42:54 AM
Quote from: scotsmist on September 12, 2014, 02:13:44 PM
Deep joy, no error today.

Sorry, I thought I'd replied to this, but I must have forgotten to press "Post". Thanks again for the information, and assuming that your connection continues in the same way I can say that this problem is fixed in the next release.
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on September 14, 2014, 11:01:33 AM
Quote from: les-70 on September 14, 2014, 10:06:03 AM
Might it be possible to have an option which just uses the modem reported values?  i.e. 24 hours averages to be based on " Latest 1 day time" in "info --stats" and up times averages to be since link time and based on "Since Link time".  The latest day could ideally be a proportional average of the latest day and previous day whenever the since link is more than 24 hours.

It's certainly possible, but I can't give you a timescale I'm afraid. Real life duties are intruding at present.
Title: Re: DSLstats pre-release version 5.0.2
Post by: AArdvark on September 14, 2014, 06:42:01 PM
A question regarding how DSLstats & HGstats are supposed to work together without tripping up each other.

(How should they be setup to work together and not conflict ?)

I tried the 'HGstats-modem-Stats-co-operation' option which stopped any stats being collected at all by HGstats !!!

Also I have found recently that some sort of conflict can happen and DSLstats have been missed due to:

14 Sep 2014 16:58:37   Error processing signal attenuation
14 Sep 2014 16:59:37   Error processing signal attenuation
14 Sep 2014 17:00:36   Modem seems to be HG622 type
14 Sep 2014 17:00:38   Error running the HG622 workaround
14 Sep 2014 17:00:38   Recording paused
14 Sep 2014 17:00:38   Unknown Event
14 Sep 2014 17:10:38   Recording resumed
14 Sep 2014 17:10:44   Error processing signal attenuation

I have now set the 'Not HG622' option in DSLstats.
I have 'restart after pause' set to 10 mins hence the resume at 17:10:38

Title: Re: DSLstats pre-release version 5.0.2
Post by: NewtronStar on September 14, 2014, 06:47:30 PM
Is your HG612_Modem_Stats software fully up to date ?
and there is an update for dslstats it's v5.0.2

Graph6 = 4.0.0.0
Graphpd = 4.0.0.0
HG612 Stats Logging GUI = 4.0.5356.15443
HG612_current_stats = 4.0.0.0
HG612_stats = 4.0.0.2
Modems = 4.0.1.0
SET_HG612_Date_and_Time = 3.0.0.0

Title: Re: DSLstats pre-release version 5.0.2
Post by: AArdvark on September 14, 2014, 08:39:42 PM
Yes, all up to date.
Title: Re: DSLstats pre-release version 5.0.2
Post by: kitz on September 14, 2014, 08:39:59 PM
In the early days if you used both then there was a possibility that one or both programs could crash as they tried to collect stats at the same time..  and youd end up with one or both not recording, which you may notice for some time.  So times are staggered so that one runs on the minute and the other at 40seconds past.   DSLstats can also detect if HG612stats is still running

I'll leave the technical explanation to BE/Eric, but basically when you set cooperation mode, then the worst case situation if DSLstats detects that HG612modem stats is still harvesting data should be that DSLstats will miss a sample

for eg

Code: [Select]
10 Sep 2014 23:55:35 1 instance(s) of HG612_stats.exe running, sample missed
10 Sep 2014 23:55:35 Unable to login to modem/router
10 Sep 2014 23:56:35 1 instance(s) of HG612_stats.exe running, sample missed
10 Sep 2014 23:56:35 Unable to login to modem/router
Quote
I have now set the 'Not HG622' option in DSLstats.
You dont need to check that - selecting the correct model from the drop down list will be sufficient to identify your router.



If youre getting lots of unable to collect due to HG612 stats still running then something is perhaps wrong with the harvesting time.
HG612 modem stats should  be done by the time DSLstats starts at 40seconds past the minute.   However there may be still times when it isnt such as if say your processor is busy.. or conversely, if you have a high spec PC there may be times when your PC processor is much faster than the routers, so you end in a loop.  This used to happen for me with my i7 processor..  so BE kindly built in a setting to account for this.

The settings within HG612modemstats where you can adjust the speed for your processor type are

Settings > Additional settings > PCSpeed.

Although I have (what was at the time) a very fast PC - it will run fine at Medium setting.
Title: Re: DSLstats pre-release version 5.0.2
Post by: AArdvark on September 14, 2014, 09:35:09 PM
Thanks kitz, I have all set as you have advised.

I will try the 'co-operation' setting again and leave it for an hour or so.
(The 'no stats' was as it should work 'Worse-case' according to your info.)

I have changed the PC setting from fast to medium.

Thanks everyone for the wonderful software :clap: :clap: :clap: and support which is SO helpful. 
Title: Re: DSLstats pre-release version 5.0.2
Post by: roseway on September 14, 2014, 11:03:41 PM
Most of it has already been said, but I'll just say what happens in DSLstats when the 'co-operation' option is set (this all applies to Windows users only):

1. DSLstats delays the start of sampling (if necessary) so that it occurs between 35 and 40 seconds after the minute.

2. When a new sample is due, DSLstats checks if either HG612_stats.exe or HG612_current_stats.exe is running, and if it is, that sample is missed. This happens for a maximum of 5 samples, after which it stops the check for the next half an hour.

3. When sampling starts, a do-nothing process called dslstatssampling.exe is launched, and killed when sampling ends. HG612_Modem_Stats checks for this process before running, and delays running until the process aborts.

These measures should ensure that conflicts between the two programs are avoided.


A brief note about the HG622 messages: DSLstats attempts to detect the HG622 automatically, because it needs to modify its login behaviour slightly for this model. Sometimes, particularly under error conditions, DSLstats wrongly detects other models as the HG622, and login fails with the error messages mentioned above. If you see this behaviour you can avoid the error messages by setting the 'Not HG622' option.
Title: Re: DSLstats pre-release version 5.0.2
Post by: adslmax on September 15, 2014, 12:32:25 AM
Nice work roseway. Here is DSLstats v5.0.2

Code: [Select]
xdslcmd info --stats
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 0
Max: Upstream rate = 36567 Kbps, Downstream rate = 102416 Kbps
Path: 0, Upstream rate = 19999 Kbps, Downstream rate = 79987 Kbps

Link Power State: L0
Mode: VDSL2 Annex B
VDSL2 Profile: Profile 17a
TPS-TC: PTM Mode
Trellis: U:ON /D:ON
Line Status: No Defect
Training Status: Showtime
Down Up
SNR (dB): 12.2 23.2
Attn(dB): 0.0 0.0
Pwr(dBm): 12.5 -0.2
VDSL2 framing
Path 0
B: 239 237
M: 1 1
T: 23 42
R: 0 16
S: 0.0955 0.3781
L: 20104 5374
D: 1 1
I: 240 127
N: 240 254
Counters
Path 0
OHF: 19101274 3732662
OHFErr: 26 10
RS: 0 3459443
RSCorr: 0 166
RSUnCorr: 0 0

Path 0
HEC: 13 0
OCD: 0 0
LCD: 0 0
Total Cells: 562169315 0
Data Cells: 26312143 0
Drop Cells: 0
Bit Errors: 0 0

ES: 12 6
SES: 0 0
UAS: 17 17
AS: 31592

Path 0
INP: 0.00 0.00
PER: 1.64 3.97
delay: 0.00 0.00
OR: 116.54 64.47

Bitswap: 11 26

Total time = 8 hours 46 min 51 sec
FEC: 0 0
CRC: 26 0
ES: 12 6
SES: 0 0
UAS: 17 17
LOS: 0 0
LOF: 0 0
Latest 15 minutes time = 1 min 51 sec
FEC: 0 0
CRC: 0 0
ES: 0 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
Previous 15 minutes time = 15 min 0 sec
FEC: 0 0
CRC: 0 0
ES: 0 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
Latest 1 day time = 8 hours 46 min 51 sec
FEC: 0 0
CRC: 26 0
ES: 12 6
SES: 0 0
UAS: 17 17
LOS: 0 0
LOF: 0 0
Previous 1 day time = 0 sec
FEC: 0 0
CRC: 0 0
ES: 0 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
Since Link time = 8 hours 46 min 31 sec
FEC: 0 166
CRC: 26 10
ES: 12 6
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
#

The only one problem is Error processing signal attenuation in the event log but...the Telnet Data still ok below:
Code: [Select]
Signal attenuation (dB) U0 U1 U2 U3 D1 D2 D3
14 Sep 2014 23:47:19 2.3 12.4 18.8 N/A 6.9 16.0 24.8

Average error rates over 24 hour period:
Code: [Select]
Per second Per minute Per hour  Per day

CRC Up 0 0 0.11 2.74
Down 0 0 0.11 2.74

FEC Up 0 0.03 1.71 41.1
Down 0 0 0 0

HEC Up 0 0 0 0
Down 0 0 0.11 2.74

ES Up 0 0.01 0.68 16.4
Down 0 0.02 1.37 32.8
Title: Re: DSLstats pre-release version 5.0.2
Post by: AArdvark on September 15, 2014, 01:26:43 AM
All appears to be working OK.

Many Thanks.

At least I will have a record of the 'Quality' of my FTTC line as it dissipates under the onslaught of Crosstalk & DLM  ;D :no:
Title: Re: DSLstats pre-release version 5.0.2
Post by: kitz on September 15, 2014, 02:29:46 AM
Quote
The only one problem is Error processing signal attenuation in the event log but...the Telnet Data still ok below:

Turn off signal attenuation in Config > Items to Monitor.
It will still continue to report under Telnet Data > attenuation log.

I think its something to do with the fact that the HG612 and Zyxel dont report signal attenuation as one combined figure. The figure its expecting is total upstream and total downstream, but these routers only report 0.0
Code: [Select]
                Down            Up
SNR (dB):        8.4             11.7
Attn(dB):        0.0             0.0
Pwr(dBm):        14.3            4.4
Instead its split down into the 3 separate bands.

Code: [Select]
Signal Attenuation(dB):  0.4     17.6    26.8     N/A     N/A    10.4    23.4    37.0 
Turning off the first, doesnt stop the second set being logged under the Telnet data tab. :)