Kitz ADSL Broadband Information
adsl spacer  
Support this site
Home Broadband ISPs Tech Routers Wiki Forum
 
     
   Compare ISP   Rate your ISP
   Glossary   Glossary
 
Please login or register.

Login with username, password and session length
Advanced search  

News:

Pages: 1 ... 7 8 [9] 10 11 ... 14

Author Topic: HG612 Stats Editor updates  (Read 41679 times)

Bald_Eagle1

  • Helpful
  • Kitizen
  • *
  • Posts: 2721
Re: HG612 Stats Editor updates
« Reply #120 on: November 21, 2013, 09:17:01 PM »

Well in the telnet commands there is "since link time stats" and also "Total time"

Its odd as the Total time shows all CRC/FEC/SES/ES since reboot, its not inconsistent. Except that upstream CRC is always 0 (a bug I guess.)


Which firmware version are you using?
US CRC reported in Total time isn't always 0 for my connection (see the extracts from my connection below).
I'm currently using Wolfy's GUI version.


Quote
The since link time is consisten that they all reset to 0, but is also buggy, as my upstream shows FEC errors when its on fast path.

I also noticed that during the very rare occasions when my connection has been on Fastpath.
Asbokid provided a plausible explanation of how FEC (RSCorr) errors can sometimes be seen even when on fastpath, but I can't find a link to his explanation now.


FWIW, OHFErr & CRC are the same thing.


Quote
So I am guessing maybe he is mixing and matching not taking all stats from the "Since Link Time"?


My programs don't actually take any stats from "Since Link Time", but it can be seen that FEC & CRC data does match RSCorr & OHFErr data.



Quote
Since Link time = 21 hours 53 min 17 sec
FEC:            0               2504
CRC:            395             214
ES:             249             163
SES:            0               2
UAS:            0               0
LOS:            0               0
LOF:            0               0

and

Total time = 1 days 22 hours 10 min 31 sec
FEC:            0               0
CRC:            41791           0
ES:             16690           8650
SES:            31              95
UAS:            945             945
LOS:            0               0
LOF:            5               0

app reports

ES 16690 8650
CRC 395 214
FEC 0 2504




Code: [Select]

Counters
Bearer 0
OHF: 84950996 1927436
OHFErr: 34233 44
RS: 272569089 342665
RSCorr: 24977870 114
RSUnCorr: 1364787 0

Bearer 0
HEC: 309338 0
OCD: 27463 0
LCD: 27463 0
Total Cells: 168965033 0
Data Cells: 72988663 0
Drop Cells: 0
Bit Errors: 0 0

ES: 2683 83
SES: 59 0
UAS: 53 53
AS: 436109


Code: [Select]
Total time = 1 days 15 hours 48 min 34 sec
FEC: 33703014 225
CRC: 45936 87
ES: 2683 83
SES: 59 0
UAS: 53 53


Code: [Select]
Since Link time = 5 days 1 hours 8 min 27 sec
FEC: 24977870 114
CRC: 34233 44
ES: 1740 43
SES: 58 0
UAS: 0 0



My programs concentrate on reporting/graphing changes each minute rather than total data but regardless of how it is worked out, the changes per minute should still be be the same (whether calculating differences per minute (delta) using total data or data since resync/reboot).
See the attached montage.

Logged

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #121 on: November 22, 2013, 04:32:53 PM »

ok bald eagle the question is.  Are the since link time lines in your logs?

if yes then I guess ronski just needs to take the data from those lines instead, I reported the issue as an issue with the gui not your graphs :)

assuming its modem_stats.log ronski is using, if the figures are not in that file, is it hard to get those figures from the sinc elink time to add to that file so ronski can use?

also is there any implications of me deleting the modem_stats.log so it makes a new one? as well as the error logs as they getting pretty big.

currently all 3 logs total 1.6gig space usage which is pretty crazy.  I had to wait 4 minutes for notepad to open the modem_stats.log :)
Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE

Bald_Eagle1

  • Helpful
  • Kitizen
  • *
  • Posts: 2721
Re: HG612 Stats Editor updates
« Reply #122 on: November 22, 2013, 06:01:54 PM »

ok bald eagle the question is.  Are the since link time lines in your logs?


Yes & no, although some of the data in modem_stats.log does equate to data since the most recent resync (i.e. since link time).


Quote
if yes then I guess ronski just needs to take the data from those lines instead, I reported the issue as an issue with the gui not your graphs :)



All the relevant stats for ongoing graphing are recorded in xlogfile.txt each minute:-

Code: [Select]
xdslcmd info --stats
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 0
Last initialization procedure status: 0
Max: Upstream rate = 5005 Kbps, Downstream rate = 22504 Kbps
Bearer: 0, Upstream rate = 4877 Kbps, Downstream rate = 20695 Kbps

Link Power State: L0
Mode: VDSL2 Annex B
VDSL2 Profile: Profile 17a
TPS-TC: PTM Mode(0x0)
Trellis: U:ON /D:ON
Line Status: No Defect
Training Status: Showtime
Down Up
SNR (dB): 5.5 6.4
Attn(dB): 24.5 0.0
Pwr(dBm): 12.7 6.7
VDSL2 framing
Bearer 0
MSGc: 26 26
B: 51 143
M: 1 1
T: 64 37
R: 12 12
S: 0.0799 0.9355
L: 6408 1334
D: 405 1
I: 64 78
N: 64 156
Counters
Bearer 0
OHF: 104293431 1769623
OHFErr: 37698 56
RS: 929265357 3934136
RSCorr: 28104579 6898
RSUnCorr: 1506044 0

Bearer 0
HEC: 342223 0
OCD: 30331 0
LCD: 30331 0
Total Cells: 4119150843 0
Data Cells: 76717959 0
Drop Cells: 0
Bit Errors: 0 0

ES: 2919 96
SES: 73 0
UAS: 53 53
AS: 535405

Bearer 0
INP: 3.00 0.00
INPRein: 0.00 0.00
delay: 8 0
PER: 5.13 8.68
OR: 49.86 29.46
AgR: 20744.96 4906.37

Bitswap: 390762/390762 7698/7718

Total time = 1 days 19 hours 23 min 30 sec
FEC: 36829723 7009
CRC: 49401 99
ES: 2919 96
SES: 73 0
UAS: 53 53
LOS: 0 0
LOF: 0 0
LOM: 0 0
Latest 15 minutes time = 8 min 30 sec
FEC: 5205 0
CRC: 0 0
ES: 0 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0
Previous 15 minutes time = 15 min 0 sec
FEC: 17303 0
CRC: 14 0
ES: 4 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0
Latest 1 day time = 19 hours 23 min 30 sec
FEC: 1904015 22
CRC: 1992 7
ES: 131 8
SES: 12 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0
Previous 1 day time = 24 hours 0 sec
FEC: 3377005 6776
CRC: 4267 10
ES: 238 10
SES: 17 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0
Since Link time = 6 days 4 hours 43 min 25 sec
FEC: 28104579 6898
CRC: 37698 56
ES: 1976 56
SES: 72 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0


xdslcmd info --pbParams
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 0
Last initialization procedure status: 0
Max: Upstream rate = 5005 Kbps, Downstream rate = 22504 Kbps
Bearer: 0, Upstream rate = 4877 Kbps, Downstream rate = 20695 Kbps

Discovery Phase (Initial) Band Plan
US: (7,32) (871,1205) (1972,2782)
DS: (33,859) (1216,1961) (2793,3970)
Medley Phase (Final) Band Plan
US: (7,32) (871,1200)
DS: (33,859) (1216,1846)
  VDSL Port Details   Upstream   Downstream
Attainable Net Data Rate:      5005 kbps     22504 kbps
Actual Aggregate Tx Power:        6.7 dBm      12.7 dBm
====================================================================================
  VDSL Band Status U0 U1 U2 U3 U4 D1 D2 D3
  Line Attenuation(dB): 8.1 53.5   N/A   N/A   N/A 21.7 65.7   N/A
Signal Attenuation(dB): 8.1 52.6   N/A   N/A   N/A 30.5 65.4   N/A
SNR Margin(dB): 6.4 6.4   N/A   N/A   N/A 5.5 5.6   N/A
TX Power(dBm): -0.8 5.9   N/A   N/A   N/A 11.7 5.9   N/A


xdslcmd --version
xdslcmd version 1.0
DSL PHY: AnnexA version - A2pv6C038m.d24j
******* Pass *********





Quote
assuming its modem_stats.log ronski is using, if the figures are not in that file, is it hard to get those figures from the sinc elink time to add to that file so ronski can use?


I believe Ronski also uses some data from modem_stats.log & some data from xlogfile.txt.
I'm sure he'll confirm which data he uses for which purpose for us.




Quote
also is there any implications of me deleting the modem_stats.log so it makes a new one? as well as the error logs as they getting pretty big.


Just rename modem_stats.log or save it somewhere else & a new one will be generated at the next sample time.



Quote
currently all 3 logs total 1.6gig space usage which is pretty crazy.  I had to wait 4 minutes for notepad to open the modem_stats.log :)



Yes, they do get rather large after a while.

My own modem_stats.log is now around 300 MB in size, but it does go right back to October 2012.

The other logs are there mainly for debugging information.
If you are not experiencing any issues with my programs, just rename them or delete them as & when you wish.
New ones will be generated starting from the next sample time.

You can turn off 'extensive' event logging via Ronski's GUI, but you would then lose some of the debugging information.
It would only restrict the size of ERROR.LOG at the moment, but that switch will also turn off (restrict) the size of the other logs when I release a public update (soon).


Logged

Ronski

  • Moderator
  • Kitizen
  • *
  • Posts: 3625
Re: HG612 Stats Editor updates
« Reply #123 on: November 22, 2013, 07:25:59 PM »

I believe Ronski also uses some data from modem_stats.log & some data from xlogfile.txt.
I'm sure he'll confirm which data he uses for which purpose for us.

I get the majority from the modem log because I feel this is more reliable long term, if anything changes then it will be extra fields appended to the end of each line, not changes to previous/existing fields.

With the Xlogfile it's harder and therefore less reliable to get the data out as it's not laid out in a specific format, and if the layout was to change then it would need my code altering to accommodate the changes.

If you hover the mouse over any data in the GUI interface then it will say where that data comes from, anything with Field XX comes from the modem log. The main reason I displayed this information was so that BE1 could tell me if I'd got something wrong, but I've also found it useful for other things so have left this function there. The SES Errors (Total) doesn't have this in the versions you're using, but I have added it.

I could scrape information out of this section of the xlogfile:

Code: [Select]
Total time = 1 days 10 hours 3 min 52 sec

FEC: 0 3341
CRC: 69904 3
ES: 24828 3
SES: 89 0
UAS: 25 25
LOS: 0 0
LOF: 0 0
LOM: 0 0

Latest 15 minutes time = 3 min 52 sec

FEC: 0 0
CRC: 1 0
ES: 1 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0

LOM: 0 0

Previous 15 minutes time = 15 min 0 sec

FEC: 0 0
CRC: 14 0
ES: 9 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0

Latest 1 day time = 10 hours 3 min 52 sec

FEC: 0 1
CRC: 657 0
ES: 350 0
SES: 0 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0

Previous 1 day time = 24 hours 0 sec

FEC: 0 1
CRC: 2639 0
ES: 671 0
SES: 4 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0

Since Link time = 27 days 10 hours 3 min 25 sec

FEC: 0 3341
CRC: 69904 3
ES: 24828 3
SES: 89 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0

But whilst Since Link time is pretty obvious, and corresponds with connection up time I'm not so sure about the others. So perhaps someone could explain what they are, and I'll know better how to present them. For instance what does Latest 15 minutes time = 3 min 52 sec mean?


Quote
Yes, they do get rather large after a while.

My own modem_stats.log is now around 300 MB in size, but it does go right back to October 2012.

The other logs are there mainly for debugging information.
If you are not experiencing any issues with my programs, just rename them or delete them as & when you wish.
New ones will be generated starting from the next sample time.

You can turn off 'extensive' event logging via Ronski's GUI, but you would then lose some of the debugging information.
It would only restrict the size of ERROR.LOG at the moment, but that switch will also turn off (restrict) the size of the other logs when I release a public update (soon).

My modem log is currently 326MB dating from when my line was connected in August 2012.

I do plan on adding functionality to GUI to automatically delete/or rename the logs once they reach a certain age/size.

If people want other stats displayed that are in either logs then I'll do my best to add them, but you need to tell me what it is and perhaps how it should be displayed.
Logged
Formerly restrained by ECI and ali,  now surfing along at 390/36  ;D

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #124 on: November 22, 2013, 09:28:07 PM »

well we dont need to worry about the 15 mins section of logs.

but what it does mean is its logging a 15min chunk but the data shown is only for 3 min 52 sec of it.  In other words the 15 min stats are not previous 15 full minutes they are part of a 15 minute period and reset every 15 minutes to 0.  The only bit needed for the SES/ES total is the since link time section.

So in short.

Previous 1 day is the full previous 24 hour block stats.
Previous 15 mins as above but for 15 min block.

Latest 1 day is the current 1 day block, but isnt complete as is current block so it tells you how much of that block is completed.
Latest 15 mins as above but for 15 min block.

When the latest 15 min (or 1 day) is filled up , it then becomes the new previous 15 min (or 1 day) data and a new latest starts from 0.

Sadly it seems yet another bug in the firmware.  As you are taking the stats from the main section of the stats this part.

Code: [Select]
                Down            Up
SNR (dB):        6.2             9.6
Attn(dB):        0.0             0.0
Pwr(dBm):        13.5            5.0
                        VDSL2 framing
                        Path 0
B:              239             236
M:              1               1
T:              21              5
R:              0               16
S:              0.1133          0.3771
L:              16944           5410
D:              1               1
I:              240             255
N:              240             255
                        Counters
                        Path 0
OHF:            98887964                1535518
OHFErr:         1145            411
RS:             0               2417958
RSCorr:         0               4640
RSUnCorr:       0               0

                        Path 0
HEC:            720             0
OCD:            30              0
LCD:            30              0
Total Cells:    1481388475              0
Data Cells:     69145143                0
Drop Cells:     0
Bit Errors:     0               0

ES:             17023           8818
SES:            32              95
UAS:            945             945
AS:             177178

                        Path 0
INP:            0.00            0.00
PER:            1.78            6.12
delay:          0.00            0.00
OR:             107.58          203.67

Bitswap:        34448           503

The bug/issue is that in all that data, most of it does reset to 0 on a new sync event, but for whatever reason the 4 lines here are inconsistent, they only reset when the modem is rebooted.

Code: [Select]
ES:             17023           8818
SES:            32              95
UAS:            945             945
AS:             177178

Ronski if you feel its not fixable, I at least suggest you add something in the gui to remind the user that SES/ES are for device uptime not sync uptime.
« Last Edit: November 22, 2013, 09:36:48 PM by Chrysalis »
Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE

Ronski

  • Moderator
  • Kitizen
  • *
  • Posts: 3625
Re: HG612 Stats Editor updates
« Reply #125 on: November 22, 2013, 09:46:23 PM »

So if I take SES and ES totals from the xlogfile snippet below that would be correct?

Code: [Select]
Since Link time = 27 days 10 hours 3 min 25 sec

FEC: 0 3341
CRC: 69904 3
ES: 24828 3
SES: 89 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0
Logged
Formerly restrained by ECI and ali,  now surfing along at 390/36  ;D

Bald_Eagle1

  • Helpful
  • Kitizen
  • *
  • Posts: 2721
Re: HG612 Stats Editor updates
« Reply #126 on: November 22, 2013, 10:11:36 PM »


The bug/issue is that in all that data, most of it does reset to 0 on a new sync event, but for whatever reason the 4 lines here are inconsistent, they only reset when the modem is rebooted.

Code: [Select]
ES:             17023           8818
SES:            32              95
UAS:            945             945
AS:             177178



I think you're correct about ES & SES, I'm not too sure about UAS, but AS is reset to zero at each resync.

Logged

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #127 on: November 22, 2013, 10:22:15 PM »

So if I take SES and ES totals from the xlogfile snippet below that would be correct?

Code: [Select]
Since Link time = 27 days 10 hours 3 min 25 sec

FEC: 0 3341
CRC: 69904 3
ES: 24828 3
SES: 89 0
UAS: 0 0
LOS: 0 0
LOF: 0 0
LOM: 0 0

yes, that section resets to 0 every time sync is restarted.
Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #128 on: November 22, 2013, 10:24:03 PM »


The bug/issue is that in all that data, most of it does reset to 0 on a new sync event, but for whatever reason the 4 lines here are inconsistent, they only reset when the modem is rebooted.

Code: [Select]
ES:             17023           8818
SES:            32              95
UAS:            945             945
AS:             177178



I think you're correct about ES & SES, I'm not too sure about UAS, but AS is reset to zero at each resync.



yep I think you right about AS actually as its 86400 per day my 177k seems to match to my sync uptime.  Which to me is even worse, so not even the 4 lines together are consistent with each other. The UAS is device uptime tho.
« Last Edit: November 22, 2013, 10:27:30 PM by Chrysalis »
Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE

Ronski

  • Moderator
  • Kitizen
  • *
  • Posts: 3625
Re: HG612 Stats Editor updates
« Reply #129 on: November 22, 2013, 11:02:25 PM »

yes, that section resets to 0 every time sync is restarted.

I've updated that, values are now taken from 'Since Link time' section in the xlogfile. The tool tip for SES Errors (total) & Error seconds (total) text now displays Totals since last resync. & Total error seconds since last resync. respectively. Tool tip for their values shows From Xlogfile, section 'Since Link time'

Do the other totals in that column reset to zero on a resync?
Logged
Formerly restrained by ECI and ali,  now surfing along at 390/36  ;D

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #130 on: November 22, 2013, 11:54:46 PM »

yep all the others are fine as far as I can tell.
Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE

Ronski

  • Moderator
  • Kitizen
  • *
  • Posts: 3625
Re: HG612 Stats Editor updates
« Reply #131 on: November 23, 2013, 01:01:05 AM »

Thanks for confirming that Chrysalis.

Now anybody want to try the latest beta version, I think it's ready?

Changes in this version.

      Added GUI update checking abiltiy
      Configuration settings for updates are on the GUI settings tab.
      SES & ES error totals are now taken from Xlogfile 'Since link time' section.
      Added Help menu, which contains 'Check for GUI update', 'Help' and 'About' menu items.

The update functionality defaults to the options shown in the attached screen shot, so when you first run it, it will check for updates, as part of this process it will check to see if 'HG612 GUI Update.exe' is in the scripts folder and download it if not, it will also check to see if that program is up to date if it's present.

Once it's done that it downloads a 95 bytes version.txt file, which it extracts the latest available version numbers from, checks to see if an update is available, and if there is gives you the option to read the change log and download and install the updated GUI.

HG612 GUI Update.exe is the final part of the update process, when it is run automatically by the GUI it will check to see if the GUI is closed, if it isn't it will wait for it to close then it will make a temporary backup, rename the download file, delete the temporary backup and start the GUI.

I'll add a beta update over the weekend at some point, and then anybody wanting an updated version will need to use the update system, unless there's any problems with it. I'd like to get this working so it can be rolled out with BE1's updated programs.

Time for bed now  :sleep: :sleep: :sleep:

Latest version
« Last Edit: November 23, 2013, 08:28:30 AM by Ronski »
Logged
Formerly restrained by ECI and ali,  now surfing along at 390/36  ;D

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #132 on: November 23, 2013, 09:21:13 AM »

initial impressions, looks good, I see correct SES/ES now, thanks for fixing that.  I see last night I had 4 upstream SES.  Currently my upstream SES outnumbers my downstream SES by 6 to 1.

Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE

Ronski

  • Moderator
  • Kitizen
  • *
  • Posts: 3625
Re: HG612 Stats Editor updates
« Reply #133 on: November 23, 2013, 11:42:10 AM »

I've added an updated beta version to my server, only a very minor formatting change, mainly so we can test if the update works OK.

I use Avast as my antivirus and it's been a right pain in the backside recently, sometimes complaining that my program has a suspected virus. This first happened a few weeks ago, and then again last night and today.

I've reported this to Avast several times now, hopefully they will address it, but I suspect as I keep changing things it may rear it's heads again.

Avast clearly has bugs as I've told it to exclude the file many a time but it still complains most times when I access it, the strange thing is that if I just scan the file it says no threat found.

Just to be certain I have scanned the exe at Virus Total, and the result is 0 infections checked by 47 different virus scanners, bizarrely one of them is Avast!

I take it that as no one has mentioned it, nobody else has had this problem?
Logged
Formerly restrained by ECI and ali,  now surfing along at 390/36  ;D

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 6203
Re: HG612 Stats Editor updates
« Reply #134 on: November 23, 2013, 11:55:07 AM »

ok so I closed and reopened it.

I just seen the normal small window that appears very briefly.

I then ticked the beta versions box and closed and reopened it again, same thing, I guess at this point I should have got a prompt to say version is available?

I then ticked the auto update box so at this point all 4 update options ticked, closed and reopened, this time the small popup window stayed open for bit longer but still not long enough to read its output as it closed after about 1 second.

Now I have a popup window stating this.

A backup of HG612 Stats logging GUI has been made.
Waiting for HG612 Stats logging GUI to close, please close it......

I then closed the gui, and it auto relaunched with build 11.21am.

So the auto update works but the updater app doesnt stay visible for long, and when I had auto update disabled, I had no prompt to tell me a new version available.
Logged
AAISP - Billion 8800NL bridge & PFSense BOX running PFSense 2.4 - ECI Cab - LINE STATISTICS CLICK HERE
Pages: 1 ... 7 8 [9] 10 11 ... 14