Kitz Forum

Broadband Related => Router Monitoring Software => Topic started by: tbailey2 on August 27, 2014, 09:44:11 AM

Title: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 27, 2014, 09:44:11 AM
Hello All,

This is to announce the availability of MyDSLWebStats v 1.0, a free to use collaboration project between the Kitz and ThinkBroadband Forum users BaldEagle1, tbailey2, RONSKI and roseway. With the right equipment and software to automatically upload data to the server via a Windows PC, you can then monitor your own DSL Line statistics from home or anywhere in the world using MyDSLWebStats on any browser on a Mac, PC or Tablet (a specific Android/iPhone app is an unlikely prospect currently). Linux should also be available but via DSLStats later.

The idea behind it was to enhance and expand the statistics that BaldEagle1's HG612 Modem Stats collects by putting the data collected from the modem into an online, internet based database.  This means that just about anything you want to know about your past and current connection history is potentially available without having to store masses of graphs and images and wade through them to locate what you want! The modem data is automatically stored on a new dedicated remote server and accessed via the MyDSLWebStats Home page using the Registration/Log On system.

MyDSLWebStats can display a summary of your connection details in real time (in the same way as roseway's DSLStats does - and Eric is in with us on this project for his application) and, depending on various factors, you will also be able to view other users' data (and see it updated in real time if the data is current) as well for comparison. Multiple panes (see attached image) allow you to carry out several monitoring or investigative tasks at the same time.

Our Home Page has more details. There is no extensive help yet (under development) as it is still being developed but there are various hover-help icons scattered around that will give some guidance.

Please post queries/bug reports etc to this thread on this forum and someone will answer when we have time.

There are currently some 17 different data graphs available (more get added quite often) - the restriction on what is available is by the data that is currently uploaded.

What you can do is look at any of the timeline graphs available for today or a period of many days in the past on a LIVE basis updating every minute or a period of your choice. Then you can choose any two dates between the first available and last available and see a summary graph of the whole period (1st Jan 2014 to today in one case). Clicking on a point of interest will zoom in on many graphs - right down to a period of a couple of hours or so very quickly. All interactive graphs and charts are courtesy of Google Charts . Note that they do NOT look like those you may be used to from current applications themselves due to limitations within the system and the way we present the data but they do suit their purpose.

The only graphs that are not available per minute  are the tone related ones - Bits/Tone, Bits/Tone SNR, Hlog and Quiet Line. They are available every 15 mins of the hour for 2 days, then every hour for 4 days and then once per day (this may well change).

If interested, please have a look at www.MyDSLWebStats.co.uk (http://www.mydslwebstats.co.uk/). There is guest access by following the links if you don't have a Log On. Guest access is intentionally very limited with only a few stats graphs available and one live line to monitor.

Log Ons are currently available after Registration (http://www.mydslwebstats.co.uk/mdws-rg.htm) but we may put a restriction on these temporarily! There is a limit of 10 characters on a User Name so you  may need to adjust yours if you want to use one similar to your forum name.

A Log On gets you full access to various users who have data on there - tbailey2 and BaldEagle1 are currently live along with five other users. To actually get your data up to the server needs a modified executable file that will be supplied as part of the GUI install/update of HG612 Modem Stats (not currently available at the time of posting though and will be v 4.0). Note that this is a Windows executable and thus needs Windows to run under. However, Eric is currently working toward providing the same stats via his DSLStats program for both Windows and Linux users.

Preferred Browser is Chrome or  Firefox. Safari also works. IE can be used but has to be v10 or later. You will need both Javascript and Cookies enabled for it to work.

ALSO PLEASE BE AWARE that you are uploading data and also downloading a small amount. We estimate it at about 30MByte per month currently for the basic modem log that provides the majority of the stats but this increases quite a lot if you upload the additional optional Bits-related  files. If you have limited bandwidth and your ISP includes uploaded data in the total then please keep an eye on what you are using. The system can handle both ADSL (limited tests so far currently) and VDSL2+ systems - up to 80/20.

Have Fun

Paul & Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: boost on August 27, 2014, 10:32:00 AM
Great stuff :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 27, 2014, 10:43:02 AM
Just a quick note as I'm at work, I've released a beta update to the GUI interface which allows entry of the required settings, simply use the automated update feature with beta updates enabled. Any problems with the GUI side of things please post in that thread.

Please note BE1 has not yet released an update to enable the stats to be sent to the server.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 27, 2014, 12:01:46 PM
dammit lol I was planning on doing something like this :P

good idea though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 27, 2014, 04:40:59 PM
registration doesn't appear to work, just says required symbol char missing with no indication of where.

also the captcha is useless, it's unreadable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 27, 2014, 05:24:54 PM
registration doesn't appear to work, just says required symbol char missing with no indication of where.

also the captcha is useless, it's unreadable.
That would be the password:

Password:
min 6 max 18 chars
Must have at least one
Upper Case letter and
at least one of (* - $ &)
and at least one number

I've added the fact it's the password it's missing from in the error response so thanks for pointing that out.

The captcha appears to work okay (unless you have cookies disabled when it will never work) and others have registered successfully, one while I was typing this. It's not designed to be easy else there would be no point in having it (I reckon it's much easier than the Kitz one myself). We've already had one brute force attack on the Registration earlier this morning and captchas help to defeat them.

If you request a new image you'll get one that is  much easier to read at some point if you are having trouble. The length varies to confuse automated attempts.

We hope to have the required new executable available in the next few days and it will be installed via the GUI as RONSKI pointed out.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 27, 2014, 05:47:26 PM
I know what captchas are for, but when they're unreadable by humans they fail to fulfil their purpose and become a frustration. I also think your password policy is a bit restrictive. Requiring symbols is fine, but why limit it to those 4 only? There's a whole keyboard full of symbols that can be used.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 27, 2014, 06:11:16 PM
Personally I found some of the captcha's hard to read (as I do on other sites), I have a very hi res monitor and glasses, but I just refresh the image until I find one I can read.

Also I find the password requirements a lot stronger than a lot of other websites that should be stronger.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2014, 05:45:41 PM
A bug fix: users may have noticed a long delay between hitting the manual Update button and anything happening.

Cause has been found/fixed and a manual Update should now be virtually instantaneous as far as starting to load the graph goes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on August 28, 2014, 06:26:00 PM
I can confirm that it is indeed much quicker now  :)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 28, 2014, 07:18:30 PM
make my line the freebie for guest users :) its a circus today.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2014, 07:22:13 PM
make my line the freebie for guest users :) its a circus today.
Mine is already and has been fun, on Fast Path for the first time in 6 months
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2014, 07:23:00 PM
I can confirm that it is indeed much quicker now  :)
Great!

A note for new Registrations. You won't see yourself in the selectable User list as you don't yet have any uploads. Once the new V4 executable is available and set up via the GUI, you'll be able to upload.

As you'll want to see your own data as soon as possible, be aware that the system checks the user list for new uploads every 3 minutes and at around 30 seconds into that minute. Users with new uploads are then added to the selectable list when it's next refreshed either via Update or through changing one of the other parameters available.

Once uploading the graphs won't make a lot of sense until after about 15 mins. The Stats Summary at the top of the pane will update very quickly though if you are watching your own stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 31, 2014, 09:04:42 AM
BE1 has now released V4 beta programs which will enable the upload of data to My DSL WebStats.

To download this please ensure you have beta updates selected, and then check for and install updates.

You'll also need to ensure that you've correctly entered your settings for My DSL WebStats. Once the new programs have been running for 15 minutes you should be able to see data starting to appear on the website.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on September 01, 2014, 07:24:37 AM
Many thanks for this great facility.

I have registered and my data has started uploading.

It does seen to be a bit 'laggy' at first, although that may be my PC as I am getting lags sometimes on other pages.
(I need to investigate what this could be ???. My PC is i7 930 with 12G Ram so not exactly slow.)

Please keep up the good work, much appreciated.  :clap: :clap: :clap:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 11:30:09 AM
A few updates.

USER REGISTRATIONS

Almost everyone that has Registered has been seen online here okay but there are several of you that haven't fully completed the process. If you feel you are missing the information needed to do so then please post here.

TBB PING/LATENCY GRAPH

A few of you had trouble when putting the link to the image into the OPTIONS menu at the bottom of the page. Please make sure you use either of the IMAGE links and NOT the SHARE link. And also make sure you haven't also put double quotes around the link.

NEW FACILITY

There is a new facility in the list now and that is All User Stats. This shows every user who has uploaded anything and their current status in one table - this is the one that appears at the top of each pane but simplified onto one line per user. It automatically updates every 30 secs. See HERE (http://www.mydslwebstats.co.uk/images/alluserstats.png) for an example screen grab image. You can find it in the Graph to Show list.

It is ordered so that anyone offline (no uploads in last 5 mins) appears at the top.

Note that it currently will NOT show you unless you have uploaded since about 10:15 this morning due to the way it collects the data.

Users have also asked what the yellow background in the SYNC ACTUAL data means. It's because your ATTAINABLE sync rate is LESS than the current actual sync rate. The chances are that if you resync for any reason, you'll then lose some download speed. (see the attached image for examples). An ORANGE background in the ONLINE section means there's been a recent resync.

GET YOUR STATS CHECKED!

One of the big advantages of the system is that you don't need to capture and upload images or paste data to get comments on your stats. Just post here (with your MyDSLWebStats User Name if necessary) and ask and one of the experts will hopefully reply after looking at them (as has happened the other way round already)!

Please also note (in light of certain comments made elsewhere) that most of us also have other jobs and are doing this out of the goodness of our hearts to help others for free so might not be around for a while to answer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 11:40:31 AM
Thanks  ;) Comments such as this are very much appreciated by us after several months solid work!

Can you be a bit more specific please as to where you think it's 'laggy' and what you do that causes this? Some of the stats take time to plot as there, for instance,  with the Tone related data over 4000 possible points to retrieve and then plot and then return. SNRM and so on are or should be pretty instant.

One of the problems is that we had hoped to refresh the graph plots using Ajax Javascript code which would seamlessly update them without you seeing it - they would 'just change'. While this works quite happily elsewhere (the summary stats at the top of the page and the new 'All User Stats' table, Google Charts will just not play ball despite enlisting help from recognised experts who came up with all sorts of devious solutions that work with anything else - except our graphs! It worked with Google Image Charts  but they have been withdrawn. There are other charting facilities out there but non as versatile as Google's.

Many thanks for this great facility.

I have registered and my data has started uploading.

It does seen to be a bit 'laggy' at first, although that may be my PC as I am getting lags sometimes on other pages.
(I need to investigate what this could be ???. My PC is i7 930 with 12G Ram so not exactly slow.)

Please keep up the good work, much appreciated.  :clap: :clap: :clap:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on September 01, 2014, 12:58:40 PM
Looks very impressive. I'll have to take a look some time :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jaggies on September 01, 2014, 02:11:10 PM
Hard work much appreciated - thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 01, 2014, 07:37:15 PM
I tried and abandoned a registration under shamus and managed to complete registration as  shamus7
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 08:01:02 PM
I tried and abandoned a registration under shamus and managed to complete registration as  shamus7
I can't see any clue as to why that may have failed. What was the problem?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 01, 2014, 08:03:38 PM
unable to view graphs--message from web page---

this operation not supported by this version of grChartimg library


I use IE9 is this the problem
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 01, 2014, 08:06:02 PM
probably me messing up the security system
you can just delete   "shamus"   account if you want
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 08:15:57 PM
unable to view graphs--message---

this operation not supported by this version of grChartimg library
I use IE10 is this the problem
That message is from the utility that saves the graphs as images via a popup window. I've never seen that message but then I don't use IE unless I am feeling really like I need to annoy myself. The pages though are generally ok with IE10 and up and there are some tweaks made when using it. Why the username affects it I have no idea at the moment. (I believe MS are going to try and force everyone to use the latest version of IE in the future.....)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 08:18:11 PM
probably me messing up the security system
you can just delete   "shamus"   account if you want
Okay, have done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on September 02, 2014, 12:12:22 AM
Can you be a bit more specific please as to where you think it's 'laggy' and what you do that causes this? Some of the stats take time to plot as there, for instance,  with the Tone related data over 4000 possible points to retrieve and then plot and then return. SNRM and so on are or should be pretty instant.

It does seen to be a bit 'laggy' at first, although that may be my PC as I am getting lags sometimes on other pages.
(I need to investigate what this could be ???. My PC is i7 930 with 12G Ram so not exactly slow.)

Sorry Slow reply:
The laggy performance is NOT at your end.

I am experiencing some stop-start lags when browsing in Firefox & Chrome.

I think the Anti-Virus / Anti-Malware etc proggies are fighting each other  ??? and causing bursts of extreme computation which kills everything else !!!
I run multiple programs to provide coverage in depth and hopefully what one misses the other catches.

I think I need to rationalise all the extra software running in the background.
[Anti-virus/Anti-Malware/Firewall/+Dslstats+/+HG612_Modem_Stats+/+++ .....]
I will add it to my list of things to do !!!  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 02, 2014, 10:04:47 AM
Okay thanks.  I had similar problems on a fast Intel machine I use. In the end I settled on MalwareBytes and MS Security Essentials (Win 7). I was using WebRoot but depending on what it had for breakfast, it has a habit of blocking everything it doesn't like and difficult to find out why and how to unblock. It doesn't like HG612 Modem Stats though. Fine on other machines on Win7/8.1. I don't use the machine (it runs 24/7) for mail or general web browsing so I think the MS one is enough.

I'll give MS credit as it found a trojan that had been on both of my NAS backups  - since 2009!! Nothing else had found it. I did check it out before obliteration and some really nasty JavaScript posing as a png file...


Sorry Slow reply:
The laggy performance is NOT at your end.

I am experiencing some stop-start lags when browsing in Firefox & Chrome.

I think the Anti-Virus / Anti-Malware etc proggies are fighting each other  ??? and causing bursts of extreme computation which kills everything else !!!
I run multiple programs to provide coverage in depth and hopefully what one misses the other catches.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 02, 2014, 10:26:45 AM
remember with malwarebytes to turn on the rootkit detection, by default its off.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 02, 2014, 03:41:36 PM
remember with malwarebytes to turn on the rootkit detection, by default its off.
Oh, didn't know that, will do. Thanks....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on September 02, 2014, 07:53:39 PM
I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 02, 2014, 10:17:07 PM
I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
[/quote
I'll PM you
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 03, 2014, 08:00:07 AM
I see you are online okay now  :)

I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
[/quote
I'll PM you
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on September 03, 2014, 11:19:19 AM
I see you are online okay now  :)

I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
[/quote
I'll PM you

Indeed! Many thanks 😊
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 07, 2014, 03:38:52 PM
I deleted all the program  and re-downloaded, updated and accepted all defaults and graphs appear ok
I abandonded sharing as I keep getting password wrong
thanks for help TB
will get round to sharing soon
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2014, 04:43:20 PM
Okay but if you don't log out you won't need to log in again for a long time.... It's really only there to stop others using it if you want.

I deleted tall the program  and re-downloaded, updated and accepted all defaults and graphs appear ok
I abandonded sharing as I keep getting password wrong
thanks for help TB
will get round to sharing soon
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 08, 2014, 10:11:26 AM
I have got everything up and running and been sharing my stats for a couple of days. The information means very little to me (Trying to learn what it all means). How do they look to the trained eye. Anything I should be looking out for?

Thanks for a fantastic service  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 08, 2014, 10:22:21 AM
My eyes are not very well trained when it comes to interpreting stats, but they look very good to me. You're on a 40/10 service but would clearly achieve the full 80/20 sync speeds, with a little to spare. You're also on fast path.

Only thing I have noticed is some very brief dips in your attainable figures, which seems to affect upstream more. I'm sure some one more knowledgeable will take a look.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 08, 2014, 10:54:30 AM
My eyes are not very well trained when it comes to interpreting stats, but they look very good to me. You're on a 40/10 service but would clearly achieve the full 80/20 sync speeds, with a little to spare. You're also on fast path.

Only thing I have noticed is some very brief dips in your attainable figures, which seems to affect upstream more. I'm sure some one more knowledgeable will take a look.

Yes I am on Sky's 40/10 offering or 38/10 as they advertise it. Thanks for the feedback  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 10, 2014, 11:35:13 AM
One thing I have noticed when reviewing my stats is my SNRM is higher than everyone else. Am I correct in thinking with FTTC connections a higher SNRM is better than a low figure like ADSL?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 10, 2014, 11:56:21 AM
its better if you at the cap of the product.

However if you not hitting the cap and your snrm is high it suggests you may be banded or you have highly variable snrm.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 10, 2014, 11:58:50 AM
its better if you at the cap of the product.

However if you not hitting the cap and your snrm is high it suggests you may be banded or you have highly variable snrm.

ok thanks for clearing that up
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 10, 2014, 12:07:07 PM
with that said I would certianly prefer higher snrm to interleaving if the line cannot handle a normal snrm with fast path.

I think openreach have listened finally as does seem a new DLM profile now that enables FEC on fastpath.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 13, 2014, 06:58:47 PM
Hi

I have registered, but not yet received an email. I don't think its gone in any Junk, as I have checked. Perhaps your system is manual and takes time and not auto generated.

Looks magnificent work :P
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2014, 12:38:43 PM
Hi

I'll resend it. If you don't see it inside a few mins then ask again and I'll PM it. There are two e-mails overall,
 haven't seen any bounces...

Thanks for the nice comments  ::)

Hi

I have registered, but not yet received an email. I don't think its gone in any Junk, as I have checked. Perhaps your system is manual and takes time and not auto generated.

Looks magnificent work :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 14, 2014, 12:46:36 PM
Really Odd nothing received, and I use Message Labs and there is nothing in there also

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2014, 12:53:03 PM
I've PMd it - they bounced it as SPAM! I'll get on to them

Really Odd nothing received, and I use Message Labs and there is nothing in there also

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2014, 05:31:14 PM
It is all automatic (unless mail bounces of course although I should see it and have only just discovered why I'm not  :( ).


Hi

I have registered, but not yet received an email. I don't think its gone in any Junk, as I have checked. Perhaps your system is manual and takes time and not auto generated.

Looks magnificent work :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 14, 2014, 05:32:48 PM
Your email is registered now, perhaps you could try a test when you have a moment to me address Cheers Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 15, 2014, 11:13:50 AM
Do you have any plans to release a linux or Raspberry pi edition of the uploading program. It would be great as they are so cheap to run 24*7.

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 15, 2014, 01:19:34 PM
Roseway is working on the uploading side of things with DSL Stats, and I'm sure he produces a Linux version,  although I don't think it runs on the Pi, it used to though.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 15, 2014, 01:39:03 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 15, 2014, 01:44:16 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.

Thats great, a RPi version would be very useful  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 15, 2014, 03:52:18 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.

Hadn't thought of using an RPi as the host but that would be a very cheap way of getting 24/7 uploads obviously. Hope they keep a reasonably accurate clock time though!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 15, 2014, 04:10:49 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.

Hadn't thought of using an RPi as the host but that would be a very cheap way of getting 24/7 uploads obviously. Hope they keep a reasonably accurate clock time though!

I'd not thought of that, you can buy boards to add RTC functionality and I suspect you could enable NTP deamon and have it check the time regularly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 15, 2014, 04:53:50 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 15, 2014, 06:38:13 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.

Pretty much any box can use NTP - I've got it running on Linus, FreeBSD, Windows XP Pro, Windows 7 Pro 64bit, Windows Server 2008 (x86) and Windows Server 2008 R2 (64bit).
The FreeBSD box is in the NTP Pool at Stratum 2 (until I promote it to Stratum 1 by adding a GPS/PPS to it), and serving time to thousands outside my network, as well as my own machines.

I'm now set up on MyDSLWebStats (same username as here) now I have a Billion BiPAC 8800NL (recommended, by the way).

Many congratulations to all who contributed to getting it all working - it's a great resource.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on September 15, 2014, 07:08:52 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.

I can confirm that a R-Pi, although lacking a RTC, will synchronise with appropriate time-servers via ntpd upon boot. (That statement assumes a typical Linux-kernel based OS is in use.)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 15, 2014, 10:57:11 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.

I can confirm that a R-Pi, although lacking a RTC, will synchronise with appropriate time-servers via ntpd upon boot. (That statement assumes a typical Linux-kernel based OS is in use.)

Indeed it can, and with a GPS/PPS module can make a very nice little Stratum 1 NTP server, with maximum offset and jitter keeping it within 5uS (yes, that's five millionths of a second) of true UTC.

Link to details of how to do this (http://www.satsignal.eu/ntp/Raspberry-Pi-NTP.html)

You can do a little better with a machine with a true serial port instead of translating it through USB, but I'd say that getting into the 100nS range (at 5 times the cost and 10 times the energy use) is overkill for most purposes :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 15, 2014, 11:21:17 PM
That's very interesting, but rather off topic. For any discussions of the above please start a new thread.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 16, 2014, 12:22:46 PM
First let me congratulate Tony again these stats are fantastic.  :P

I think I may be now suffering from paranoia as I can see so much detail. I have noticed my SNR falls at night. This I know is normal, however I'm surprised by the size of the drops and times. last night just after 4PM and similar the previous nights large drops. At this time there is certainly no electrical activity in our home or I expect in any others between here and the cab.

I know other are able to see our stats, so appreciate any information for interest sake. ??? Fortunately even with SNR falling below 3db I'm staying in sync. Incidentally, I'm only 600m from the cab, but unfortunately part of that at the beginning is on AL cable not copper hence the poor speeds. I'm also on a busy cab.

I'm in IT so would like the benefit of more experienced knowledge in this area.

Thanks

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 16, 2014, 04:34:53 PM
had a look at your 5 day history of snrm, that looks concerning to me, I dont think its due to what you might call the usual external radio interference, for 2 reasons, its not consistent every night and its excessive on its worst nights.  My gut guess it is some external device been used occasionally at night causing interference of some sort.  Its giving you FEC spikes so might be the difference between fast path and interleaving but on your current interleaving its not giving you any changes of note on CRC so looks like isnt affecting your stability, so from me its good and bad news.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 16, 2014, 04:49:22 PM
Thanks, that sort of confirms what I thought. I'm not sure how I might trace that, I guess it started around the beginning of June when I went from Fastpath to 407 Interleaved. Given the times of the spikes I really have no idea. I don't think its in the home, unless I've overlooked something. There isn't much between here and the cab as its all residential, except the line path goes over a railway bridge (non electric). I'm not aware they are doing anything at night on the railway line.

I guess If it gets worse and the DLM kicks my speed down below the BT minimum, then I can get PlusNet to look, otherwise I don't suspect I can get anywhere.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 02:09:59 PM
SITE UPGRADE   :)

The web software has now been upgraded to V1.1.0 - if you are actively running it you will want to hit F5 to pick up all the changes. We currently have 50 people registered and more joining every day. Don't forget that if you want comments on your stats and be able to keep a view of them while away from your base then this is the way to do it!

Sign up at MyDSLWebStats (http://mydslwebstats.co.uk)

These notes are also available in the Change Log link at the bottom of the MyDSLWebStats window:

1)  Addition of RESYNC, LOS, LOF and LOM data.  This takes the form of a set of tables rather than graphs that list the dates on which these events occurred, most recent at the top. For the currently selected user, there is a table for each of the above events with appropriate data for each, all in the same pane.
   
Then below, another table with the most recent RESYNC data for every user with available data. Events for the current day are highlighted in red.
       
There is also a list of RESYNC codes and what they mean.
   
LOM and LOF data _may_ possibly help in identifying problems at the cabinet when an engineer is working on the wiring.
   
This pane auto-updates every minute.

2)  RESYNC E-mails. You will, by default, receive an e-mail when a RESYNC event occurs on your line. This gives detail of the time (which is accurate to +/- 1 minute), the current SYNC rates and the reason for the RESYNC. You can elect to turn these e-mails OFF using an entry in the Options menu at the bottom of the MyDSLWebStats window.
   
3)  All User Stats. This option has been updated and now shows more Users and  also allows you to list the data ordered by various parameters (SNRM, Sync, FEC, Offline etc etc) and in either Ascending or  Descending order.

This pane auto-updates every 30 seconds.   

4)  Assorted bug fixes and improvements in displayed data.

5)  The frequency at which the various Bits and Tone related files are uplodaed has been changed. They are now (if selected in the GUI) uploaded every 15 mins and then later, after two days deleted to leave one every hour and after 5 days, to one every day. This keeps the number of stored files down for data that  really isn't needed at the old frequencies. The Historical  option for these will pick up which files are available.

6)  Addition of 'proper' Apple Touch Icons for those with Apple devices for creating shortcuts to MyDSLWebStats.

Enjoy!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 17, 2014, 03:49:56 PM
I can't seem to get the all users graph to sort via order.  Changing the order by and direction both seem to refresh the graph, but it stays the same, update also has the same results.

I've also noticed on the 24hr graph that there is some text left at the bottom of the pane "Please wait a few seconds while the graphs loads"

This in Chrome on my tablet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 04:51:18 PM
I just checked the FTP log and a file transfer failed. Should be okay now if you hit Update. And a lot quicker as well.

I don't see that text in Chrome or Opera here on my tablet or two PCs - can you post a screen grab please? I know the text but it should be behind the graph, not under it or wherever.


I can't seem to get the all users graph to sort via order.  Changing the order by and direction both seem to refresh the graph, but it stays the same, update also has the same results.

I've also noticed on the 24hr graph that there is some text left at the bottom of the pane "Please wait a few seconds while the graphs loads"

This in Chrome on my tablet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 05:11:50 PM
Ah I thought you meant the normal 24 hr graph, not the 24Hr selector... That is meant to be there and there is more text under it that you can scroll up to see.  It says

Please wait a few seconds while graphs load....
Once loaded you may select a title to see larger graphs (you'll need Pop-ups enabled)

It wasn't intended to be invisible after loading. I don't see it here at all as it's just outside the visible area on my display. I seem to remember I was going to make the graphs smaller vertically to show it.

Edit: which I have now done.

==

I've also noticed on the 24hr graph that there is some text left at the bottom of the pane "Please wait a few seconds while the graphs loads"

This in Chrome on my tablet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 17, 2014, 05:28:47 PM
I can confirm it's now working, and all the text is visibl, nice improvements,  thanks.

I may not have the fastest connection, but we do seem to get the most FEC errors on our works connection.

I take it that quite a few users have opted to keep their stats private, a quick count only shows 29 users?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 05:44:49 PM
Private stats isn't an option currently as no one has asked. The others are Registered but just watching currently.

I can confirm it's now working, and all the text is visibl, nice improvements,  thanks.

I may not have the fastest connection, but we do seem to get the most FEC errors on our works connection.

I take it that quite a few users have opted to keep their stats private, a quick count only shows 29 users?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 17, 2014, 05:54:57 PM
can we have an option to make our own stats allow guest access?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 08:25:26 PM
can we have an option to make our own stats allow guest access?
Basically, no. It's not possible the way it's set up at the moment, nor likely to be an option in the future.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 17, 2014, 10:10:31 PM
is this due to policy rather than technical reasons? as your stats work for guest access.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 11:06:33 PM
Because that's how I coded it as there was no one else using it at the time that was on 24/7....

Why are you so keen for everyone to see your stats then?

is this due to policy rather than technical reasons? as your stats work for guest access.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 18, 2014, 04:24:42 AM
got a few friends I want to show but they dont want to register just to view my stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 18, 2014, 07:09:07 AM
Well if they can't be bothered to Register then that answers that....

got a few friends I want to show but they dont want to register just to view my stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 18, 2014, 07:11:00 AM
g3uiss
Thanks for the Donation to the cause! Much appreciated  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 18, 2014, 06:10:10 PM
First let me congratulate Tony again these stats are fantastic.  :P

I think I may be now suffering from paranoia as I can see so much detail. I have noticed my SNR falls at night. This I know is normal, however I'm surprised by the size of the drops and times. last night just after 4PM and similar the previous nights large drops. At this time there is certainly no electrical activity in our home or I expect in any others between here and the cab.

I know other are able to see our stats, so appreciate any information for interest sake. ??? Fortunately even with SNR falling below 3db I'm staying in sync. Incidentally, I'm only 600m from the cab, but unfortunately part of that at the beginning is on AL cable not copper hence the poor speeds. I'm also on a busy cab.

I'm in IT so would like the benefit of more experienced knowledge in this area.

Thanks

Tony

I wonder if anyone between you and your cabinet is using cheaper night electricity to run dishwasher, washing machine, immersion heater, etc.
Thermostats opening and closing or motors switching on and off can create some nasty RF spikes if not properly suppressed (a capacitor across the contacts does it - which sometimes fails and makes the relay suddenly become noisy.

I'm not sure how you'd track it down, unless you watch for the interference starting and then go on street patrol with an AM radio tuned between channels.  Even if you find it, I'm not sure how you'd persuade the owner to fix it unless it's affecting anything of theirs as well.
You could try pointing out that the contacts will fail if it isn't fixed (which is true, although it takes quite a while).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 18, 2014, 07:31:32 PM
Well if they can't be bothered to Register then that answers that....

got a few friends I want to show but they dont want to register just to view my stats.

to be fair I avoid registering on various sites because its a hassle.

The need to register and have a very complex login page as well just to view stats seems excessive.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 19, 2014, 02:59:06 PM
Thanks for the comments. I think its likely a house that is having very major extensions and they are still living in it. I guess perhaps lots of electrical kit used nightly is temporary and may be the evening drop. I've also noticed a spike every night at 0500 so I'm sure that's some sort of timer. Looking over the last week its marginally better each night, interested to see if weekend is worse. The path of my line goes right in front of this property. I recon another 2 months ( its been 6 already) and it will be completed. If after then I might think again.

Thanks for the input it confirms my thoughts

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on September 21, 2014, 01:27:14 AM
Is there a reason for a dual-password setup for the login page?

The "memorable phrase" defeats my lastpass setup, which is the place I assign password memory to - and by doing so, makes sure I generate really obscure passwords for sites where it works.

Unfortunately, this means my "memorable phrase" tends to be very un-memorable, and means I have it written down somewhere - and then have to scramble to find that when the website croaks and logs me off (such as this evening). This is partly exacerbated because my favourite "memorable phrase" is actually too long to be stored in the 18-character limit.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 21, 2014, 01:51:24 AM
I have same issue WWWwombat, its hard to quickly login.  Firefox is entering a cached value into the wrong box.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 21, 2014, 07:08:17 AM
  It is not that bad as once you login the first time a cookie ensures that in future there is no login if you go straight to the display page.-just straight there
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 21, 2014, 07:43:20 AM
Those cookies seem to expire, if I try to go straight to the page after a while I am guest.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vs1 on September 21, 2014, 02:03:30 PM
I'm working on something similar to this for my own personal use. I didn't know anyone was interested in doing a service like this. Good job. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 21, 2014, 11:36:21 PM
Those cookies seem to expire, if I try to go straight to the page after a while I am guest.
I'll attempt to answer several queries at once here.

Cookies don't expire until 28 days or more after creation and will occasionally be extended.  If they appear to be deleted or expiring then something is deleting them, they don't just vanish unexpectedly, and it won't be the website either (which has been up for 58+ days with no problems) nor should a connection loss have any effect.

Specifically logging out will though make you log on again and you really only need to do that if you don't want someone else on your terminal using it.

You may have discovered also that once you've logged on a few times, the logon requirement becomes much simpler. The cookies will (should) survive shutting down the terminal and/or closing the browser and restarting if everything is set up correctly.

No cookie(s) and you become a guest as observed. Also, if you repeatedly get told your Memorable Phrase is incorrect (which, being easily remembered you won't get wrong) then you are almost certainly not setting any cookies in the first place and you'll never be able to log on.

Both of you affected are using FF32 so maybe it's not set up correctly? Cookie phobia on the browser developers part seems to mean we'll delete them if we get the chance without you knowing...

To set FF up to keep cookies, open the Tools, Options menu. Then select Privacy, and under History change the dropdown list to read Use Custom Settings for History. Then check Accept Cookies from Sites and change Keep Until to read they expire. Then select Exceptions. Enter mydslwebstats.co.uk in the text box and select Allow. Then also add and Allow www.mydslwebstats.co.uk Then Close and then Okay the original dialogue box. Without these settings you may well be deleting cookies.

Make sure you don't have extensions like Self Destructing Cookies or the like that will still delete cookies.

The Memorable Phrase is NOT a password! It's just what it says, a phrase that you can easily remember. It would usually be plain text like 'I love carrots' or 'dogs hate cats' or whatever but not a character concatenation that is impossible for you to memorise. Now you have mentioned that, the reason FF is treating it as a password is because the box you are typing it into is defined as a password box, hence the hidden characters. So I've changed it to a text box, can't say I'd really noticed though as I can easily remember my memorable phrase....

Personally, I don't trust LastPass or it's ilk in the same way that I no longer trust Roboform that I had been using since I found out that it sends your supposedly private master password back to its creators!

Hope that helps  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 22, 2014, 08:10:49 PM
Tony

Any more info on this statement

Quote
Cookies don't expire until 28 days or more after creation and will occasionally be extended.

any chance these can be set for xxx months/years.

LAst pass is not compatible with the login page...it seems to replace the mem phrase  with the password proper; i have unticked the autofill option (in the lastpass "site") and hopefully that will work next time i have to login.


Tony these are not complaints..just comments/help for other users....your website saves me having to remote desktop into my pc to see the stats and is much appreciated.

Ian



Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 22, 2014, 09:53:50 PM
Ian

I've changed the cookies to 6 months. Just hope you aren't still using it in 2038 when the world ends (or at least the 32-bit world)

Also had a look at the way the Log On page is coded and have removed/renamed anything that could possibly make LastPass think that there is another password field there for the Memorable Phrase. See if that helps please.

Also note that there is a problem with the current way of detecting resyncs. Some are being missed. I've coded a new way of doing it that solves the problem but need to find a way to get this into the existing page code. Hope it doesn't do what happened during original testing when I woke up to find every user had had a resync every minute all through the night after 00:00....  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 22, 2014, 11:01:36 PM
thanks, I will check if its my browser expiring the cookies.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 22, 2014, 11:13:37 PM
Mine expired tonight...  which is the 2nd expiry since I began using it.   

Ive struggled both times to re-login. Couldnt recall my password -grr damn hyphen - then forgot my memorable phrase.  and by gawdd I cant tell you the number of times I refreshed the capcha either  :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 23, 2014, 04:42:48 AM
:) kitz

as it so happens When I clicked continue my cookies were working, which is good but I had noticed I only set to allow mydslwebstats.co.uk cookies whilst www. was session only, so now both on full allow.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2014, 07:57:48 AM
:) kitz

as it so happens When I clicked continue my cookies were working, which is good but I had noticed I only set to allow mydslwebstats.co.uk cookies whilst www. was session only, so now both on full allow.
Sorry I forgot some browsers need both the root domain AND the www sub-domain to be treated separately. I've updated the original suggestion in this thread to add both. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 23, 2014, 09:06:51 AM
I think firefox by default treats both same not sure tho.

I am using cookie monster extension which has much finer control over cookies.  I dont know if normally in firefox a sub domain of primary domain counts as third party or not.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2014, 09:47:12 AM
I think firefox by default treats both same not sure tho.

I am using cookie monster extension which has much finer control over cookies.  I dont know if normally in firefox a sub domain of primary domain counts as third party or not.
I think you'll find it has to be a separate root domain to be 3rd party.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 25, 2014, 06:05:27 PM
Have found IE9 is somewhat lacking in the graphing department and by using Google Chrome with mydslstats the graphing is working fine on vista, it should be ok with windows 8 IE11 i'll check that later after a reboot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 25, 2014, 06:32:54 PM
All my devices seem to be working better now, I haven't need to log back in since I think the v1.1 update on any of the browsers I use.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 25, 2014, 10:29:10 PM
I am really injoying using mydslstats,can even see some users suffering the evening RFI at 18:00 same as me, with all that info to hand you get clearer picture into how the distance from exchange/FTTC cabinet effects the end users stats  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 25, 2014, 10:46:22 PM
yes and let us watch your line also please :)

even if its only partial data.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 25, 2014, 10:58:43 PM
yes and let us watch your line also please :)

even if its only partial data.

Ha Ha i did say from the start the data collected will only be when the PC is ON and the data usage is not that bad as first thought, unless I get a laptop and also go unlimited this offline and online is not going to change  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 26, 2014, 07:58:36 AM
yes and let us watch your line also please :)

even if its only partial data.

Ha Ha i did say from the start the data collected will only be when the PC is ON and the data usage is not that bad as first thought, unless I get a laptop and also go unlimited this offline and online is not going to change  :)

Glad you like it now we've got there  8)

Well I have my Raspberry Pi here ready for testing 24/7 when the code is available. That consumes under 2A at 5v max on its own (so the data says). Hopefully I can do a beginners guide eventually (I am very much one as I'm not a Linux user and have never even installed it on anything) as to how to set it up (and probably what not to do as well).

The raw board is around £30 for the B+ model and you can get a small 3 inch touch screen that sits on top for just over the same price.

Eric can probably make some relevant comments as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 26, 2014, 12:53:42 PM
  My appreciation and thanks to the developers of myDSLwebStats, I find it a valuable resource.  At risk of immediately being thought of as Oliver Twist I wonder if you could think about adding something extra? 

   It would very useful to be able to see the average errors rates over time more clearly than with the bar charts, especially if like me your PC is not always running. (I hope I am not missing something).

As a suggestion, and to clarify what I might mean, one suggestion would plotting the average error rate/hour since the last resync (starting one hour after the last resync).

This could be plotted as a continuous line on each of the current bar error plots e.g. ES and CRC.  I don't know exactly what is uploaded to myDSLWebstats but this average is easy to calculate if you have the results of "info --stats" using the "since link time" stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 26, 2014, 03:24:25 PM
  My appreciation and thanks to the developers of myDSLwebStats, I find it a valuable resource.  At risk of immediately being thought of as Oliver Twist I wonder if you could think about adding something extra? 

   It would very useful to be able to see the average errors rates over time more clearly than with the bar charts, especially if like me your PC is not always running. (I hope I am not missing something).

As a suggestion, and to clarify what I might mean, one suggestion would plotting the average error rate/hour since the last resync (starting one hour after the last resync).

This could be plotted as a continuous line on each of the current bar error plots e.g. ES and CRC.  I don't know exactly what is uploaded to myDSLWebstats but this average is easy to calculate if you have the results of "info --stats" using the "since link time" stats.

Thanks. Anything is possible in the future. You can already get a visual idea of error trends over a period using the 'Period to show' option set to look further back than 24 hours, it can go back 120 days currently. Or use the Range option for any two dates between 1st Jan 2014 (a couple of users have this) and today. The only 'Bar' Chart is ES - although it's actually a Column Chart. The others are mainly Line Charts.

I have to give this project a rest for a while though for real work that pays money. Been pretty well flat out since June working on it when I first had the idea.

There is one major new option to come though I'm just working on now. There is also a finished graph for Uptime that has yet to be released.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 27, 2014, 04:29:18 PM
  Please could you say how errored sec/hour are dealt with in the plots when there gaps in the samples received?  For those with continuous data it looks like a average every hour is plotted but with switching PC's on an off some intermediate times appear along with some whole hours. 

 I assume crc/min is just that whenever two consecutive  samples are received.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 27, 2014, 10:15:13 PM
After a few days using mydslstats it would seem the shorter lines 79000 kbps DS sync with 19999 kbps US sync have really nothing to complain about as your stats are static (boring)  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 28, 2014, 09:45:55 PM
Please dont take this the wrong way, but when did you start displaying ISP information.   For me its not really applicable as Im sure most people know which ISP Im with..  but I do have some slight concerns that anyone can register to lurk and check out info on other people lines without them actively partaking in the project themselves.

Im not criticising your hard work.. I think what youve done is a brilliant idea...  Im just not sure about the ISP and whether that is relevant for people of the lurker type to know.  Thoughts by others?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 28, 2014, 10:16:52 PM

Please dont take this the wrong way, but when did you start displaying ISP information?  For me it's not really applicable as I'm sure most people know which ISP I'm with..  but I do have some slight concerns that anyone can register to lurk and check out info on other people lines without them actively partaking in the project themselves.

Im not criticising your hard work.. I think what youve done is a brilliant idea...  Im just not sure about the ISP and whether that is relevant for people of the lurker type to know.  Thoughts by others?

When? About three hours ago after collecting them all over the past week as I thought it would be of general interest.... It's there for a specific purpose, as well as general info, which is looking for possible ISP specific faults that might occur as will become apparent in the next update. I can easily remove it if there is concern now that you've publicly raised the possibility but I'm not convinced it's of any benefit to the type of person you mention, and I am very aware of them - other than it's apparent that the majority of people on MDWS use one particular ISP, if it was an IP address then yes, there would be a problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 29, 2014, 05:03:35 AM
OK, I've set it all up, I've been viewing results, and it all looked good - then I had a problem with my FTTC.
So I swapped out the Billion 8800n for the HG612 and TG582n, just to eliminate that.
The program kept running, but couldn't get anything from the (still locked) HG612.
Since changing made no difference I changed back, and now appear to be getting valid data again - which I assume is going up to the MyDSLWebStats site, via my registration.

But I can't log in - Even when clicking the link in the GUI which should take me there.  If the GUI can store the required information to push data onto the site, it certainly should be possible to use the same information to read what you've pushed up there!
All it takes me to now is the guest page.
My browser has remembered my password, but there's so much other faff involved in fighting my way into the login screen that I just can't remember (Is it really necessary to have username, password, memorable phrase, Captcha AND a Q &  A on what the capital of England is?

Having all that stuff is contrary to all basic tenets of decent security, since the result is that you HAVE to write it down somewhere - and that is a security risk.

Once registered, a user should only need username and password, with complexity requirements on the password if you feel the need to be more secure than average.
Captcha is only necessary for registration.
And I was under the impression when I registered that the other stuff would only ever be needed if I lost my password, which is saved in my browser and backed up (unlike that of any site with properly sensitive data on it, btw - I keep a strongly encrypted file with a record of all of those, stored somewhere else with an air-gap between it and the internet).

Do you really think you need stronger security than paypal or most banks?
Or the MOD (for whom I have set up security, so some well qualified people other than myself seem to think I know just a little bit about it).

AND THERE'S NO FACILITY FOR RESETTING LOGIN INFORMATION WHEN IT GETS LOST!

fix it please, as it is useless in it's current form.

Once you make the mistake of logging out, you can never get back in!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 29, 2014, 07:20:31 AM
The link on the GUI is not supposed to log you back in, the GUI doesn't know your username or password, only the info needed to upload stats.

On the occasions I've had to log back in I've had no problems,  maybe I've had to refresh the captcha a few time though. Since the v1.1 update I haven't had to log back in on any of my devices. As long as you don't log out a cookie should be stored on your device, this seems to be working very well for me. There is an earlier post detailing all this.

With reference to our ISP's being displayed, it doesn't bother me at all, there's plenty of places on the net where I make it clear enough whom I'm with, and I've also used the Plus Net ping graph pages when I've had a problem to see if it's affected others. However I can see that some may see this as a problem, so the simple solution would be to allow people to opt out of having their ISP shown.

I am curious as how he's worked out who our ISP'S  are? I know this information is available when doing a speed test, so must be available somehow.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:23:12 AM
Quote
I am curious as how he's worked out who our ISP'S  are? I know this information is available when doing a speed test, so must be available somehow.

In most cases your IP address identifies your ISP, and this can be read by every website you visit. It's certainly not a secret.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:28:32 AM
@TimeBandit: please remember that MyDSLWebStats is a free service set up by someone at his own expense, and he even took time off paid work to set it up. Logging in may be slightly complicated, but it's not a big problem, and lots of us are using it every day without difficulty. Give the man a break. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 29, 2014, 09:08:51 AM
I suggest making the isp info be controllable by the account holder.

I also agree with the login page comments, I consider captcha and the q&a overkill.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 29, 2014, 10:59:07 AM
Hi

I also access the MyDslWebstats via my mobile and other peoples/clients broadband connections and noticed that my isp was showing as VodafoneUK ie. the IP addy I was accessing the website by not the ISP of my upload PC.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2014, 11:36:41 AM
But I can't log in etc etc etc etc

As Ron says, the GUI has no idea how to log you in so that will just take you directly to the Registration page. There is no code in there other than links that would take you directly to any other page - unless you successfully Log On.

Can I please strongly suggest that you ask for help first on what the problem might be next time rather than hurl your toys out of the pram and scream and shout in public. If there is a problem for you that others apparently don't have, we can locate and fix it if possible.

In answer to your question, your uploads ceased with the last one being at 08:17 this morning - you might want to check the upload terminal details as the web site Log On data has no connection with the upload at all. One person recently changed their username inadvertantly but that causes loggable errors and there haven't been any from you. It was working for you so something apparently has to have changed and there have been no changes with the upload side code for some time now. Unless you have disabled it since posting of course.

As said before, if you have cookies that are not destroyed when you finish the session, close the browser or whatever, then you should NOT have to log on again for a long time if atall. And if you do you'll only need to enter your UserName and Password, again as I've said before - all providing you have permanent cookies. It sounds like you do not I'm afraid. But I could be wrong of course.

The captcha IS needed when first logging on in my opinion - it is an easier server entry point than the Registration. I have also worked on programming including security for Government and other entities over the past 22 years and am very conscious of the need for it after servers have been compromised. It isn't primarily to protect the data as such, which as you say is not particularly sensitive. It's there to protect the server itself as you should well know if you have worked in security. When you have the ability to see tens of thousands of continuous root (and other account) automated login attempts caught and the IPs banned by cPHulk, it tends to bring the risk home.

The blanket statement it is useless in its current form is untrue, it's your own opinion of your own experience. Since yesterday morning nine people have logged on at the first attempt and two have failed through invalid passwords but succeeded on 2nd attempt. Other people have mailed to say they have no problems.

As explained before at some length, please check that you are retaining Cookies permanently for the site. IE11 is particularly agressive in this repect. I don't think I've logged in on any of the browsers and terminals I use (4 workstations and 2 laptops, each of which has up to 5 browsers available for testing this and other projects etc).

Please bear in mind that this is currently a FREE access project for everyone out there (with an option to Donate to keep it going that is being pretty well ignored except by one kind soul) that four people have given up their time and energy, also for free, over the past three months to get it going after the initial idea came up.

There were a lot of problems that had to be worked around, at one point we had to give up and start again with the uploads to find a much more secure method that otherwise threatened the entire project.

I fund the dedicated server myself out of my own pocket and like to protect it from the nutters out there as far as possible as you might possibly imagine.

There is also now a monitor on the Cookies and their expiry dates in an effort to see if anything unexpected might be happening and to see why yours might be failing if you want to try again. There should already be specific evidence of this in the logs but I can't find anything at the times you were trying.

So. if you want help PLEASE ASK FIRST. I don't see any major problems with the security requirements looking at the logs that would cause me to change the requirements at this moment, certainly the extra effort needed initially is not a valid reason. Changing your account details etc is underway but needs some more work that I could have continued attended to had I not spent hours working on this reply in between other chores/mails/phone.

Ron: re ISP details. As roseway says, a Host lookup on the the IP Address that is returned to the server by everyone (and I have a massive cache of Host lookups) will return enough info to determine it in 90% of cases, the others need a bit more work - such as our Swiss LIVE user. And OK on it as an option which I may well do. Most people on TBB state their ISP in their sigs anyway, not so much though on Kitz. I've removed them for now until I can attend to the user comments later.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2014, 01:06:14 PM
@TimeBandit: please remember that MyDSLWebStats is a free service set up by someone at his own expense, and he even took time off paid work to set it up. Logging in may be slightly complicated, but it's not a big problem, and lots of us are using it every day without difficulty. Give the man a break. :)
Thank you Eric. A rather more compact version of my post I hadn't spotted beforehand  ::) 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 29, 2014, 02:45:34 PM
 :-\   Please remember this isnt TBB.  I can sense frustration on both sides. :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 29, 2014, 02:54:23 PM
my issue's with captcha's are is that they only serve to frustrate, bots get by them anyway and it can block human's who struggle to read them.

yes its not a major issue given the cookies last a long time now, but I find your point interesting you say it can help prevent the server been rooted somehow, given I also work in server security I have interest in that comment.

I remember not been able to register on palemoon's forum due to the captcha, the admin eventually gave in and manually registered me after he seen I had over 20 failed attempts. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on September 29, 2014, 03:19:29 PM
But I can't log in etc etc etc etc
... Please bear in mind that this is currently a FREE access project for everyone out there (with an option to Donate to keep it going that is being pretty well ignored except by one kind soul) that four people have given up their time and energy, also for free, over the past three months to get it going after the initial idea came up. ...

Thanks for the prompt re: Donations

Something is on its way with thanks.

*** Please Support Tony et al & Kitz for their hard work and time given freely to us all ***
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2014, 03:53:35 PM
my issue's with captcha's are is that they only serve to frustrate, bots get by them anyway and it can block human's who struggle to read them.

That can be frustrating - a bit like people who put apostrophes everywhere they are not needed....  :graduate:  (sorry I proof read publisher's drafts as one of my activities)

yes its not a major issue given the cookies last a long time now, but I find your point interesting you say it can help prevent the server been rooted somehow, given I also work in server security I have interest in that comment.

You are reading into what I said - I was making the general point that security overall is there to protect the server as well as the specific data you are trying to access, not that captchas can do anything directly.

I remember not been able to register on palemoon's forum due to the captcha, the admin eventually gave in and manually registered me after he seen I had over 20 failed attempts. :)

Um that's interesting. Doesn't that maybe indicate a visit to the opticians might be needed if you've had such trouble elsewhere with reading captchas? Two or three tries maybe but 20  :no:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 29, 2014, 05:18:21 PM
no because captchas are deliberately made to be hard to read, but different sites have different captchas some can be incredibly hard to read with letters overlapping, covered by lines and shapes etc.  I also dont know if the palemoon registration had some kind of bug or not but regardless I kept getting fail's on the captchas.

Some developers try to get best of both worlds, an idea is to not initially show the captcha but if there is say 3 failed attempts in a row then require the captcha to login from the 4th attempt onwards, google do it that way, and yes I may or may not have an eye issue, although whenever I get tested doc's always say is fine. Although I probably dont have the same vision as an 18 year old.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 06:14:29 PM
Have to say I quite like the ISP tag and have not had to use the captcha since the registration was succesfull and let the username & password save to the browser and all you need to do is click logon and your in.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 29, 2014, 06:25:25 PM
Quote
Um that's interesting. Doesn't that maybe indicate a visit to the opticians might be needed if you've had such trouble elsewhere with reading captchas? Two or three tries maybe but 20

eke... I dont wear glasses..  but I mentioned previously that I did find the login precess & captcha difficult.   I certainly refreshed well over 20 times and I did have considerable problems logging back in (http://forum.kitz.co.uk/index.php?topic=14361.msg270271#msg270271).  The extended use of cookies should remedy this to a large extent.

At the end of the day, it is tbailey's baby so the choice of security is entirely down to him.  Its also up to him whether he takes on-board feedback and constructive suggestions.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 07:18:25 PM
Since I moved from HG612_Modem_stats to dslstats to upload the data to mydslstats have noticed my DS FEC/Min count is mirrored on the US FEC/Min count don't think that sould be the case  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 07:24:50 PM
Since I moved from HG612_Modem_stats to dslstats to upload the data to mydslstats have noticed my DS FEC/Min count is mirrored on the US FEC/Min count don't think that sould be the case  ???

I'll check that out - it's probably my error.

[Later] Yes, it was an error on my part, now corrected.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on September 29, 2014, 07:38:36 PM
I can confirm this. Also the upstream crc errors are completely missing in MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 07:52:37 PM
Since I moved from HG612_Modem_stats to dslstats to upload the data to mydslstats have noticed my DS FEC/Min count is mirrored on the US FEC/Min count don't think that sould be the case  ???

I'll check that out - it's probably my error.

[Later] Yes, it was an error on my part, now corrected.

Thanks Roseway
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on September 29, 2014, 07:55:54 PM
TBH, CRC errors in MDWS are slightly redundant.
They are there as legacy data from when my original HG612 Modem Stats scripts/programs didn't report US data.

CRC & OHFErr (or SFErr for ADSL connections) are basically the same.

Take a look at the CRC & OHFErr graphs.
DS will be pretty identical in both & the OHFErr graph also reports US data. 


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:08:12 PM
TBH, CRC errors in MDWS are slightly redundant.
They are there as legacy data from when my original HG612 Modem Stats scripts/programs didn't report US data.

CRC & OHFErr (or SFErr for ADSL connections) are basically the same.

Take a look at the CRC & OHFErr graphs.
DS will be pretty identical in both & the OHFErr graph also reports US data. 

People will be more familiar with the term 'CRC', so perhaps the OHFErr graph should be renamed 'CRC errors'.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on September 29, 2014, 08:18:35 PM

People will be more familiar with the term 'CRC', so perhaps the OHFErr graph should be renamed 'CRC errors'.

Or maybe even CRC (OHFerr) to also confirm they are one & the same?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on September 29, 2014, 08:27:40 PM
Or maybe even CRC (OHFerr) to also confirm they are one & the same?

Yes, that is a good idea!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:28:00 PM
... except that on ADSL it's called SFErr.

I suppose it's up to Tony how it's labelled, but I certainly think it would be best to remove the confusion in some way, and have only one graph for these values.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 08:44:59 PM
use OHFerr and call is CRC DS & US/Min  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 29, 2014, 09:02:50 PM
But I can't log in etc etc etc etc

As Ron says, the GUI has no idea how to log you in so that will just take you directly to the Registration page. There is no code in there other than links that would take you directly to any other page - unless you successfully Log On.

But each time up until now just going to the site has taken me straight to my stats page.

Can I please strongly suggest that you ask for help first on what the problem might be next time rather than hurl your toys out of the pram and scream and shout in public. If there is a problem for you that others apparently don't have, we can locate and fix it if possible.

Well, I thought this was the preferred place to look for help.
I'm sorry if I was rather irate about it, but Id been up all night fighting with routers, modems and reconfiguring networks to ensure that there weren't any  problems on my own internal network (there weren't as I suspected).
That may sound trivial, but it isn't when you can't walk unaided and the router and modem are not within reach of the PC, and at a height which means dragging myself upright and wedging myself in a rather painful position so I have my hands free to swap cables around.

In answer to your question, your uploads ceased with the last one being at 08:17 this morning - you might want to check the upload terminal details as the web site Log On data has no connection with the upload at all. One person recently changed their username inadvertantly but that causes loggable errors and there haven't been any from you. It was working for you so something apparently has to have changed and there have been no changes with the upload side code for some time now. Unless you have disabled it since posting of course.

I did mention, I think, that I'd had to change back to the locked HG612 and TG582n combination, to be able to eliminate any fault with the modem/router.  I wouldn't expect uploads to have continued after that.

As said before, if you have cookies that are not destroyed when you finish the session, close the browser or whatever, then you should NOT have to log on again for a long time if atall. And if you do you'll only need to enter your UserName and Password, again as I've said before - all providing you have permanent cookies. It sounds like you do not I'm afraid. But I could be wrong of course.

I still have cookies stored in my browser for mydslwebstats.co.uk - FID1, FID2, FID3, FID4, FID5, User, Theme, and PHPSESSID.

The captcha IS needed when first logging on in my opinion - it is an easier server entry point than the Registration.

I'm seeing exactly the same as when I was first registering.
Which took about a dozen tries, but I got there in the end.
As stated, I'd never even seen the login screen after that - each time I'd connected it just went straight to my stats page.

I have also worked on programming including security for Government and other entities over the past 22 years and am very conscious of the need for it after servers have been compromised. It isn't primarily to protect the data as such, which as you say is not particularly sensitive. It's there to protect the server itself as you should well know if you have worked in security. When you have the ability to see tens of thousands of continuous root (and other account) automated login attempts caught and the IPs banned by cPHulk, it tends to bring the risk home.

Well, disabling root login from the web interface would seem to be the simplest way of avoiding that - and restricting SSH (or whatever remote control you  do use, if it's not a local machine), to specific IP addresses owned by or known to you.  Anything else will just see a closed port, or no port at all if it's properly stealthed.

The blanket statement it is useless in its current form is untrue, it's your own opinion of your own experience. Since yesterday morning nine people have logged on at the first attempt and two have failed through invalid passwords but succeeded on 2nd attempt. Other people have mailed to say they have no problems.

As explained before at some length, please check that you are retaining Cookies permanently for the site. IE11 is particularly agressive in this repect. I don't think I've logged in on any of the browsers and terminals I use (4 workstations and 2 laptops, each of which has up to 5 browsers available for testing this and other projects etc).

I'm certainly retaining cookies (I'm using firefox, and didn't try a different browser as I'm aware that they wouldn't have the cookies which would allow them to be "remembered").

Please bear in mind that this is currently a FREE access project for everyone out there (with an option to Donate to keep it going that is being pretty well ignored except by one kind soul) that four people have given up their time and energy, also for free, over the past three months to get it going after the initial idea came up.

I fully intend to donate as the concept is a good one.
But I really think the over aggressive security has some problems - I note from other posts on here that I'm not the only one to have had problems registering, so there seems to be something a bit awry - repeated attempts got it working for me.
The fact that it's dropped me back to the registration style page seems to confirm this.
This isn't intended to be a rant, but constructive feedback to help you fix whatever the problem is.

There were a lot of problems that had to be worked around, at one point we had to give up and start again with the uploads to find a much more secure method that otherwise threatened the entire project.

I fund the dedicated server myself out of my own pocket and like to protect it from the nutters out there as far as possible as you might possibly imagine.

I'm in full agreement with the need to protect it, but I do think that you are going about it the wrong way.
You send an email with the validation key for uploading data anyway - couldn't the same key be used to validate an interactive user?
Once you are getting validated data from an IP address, it shouldn't be necessary for much more than username and password (which my browser have remembered) in the way of validation for login attempts from that same address.  Maybe a bit more if they attempt to log in from somewhere else - I can see that has some benefit.

There is also now a monitor on the Cookies and their expiry dates in an effort to see if anything unexpected might be happening and to see why yours might be failing if you want to try again. There should already be specific evidence of this in the logs but I can't find anything at the times you were trying.

So. if you want help PLEASE ASK FIRST. I don't see any major problems with the security requirements looking at the logs that would cause me to change the requirements at this moment, certainly the extra effort needed initially is not a valid reason. Changing your account details etc is underway but needs some more work that I could have continued attended to had I not spent hours working on this reply in between other chores/mails/phone.

OK, tell me please what I need to do to get back in, because at the moment I'm stumped
You have my email address, so if you need to send a validation token or something, you can.
Putting an "I've forgotten my password" link on the login page to automate this would seem to be a sensible precaution as the site grows - this could just mail a temporary password (with a change requirement) to the email address associated with the account.

Ron: re ISP details. As roseway says, a Host lookup on the the IP Address that is returned to the server by everyone (and I have a massive cache of Host lookups) will return enough info to determine it in 90% of cases, the others need a bit more work - such as our Swiss LIVE user. And OK on it as an option which I may well do. Most people on TBB state their ISP in their sigs anyway, not so much though on Kitz. I've removed them for now until I can attend to the user comments later.

I'm not worried who knows I'm with Zen :)
But it would seem more sensible to use the IP address that the data comes from for the ISP lookup, rather than the one the user is logging in from.
Not a bad idea to make it optional though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 29, 2014, 10:54:57 PM
Tonight I swapped from using HG612_modemstats to DSLstats to send records to mydslwebstats and I noticed a slight issue when recording attenuation which Ive raised with eric in the relevant thread. 

However its also brought to my attention the fact that mydslwebstats is recording Line Attenuation but not Signal attenuation and I wondered if it may perhaps be better to monitor Signal attenuation rather than Line attenuation (or even both? ). 

Line attenuation should rarely change as its only measured during the sync phase, but its possible that Signal attenuation can change at any time.   When I had a line fault, my signal attenuation was all over the show - yet my line attenuation never changed. Difference between Signal Attenuation & Line Attenuation (http://www.kitz.co.uk/adsl/linestats.htm#Signal_v_Line_Attenuation).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 30, 2014, 04:42:06 AM
what is the actual difference between the 2?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 08:25:40 AM
Tonight I swapped from using HG612_modemstats to DSLstats to send records to mydslwebstats and I noticed a slight issue when recording attenuation which Ive raised with eric in the relevant thread. 

However its also brought to my attention the fact that mydslwebstats is recording Line Attenuation but not Signal attenuation and I wondered if it may perhaps be better to monitor Signal attenuation rather than Line attenuation (or even both? ). 

Line attenuation should rarely change as its only measured during the sync phase, but its possible that Signal attenuation can change at any time.   When I had a line fault, my signal attenuation was all over the show - yet my line attenuation never changed. Difference between Signal Attenuation & Line Attenuation (http://www.kitz.co.uk/adsl/linestats.htm#Signal_v_Line_Attenuation).

Are/were you a teacher or police officer or other official in public life :graduate: :police: ? Brought to my attention sounds very official and reminds me of the day when .....  :-X  :-[ :'(

I am trying to answer several posts at once here in summary before I have to go out. I seem to have a failing disk on my main workstation (this one) and an attempt at a restored backup to another disk is apparently corrupted so I need to sort that out promptly

Signal Attenuation can be available, I'll add it to the list of things to do, currently running at 25. There are over 140 possible individual graphs that could be drawn from the data available to MyDSLWebstats and the, now over 2 million, uploaded records.

I hadn't intended to but after working on this until 03:30, I will enable facilities to Reset a lost/forgotten Password and also to Change a Password. These are fairly complex to get right and catch all sorts of failures and other possible problems but are now hopefully working. They will be available via the Login page for the Reset and the Options menu for the Change.  Changing your e-mail will come later on.

There are no other Security changes apart from those I mentioned in an earlier post. The ISP revelations have gone for now and other comments on these are noted.

And thanks for the little flurry of Donations from some users  :clap2: I'll acknowledge these here later.

I'll announce here when the Password options are available, I need to check them one last time. So please don't post saying you can't find them  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 30, 2014, 08:27:29 AM
I plan to donate also but you may need to remind me if I forget.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: G.DMT on September 30, 2014, 02:35:01 PM
First off - a huge thanks to all involved for creating this superb free service.   ;D
Well done!  :clap2:

And now for a small observation / feature request.

When I registered at: http://www.mydslwebstats.co.uk/mdws-rg.htm
 I was not allowed to enter my Kitz username  (G.DMT) because it contains a '.'

Could you enlarge the set of allowed characters slightly so as to not prohibit legal usernames from kitz.co.uk (and also, I suppose, http://forums.thinkbroadband.com)

That would make the service even more purr-fect than it is now.

[edit: added suggestion for which characters could be considered for inclusion]

 I performed a quick check on the Kitz registration page:
http://forum.kitz.co.uk/index.php?action=register

I didn't want to go creating loads of junk users so I tested only the interactive (javascript) validator.

Allowed characters included:
`¨|!£$%^()-+_{}[]:;@'~#,.?/

Rejected characters included:
\|"&*=<>

Looking quickly through the Kitz members pages I do see
#-._[]

If the space character ' ' is to be disallowed in usernames then it would seem to me to be even more important to allow the use of the underbar '_' character instead.

 I hope my small contribution may be of some use.  :)

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 03:19:38 PM
I'll announce here when the Password options are available, I need to check them one last time. So please don't post saying you can't find them  ;)

So here is the announcement.

LOST/FORGOTTEN PASSWORD
The Logon page now has an extra line under the Log On button:

Forgotten your password? Select HERE

Doing so takes you to another page where you can enter your Registered e-mail address. Doing so and providing it is Registered will send you an e-mail with a Reset link in it, otherwise you'll see an error. There is of course (as it says in the e-mail) nothing to stop anyone putting in/ guessing your e-mail who knows it and you'll get a mail that you can ignore if you didn't ask for it as nothing will happen - this is in common with many other reset mails on sites. There are some other questions one could ask to get round this but I hesitate to do so.

NB the earlier problems with e-mail have now been resolved after a lot of agro with Symantec, Message Labs and Microsoft.

If you select the mail link, and as it warns you several times in the mail, your password will be reset IMMEDIATELY to a random one chosen by the system and meeting the criteria. This is displayed to you ONSCREEN on the next page you see (some people get very upset if they get passwords by e-mail) so you need to write it down or copy it so you can then use the Log On page (via the link you'll see) to type or paste it in and actually Log On.

Change Password
Of course, you might want to be able to remember it so if you then go to the Options menu at the bottom of the MyDSLWebstats window, there is now a Change Password option. You'll need your (easily) memorable phrase I'm afraid (for reasons I will not explain at length) and the new password twice which has the same criteria as the original Registration entry.

Once successfully changed that's it (as long as you remember what you changed it to). No need to Log Out or do anything else. You'll probably want to tell or confirm the change to your Password Manager if you use one.

I'll add an option to change your e-mail later.

OHF ERRORS
While I am here (as I now definitely need to rebuild this machine so will be out of action for a while) someone mentioned a lack of upstream OHF/CRC errors. Upstream CRC errors are in fact already reported using the uploaded upstream OHF Error values as the upload doesn't have that data for CRCs (at least from HG612 Modem Stats). However, I checked and no values have ever been uploaded or recorded in the database, they are all zero. Hence why there are no values seen. Why I don't currently know. Edit Wrong  Date being imported  :-[ now corrected but there isn't very much of it anyway

Also I notice that some of you are physically logging out - doing so will make you Log On again but doing so does NOT also reinstate the need for the much-loved captcha etc (as long as your Cookies are not being destroyed).

And I do take notice of comments and useful suggestions but many are not always practical or advisable for reasons I may not choose to explain.

G.DMT noted, I'll have a look - hadn't occurred to me I'm afraid.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: G.DMT on September 30, 2014, 04:02:18 PM

Quote
G.DMT noted, I'll have a look - hadn't occurred to me I'm afraid.

 8)
 I was editing my post and I see that they crossed in flight there...

TLDR: Suggestion for which characters could be considered for inclusion

#-._[]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 30, 2014, 07:23:26 PM

Are/were you a teacher or police officer or other official in public life :graduate: :police: ? Brought to my attention sounds very official and reminds me of the day when .....  :-X  :-[ :'(


No..  but Im well used to being in a tech environment where willy waving and bragging seems to be the norm.   I was however brought up with manners and with the ethos that you treat others with respect.  You'll find quite a few members here dont go for the one one-upmanship, sniping & smart ass replies that is so apparent on some other tech forums.. and for that reason alone avoid TBB - hence my earlier comment.  We are actually pretty laid back..  but I can bite.   

Sorry if my style of posting doesnt meet with your standards.  But at least I can take on-board suggestions by others.... so I'll try to refrain from using anything 'brought to my attention'  to you again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 08:38:45 PM

Are/were you a teacher or police officer or other official in public life :graduate: :police: ? Brought to my attention sounds very official and reminds me of the day when .....  :-X  :-[ :'(


No..  but Im well used to being in a tech environment where willy waving and bragging seems to be the norm.   I was however brought up with manners and with the ethos that you treat others with respect.  You'll find quite a few members here dont go for the one one-upmanship, sniping & smart ass replies that is so apparent on some other tech forums.. and for that reason alone avoid TBB - hence my earlier comment.  We are actually pretty laid back..  but I can bite.   

Sorry if my style of posting doesnt meet with your standards.  But at least I can take on-board suggestions by others.... so I'll try to refrain from using anything 'brought to my attention'  to you again.

I don't know what to say to that totally unwarranted response, I did try but deleted it and will leave it at this in case it gets misinterpreted again. It was a joke after all.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 08:51:47 PM

Quote
G.DMT noted, I'll have a look - hadn't occurred to me I'm afraid.

 8)
 I was editing my post and I see that they crossed in flight there...

TLDR: Suggestion for which characters could be considered for inclusion

#-._[]

Thanks. Can't have underscore or the [] as they are already used as delimiters in parsing various things. - (hyphen) is already specifically allowed. The other two are probably okay for new users but I'd have to check.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 01, 2014, 09:27:57 PM
Notice a large spike of FEC/min errors in the range of 900000 at 19:21 and also noticed on MDWS quite a few users also on interleaved had the FEC/min spike at around this time  :o
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on October 04, 2014, 07:48:02 PM
My MyDSLWebStats login problems are all now resolved (many thanks, Tony), and I'm now able to view the statistics on-line again. ;D

Now I just need to do battle with BT, who have apparently reported the fault to Zen as a chargeable one   :angry:

Since it was their side of the master socket, in a cable joint that their original line installer had made (against my advice, I might add - he double punched into a shallow patch panel IDC instead of using crimps) I don't believe they have any grounds for this.
Not only that, but if it hadn't been on their side of the master socket (which I'd been warned off tampering with) I'd have probably found and fixed it myself. 
It's not as if I don't know how punch-down connections work (or don't, as in this instance).  I've built enough networks, some, ironically, for BT themselves (which is why I knew that IDC was too shallow to safely take two wires).
The problem was simply that the second wire had come loose, as the IDC wasn't deep enough to hold onto it properly.  It was something or a miracle that it was working at all, never mind that it had held on for over 6 years.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 06, 2014, 09:23:25 AM
Thanks to the following for donations to go towards keeping the MyDSLWebStats server running, they are much appreciated  :drink:

:clap: Aardvark
:clap: burakkucat
:clap: Chrysalis
 :-X Anon by request

Currently with 71 Registered Users and 41 Uploaders.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 06, 2014, 11:55:51 PM
We had two very brief power cuts at work today, the modem and network gear are all on a UPS as is my PC, so you can see the effect in the stats. The SNR went up to 13, and the maximum attainable went from 39Mbps to 52Mbps. The power outage was at 14:04 and lasted two minutes, the second power cut lasted less than a minute and the power came on just before the stats were harvested at 15:26. Also the FEC errors shot up after the power cut. User name Ronskiwork

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 07, 2014, 12:12:28 AM
Hello Ronski

Have to say I am still a little concerned with your constant high FEC/errors in the work place yet it does not seem to impact the DLM at all, to me it looks like you have ethernet powerline adapters on this line.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 07, 2014, 03:31:13 AM
The DLM doesnt count FEC's.  They just prove that interleaving and error correction is working as it should.

A very busy connection with many users and lots of data flowing through (such as a workplace/business) will tend to show lots of FECs.   The more data that goes through the connection, then the higher the FEC count will likely be - as long as its in proportion to the total traffic then its fine.   Err Secs are the ones to watch for and from a quick glance, they seem fine :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 07, 2014, 06:22:06 AM
There isn't that much data, we use around 50 to 60 GB a month. My thoughts are that the telephone cables come into the building where the 3 phase power does, and this causes interference. Many years ago I was also told the lines were in poor condition. Plus they also pass various other businesses, and we have a factory behind us. I often see the FEC errors step up or down and then stay that way for a long time, normally this occurs on a resync. I do have the highest FEC errors on MDWS though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 08:18:27 AM
The DLM doesnt count FEC's.  They just prove that interleaving and error correction is working as it should.

A very busy connection with many users and lots of data flowing through (such as a workplace/business) will tend to show lots of FECs.   The more data that goes through the connection, then the higher the FEC count will likely be - as long as its in proportion to the total traffic then its fine.   Err Secs are the ones to watch for and from a quick glance, they seem fine :)

Interestingly, and this is listed on Kitz elsewhere some time back by roseway, Reason 3 for a resync is:

High Upstream FEC (actually TooManyUsFEC)

It's used in MDWS as the reason when/if that error occurs. Is there some later data that would negate that or offer a different reason? Or, maybe it only occurs on ADSL lines?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 07, 2014, 08:20:51 AM
I expect the higher FEC's that whenthe powercut happened, the modem bitswapped into new available tones thinking this is cool, then those tones were lost again and as a result there was more errors to fix.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 07, 2014, 09:39:34 AM
I see requirement R.VDSL2.17 in SIN 498 indicates that FEC seconds are reported by the modem for DLM.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 07, 2014, 10:21:13 AM
Interestingly, and this is listed on Kitz elsewhere some time back by roseway, Reason 3 for a resync is:

High Upstream FEC (actually TooManyUsFEC)

It's used in MDWS as the reason when/if that error occurs. Is there some later data that would negate that or offer a different reason? Or, maybe it only occurs on ADSL lines?


The posting you refer to is here:

http://forum.kitz.co.uk/index.php?topic=12504.msg236038#msg236038

This of course is not related to DLM, it's just a list of recognised reasons for the connection to re-sync.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on October 07, 2014, 11:00:50 AM
I imagine that DLM doesn't care about the number of FEC's when it is trying to make a decision about whether further intervention is required: FECs represent success for DLM, showing that the current settings are appropriate for the noise environment.

It is only the CRC count, and the associated ES and SES values, that continue to represent failure to DLM - so it will continue to monitor these.

However, when DLM is choosing to remove intervention, there is the possibility that the FEC level is considered. If DLM only looked at whether the ongoing ES and SES levels are low enough, it might decide that FEC+Interleaving is no longer required - when a high level of FECs (or FEC seconds) could be a contra-indication. In those circumstances, service would flip-flop back and forth.

DLM could sensibly use FECs in this way, but I'm not sure it does.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 12:10:52 PM
Interestingly, and this is listed on Kitz elsewhere some time back by roseway, Reason 3 for a resync is:

High Upstream FEC (actually TooManyUsFEC)

It's used in MDWS as the reason when/if that error occurs. Is there some later data that would negate that or offer a different reason? Or, maybe it only occurs on ADSL lines?


The posting you refer to is here:

http://forum.kitz.co.uk/index.php?topic=12504.msg236038#msg236038

This of course is not related to DLM, it's just a list of recognised reasons for the connection to re-sync.

Thanks Eric. Yes that's exactly what I was pointing out I thought? I purposely didn't refer to the DLM as the cause, just that there can be a resync caused by high FEC == Reason No 3, by whatever piece of equipment initiates the resync in that instance - which would be?

I just want to get the reported MDWS cause of High Upstream FEC for the resync correct if it isn't.

Incidentally resync mails are currently disabled.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 01:54:21 PM
Multi User Monitor

There is a new page available in MyDSLWebStats that a few have asked for. It's different to normal in that it is a standalone page (or tab) that occupies a whole page. There is a link to it within the Control Box All User Stats monitor now when displaying that but that is getting difficult to use as the number of active uploaders rises.

This standalone version of it shows every user at once depending on your screen resolution. It still updates every 30 secs but only currently lists sorted by User Name. It should be possible to add some additional column sorting later. There is a larger display font as well.

All the ISPs have been collected from the upload data now and for new users as they appear and once the facility to allow use of this for each user is in, they can appear on this page as well. This will then offer the option to list the stats by ISP rather than User which might reveal trends when large area problems occur.

There are other standalone pages coming along of the multi-monitoring type plus additional standard line graphs for the panes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 05:18:20 PM
Multi User Monitor

A slight change, rather than control the display paramter/order from the new page, it now picks up the current settings from the original pane-based facility. If you change that, the full page version will pick up the change at the next 30s refresh.

The smaller version does not have to be running to view the larger one unless you want to change any of the settings.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 08, 2014, 11:28:27 PM
Can I just say tbailey2 your MyWebStats site is excellent  :)
It extends BE1 + Ronski's and Roseways programs for us the users to gain more knowledge and the only way for me is to compare others stats against my own.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 09, 2014, 03:26:58 PM
Can I just say tbailey2 your MyWebStats site is excellent  :)
It extends BE1 + Ronski's and Roseways programs for us the users to gain more knowledge and the only way for me is to compare others stats against my own.

Thank you for that, much appreciated  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 09, 2014, 04:03:29 PM
Raspberry Pi uploading to MyDSLWebStats

For those interested in using a Raspberry Pi to upload data, I've managed to get one working and actively uploading, although I need to tidy up the wiring that is currently going all over the place  :(

I have never used a Linux command in my life having worked with Windows since the dawn of time so it was a bit of an experience.  With help from Eric, roseway, and a few aborted installs, it now runs reliably.

You can see it logged on as Crusty-rpi and it is using the same data as my own username but uploaded at a different time within the minute. It's using dslstats32RPi-5.1.2. OS is Raspbian running directly from an image on the 8gB SD card.

This is the basic B+ model running off a USB supply and HDMI o/p to my main PC currently. I also have a 3.2" LCD colour plug-in touchscreen for it but have yet to set that up. My desktop screengrab is attached from which you can see that it runs MyDSLWebStats okay as well in the Epiphany browser (the other one doesn't seem to have Javascript support that I could find). It is a bit on the slow side rendering the graph though as you might expect.

What I'll do is develop a page or two over the next week on my experience of setting it up and installing it and the pitfalls I encountered in the process. Eric will also kindly contribute as there are things I still need to do.

Hopefully this will then help anyone who wants set up a 24/7 low power 5v machine for the purpose. I'll measure the current consumption when I can find my USB V/A meter!

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 09, 2014, 07:47:09 PM

What I'll do is develop a page or two over the next week on my experience of setting it up and installing it and the pitfalls I encountered in the process. Eric will also kindly contribute as there are things I still need to do.

Hopefully this will then help anyone who wants set up a 24/7 low power 5v machine for the purpose. I'll measure the current consumption when I can find my USB V/A meter!

That would be very helpfull indeed tbailey2  :) had a linux partion on the PC drive and used it for 6 months it's the RPi hardware & software setup that may confuse me and this moniter only has VGA and DVI outputs (DVI in-use) looks like i'll also need a HDMI to VGA adapter.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on October 09, 2014, 08:05:26 PM
That would be very helpfull indeed tbailey2  :) had a linux partion on the PC drive and used it for 6 months it's the RPi hardware & software setup that may confuse me and this moniter only has VGA and DVI outputs (DVI in-use) looks like i'll also need a HDMI to VGA adapter.

HDMI is digital, VGA is analogue. Can't convert between them without a powered box of electronics which will be quite expensive.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 09, 2014, 08:21:46 PM
it would be awesome if a asuswrt router can be made to manage/upload data :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 09, 2014, 08:40:17 PM
That would be very helpfull indeed tbailey2  :) had a linux partion on the PC drive and used it for 6 months it's the RPi hardware & software setup that may confuse me and this moniter only has VGA and DVI outputs (DVI in-use) looks like i'll also need a HDMI to VGA adapter.

HDMI is digital, VGA is analogue. Can't convert between them without a powered box of electronics which will be quite expensive.

It's not that expensive £6 to £8 Connector: HDMI male to VGA female
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 09, 2014, 09:33:43 PM
You don't need to go to that trouble. Just Remote Console into the RPi and with a WiFi dongle on it, all's you need is power to the RPi, no other leads...

Edit:
As for installing software problems, it would be possible for someone to get a basic working setup running and then image the SD card (less the DSLStats logon details) (using Win32diskimager on Windows say) and pop that image onto Dropbox for download. Put that image onto your own SD card using the same software, pop it in, power on and off you go....  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ducky on October 10, 2014, 10:12:36 AM
Am I being a 'bit fick' here, but how have the people got their systems configured who are uploading stats?  I have to have my monitoring laptop plugged into my 612 on Lan2 to access the stats/web interface, but then it doesn't have any internet connection (Lan1 is the uplink to my BT router).

Are people changing the gateway on their 612 to run on their internet network? i.e. from 192.168.1.254 to say 192.168.2.254 (what my internal network is on)? 

thx
:)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 10, 2014, 10:17:18 AM
Change the address of the HG612 to match your LAN and connect LAN2 to your LAN, then your stats should be available to any PC.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 10, 2014, 11:39:26 AM
Am I being a 'bit fick' here, but how have the people got their systems configured who are uploading stats?  I have to have my monitoring laptop plugged into my 612 on Lan2 to access the stats/web interface, but then it doesn't have any internet connection (Lan1 is the uplink to my BT router).

Are people changing the gateway on their 612 to run on their internet network? i.e. from 192.168.1.254 to say 192.168.2.254 (what my internal network is on)? 

thx
:)
This may help  I've unlocked my HG612.  How do I get my linestats? (http://www.kitz.co.uk/routers/hg612unlock.htm#hg612_linestats) - Follow the diagram :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 10, 2014, 11:55:34 AM
I think all the devices on the network need to be on the same subnet. If the rest of the network is on 192.168.2.x, then to get the stats from the HG612 it will need to have a 192.168.2.x address as well. Of course I might be talking nonsense.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 10, 2014, 11:57:54 AM
System Outage  :'(

There was an outage from about 11:35 - 11:52 earlier during which no uploaded records were collected while some emergency maintenance was carried out. All should be back to normal now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ducky on October 10, 2014, 12:42:04 PM
That's what I thought, I don't use the default 192.168.1.x on my home network so need to adjust the 612 to match.  Cheers peeps! :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2014, 07:34:04 AM
V1.2.0 Update October 12 2014

You may need to hit F5 to see all updates - there should be a message
telling you this if everything isn't already updated.

1) ISP is visible again per user IF you enable it for yourself via the
    Options menu at the bottom of the window. This appears in various
    places and is now derived from the upload data Host. It will update
    within three minutes if you change ISP.

2) Resync e-mail is enabled again and should only be going to
    those who want them now.
      
3) Addition of several new graphs:
    a) Signal Attenuation per band Down and Up
    b) Line Uptime
    c) and CRC Upstream errors now show the data for OHF Upstream
    errors as they appear to be the same thing. CRC graphs could
    probably be removed at some point. These are Delta error counts -
    that is the difference between the previous and current total
    CRC/OHF error counts reported by the modem.
    d) Already annnouced on Kitz and active, the All User Stats option in
    a pane now has a link to open a version in a new window/tab
    so you can see them all without a lot of scrolling. It has a larger
    font as well and also shows the program that was used to Upload data
    to the server. This latter option will soon also show the flavour
    of DSLStats used to upload - i.e. Windows, Linux, Raspberry Pi etc.
    The settings are controlled by the smaller version and the full page
    option will pick up changes within the 30 second auto refresh period.
    The original pane does not need to be in use unless you wish to update
    the settings of the larger one. The settings can get out of sync if
    you sleep or hibernate your terminal though.

4) When a user is offline, the graphs are currently shown with a
    straight line connecting the last and next available data points.
      
    As an experiment, for the SNRM Current graph options only at the moment,
    there is now a gap with no plot between such points whenever they
    occur - this can show odd looking graphs if the user has only
    uploaded occasional data! This entails a lot of additional
    calculations so the graphs may be a bit slower to render. The only
    proviso is thet the user has to have at least 15 mins of data available
    in the displayed period, otherwise it will revert to the original
    behaviour.

5) Several people have commented that if you look carefully at the
    24 hours and longer plots, you can't see all the minute plots.
    That's simply because there aren't enough pixels to plot them all.
    If you zoom in (drag an area horizontally) then you'll see more
    of them. This applies to the time periods below 3 day spans. Above
    those, points are actually removed from the plots to keep the
    rendering and calculation times within limits.
      
6) User names can now have periods and hash symbols in them. This
    is not possible retrospectively though unless you register with
    a new User Name and start a complete new data set.

7) Just because you see the Log On window doesn't mean you HAVE to
    Log On. If you were logged on and haven't lost your cookies,
    the Continue option should take you back to the setup you last
    had.

This will likely be the last update to the site for a while now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 13, 2014, 01:51:34 PM
thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ducky on October 13, 2014, 06:08:43 PM
Just a quick one, I'm not sure if it's a glitch or something but when viewing my stats it looks to be a day out.  It says I'm offline, but when I view a specific stat it's showing the current time at the top left, and a day behind on the graph?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2014, 09:31:50 PM
Just a quick one, I'm not sure if it's a glitch or something but when viewing my stats it looks to be a day out.  It says I'm offline, but when I view a specific stat it's showing the current time at the top left, and a day behind on the graph?

Hi

Just had a look and the database is showing your upload data is timed a day out.

So I captured one of your stats log uploads which starts:

12/10/2014 21:17

and it should be reading

13/10/2014 21:17
 
That's the time that goes into the database so your device has a clock that's a day out  :o
Fix that and all will return to normal - except you'll have an apparent one day hole in your data.....

NB: Windows users note that in 7 and 8/8.1 time syncing is NOT enabled by default despite what MS tell you. It's disabled by default. If you do a manual time sync via the net it will then sync (but only every 5 or 10 days or so I think but you can change that via the Registry) - until you restart then it will be off again. To have it on permanently you need to enable it via the Task Scheduler. MyDSLWebStats really needs the time to be accurate within a minute if possible.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 13, 2014, 10:19:49 PM
That is a concern as the RPi does not have a Bios RTC battery you will need a time sync from an online time provider from the ethernet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2014, 11:15:09 PM
That is a concern as the RPi does not have a Bios RTC battery you will need a time sync from an online time provider from the ethernet.

I believe the ntpd daemon is launched at boot time and syncs the clock automatically via ntp as long as there is a network connection which there should be if you are uploading. Mine seemed to be keeping within visual sync of the other machines here with no problem (it helps to see that if you set the RPi clock to show seconds rather than just hours/minutes). They all have the NetTime app on them using UK pool ntp servers rather than the Windows inbuilt system.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 14, 2014, 09:20:20 AM
Hi Tony

The new version is great thanks. My stats seemed to have not uploaded this morning from around 2-4AM. I cant see why at my end . Anything you can shed a light on. Uploading has been fine since ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 14, 2014, 09:55:34 AM
Just had a log at the Logs, seems there were 2 instances of HG stats running during that period, the PC was not in use and it cleared by 0400 on its own, any thoughts why that would happen appreciated ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2014, 02:47:02 PM
Just had a log at the Logs, seems there were 2 instances of HG stats running during that period, the PC was not in use and it cleared by 0400 on its own, any thoughts why that would happen appreciated ?

Tony

Hi

You need to get BaldEagle1's attention as HG612 Modem Stats is his baby  - but I haven't heard from him in nearly a fortnight now.

I am no expert on his code but it may have something to do with the speed of your PC  - too fast or too slow - for the current program settings. So it's taking too long to process everything (if it is atall, it can get stuck trying to get data from the modem) and hasn't finished inside a minute when another instance starts up. The logs will tell him. Sorry. I may be totally wrong though. One of the others who has had this problem (Chrysalis?) might be able to suggest something.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2014, 09:45:43 PM
I have the RPi running DSLstats fine but MDWS is not showing me as online, username @password looks ok upload data is ticked.

Need help.

EDIT sorted it was a key mistype  :blush: so thats me using the very small Raspberry PI as the stats collector and uploader  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: VDSL2User on October 15, 2014, 09:09:17 AM
Hi, been using the site since it went live and it is great.
Well done to all involved for creating a great place to store, view and compare DSL service statistics.
I do however have one issue that has just come to light.
I enabled the option to show my ISP and saved it a couple of days ago.
It appears to be showing me (VDSL-User) as BTW (BT Wholesale) however I am on a static
IP address with PlusNet, switch from BTW on 7th October 2014.
Any idea why this has not updated ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 15, 2014, 10:36:56 AM
Hi, been using the site since it went live and it is great.
Well done to all involved for creating a great place to store, view and compare DSL service statistics.
I do however have one issue that has just come to light.
I enabled the option to show my ISP and saved it a couple of days ago.
It appears to be showing me (VDSL-User) as BTW (BT Wholesale) however I am on a static
IP address with PlusNet, switch from BTW on 7th October 2014.
Any idea why this has not updated ?

Thanks for the nice comments....

Sorry, I disabled the update side for some reason I can't now remember. It's enabled again and auto-picked up the change at 10:30....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 15, 2014, 02:56:30 PM
whats the rdns of your ip?

I am guessing he either uses the rdns or a ip database of some sort.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 16, 2014, 08:57:54 AM
Chrysalis

I understand you might have had this problem At between 1-3AM each morning the HG612V4 stops logging. The Logs show 2 instances of the stats program running. It only started a few nights ago (see post). Tony suggested you had this ? Its running on a Server 2008R2 that is doing noting else. There are no backups or any log activity.

Perhaps you might have seen this, and found a resolution. Its strange it happens at the same time each early morning. I have the delay settings at 0 and 10 secs.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 05:15:30 PM
Tony

I've been trying to find why my stats stop at 0101 every day until 0301. It seems the failure is just after its uploaded to your server. I am not getting a curl return = 0 . After that tyhen the HG612 doesn't close. At 0301 I get a curl = 53 which then allows the proper closure of HG612 and then all returns to normal. Can you perhaps look and see if there is anything in your logs that might indicate why the upload hangs at this time and release later. I'm willing to believe that if I disable the upload, it wont stop the logging locally in the night.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2014, 06:02:43 PM
Tony

I've been trying to find why my stats stop at 0101 every day until 0301. It seems the failure is just after its uploaded to your server. I am not getting a curl return = 0 . After that tyhen the HG612 doesn't close. At 0301 I get a curl = 53 which then allows the proper closure of HG612 and then all returns to normal. Can you perhaps look and see if there is anything in your logs that might indicate why the upload hangs at this time and release later. I'm willing to believe that if I disable the upload, it wont stop the logging locally in the night.

Tony

I don't think this is the reason as it apparently doesn't affect anyone else but at 01:00 the server is locked for all access while an automatic backup takes place (since it went live). Because of this, no uploads are collected until after 01:01 and they will fail upload anyway due to the lock. The lock is released after about 1m 30s which will allow the 01:01 logs to be collected. There are no other indications of failures in any of the six logs I can look at for you (or anyone else that I can see).

I would see if BE1 can help via your local logs but he seems to be away at the moment.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 06:10:32 PM
Tony

Thanks. It's really interesting that its at the same time, but unless you changed something it's odd it started this Wednesday AM.

I've moved the logging to a PC from the server, and if it fails again, I can try disabling the upload.

If BE1 sees this perhaps he could PM me and I can send the local logs for the periods.

Unless I've misread them it's the Curl that's failing to exit the keeps the HG stats running its instance.

Thanks for the info

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 06:37:56 PM
All

On further thought, I suspect Curl is hanging because it can't login. I'm not sure why this has just started to happen, maybe a slight time difference or something that stops it exiting with an error as you would expect if the server were locked.

I'm not sure of the significance of the two hours exactly when it finally exits with the code that indicated the server was locked and not straight away. That may be an OS issue, that the change I have made today might prove. Comments are welcome

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2014, 06:57:32 PM
All

On further thought, I suspect Curl is hanging because it can't login. I'm not sure why this has just started to happen, maybe a slight time difference or something that stops it exiting with an error as you would expect if the server were locked.

I'm not sure of the significance of the two hours exactly when it finally exits with the code that indicated the server was locked and not straight away. That may be an OS issue, that the change I have made today might prove. Comments are welcome

Tony

Just to confirm that I haven't made any changes to the upload processing for some weeks. Your uploads are timed normally within the first 15 seconds of the minute.

You could try installing DSLStats V5.2 as well and then temporarily turn off HG612 uploading while you try it and see what happens. They both use curl.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 07:06:30 PM
Tony thanks. I will see if the change of OS makes any difference. If it still fails tomorrow at the same time, Sunday I will turn off uploading late evening and see if the collection localy doesn't stop.

I did think of trying DSL Stats but I guess I need to try one thing at a time. Pity I can't force the error and it's always on the 0102 instance.

I pretty convinced it's hanging when your backup takes place and its not releasing, but no idea why !

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 10:37:09 AM
Update

Move to a W7 PC with a clean install and setup last night.

No logging again between 0101 and 0301, when Curl hung presumably at the time the Website backup started. To  confirm my thought, this is what's causing the 2 instances starting and stopping local logging I am going to disable the upload tonight. If that allows my local logging to continue, I'm going to have to wait for some more support, unless Tony B can see anything more on his server.

Thanks all

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 19, 2014, 11:17:00 AM
Update

Move to a W7 PC with a clean install and setup last night.

No logging again between 0101 and 0301, when Curl hung presumably at the time the Website backup started. To  confirm my thought, this is what's causing the 2 instances starting and stopping local logging I am going to disable the upload tonight. If that allows my local logging to continue, I'm going to have to wait for some more support, unless Tony B can see anything more on his server.

Thanks all

Tony

There is one other user with the same problem (clystron) that I spotted after a search specifically for it last night You'll see his problem  is identical to yours if you run his SNRM graph). Backups have been happening automatically in the same way since early September when it went live. A way round it with would be for the two upload programs to not upload at 01:00 and probably 01:01 as well. This would lose some records. Could maybe be a user choice for those affected.

Still no sign of BE1 for whatever reason. I suspect your logs will show him the cause but I have to get him to decipher mine....

This change may be unnecessary as we are going to hopefully move to a new server and URL in the next few weeks and that one doesn't lock in the same way during backups AFAICT.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 11:44:49 AM
Tony. That's really assuring as looking at his stats it started on the same night as mine .I wonder what's common ?

 I suppose the way would be as a workaround to have 2 scheduled tasks. One that ran say 0105 for 23 hours evey minute daily and one at 0006 to run for 53 minutes every minute daily if I have my maths right !

I have cut down version's of the logs ready for when BE1 can look at them

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 05:15:52 PM
Tony

I have given this a bit more thought today.

Firstly, I monitor the SNRM as I have a problem in the early hours with noise, with CRC in a pane below. Your great improvement showing the "gap" in this graph, made the lack of logging obvious, otherwise I might not have noticed. If "clystron" is not looking at SNRM it may not be obvious he has the same issue.

Secondly, I'm convinced this issue arose after the MS patches on Tuesday they involved a lot of security issues especially with SSL and certificates. I've already had some MS Exchange credential issues since, might it be that only 2 of us are using this weeks patches on windows boxes ?

Thirdly I have setup up two scheduled tasks now to avoid the "Lockout Period" 01:04 - 23:59 = 22:58:00 and 0001 - 0059 = 00:58:00. I'm happy to provide an xml file to import these if any one needs them. I trust you think my maths is correct here.

Finally, is the scale on the SNRM "x" axis different to all others as it appears so on my display ?

Hope this information is useful and I will confirm if the "Gap" between 00:59 and 01:04 stops the issue tomorrow (The gap between 00:59 and 00:01 was intentional to avoid task scheduler issues)

Tony

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 19, 2014, 05:31:07 PM
I'm running mine on Windows Home Server 2011, which is Basically Windows Server 2008. Mine is fully patched and up to date, no problems here at the moment.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 05:44:37 PM
That blows my theory then !

Thanks for the input Ronski
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 19, 2014, 05:47:12 PM
Tony

I have given this a bit more thought today.

Firstly, I monitor the SNRM as I have a problem in the early hours with noise, with CRC in a pane below. Your great improvement showing the "gap" in this graph, made the lack of logging obvious, otherwise I might not have noticed. If "clystron" is not looking at SNRM it may not be obvious he has the same issue.

Secondly, I'm convinced this issue arose after the MS patches on Tuesday they involved a lot of security issues especially with SSL and certificates. I've already had some MS Exchange credential issues since, might it be that only 2 of us are using this weeks patches on windows boxes ?

Thirdly I have setup up two scheduled tasks now to avoid the "Lockout Period" 01:04 - 23:59 = 22:58:00 and 0001 - 0059 = 00:58:00. I'm happy to provide an xml file to import these if any one needs them. I trust you think my maths is correct here.

Finally, is the scale on the SNRM "x" axis different to all others as it appears so on my display ?

Hope this information is useful and I will confirm if the "Gap" between 00:59 and 01:04 stops the issue tomorrow (The gap between 00:59 and 00:01 was intentional to avoid task scheduler issues)

Tony

Thanks.

Yes, SNRM is different as it now covers the requested period exactly rather than using what data is available and can be incomplete. It can get a bit out though if the user is on and off air a lot (excuse the analogy!). If you stack several users graphs on top of each other they should all match for SNRM. I do have an experimental page that can display 16 users graphs at once for comparison and that works well with SNRM.

The scheduled tasks look fine to me although I would guess 01:02 would work at the moment. Um, I haven't run this week's updates yet on my Win7 terminal.... Maybe I won't for a while  :no:

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 05:58:49 PM
Yes I saw the SNRM graphs matched, just slightly out with other measurements, still its brilliant anyway.

I might change to 0102 after it runs OK. I have a couple of ESXi hosts here so I could run up an unpatched W7 machine and test that also, just useful to know why!

I guess I could force the lockout by changing the password slightly  for testing ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 20, 2014, 08:35:22 AM
The split of the schedule tasks worked perfectly and apart from missing a few minutes it carried on normally. I had a drop for there minutes at 0418, but I see a couple others did. The curl error was  7, couldn't connect to host. I guess a network blip.

Thanks, if anyone has a similar problem use the task times I suggested above.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 06:56:36 PM
The errored seconds look different from bar chart to line chart it will take a bit of getting used to  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 20, 2014, 07:32:51 PM
The errored seconds look different from bar chart to line chart it will take a bit of getting used to  :)

As posted elesewhere here, there seems to be a bug in the Column Charts where if the errors exceed a certain value and count, the bars just don't display, especially Upstream. For the moment, and I know everyone is used to viewing bars for ES, the charts for now display as Line Charts like all the other ones but at least all the values are now visible for the longer periods - even if they do look like a map of the Pyrenees at times
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 09:09:56 PM
Hmmm this may be a hard question to answer tbailey2 do you know how much upload is sent per minute / sample to server it's just as I'm now running the stats 24/7 on the Raspberry Pi it would help me calculate the usage per month as I only have 40GB monthly allowance.

Cheers NS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 20, 2014, 09:56:52 PM
is uploading even counted in your allowance?

I havent measured it but this wont be an issue, you uploading small text files.  Not movies.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 10:04:07 PM
is uploading even counted in your allowance?

I havent measured it but this wont be an issue, you uploading small text files.  Not movies.

Yes Download and Upload are both connected to the allowance, for example you could download 20GB per month and upload 20GB you have then reached your 40GB limit.

Info from the router the 0.1GB transmitted data has been like this for 3 days  :-\

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 20, 2014, 10:57:57 PM
According to my calculations the uploaded amount will be less than 2 MB per day for a VDSL2 connection. It will vary a bit, depending on the user's system.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 11:09:21 PM
According to my calculations the uploaded amount will be less than 2 MB per day for a VDSL2 connection. It will vary a bit, depending on the user's system.

Thanks Roseway

With that info the upload total for a month will work out as 392 MB upload data for a month thats good news  :dance:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 21, 2014, 09:52:30 AM
There are two new graphs available at the top of the Data to List dropdown just under the normal SNRM entry. Hit Update if you don't see them at first on a pane or F5 to update all panes at once.

SNRM/Band DS for the three available downstream plots by dB
SNRM/Band US for the three available upstream plots by dB

These may be useful for spotting problems that the normal SNRM graph doesn't show. As per the attachment which is somewhat awry (kitz)  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 21, 2014, 11:41:01 AM
Brilliant - thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 21, 2014, 11:55:32 AM
Agreed  :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 21, 2014, 12:54:04 PM
Thanks for the comments  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 21, 2014, 12:58:55 PM
I think the errored seconds is much more clear and useful.

My only complaint is this can lead to compulsive obsessions about stats.

I hated them once  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 21, 2014, 01:01:52 PM
for user Evga

If they are reading this, if not I'll e-mail him/her. Many of your graphs are blank as, since you are in France, your decimal places in say the SNRM data are being uploaded as commas and not periods. The system wasn't designed for this and so doesn't know how to display the data so gives up. We do have a user in Switzerland though who uploads the correct data so I don't know if you are able to change to use periods (full stops) to solve the problem please? I guess this would be in the Regional settings on your equipment.

For now, I've intercepted the SNRM data (only) and changed the commas to periods so the data displays. As others will notice, you are also an hour ahead of the UK so the graphs appear timed incorrectly here but likely look okay where you are?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 21, 2014, 10:54:29 PM
I would be interested in any views why my SNRM is so wobbly at the noisy times ? I appreciate and understand the effects of noise in the evenings when the cabs are busy, and also early morning when it starts to get busy again before daylight calms the noise. What's odd about my SNRM compared to most others is the large fluctuations over very short periods of time.

Not that I could do anything, I doubt its in my home. I have about 900m to the Cab and part is aluminium. The path runs by a railway station and a substation....not ideal I guess. The good thing is I have a low CRC error and error'd seconds so its not all bad news

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 08:25:57 AM
Tony

Had the same gap last night, I see my gap from 0058 to 0104 but then it stopped at 0105 until 0303 perhaps my time was not synced with your server ? I see Cryston had the same issue ?

Can you see anything at your end, did the server close a bit later perhaps ???

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 08:46:38 AM
Tony

I see from others stats it seems to have been closed to around 0109. Is that going to be the norm as I will alter my delay ? Perhaps the backup is taking longer

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 23, 2014, 09:24:19 AM
my gaps are deliberate, I am disabling the task when playing ff13 as it makes the game stutter.

When bald eagle shows up (or can ronski do this?) I will request a low priority task option.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 23, 2014, 09:33:25 AM
Tony

Had the same gap last night, I see my gap from 0058 to 0104 but then it stopped at 0105 until 0303 perhaps my time was not synced with your server ? I see Cryston had the same issue ?

Can you see anything at your end, did the server close a bit later perhaps ???

Tony

Yes, there was some sort of event on the server that lasted from 01:00 until 01:08 or so. Couldn't get new locks on anything and the process that runs stats collections (which was locked) took 6 minutes to run rather than under 5 secs... No idea what, possibly the backup overran. Haven't seen it before though AFAICR.

I'll also mention that from today if anyone hasn't uploaded data in the immediate past 48 hours, they will disappear from the Users listing on the panes and will reappear when 15 mins of recent data has been uploaded.

Also, should be able to display SES records soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 09:35:34 AM
Tony

Thanks until BE1 can tell me why some of us get locked out, I will leave my collection gap a little longer. That way I don't lose 2 hours worth.

Thanks for clearing that up

Cheers

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 23, 2014, 09:45:43 AM
Tony

Thanks until BE1 can tell me why some of us get locked out, I will leave my collection gap a little longer. That way I don't lose 2 hours worth.

Thanks for clearing that up

Cheers

Tony

If the server is locked the local prog won't able to log on (at the server end) to transfer the files and will likely hang trying but why it should do it for hours I have no idea. Maybe have a look in your logs for clues? BE1 seems to be AWOL last heard from him 22 days ago...  Or try DSLStats for a day or two?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 09:48:05 AM
Tony

Yes it does the Curl upload program hangs and I don't get an exit for 2 hours then its the expected exit code. I'm happy to extend the period its not collecting which I have now until 0110.Seems easy solution until we hear from BE1 again.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on October 24, 2014, 05:37:37 PM
I've been away on holiday for a while.

Now I'm back, please post some relevant log extracts or email them to me.

My latest version of HG612_stats.exe (v 4.0.0.6) does have a timeout of 20 seconds for the Curl program.

Are you using an older version than that?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 24, 2014, 07:34:52 PM
Welcome back BE1, hope you had a good one  :)

Your latest version may well be 4.0.0.6, but the latest available is 4.0.0.2  :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on October 24, 2014, 08:04:24 PM
Quote
Your latest version may well be 4.0.0.6, but the latest available is 4.0.0.2

+1  :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 24, 2014, 10:24:51 PM
Welcome back BE1, hope you had a good one  :)

Your latest version may well be 4.0.0.6, but the latest available is 4.0.0.2  :P

+1 but also I Cannot do snapshot graphs currently :)  so a new bug.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 25, 2014, 09:33:12 AM
Version 4.0.0.6 is now available for download. Thanks BE1
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 31, 2014, 09:16:49 PM
The errored seconds graph seems to have become funky thats the only word that comes to mind when looking at it, the total errors over 24h just jump out and the es per hour are hidden away in the background.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on November 01, 2014, 07:45:03 AM
  The new graph is actually the best for judging the error state of the connection.  :) The 24 hour is the most important stat.  I agree that the hourly values are harder to see at the bottom, although a good indication is given by the local slope of the 24 hour plot.  The cursor still gives the exact values should they be wanted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on November 01, 2014, 08:06:05 AM
Quote
I agree that the hourly values are harder to see at the bottom

I think it may require another option to switch the running total and average off. ;)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: bigbossa on November 01, 2014, 11:14:28 AM
Help!
I have registered on the  MyDSLWebStats but cant log on as I have forgotten my memorable phrase , on resetting via the "forgot password" facility I get "Password reset has failed - please go back and try again....";  through the email
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 01, 2014, 03:42:31 PM
Help!
I have registered on the  MyDSLWebStats but cant log on as I have forgotten my memorable phrase , on resetting via the "forgot password" facility I get "Password reset has failed - please go back and try again....";  through the email

Please try the link again, it should work for you now, took a while to puzzle the failure out. I've PMd you separately.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 02, 2014, 03:51:15 PM
Quote
I agree that the hourly values are harder to see at the bottom

I think it may require another option to switch the running total and average off. ;)

Ian

Done, there is now a checkbox to click on for an instant with and without  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on November 02, 2014, 04:12:33 PM
Thanks again Tony.

You really are a star. ;D ;D

One more option you may care to think about implementing; as I am on a dynamic IP address and am unable to switch to a static one, I use the ping monitoring graphs from http://f8lure.mouselike.org/ (http://f8lure.mouselike.org/) a static png is produced just like the TBB ones http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705 (http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705) or http://f8luresig.mouselike.org/sig.png?/53705.png (http://f8luresig.mouselike.org/sig.png?/53705.png)


Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 02, 2014, 10:27:37 PM
Yeah sometimes to much info can be distractive and it's nice to have the option to filter out what you need and don't at that time.

Good Job Tbailey2  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 02, 2014, 10:39:00 PM
HG612 Modem Stats V4.0.0.6

Just a reminder that those of you using BE1's software with MyDSLWebStats should upgrade to this latest version to overcome various problems relating to timeouts and occasional uploading of files full of zeros. There are about a dozen active users who need to do this, in particular WWWombat, Mike-IG and spadge007....

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 10, 2014, 08:34:22 AM
MyDSLWebStats is Moving next Sunday 16th November 2014

For a number of reasons but primarily due to a lack of enough donations from our 90 registered users (63 of whom currently upload) to support even the first month of the £120 a month that the dedicated server rental for this facility costs, MyDSLWebStats is moving to a new web site URL and much cheaper server next Sunday 16th November 2014 at 10:00 GMT.

There is a danger that the new server will not cope but that remains to be seen as it's only been possible to carry out limited stress tests. The current server monthly rental expires on 19th November and it hasn't crashed/failed or been overloaded since it was started up back in July.

However, IF any of you out there who find the facility useful want to help keep the current server going via donations for at least a couple more months to evaluate a way forward then that is a possibility and the change could be avoided, possibly permanently. And many thanks to those who have donated so far.

If the change goes ahead, the site will still be known as MyDSLWebStats but the access URL from the 16th will be:

http://www.livedslstats.co.uk/

This new site is active but there is just a holding home page at the moment until the 16th.

This will inevitably result in some disruption but this will be minimised as much as is possible. If you are uploading then you need to read this post carefully as you MUST make changes if you are to continue uploading.

The changeover will start at 10:00am local time. From then on you will automatically be diverted to the new site holding page as far as viewing results go. The holding page will auto update every few minutes and change to the normal Home page with a Log On link etc when it is available again. Everyone using the site to VIEW data will then need to Log On on and set up their pane(s) again. All other user data is still there, you do NOT need to Register again. The site should then operate as before for you.

Please make sure that you are permitting Cookies from the new site (as www.livedslstats.co.uk).

If you are UPLOADING then then there are ESSENTIAL additional changes...

At 10:00 GMT, no further uploads will be accepted by www.mydslwebstats.co.uk and nothing will be processed. Your upload program will appear to have lost connection to the site and you may as well switch uploads off.

In the background, there will be a lot going on to finish the remaining transfers to the new site, much of which is already done and tested.

While this is happening, YOU MUST UPGRADE YOUR STATS PROGRAM BEFORE YOU CAN UPLOAD AGAIN.

Both HG612 Modem Stats and DSLStats will have new versions available by 10:00 GMT. After upgrading PLEASE WAIT until 10:15am before trying new uploads which will then automatically go to the correct place only IF you have upgraded. Before that they will likely be ignored unless the database is available earlier, but there are no guarantees with the availability time. The site itself may not be available until later for viewing.

There will be more info available on the upgrades from Bald_Eagle1/Ronski and roseway nearer the time.

If you hit any problems after the upgrade, or nothing happens at 11:00, please don't post a multitude of Help! It isn't working messages here as we probably know about it! There will be a post in the Kitz MyDSLWebStats thread if there is a hold up or as soon as it is available.

If for any reason the time or date changes or the change is cancelled then there will be a another post made.

Thanks for bearing with us and those of us on the development end hope you find the facility useful.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on November 12, 2014, 11:09:47 PM
Admin note - Ive moved all discussions about donations to the other thread started by Tony here (http://forum.kitz.co.uk/index.php?topic=14663.0). 

Please continue any discussions about donations to MDWS in the other thread (http://forum.kitz.co.uk/index.php?topic=14663.0), and leave this one for technical discussion/help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2014, 07:48:28 AM
MyDSLWebStats Server Move on 16th Nov CANCELLED

Just a note that the proposed move will NOT now take place until the hosting is sorted out. More later when anything is available....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 23, 2014, 09:24:43 PM
noticed around 16:24 with all users there was no uploading until 16:59 a gap of 35 minutes  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2014, 08:09:21 AM
noticed around 16:24 with all users there was no uploading until 16:59 a gap of 35 minutes  :-\

Only just spotted this - the server was still running okay at that time so looks like a lost database connection at the data centre end... There was another one a few hours before but with shorter duration.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2014, 08:14:05 AM
There is now a MyDSLWebStats Mobile Edition (http://forum.kitz.co.uk/index.php?topic=14737.0) that allows you to get your basic stats on the move.

This has a separate thread on the link above.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on November 30, 2014, 01:37:30 PM
   It seems very likely that SES as well as ES are counted by the DLM.  Assuming that it is uploaded I wondered if at some stage SES could be added to the ES plot in a maybe in  a different colour and perhaps as narrow bars and not a joined up line.   For most people they will be infrequent and most often zero so I don't think they will add to much confusion to the plots.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2014, 01:22:57 PM
Thanks again Tony.

You really are a star. ;D ;D

One more option you may care to think about implementing; as I am on a dynamic IP address and am unable to switch to a static one, I use the ping monitoring graphs from http://f8lure.mouselike.org/ (http://f8lure.mouselike.org/) a static png is produced just like the TBB ones http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705 (http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705) or http://f8luresig.mouselike.org/sig.png?/53705.png (http://f8luresig.mouselike.org/sig.png?/53705.png)


Ian

This does now basically work with either of the mouselike.org graphs you linked, sort of.... The thumbnails are a bit challenged in width due to space available and the popup is either too large or not wide enough depending on which version you use  :( Now fixed mostly but width is a bit browser dependant.

There seemed to be a problem with the thumbnail refresh anyway but that is hopefully now working with a fixed 3 minute refresh period currently. I'll try and fix the other problems when I get a moment and the code can tell which graph it's loading...

You will likely need an F5/Refresh or get the refresh time and popup working properly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on December 01, 2014, 06:25:42 PM
 :drink: :congrats: :clap:

That is working fine.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 14, 2014, 09:47:37 PM
Thanks for increasing period to show from the max of 10 days to 30 days thats very helpful  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 14, 2014, 11:27:25 PM
Thanks for increasing period to show from the max of 10 days to 30 days thats very helpful  :thumbs:

That's okay thanks  :)   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 20, 2014, 10:31:06 AM
Thanks for increasing period to show from the max of 10 days to 30 days thats very helpful  :thumbs:

And you now have 60, 90 and 120 days as well  :)

Note that with 60 days, each plot point is about 2 hours apart (pro-rata for the others) so you lose all the detail (ES are handled to total correctly) but good for an overview of many stats. Also depressing to see what's happened to the line in many cases....

The 24 Hour graph option now displays the correct thumbnail graphs for ES and FEC. Again, note this is 24 Hours as in the current day starting 00:00 so will mostly not be the full 24 hours.

NB the Range option is not very usable currently over longer period and needs a rewrite. I may remove it temporarily.

As the new server and its revised database is between 2 and 10 times faster overall than the old one at delivering data back to you to process locally (the graphs are actually calculated and plotted on your local machine if anyone wondered - which is why a Raspberry Pi takes forever if you try it), the 24 Hour set of graphs can probably be made to auto refresh now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 21, 2014, 04:02:42 PM
(the graphs are actually calculated and plotted on your local machine if anyone wondered - which is why a Raspberry Pi takes forever if you try it),

Thats why i just let the RPi gather the stats and use the PC to look at the stats  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 23, 2014, 03:49:13 PM
Donations

A bit late but a Christmas Thank You to those users who kindly donated some much needed extra funds to help keep the old (expensive) MyDSLWebStats server going until the replacement was ready and a for few more recent donations. The new server has now been up and running for two weeks and the old one retired.

Thanks go to:

g3uiss pooclah (twice) roseway plutox myadsl

 :clap2: :clap: :clap2: :clap: :clap2: and a Merry Christmas and Happy New Year to all users  :drunk: :drink:

Donations will still be gratefully received of course
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on December 24, 2014, 10:14:15 PM
Tony, is there a problem atm.  I dont seem to be able to get any SNRm stats for more than 5 days.

Ive tried using both range and current, but neither work and I get the date Jan1 00:00 keep coming up - see attached.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on December 25, 2014, 11:31:14 AM
  I can confirm that there is an problem with SNRM. 

 I have a quick question -- I am away for Xmas but left things running via raspberry pi and dslstats.  I notice that data upload to  MDWS seems to have ceased exactly from the time that I logged into MDWS yesterday from another location.  A ping monitor is still running so I assume the house has not burnt down!!. 

   Could logging in from another location cause any issue with the upload and logging?

  I am not expecting a reply any time soon as I expect you will have other Xmas priorities.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 25, 2014, 04:20:29 PM
Tony, is there a problem atm.  I dont seem to be able to get any SNRm stats for more than 5 days.

Ive tried using both range and current, but neither work and I get the date Jan1 00:00 keep coming up - see attached.

I knew I shouldn't have checked in here   ::)

Couldn't see anything wrong from my location but using a proxy server shows the problem.  I've put back some code that was changed late yesterday in the area where the data is fetched and that seems to have fixed it viewing via the proxy so I'll try to find out what's causing it later. 

Back to Christmas now  :sleep:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 25, 2014, 04:51:16 PM
  I can confirm that there is an problem with SNRM. 

 I have a quick question -- I am away for Xmas but left things running via raspberry pi and dslstats.  I notice that data upload to  MDWS seems to have ceased exactly from the time that I logged into MDWS yesterday from another location.  A ping monitor is still running so I assume the house has not burnt down!!. 

   Could logging in from another location cause any issue with the upload and logging?

  I am not expecting a reply any time soon as I expect you will have other Xmas priorities.

Hopefully SNRM is fixed.

There is no relationship at all between the data upload operation and logging on/off/changing IP for a user so that wouldn't be the cause.

Also, your last data upload was 13:47 while your logon with a changed IP was at 14:21...

Maybe a glitch at the moment you accessed the server. See if the DSLStats log shows anything? My own RPi seems to recover quite happily from connection glitches though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on December 26, 2014, 09:12:09 AM
  Many thanks for the info.  I have not had my Rasp pi stop logging before and I did did not get round to enabling remote access from outside the lan.   I will have to see what has happened when I get home next week.  As I mentioned ping to the router from TBB is working so the house must still be there.  I also can't see any resyncs on the TBB ping.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on December 26, 2014, 09:44:01 AM
Quote
Hopefully SNRM is fixed.

Thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on December 27, 2014, 09:15:27 AM
Loaded up the mobile version to check my stats this morning and noticed a formatting problem with the date (see screenie).

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 27, 2014, 10:40:09 AM
Loaded up the mobile version to check my stats this morning and noticed a formatting problem with the date (see screenie).
Ian

Oops!  :-[

Thanks and fixed - it was showing the truncated year as the day's date.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 30, 2014, 09:02:40 PM
Tried setting it up tonight but I keep getting the following error...

Error code 2 while uploading MyDSLWebStats data

Not sure what I've missed, if anything.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 30, 2014, 11:05:45 PM
Error code 2 while uploading MyDSLWebStats data

Well nothing is arriving at MyDSLWebStats so that error is coming from the local client but unfortunately I don't recognise it. You need to get the attention of either Bald_Eagle1 (if he's still around as have heard nothing from him for 6 weeks or more) if it's HG612 Modem Stats or roseway if it's DSLStats (I'd guess the latter).

The usual problem is using your password as the validation code for uploading (which should have arrived as a separate e-mail after validating your own e-mail). DSLStats should validate that for you though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 30, 2014, 11:19:38 PM
I'm using DSLSTATS 5.3 with my username and validation code from the email received (in DSLSTATS it says Checked OK in green).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ardsar on December 30, 2014, 11:23:37 PM

I'm using DSLSTATS 5.3 with my username and validation code from the email received (in DSLSTATS it says Checked OK in green).

I initially had similar problems and found norton security had blocked some of the apps required to upload the data   


Sent from my iPhone using Tapatalk
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 30, 2014, 11:48:30 PM
I had considered it being Kaspersky Internet Security I use, but disabling it made no difference.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on December 31, 2014, 08:07:21 AM
Tried setting it up tonight but I keep getting the following error...

Error code 2 while uploading MyDSLWebStats data

Not sure what I've missed, if anything.

Error code 2 is a curl.exe error code reported by DSLstats. The official description of this error is:

Code: [Select]
CURLE_FAILED_INIT (2)

Very early initialization code failed. This is likely to be an internal error or problem, or a resource problem where something fundamental couldn't get done at init time.

Did you copy all the files from the downloaded archive, including curl.exe? The reason I ask is that the error suggests that the version of curl.exe which is being used isn't compatible.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 31, 2014, 09:02:19 AM
All files are intact and straight from the v5.3 zip file.

Edit: I deleted the installation and created a new one and it's now working.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on December 31, 2014, 10:32:48 AM
All files are intact and straight from the v5.3 zip file.

Edit: I deleted the installation and created a new one and it's now working.

Thanks for that. One of those mysteries then. :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 31, 2014, 05:43:22 PM
Anytime Roseway puts out a new version of DSLstats I uninstall/delete the old version before zipping the new version to a folder this way seems to keep all files upto date  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: snadge on January 02, 2015, 08:17:46 AM
its very difficult to register and setup

there is no validation key in my email and it kept saying the captcha was wrong? 

Quote
Hi Paul

Here are your Registration details:

Username: snadge
Memorable Phrase: hidden

You now need to visit:

http://www.mydslwebstats.co.uk/[removed]

to validate this registration.

The MyDSLWebStats Team

Donations are gratefully received via the web site - thank you!

no validation key anywhere?


----
link edited by Admin
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 02, 2015, 08:55:37 AM
its very difficult to register and setup

Welcome and sorry you've had some problems but are now logged on okay.

there is no validation key in my email and it kept saying the captcha was wrong? 

The upload validation key is sent separately by email after you successfully validate the email via the link. The log shows it was sent  and accepted by your mail server so you may need to check your spam folder?

You have also now posted your private mail validation link publicly  - can you remove it please, as it will invalidate your registration if enough people select it ....

The captcha errors were because you were entering the captcha (you get a new one every time it's entered incorrectly BTW) incorrectly according to the logs...

Do you have the Validation key now to upload? If not I'll PM it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on January 02, 2015, 10:24:57 AM
Quote
You have also now posted your private mail validation link publicly  - can you remove it please, as it will invalidate your registration if enough people select it ..

edited.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 02, 2015, 10:51:43 AM
Quote
You have also now posted your private mail validation link publicly  - can you remove it please, as it will invalidate your registration if enough people select it ..

edited.

Thanks  :) I see he is uploading now so must have found the mail....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: snadge on January 02, 2015, 11:01:51 AM
thanks

the problem here is that the reg link and reg code come from 2 different email addresses meaning both can get junked

I also entered a new captcha every time,,,, but at least im sorted now :)

so, can you use it to say get a friend to login a non-broadcom router just for basic line stats of LA,SNRM,SR ?


where is the page to view my connection on>?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 02, 2015, 03:21:45 PM
Go to the home page www.mydslwebstats.co.uk/index.htm

Click the Log On (http://www.mydslwebstats.co.uk/mdws-lg.php) button, first line of text under welcome.

Once you've logged on there are cookies stored on your PC which remember your details and you can then go directly to www.mydslwebstats.co.uk/Container.htm and shouldn't need to log in again.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 07:17:55 PM
Have just started to run Version 5.3.1 of DSLstats on the RPi thats was 40 minutes ago but MDWS is showing uptime as 0d 0h 0m though the stats are being sent to the server.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 02, 2015, 08:26:06 PM
Could you check this please:

The first item in the DSLstats event log shows where the configuration files are stored. Inside that folder is another folder called mydslwebstats. Inside this there are several files including one called NStar_live_modem_stats.log. The full pathname should be /home/pi/.dslstats/mydslwebstats/NStar_live_modem_stats.log

This is a plain text file, and you can double-click on it to view it in a text editor. It consists of a number of short items separated by single spaces. The 23rd item should be a number with three decimal places, such as 28.012, and this is the uptime in hours. Please let me know what it shows.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 08:45:58 PM
the configuration files are stored in Home/pi/dslstats32RPi-5.3.1 there is no folder called mydslwebstats just the standard files and dslstats executable.

Edit have found /home/pi.dslstats and there is a folder called mydslwebstat and see NStar_live_modem_stats.log there is so many numbers in here it's hard to find the 23rd  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 02, 2015, 09:13:24 PM
No, the configuration files are definitely where I said they were. The folder .dslstats (note the dot in the front) is a hidden folder, and you will only see it in a file manager if the enable the option View --> Show hidden files. If you look in the event log, the first (or maybe the second) line shows where the configuration files are.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 09:23:46 PM
No, the configuration files are definitely where I said they were. The folder .dslstats (note the dot in the front) is a hidden folder, and you will only see it in a file manager if the enable the option View --> Show hidden files. If you look in the event log, the first (or maybe the second) line shows where the configuration files are.

I have found the folder your interested in just trying to find 23rd item should be a number with three decimal places, such as 28.012.

could i paste this log for you to look at ?

02/01/2015 21:15 30325 6371 5.4 6.0 11.2 0.3 33292 6315 PTM 1396 115 3054087 196 13307 0 191655 0 0 2891 0  3054087 196 0 54670298 724514 0 1396 115 0 1110622101 2437317 0 59893 0 0 593 1 474 85 0 0 0 0 0 0 0 0 7.9 42.9 0 0 19.5 52.6 81.1 7.9 42.3 0 0 21.8 52.2 0   0 0   0 10.9 0.1 0 0 8.5 7.8 0 Showtime 0 0 L0 17a ON ON No Showtime 24.7 0.0 0 0 0 0 0 0 0 0 0 0 0 0 769 0 769 0 2584251782 0 5188115 0 0 0 0 76 76 3.00 0.00 3.50 9.84 8 0 54.77 26.00 138401 65 VDSL2 43 0 0 0 24.7 0.0 0 0 33292 6315 0 0 0 0 0 0
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 10:54:22 PM
I'll go back to version 5.3 on the RPi and wait for a fix, the Windows 32bit 5.3.1 is showing as the correct uptime on MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 02, 2015, 10:55:06 PM
The one you've made bold is number 21 (downstream FECs per minute). Number 23 is the one two places later, and the number is quite wrong. I guess this is a bug in the RPi version of DSLstats. I'll check it out tomorrow.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: big360 on January 03, 2015, 01:39:14 AM
Set up one of my Raspberry Pi with DSLstats 5.3 and MyDSLWebStats in the hope of trying to diagnose intermittent REIN issues. Seems to be working great so far!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 03, 2015, 07:29:08 AM
Welcome big360, and thanks for letting us know.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: snadge on January 03, 2015, 11:55:41 AM
Go to the home page www.mydslwebstats.co.uk/index.htm

Click the Log On (http://www.mydslwebstats.co.uk/mdws-lg.php) button, first line of text under welcome.

Once you've logged on there are cookies stored on your PC which remember your details and you can then go directly to www.mydslwebstats.co.uk/Container.htm and shouldn't need to log in again.

thanks ronski - -tbailey2 who thought of this should be knighted! :) - great :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 05, 2015, 03:56:03 PM
thanks ronski - -tbailey2 who thought of this should be knighted! :) - great :)

Eek  ???   I'd better get my hair cut then....  Thank You!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 05, 2015, 04:24:16 PM
MyDSLWebStats  - User Guide/Help System

We now have a User Guide/Help system some many months later than I had hoped to provide it originally  :(

It's only available if you are logged on and you'll find an icon link to it to the left of the Social Media icons at the bottom of the main screen. You may need to hit F5 to reload the container to see it.

It's all web based and comes with a topic list, index (needs a bit of sorting) and Search (the text is all indexed).

There is no direct linking between the main MDWS site and Help currently but that will come.

I have no doubt that as it's V1.0.0.0 there are bound to be loads of errors/incorrect info/snafus/missing info etc etc so feel free to say and I'll try to fix it. I've borrowed a lot of general background and info  to go with the stats etc from Kitz generally (I did ask ages ago!)  to add some extra depth to it. Also lots of examples of graphs everywhere. There's an example page attached - there are about 140 individual pages in all.

Also have tried to add some info on getting going and where to find the upload progs etc.

Hope it works for you  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 13, 2015, 04:57:41 PM
V1.3.0 Update January 13 2015

This is now available as of 16:56 today.....

You may need to hit F5 to see all updates - there should be a message
telling you this if everything isn't already updated. Some of these
changes were already implemented via rolling updates since v1.2.0

1) Changes to support International Users in Time Zones other than the UK.
    Panes now display the correct local times for Non-UK users in most
    instances. Non-UK users have an asterisk against their User Names in the
    Whois online/uploading displays and the offset from UK time in Hours is shown
    at the top of a Control Box against their User Name. There are now users
    in France, Switzerland, Italy, USA and Canada although not all are currently
    uploading.
               
2) Web-based Help system implemented for Logged On users reachable via
    a link at the bottom left of main window
   
3) 'All User Listing' revised for both Pane and large window versions. Both
    versions now use the Column Headers to sort the listings

4) Mobile version implemented as a browser based app. This is quite simple
    and offers basic stats once logged on. Can be used from a main browser
    but a bit too large. Works well with Android and iPhone etc. There is a
    more extensive description/images on the Kitz forum at:
    http://forum.kitz.co.uk/index.php?topic=14737.0 (http://forum.kitz.co.uk/index.php?topic=14737.0)

5) The Current Stats Date periods now extend back up to 180 days

6) Errored seconds now include an option to display the Average and
    accumulated Total  counts over each 24 hour period. This is only
    accurate if you are using 24/7 stats and helps with diagnosing if the
    DLM is likely to intervene on your line or not. Note that the last
    reading each day is shown as 23:00 but is actually the total from
    23:00-23:59 to give a 24 hour Total in all

7) The Pane Recent Resync list for All Users (at the bottom) now shows the most
     recent resync for 30 users rather then 10

Plus an assortment of bug fixes and so on
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 13, 2015, 10:37:33 PM
Nice work, looks like you have been busy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 19, 2015, 04:25:00 PM
Nice work, looks like you have been busy.

Thanks  ;)

And a few more things as well now....

DSLAM TYPE
The Cabinet DSLAM type is now potentially available for everyone and appears in the large page (only) All User Stats as a separate last column at the end. Overseas and ADSL users don't have the entry.

This facility needs a Bits Per Tone upload file as the source to work out which cab type it is - any new user will get it added within about 3 minutes of the first hourly zip file upload as long as that includes the BPT file so if you are missing it you need to upload at least one BPT file (enable this in the GUI for the upload prog). The Cab type should then appear in the listings with 3 or 4 minutes of the on-the-hour tone file(s) upload.

When available, the DSLAM maker also appears at the top of a pane in the Summary Stats just below the SNRM title inside square brackets for each user.

ALL USER STATS
Also updated are the All User Stats pages (both large and small versions) to make them more reliable when fetching data (some people have equipment clocks up to four minutes slow which does cause problems) and also to sort on more columns.  Also the INP and Delay columns were integers but as they both had DB values to two decimal places, they now display as such and are also now sortable. Example attached.

NB
The DSLAM type is dependent on your Modem returning accurate data. At least one UK BTW user has a sequence of tones (861-870, each with 8 bits) that aren't in the UK bandplans for either type!!

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 21, 2015, 06:00:46 PM
There is a maintenance window of between 08:00 - 09:00 on a Friday but only likely to take a minute or two normally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 21, 2015, 11:52:53 PM
(some people have equipment clocks up to four minutes slow which does cause problems)

Thats kind of odd as the PC should be using Internet Time (time.nist.gov) there should be no reason for this discrepancy, unless they forgot to tick the synchronize with an Internet time Server, must check my RPI time status while i'm here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 22, 2015, 06:39:02 AM
Windows 7 is terrible, I often need to update the time on one of my media PCs. I keep meaning to install net time (http://www.timesynctool.com) but haven't got around to it. I'll have to check my server and see how accurate that is.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 22, 2015, 09:14:17 AM
Windows 7 is terrible, I often need to update the time on one of my media PCs. I keep meaning to install net time (http://www.timesynctool.com) but haven't got around to it. I'll have to check my server and see how accurate that is.

I use NetTime here on all the machines (but without a master) using uk.pool.ntp.org which keeps everything on time. Windows is always losing the ntp connection when syncing - even with a 15 min resync interval set in the Registry it was often days since it had succeeded.

Bear in mind the default resync time on Windows is 7 days or so!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on January 22, 2015, 09:24:02 AM
Only just had chance to look at the updates. Looks great. Also the Mobile Template is really useful.

Cheers

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on January 22, 2015, 10:10:34 AM
thanks for the tip, installed net time.

windows time sync is indeed terrible.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 22, 2015, 05:37:01 PM
Bear in mind the default resync time on Windows is 7 days or so!

Then it sounds like there motherboards Bios battery clock is pitiful if it's 4 minutes slow after 7 days since the last time sync....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 23, 2015, 11:20:12 AM
G.INP

Just as an experiment to see if it's useful, I've changed the Large Window version of the All User Stats displays to show, by highlighting the two values (downstream only currently), anyone who has an FEC count > 0 and with Interleaving set to 1 that might indicate G.INP is running on the line.  There is one user at the moment with FEC counts in the 1000-2000 and no Interleaving. Two others pop up occasionally [attached]. Two are on Huawei and the other ECI FWIW.

Show Active Users Only
Also, if you prefer you can now select an option to display only users who are currently active - this gives a more compact display (Large Window version only)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on January 24, 2015, 12:24:47 AM
thanks tony, as seems is no g.inp indicator in the gui tool.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 03:26:07 PM
Hi all one seems to of forgotten his security question. Whom do i go to, to sort this? If site admin for Mydslwebstats could PM me i can verify its my account.

If its better to just delete the account and then me to resign up thats not a problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2015, 05:03:28 PM
Hi all one seems to of forgotten his security question. Whom do i go to, to sort this? If site admin for Mydslwebstats could PM me i can verify its my account.

If its better to just delete the account and then me to resign up thats not a problem.

Hi

I assume you mean your 'Memorable Phrase'? Request a password reset - although I see you have done that already as a mail was sent to you at 15:22... It is sent along with the reset.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 05:09:22 PM
Ya i have but it doesn't direct me to the reset page. Hence why i am asking.

When i click the link for password reset it just takes be to the homepage and not a password reset page.


Also yes its the Memorable Phrase question i forgot (So for me it wasn't quite so Memorable Phrase for me to remember as i have tonnes of them to remember!)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2015, 05:47:11 PM
When i click the link for password reset it just takes be to the homepage and not a password reset page.

Oops! Took a while to figure this out but sending you to the wrong place  :-[

Request a reset again and all should work now....

Apologies
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 06:39:13 PM
Cracking mate it works no need to say sorry.

Now i am unsure how to get the key for DSL stats. LOL it seems so different since the last time i used it. Also i can't tell if i have logged in or not either after typing the login info


Edit: I am after validation Key.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2015, 07:03:46 PM
I've sent you a PM...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 08:10:16 PM
Thanks for your help, Its streaming directly to site now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2015, 05:45:29 PM
Donations
Thanks to the following users for their donations to the project during January  :clap2: :

big360
johnbullas
morphium
Msurly
NStar
pooclah

NB: it helps if you state your user name in the donation message if you want acknowledgement else it might not be possible to find you if you use a different e-mail to that you registered with.

And a note to pagodawow that your e-mail account has expired and your Resync messages are bouncing....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 01, 2015, 07:06:24 PM
I do find MDWS is helping me see the changes I do on my internal broadband side for the better or worse it's the only way with 24/7 stats being logged to judge if was fruitful or not  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on February 04, 2015, 10:41:11 AM
My DSL Web Stats is now LIVE under my name adslmax. What happen if I switched off PC. Will My DSL Web Stats continue running itself in the background on Billion 8800NL router? As I don't want my PC on at all times.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 04, 2015, 01:50:28 PM
My DSL Web Stats is now LIVE under my name adslmax. What happen if I switched off PC. Will My DSL Web Stats continue running itself in the background on Billion 8800NL router? As I don't want my PC on at all times.

the site will be available but data is being uploaded from your PC, so when your PC is off no data will get uploaded.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 04, 2015, 05:54:39 PM
My DSL Web Stats is now LIVE under my name adslmax. What happen if I switched off PC. Will My DSL Web Stats continue running itself in the background on Billion 8800NL router? As I don't want my PC on at all times.

Get a cheap Rasberry PI it's uses very little power @ 0.86 - 1.2 watts and install DSLstats this is what I have done to get 24/7 stats being logged to MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on February 04, 2015, 08:47:14 PM
^^ Will do.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 04, 2015, 10:33:27 PM
Get a cheap Rasberry PI it's uses very little power @ 0.86 - 1.2 watts and install DSLstats this is what I have done to get 24/7 stats being logged to MDWS.

I'll recommend this option too, they're cheap to run and work very well  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on February 05, 2015, 12:29:50 AM
I just ordered this: http://cpc.farnell.com/jsp/bespoke/bespoke7.jsp?bespokepage=cpc/en_CC/makerspace/raspberrypi.html&CMP=NLem2

Raspberry Pi 2 model B
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 05, 2015, 07:42:23 AM
The V2 has a different processor to the V1 (ARM7 as opposed to ARM6). I think that the present RPi version of DSLstats will still work with it when using the Raspbian OS, but I can't be certain.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 15, 2015, 05:33:04 PM
Just looking at my 24 hours graphs and when I click on "Error Secs/Hour" the pop up graph is blank (as shown below).

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 21, 2015, 08:48:32 AM
Is the site down

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 21, 2015, 10:16:34 AM
It was, but it's back now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2015, 10:32:59 AM
Is the site down

Ian

Has been, yes, sorry. It came back up just at the point you posted....

Caused by modem failure it appears, now running a new one but it's locked so I have no stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 24, 2015, 04:38:24 PM
Since realising my time was wrong on the RPi :-X, i'm now showing as yellow in the all user stats, and apparently as being a Non-uk user?

I'm now uploading in the correct time though, but the website is still showing I'm not?

user: jidavies

Log also shows uploading the correct date and time?
Code: [Select]
24/02/2015 16:39 72076 19999 6.2 15.1
Also i'm showing as "jidavies (-1Hrs)" so guessing the site doesn't think my time is now fixed, or the upload still is the wrong time ???

Any advice would be greatly appreciated, I understand this is my own mess up thats caused it, I completely didn't notice the time was wrong on the Pi!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 24, 2015, 04:56:48 PM
Since realising my time was wrong on the RPi :-X , i'm now showing as yellow in the all user stats, and apparently as being a Non-uk user?

I'm now uploading in the correct time though, but the website is still showing I'm not?

user: jidavies


Hi

Looks like it's auto corrected itself now and you show as uploading/online currently  :) , the time offset is only checked periodically after it's first set....

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 24, 2015, 05:04:28 PM
Since realising my time was wrong on the RPi :-X , i'm now showing as yellow in the all user stats, and apparently as being a Non-uk user?

I'm now uploading in the correct time though, but the website is still showing I'm not?

user: jidavies


Hi

Looks like it's auto corrected itself now and you show as uploading/online currently  :) , the time offset is only checked periodically after it's first set....

Cheers

Thanks Tony!

I donated in December, I'll put in a bigger one next month, thanks for all the hard work, love the site knowing its there in the background, was invaluable when I had a BT OR engineer here a few weeks back!

Jamie
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 24, 2015, 08:14:49 PM
Thanks Tony!

I donated in December, I'll put in a bigger one next month, thanks for all the hard work, love the site knowing its there in the background, was invaluable when I had a BT OR engineer here a few weeks back!

Jamie

Thanks for the kind offer, very quiet this month with only one donation so far....  A lot of new Registrations though.

Nice to know that OR engineers also find MDWS useful, nothing like evidence in black and white (well colour but you know what I mean ). Shame that there's no support for the HH5 et al to get some upload data into MDWS.... Even the basic SNRM/Speed would be something.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 24, 2015, 10:49:49 PM
Nice to know that OR engineers also find MDWS useful,

Not all, the one I had just said i don't understand what your showing me  :o

and i'll sort you out this month, it's just Amazon took £79.00 out of my account it called Amazom Prime look at the small print and don't get caught out !
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 25, 2015, 12:25:44 AM

Thanks for the kind offer, very quiet this month with only one donation so far....  A lot of new Registrations though.

Nice to know that OR engineers also find MDWS useful, nothing like evidence in black and white (well colour but you know what I mean ). Shame that there's no support for the HH5 et al to get some upload data into MDWS.... Even the basic SNRM/Speed would be something.

Give me a week or two and I'll help out :)

The OR engineer was very impressed, straight away he saw what I was talking about, and was able to understand there was a problem!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 25, 2015, 08:44:43 AM
Outage

Due to some unplanned DB maintenance there were no modem record uploads collected between ~08:00 and ~08:30 this morning.

You should also find that graph updates have been running much more quickly for the past 24 hours (except around 07:45 this morning...)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 25, 2015, 08:17:39 PM
Outage

Due to some unplanned DB maintenance there were no modem record uploads collected between ~08:00 and ~08:30 this morning.

You should also find that graph updates have been running much more quickly for the past 24 hours (except around 07:45 this morning...)

Thanks Tony.

Is it me or is the site slower loading recently?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 25, 2015, 08:19:22 PM
Hi Tony

I'm finding that the site is loading slowly today also, more so since around 5pm.

All the rest is great.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 26, 2015, 07:56:19 AM
Hi Tony
I'm finding that the site is loading slowly today also, more so since around 5pm.
All the rest is great.

Tony

Just had a chance to look at the logs for you - the server keeps custom logs for every access that users make with times to 1ms for debugging this sort of thing, from the time the page or graph starts initial load through to when the load has finished. I can only see one access for you at 17:22:49 when the main Container page initially loaded with two graphs up, 24Hr SNRM and ES.  Main page was 4 secs to load which is about normal and both graphs then loaded each in about 1 second which is good  (inc processing at your end).

However, I can see from other logs that you tried several more times to load the main page around then,  presumably with no response? Why I don't know, there are no indications of problems at that time.

Later on in the day maybe. My line (the server runs here) is ****** at the moment if you have a look at the SNRM. Some really bad evening noise started up a couple of days ago that  is taking the SNRM down to near 0 at times and my latency has gone from 8ms to 26 ms or so after DLM poked it's nose in. However, the data is served back to you via what is the U/S here and that isn't particularly affected (its on fast path anyway) and there isn't a lot of data to send.

I have remote access to a terminal some 100 miles away and will keep an eye on performance on that later.

The same applies to jid, nothing obvious. Having said that there are times when a page load seems to take forever and I've never found out why.

Problem is that all this takes time to work through, occasionally I feel like throwing the sever out the window  :-X , and it is after all a 'spare time' project that, at times, takes over my life.....  :'(   Fixes don't always work either as expected although yesterday morning's database change seems to have permanently boosted response time as far as delivering the data back to the user goes for the majority.

I am about to restart the server for a software upgrade  in case anyone notices a blip shortly.

Edit: 10 min outage when software 'upgrade' had to be removed  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 26, 2015, 08:31:25 AM
Tony

Thanks for the info. Loaded up fine just now, so as you say perhaps a IT blip that we never know why :-\

Best

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 26, 2015, 10:06:33 AM
Tony
Thanks for the info. Loaded up fine just now, so as you say perhaps a IT blip that we never know why :-\
Best
Tony

Okay but maybe not. I may have spotted a problem that is causing the delay as I found several of 10 secs or more in logs so I've removed the offending bits of code (just some logging that is failing to output anything - timeout?) and see what happens.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 26, 2015, 10:10:40 AM
Thanks for the update ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 26, 2015, 10:43:59 AM
Tony
Thanks for the info. Loaded up fine just now, so as you say perhaps a IT blip that we never know why :-\
Best
Tony

Okay but maybe not. I may have spotted a problem that is causing the delay as I found several of 10 secs or more in logs so I've removed the offending bits of code (just some logging that is failing to output anything - timeout?) and see what happens.

Seems faster today Tony :)

Didn't realise you ran the server from home, in which case the odd bit of a slow down at peak time is to be expected :)

Jamie
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: big360 on February 27, 2015, 08:42:55 AM
Hi , I've been having issues the last few days with the MDWS site becoming inaccessible from my broadband connection. It still works fine from my phone. I'm wondering if its the "Port Scan and DoS Protection" setting on my router. (Netgear DGND3700v2). Strange that its only just recently started happening
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 11:52:22 AM
At 07:55 this morning the Internet connection (but not sync to the cab) went down for best part of 30 mins -  others users in the road nearby were also affected. As a result about 25 people lost their upload connection to MDWS and have not resumed uploading so you might want to check that you are if you were  ??? I've seen my client crash in the past when there has been a long outage.

Also I am completely unable to do anything with the server here as I have lost any connection to Google, can't even search using it.  Home page on MDWS is fine as is the Big User Stats page as they have no need of Google but all other pages do  - all's I see is 'connecting to Google. and ' waiting for  Google...' and very long timeouts.

Of two remote terminals I have access to, one is functioning normally but the other has the Google problem.

Anyone else have this problem with Google, maybe DNS? I may restart the modem later if no one has but that will mean  downtime again. Shame as the server ran very well for the 24 hours previous after some tweaks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 27, 2015, 12:05:19 PM
Hi tbailey2

No issues with google

It's just a thought, which I'm sure you have tried, but have you flushed your dns cache

I'm thinking it may be pulling stale cache

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 27, 2015, 12:43:12 PM
Like the above, I have no issues with Google, but I can't contact MDWS at present. Maybe John's suggestion of a stale DNS cache is a good one.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 12:46:49 PM
MDWS down here also.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 27, 2015, 01:07:40 PM
+1 still down
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 27, 2015, 01:23:35 PM
Hi

I'm sorry, I do not use the software but if the following picture is the website down, I can see it.

I hope that helps a little but sorry if I'm wrong.

Many thanks

John(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Ftapatalk.imageshack.com%2Fv2%2F15%2F02%2F27%2Fb59a01a4575d5764e9d7f3172a580d3e.jpg&hash=70f94c6afc14b2222f8f2dc77820d718)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 01:30:14 PM
Thanks for replies and also at least someone can see it!! Yes that's my own (currently) grotty line you can see!

Um. I've flushed the cache on 3 terminals but no effect. Yahoo is okay. Still 'waiting for Google'. Roseway can't ping it but gets the IP from the host name okay. I can ping it from 200 miles away via rconsole okay and fully functional.

There are some people in on the web site:

big360 Corinthian craigv g3wpo GateKeeper Guest jizzerman qslam1

and these are uploading okay:

AnnM ardsar axelfoley* bart613 bigg broadstair bsdnazz Chrisszzyy craigv digginsa discom Eaglebeak Fuggi garypower GodolphinX Jasonkruys jidavies JustAnothe les-70 Liam mattb maybecrazy morphium* mrspock nb99999 NStar oliver602 pagodawow perry1964 pianist pooclah qslam1 shadow4dog splbound Starman tbailey2 TimeBandit Tyke vic0239  (39)   

But there should be around 65 of them...

Uploading doesn't need Google.

I think I'll stop modem with a 5 min pause after at 13:35. Line is bad anyway at the moment. This is a new HG612 after the other one failed some days back but has been okay up until this morning. I do have another boxed one I can unlock if that might be the problem....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 01:46:47 PM
Now I have a flooded kitchen from washing machine to sort out..  >:D

Seems to be working here now at last so hopefully elsewhere? Also restarted router.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 01:50:22 PM
back up here, good job.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on February 27, 2015, 01:57:51 PM
I am confused, tony you now hosting this at home?

Also I did wonder why google is needed for some parts of the site. your FTTC line looks a mess wow.  It makes newt's swings seem insignificant in comparison.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on February 27, 2015, 02:04:36 PM
Yes he's hosting at home.

Both mine were down from 07:55 to 13:43, both have come back up with no intervention from me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 27, 2015, 02:11:23 PM
Similar. No uploading between 0800 and 1330 approx. Wasn't able to access site either. Seems fine now. Not had any Google issues here.

Always a routing issue possibility at the ISP. Quite often if its just on one switch not enough users get affected for the ISP to say anything !

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 02:20:00 PM
Thanks for the comments to all.

I am confused, tony you now hosting this at home?

Also I did wonder why google is needed for some parts of the site. your FTTC line looks a mess wow.  It makes newt's swings seem insignificant in comparison.

Google Charts are how the graphs are produced and you have to have a live connection for their Javascript, not allowed to use local copy.

Yes, it's been hosted here since Dec 8th with no real problems. If you recollect very few people (except for some kind souls who kept the paid hosting going for a while)  were willing to donate enough for 'proper' hosting and the offer of free hosting never materialised despite a lot of reminders so I moved it here on to a spare machine I have. It will stay here now.

The line has been pretty well stable for over a year except for crosstalk halving everything until three days ago when that lot of interference appeared. I can't hear it via a receiver (if it's REIN) on any of the frequencies locally but from the rise and ebb it almost looks like a radio station. Doesn't seem to affect service back out which is U/S from here. I'll investigate further when I get a chance.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 02:46:55 PM
I have a big server I could host it on if you like. Assuming it will run on linux/nginx/mysql. I have php but if it uses some other language I might be able to accommodate that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on February 27, 2015, 03:41:35 PM
yeah I can offer also but it be apache/php/mysql.

Although I do have a windows box in a datacenter sitting idle if its windows based.

donated hosting is more effective than cash, as then you got no bill to worry about.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on February 27, 2015, 03:45:21 PM
Yes he's hosting at home.

Both mine were down from 07:55 to 13:43, both have come back up with no intervention from me.

Mine was the same, plus just 1 timeout at 14:03 since then

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 05:15:51 PM
Amongst all the goings on, it appears that the main database table has now crashed and auto repair has failed. I've manually started a repair but this may well take a long, long  time. Not accepting any uploads currently for this reason as that's where they go.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 27, 2015, 05:17:22 PM
Feel for TB2 seems to be having a lot of issues over the last 24hrs. Now the Database. Im sure we all appreciate the time its taking. No rush here

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 05:39:05 PM
Feel for TB2 seems to be having a lot of issues over the last 24hrs. Now the Database. Im sure we all appreciate the time its taking. No rush here

Tony

Did I mention my 30" monitor failed yesterday after 5 years of faithful service? The new one arrived a few hours ago  :'(

Site back up and running. I changed my mind and restored a very recent backup...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 05:42:57 PM
Did I mention my 30" monitor failed yesterday after 5 years of faithful service? The new one arrived a few hours ago  :'(

really now, you don't need a 30" monitor for dslstats, I run it on a 10" :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 27, 2015, 07:22:41 PM
I am confused, tony you now hosting this at home?

Also I did wonder why google is needed for some parts of the site. your FTTC line looks a mess wow.  It makes newt's swings seem insignificant in comparison.

He has some radio china international in the tones of 1700 and radio romania international on tones 1400 on the D2 band but they are not the overall cause of the low SNRM dips.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on February 28, 2015, 02:00:45 AM
Quote
If you recollect very few people (except for some kind souls who kept the paid hosting going for a while)  were willing to donate enough for 'proper' hosting

Whilst I sympathise, I think you may just have to accept that donations alone are unlikely to be able to maintain the cost of a dedicated UK server.  I do know how much they cost and you will recall that I confirmed the figures in a previous post because I know this sites requirements. Donations from dsl based sites isnt profitable - again I can confirm this.  I keep a record of each and every person that has donated for the full 12 years this site has been running (here (http://www.kitz.co.uk/sites/support.htm)). There's been many a year when Ive funded out of my own pocket and one year I even had to borrow money from a friend to keep it going and another personal friend of mine donates to my hosting costs each year rather than buying me a birthday pressie.


For one database with 65 users then you are likely to be able to get away with low level cloud based hosting to cut costs.  If push came to shove, then this forum alone would cope with cloud based hosting.  The DB is pretty large as its been running a years.  However, my problem is the main site whilst also contains some large DB's for things such as the adslchecker, my hits run into millions per week and tens of thousand of individual visitors, yet you can quite clearly see that donations never, ever cover my hosting costs.   I just have to look at the site as an unpaid hobby for which I spend many hours per week (theres a lot of b/g stuff that you guys never get to see)...  and unfortunately I cannot get away with cheap hosting.. and its also too big for me to run on my own without some help from my hosts (security and config issues) which is why I need decent UK support too. 

I'm not alone here,   BE dedicates his own time to produce hg612 modem_stats for nothing, same with Ronski for the GUI.   Eric dedicates a lot of time to maintaining dlsstats and has to also pay for his hosting, for which he too gets nothing. John doesnt make any profit from routerstats.     

You could try some other methods, I tried Amazon shop, but tbh that is a waste of time, because of the floor limit for min payment. I think Ive been using it for 8yrs and it was only 2 months ago I got my first ever payment when someone purchased some download videos.   You use google already so try google ads,  again this isnt always successful, I keep my ads as small as possible with none of the big banners which are supposed to bring more income, but a warning there.  I find that because a lot of the frequent visitors to sites such as this are tech savy so tend to use ad blockers, so perhaps you could appeal to users to white list your site? It may bring in a couple of quid per month?   Perhaps get a host to sponsor you?

I'm not trying to be pessimistic, Im just trying to state facts as they are and you're going to be very lucky if you think you can make any sort of profit from it.  Like I say, Ive been running this site for 12/13yrs and have never personally made a single penny from it, everything gets ploughed back in.  Its often a full time unpaid job, that costs me to run :D 


---
btw I want to stress that this isnt a hint at the regs to make donations for this site.   I see the forums as a community and I greatly value the input of the regs with their time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 28, 2015, 08:37:23 AM
Thanks for various PMs, private mails and posts here with comments on the hosting.

But as I said in the original post yesterday, I'm happy to have the server running here until whenever - so am not looking for alternative hosting, paid, free or otherwise as donations could never cover the cost, a fact I learned many years ago in the '90s and there are not enough users here anyway (200 registered currently) - but again thanks for several offers. DNS is NOT on this server here BTW.

Like the others involved in MDWS, I too have never looked to cover the time spent on developing this project as that would be a total impossibility anyway.

But it's great to have some ongoing donations to show appreciations and cover a few outgoings if possible thanks. It also gives one a warm feeling when they arrive and helps to counteract days like yesterday and plough on  :)
It also appears that yesterday's problem to do with Google etc was quite possibly a PlusNet fault  >:D   Again thanks to those who mailed me to mention that.

I already have paid shared hosting available and run nine web sites currently. MDWS was developed on that shared hosting but they refused use of the production version due to the continual uploads and unpredictable future traffic, plus it was shared with ~1700 other sites.

Thanks again to everyone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 28, 2015, 06:47:16 PM
errrm......Tony.........Is the website running very slow after the restore.

A 10 day error second plot is taking >12 seconds.

No big problem  ;)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 12:32:19 PM
errrm......Tony.........Is the website running very slow after the restore.

A 10 day error second plot is taking >12 seconds.

No big problem  ;)

Ian

Thanks, hadn't spotted that.

Um. Well it shouldn't!   Fixed and it's about 100 times faster now....  ;)

Note that the 24 hour and less ES graphs look different to the 48 hour and greater as the latter do NOT include the current day on the right. The longer periods have a dedicated summary table for speed of access and that is updated at 00:30 each day for the previous day. Also, the last two days were missing and that's fixed as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 01, 2015, 12:35:28 PM
Very fast today Tony was browsing earlier and its much quicker!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on March 01, 2015, 12:50:18 PM
  It does not matter much but I think it may be more helpful to allow the current day to appear in less than 5 day periods.  I like to look at the current day in relation to the last few days.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 12:56:43 PM
  It does not matter much but I think it may be more helpful to allow the current day to appear in less than 5 day periods.  I like to look at the current day in relation to the last few days.

It will then run very slow again....

Try running two panes one with the last day/few days and one with more?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 01, 2015, 01:02:06 PM
Thanks Tony, as you say much faster now. I had to come back and re-read your post as I was about to mention the lack of current day in my preferred 10 day plot.

As les mentions i also like to keep an eye on the live trend in real time with a manual refresh only, but if you think it slows the server too much then OK.

Thanks again
Ian

EDIT: you have replied whilst I was composing this....the server would run slow  :( I will try modifying my panes  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 01:11:32 PM
Thanks Tony, as you say much faster now. I had to come back and re-read your post as I was about to mention the lack of current day in my preferred 10 day plot.

I might be able to do something about it by adding on the current day's data to the end of the quick fetch data.... Have to wait a little while though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 03:48:57 PM
Okay, all date spans are now displaying ES along with running totals for current day as well  :)

Bear in mind that horizontal compression on the graphs may lose the last hour plot or so on wider spans.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on March 01, 2015, 04:03:04 PM
  Many thanks for the quick work.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 01, 2015, 05:57:30 PM
Quote
Many thanks for the quick work.
+1
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 02, 2015, 09:36:25 PM
Back again Tony...something strange with the multi-day error second graphs...March 1 st seems to be missing (are you anti Welsh)  ;) ;)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 02, 2015, 10:33:27 PM
Back again Tony...something strange with the multi-day error second graphs...March 1 st seems to be missing (are you anti Welsh)  ;) ;)
Ian

Seems the process that generates the entries timed out and only completed about 10 users rather than 70 or so. I've rerun it and the others are there now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 02, 2015, 10:46:50 PM
well at least your DS SNRm is getting better your not getting below 1dB though 4.5dB says to me that your line has had more crosstalk an you may need to let go of some sync to balance your SNRm it's up to you  :(

If you do decide then 20:00 is the best time to resync and also remember to take 30mins modem off into consideration so modem off at 19:30 and modem on at 20:00.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 02, 2015, 11:38:43 PM
well at least your DS SNRm is getting better your not getting below 1dB though 4.5dB says to me that your line has had more crosstalk an you may need to let go of some sync to balance your SNRm it's up to you  :(

If you do decide then 20:00 is the best time to resync and also remember to take 30mins modem off into consideration so modem off at 19:30 and modem on at 20:00.

If you are referring to my line, thanks for the ideas but it's better this evening because I rerouted some wiring earlier today that I added about five days ago and that seems to be picking up the rubbish - an experiment on Saturday also gave an improvement. I still need to do some more work on that.

There was a local power outage in the village at 16:04 for a couple of minutes that raised the SNRM briefly. I'm not worried about trying to possibly 'improve' it by forcing resyncs etc at the moment, or taking the server offline for 30 mins though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 05, 2015, 08:57:46 PM
Upgrade

If all goes as planned, there will be a number of software updates tomorrow morning (Friday 6th Mar) starting just after 08:00 that will put the server offline for up to an hour so it won't be accepting any uploads or delivering web pages.

Hopefully it will be back much more quickly though  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 06, 2015, 08:44:12 AM
All should be well now, back up at 08:21  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 06, 2015, 09:47:04 AM
It's all working fine here. Well done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 06, 2015, 10:01:41 AM
It's all working fine here. Well done.

Thanks! One of the changes was to attempt to get all the database tables into some added memory to speed it all up and that seems to have almost worked, might need to allocate a bit more, certainly disk usage has dropped dramatically and I see faster user access times in the logs.

Also put on a new HG612 and flashed the 08 firmware we talked about, plus a bit of rewiring to leave the modem and lead to master socket (10 inches) away from any PSU cables. Also turned off QOS.

I see my Attainable is back up to 42 again and Sync 2.7 better but still interleaved  so will see what happens...

Also Gateway is now pcl-bng02, it was ptn-ag03.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 06, 2015, 12:03:02 PM
Load times do seem much quicker Tony, nice work!

Hopefully the unlocked hg612 will improve things for you too :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 08, 2015, 04:41:19 PM
Another G.INP line  :thumbs:

Just to say that there is now another G.INP enabled line (garypower1). Each new addition and the admins get an automatic mail once this is detected.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 08, 2015, 09:09:20 PM
Another G.INP line  :thumbs:

Just to say that there is now another G.INP enabled line (garypower1). Each new addition and the admins get an automatic mail once this is detected.

I it's strange it only happening to recently signed up members to MDWS what i would like to see is a regular member like Baldeagle1 moved to G.INP and compare the difference as he has the before and after stuff we need.

For example to see changes in errored seconds and crc's fec's the list go's on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 09, 2015, 10:19:19 AM
I it's strange it only happening to recently signed up members to MDWS what i would like to see is a regular member like Baldeagle1 moved to G.INP and compare the difference as he has the before and after stuff we need.

For example to see changes in errored seconds and crc's fec's the list go's on.

Well that's easy to solve as he has records available back to September 2014..   ;)

Trouble is he registered a new but similar username on the day G.INP was detected so has lost access to all the old records in the Current View (which needs uploads in past day or so for a user to be visible) as they don't exist under the new username.

To solve that, open a new pane and use the Range option - this lists all users who have ever uploaded anything since we went live so you'll see him next to his current username. The select a day or range to match a Current pane view for him etc etc etc...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 09, 2015, 05:52:41 PM
Its ok TB can now see the previous username as garypower and they have gone back to using that username thats good  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: garypower on March 09, 2015, 10:49:08 PM
Hi, guilty as charged sorry!

I noticed that I had stopped sending stats a few days ago - upgraded to the latest version as I had not done that for a while and the settings for the upload validation key had gone.
I poked about on the site for quite a while but could not find a way to retrieve it anywhere unless I am missing somewhere so set up another account to get some logging going.

Some more digging today and I found I had filed away the original mail from last year so back to the first account!

The increase in upload is noticeable since g.inp went on - regained me a couple of mbits of usable throughput

Gary
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on March 10, 2015, 07:42:52 AM
As you are one of the very few users on G.INP enabled connections (that we are aware of) I'd very much like to see a zipped copy of your ongoing modem_stats.log, including the periods before & after G.INP was enabled.

(PM also sent).


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 10:17:48 AM
Donations

Thanks to those who donated to MDWS over the past 6 weeks:

jizzerman
NStar
oliver602
vic0239
 :clap2:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 10:41:18 AM
MDWS Updates

A few changes to the 24Hr (00:00 - 23:59 for selected date) set of graphs.

1) The small CRC graph now shows Upstream as well
2) Errored Seconds popup works on all browsers I have here (but View Image/Save still won't work with FireFox/Waterfox)
3) For the Current Day only all eight graphs now autoupdate every 5 minutes - last update time is now shown after the date at the top for today only as you may not see it happen

A problem with the Available Dates in the dropdown lists everywhere not showing past 4th March has also been fixed (thanks to Chrysalis for noticing this)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 14, 2015, 12:36:50 PM
Tony
There is probably a bug in the FEC graph. The upstream data is not displayed. It seems to affect all users.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 01:14:47 PM
Tony
There is probably a bug in the FEC graph. The upstream data is not displayed. It seems to affect all users.

No it's not a bug. There is no data for Upstream FEC Delta supplied to the database tables by the upload progs that matches the downstream entry ....

It's possible that it might be available via another parameter but I don't know what it is if so....

Having had a look, there is a non-delta us_cb1_FEC value but if that is usable, I really need delta values to avoid having to calculate them on the server every time...

There are unused data columns that could be pressed into service if BE1 and roseway could agree to use one for us_FEC_ERRORS_delta?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 14, 2015, 01:53:45 PM
You could possibly use field 47 (us_RSCorr_delta). In general RSCorr equates with FEC, although I believe the former doesn't get zeroed on a modem resync (but that doesn't matter with delta values).

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Korben_dallas on March 14, 2015, 02:05:12 PM
Hi,

I tried to logon  but I got a message advising of incorrect memorable phrase,  I did attempt to rest my password but whils ti got an email with a link when I clicked on this the web page advised 'Password reset has failed - please go back and try again...."; '

Am really keen to have a look at the graphs and since after some issues with BT on my phone line which resulted in a loss of the phone and FTTC for a couple of days, BTOR resolved the matter on Thursday morning, which after this the speed has actually improved that and it now appears the G.INP has been activated.

I like to see if the latest change in sync speed is a result of G.INP or the fact that when BTOR resolved the lone issues they improved the quality of the connection.

Any ideas on how I can reset the password and or memorable phrase.

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on March 14, 2015, 02:05:38 PM
Indeed, field 47 is the one to use for us_RSCorr_delta values

Field 26 can be used for ds_RSCorr_delta values

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 02:26:58 PM
Hi,

I tried to logon  but I got a message advising of incorrect memorable phrase,  I did attempt to rest my password but whils ti got an email with a link when I clicked on this the web page advised 'Password reset has failed - please go back and try again...."; '

Any ideas on how I can reset the password and or memorable phrase.

Cheers

Hi

Please try again.... G.INP is activated for you but you are NOT uploading currently and haven't been since 03:32 this morning. You should have had an e-mail saying G.INP had been activated from MDWS at the time it was detected (02:21) Your D/S sync increased by ~15Mb...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 02:41:21 PM
Indeed, field 47 is the one to use for us_RSCorr_delta values

Thanks to both - we now have the plots!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Korben_dallas on March 14, 2015, 06:26:02 PM
Hi,

I tried to reset my password which was successful and I did get a new password however it seems I have an issue with the Memorable Phrase, is there any way to reset this?

Concerning the last upload, my old friend Norton decided to once again quarantine HG612_run.exe and the gui.exe despite me telling it previously to ignore it.

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 14, 2015, 06:51:46 PM

Thanks to both - we now have the plots!

Thank you.
Unfortunately there is no plot for users uploading with DSLStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 06:58:13 PM
Hi,

I tried to reset my password which was successful and I did get a new password however it seems I have an issue with the Memorable Phrase, is there any way to reset this?

I just logged on as you okay using the Memorable Phrase you have set and the current password so not sure what the problem is? You should have seen the phrase when you reset the password if you couldn't remember it....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Korben_dallas on March 14, 2015, 07:40:06 PM
Hi,

Thanks again for your help,  I tried IE 11 and it worked without an issue.  It appears that using Firefox was causing the issue not sure why.

Cheers

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 15, 2015, 10:48:00 AM

Thanks to both - we now have the plots!

Thank you.
Unfortunately there is no plot for users uploading with DSLStats.
I've had a look and can't see any real problem here - there are users on DSLstats with Upload FEC's visible (try 24Hr roseway) and assuming that is your problem as you didn't say.

Can you let us know what modem you are using please as that may be the cause if it's your own stats that are not showing u/s FEC/CRCs....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 15, 2015, 06:49:18 PM
In DSLStats up/down FEC and CRC are displayed. MyDSLWebStats shows the same but without upstream FEC.
My modem is a BCM6368 with version A2pv6C030h.d22k.
There are some differences in the reported data from the modem depending on the firmware version. Maybe this causes DSLStats not to report this parameter correctly.

I attached a copy of the info --stats output if roseway wants to test if DSLStats is able to calculate the upstream FEC correctly.

Thanks for your help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 15, 2015, 07:03:34 PM
I can confirm that your stats data is in the format which DSLstats expects, so there shouldn't be a problem. But I think there may be a small bug in the latest version, which results in the RSCorr data required by MDWS not being uploaded correctly. I'll check this out and let you know.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 16, 2015, 11:18:02 PM
I've now fixed this on my test version, and MDWS displays my FECs correctly (as from about 19:30 today). I'll make the fixed version available shortly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 22, 2015, 06:48:20 PM
Tony

Is the last hour worth of error seconds/day recorded?

(I would expect the line to be vertical on the total plot)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 22, 2015, 07:36:53 PM
Tony

Is the last hour worth of error seconds/day recorded?

(I would expect the line to be vertical on the total plot)

Ian

Yes, that's been asked before. Although it says 23:00 at the top of the plot, it's really the total for 23:00 - 23:59 after adding on the previous hourly totals. Same applies to all the other points on the hourly plot. So the one after that at the bottom is 00:00-00:59.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 22, 2015, 08:14:42 PM
Quote
So the one after that at the bottom is 00:00-00:59.

Thanks, I always thought that looked as if it was zero.

Thangs again for your quick support.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2015, 01:01:52 PM
Downtime for MyDSLWebStats

A note that the server will be down for 5-15 mins this afternoon around 15:30 for a hardware/cabling change and a few other updates. So no web pages served or uploads possible.

You don't need to do anything but DSLStats users may or may not find that the uploads have been stopped automatically by DSLstats depending on how long it's down for so might need re-enabling in the MDWS config section. 

I'll post here when it's back up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 26, 2015, 04:23:38 PM
@roseway
During the downtime DSLStats was running but the GUI freezed, only a grey surface was visible. It has not crashed or displayed an error and as soon as MDWS was back online it keeps sampling/uploading as before. It's not the first time I notice this behaviour during a downtime of MDWS.
I'm running v5.4.3 on rpi.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 26, 2015, 04:36:21 PM
Yes, that's quite right. DSLstats hangs while trying to contact MDWS. I need to add a timeout, but personal circumstances are limiting my time at present.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2015, 04:53:36 PM
Well, that didn't go as planned due to a Windows update failure. Then, the (not changed) router seems to have some sort of problem and either fails to connect at all or restarts itself every so often.

What is more of a problem though is that my U/S sync is 5347 but actual U/S speed via TBB, usually ok, is consistently a whopping ... 450k  :-X ???   

Edit: seems the newer TBB speedtester is consistently completely wrong! The Flash one gives the expected result of ~5000kbs as does FTP and also a large HTTP file upload.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 26, 2015, 11:32:40 PM
No worrys tony it's up and running that's the main thing and we have are RPI's and PC's gathering the stats to fallback on if there is a small gap  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 29, 2015, 08:46:32 AM
Trouble this morning Tony??

Not recorded from 9:42PM last night.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on March 29, 2015, 09:24:03 AM
I can't seem to access the site either myself.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on March 29, 2015, 10:31:09 AM
same here
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 12:44:43 PM
Okay it's back up after a lot of grief including 3.5 hours lost connection.

PLEASE CHECK YOUR CLOCKS ON YOUR UPLOAD DEVICE!!  :-X
THEY NEED TO BE ACCURATE (+/- 1 min) AND ON BST CURRENTLY


A fair number of  people don't have updated clocks from this morning's change and are still running GMT, not BST. Convention is to upload in LOCAL time please as the majority of users are (your stats log has the local date/time embedded in it) .  This doesn't affect the graphs as such although it will show your latest upload as an hour ago but does make several other checks malfunction.

ADDENDA
The answer to the problems here appears to be that you need to restart your DSLstats prog if you are in the list below and thus pick up the time zone change.

I've had to turn off the TimeZone detection because of this and also repair a crashed database  (not related) .

The ones I can see still on GMT at a quick check are (this may not be all) - [Edit] I've removed those that are fixed so far:

bart613
bigg
davesals39
JustAnothe [added]
les-70
longstaff
mhisani
oliver602
splbound
thepfy
toulouse
xreyuk
zk583


Everyone else is on BST as they should be. I currently can't tell if anyone above is outside the UK though.
The graphs of those above will show the latest uploads as an hour ago until corrected, after which there will be an hour's gap before the correction.

First outage was at 07:42 but had been running up until then. Back at 08:22 after database repair but then I lost my Internet connection for the best part of three and a half hours  >:D

No idea why. Everything was synched according to the status LEDs and made a few restarts but no effect. Suddenly came back with no help at 11:52. Maybe I ought to have wandered up to the cab....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2015, 01:15:14 PM
The clock on the PC & RPi says 13:14 the atomic clock says 13:14 so it's find here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lloyd on March 29, 2015, 01:19:21 PM
Clock on my server is correct. Have restarted dslstats to see if that makes a difference.
Lloyd (pianist)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 01:37:06 PM
The clock on the PC say 13:14 the atomic clock says 13:14 so it's find here.

Maybe but the date/time embedded in your modem log file is an hour slow currently.... I don't know why but will have a look later (I need a rest) and see what might be causing that at your end .... 

Um ..... A quick look say everyone in the list is using DSLstats, either the RPi or the Linux 32/64-bit versions (No Windows version and that's what I'm using and am ok)...

I am pretty sure it's not this end as everyone would be affected as you are all imported in exactly the same way.

Have a look in

C:\Users\xxxxx\AppData\Local\dslstats\ (or wherever it is - check the start of the Event Log tab for location)

and see what your current xxxxx_live_modem_stats.log says about the date/time please...

29/03/2015 13:35 34616 5527 6.0 6.1 .......
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 01:59:43 PM
Clock on my server is correct. Have restarted dslstats to see if that makes a difference.
Lloyd (pianist)

That's fixed it for you  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 29, 2015, 03:14:28 PM
Restarted DSL Stats on the Pi, seems to have sorted it Tony?

Quote
pi@dslstats ~ $ date
Sun Mar 29 15:16:58 BST 2015
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on March 29, 2015, 03:15:47 PM
Sorry about that, my PI was running on UTC.  :-[  Have now set the correct locale:

Current default time zone: 'Europe/London'
Local time is now:      Sun Mar 29 15:04:16 BST 2015.
Universal Time is now:  Sun Mar 29 14:04:16 UTC 2015.

BTW I'm seeing this message on the MDWS monitor page:

User vic0239 - your e-email server refuses our mails - please whitelist us!

Yet I have received emails in the past, the last being on 24th March?  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 03:22:16 PM
Restarted DSL Stats on the Pi, seems to have sorted it Tony?

Quote
pi@dslstats ~ $ date
Sun Mar 29 15:16:58 BST 2015

Yes,  thanks  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 29, 2015, 03:23:46 PM
Restarted DSL Stats on the Pi, seems to have sorted it Tony?

Quote
pi@dslstats ~ $ date
Sun Mar 29 15:16:58 BST 2015

Yes,  thanks  :D
Seems DSL Stats needs to be closed and opened again on the Pi for the update to take affect Tony

Thanks again!

Sent from my Nexus 6 using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 03:26:33 PM
Sorry about that, my PI was running on UTC.  :-[  Have now set the correct locale:

Current default time zone: 'Europe/London'
Local time is now:      Sun Mar 29 15:04:16 BST 2015.
Universal Time is now:  Sun Mar 29 14:04:16 UTC 2015.

BTW I'm seeing this message on the MDWS monitor page:

User vic0239 - your e-email server refuses our mails - please whitelist us!

Yet I have received emails in the past, the last being on 24th March?  ???

Okay now on time.  Answer seems to be to restart DSLstats.....

Re mail:

Date: Wed, 18 Mar 2015 10:21:58 +0100
Subject: MyDSLWebStats RESYNC Alert for vic0239!

SMTP error from remote server in greeting:
host: mx.bt.lon5.cpcloud.co.uk:
rgin02.bt.ext.cpcloud.co.uk Service not available - access denied

another on 22nd as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2015, 03:30:38 PM
Rebooted RPi and my MDWS account seem to be on BST yet the RPi was showing the correct time it must be one of those RPi thangs  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ip75 on March 29, 2015, 03:38:38 PM
Thanks. For anyone using a Raspberry Pi who doesn't know this, you might need to run:

$dpkg-reconfigure tzdata

and then reselect your timezone to pick up BST. Then restart DSLStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 03:41:43 PM
BTW I'm seeing this message on the MDWS monitor page:
User vic0239 - your e-email server refuses our mails - please whitelist us!

This is a new User messaging system I came up with - only the addressed user sees the message. Difficult to contact anyone if there is a problem with e-mail. One guy has been banned from uploading for several months as there's no data being sent. His e-mail doesn't exist any more and he never logs in though....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on March 29, 2015, 04:08:45 PM
SMTP error from remote server in greeting:
host: mx.bt.lon5.cpcloud.co.uk:
rgin02.bt.ext.cpcloud.co.uk Service not available - access denied

Looks like there may be an issue with BT/Yahoo mail servers. I have an alternate email address, but can't see where to change  it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 10:43:30 PM
MDWS BST Clock settings (from earlier post this morning)

As best I can tell, these users still need to reload their copy of DSLstats to get the correct upload time:

JustAnothe
les-70
oliver602
thepfy
toulouse

TIA
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: splbound on March 31, 2015, 02:49:49 PM
I have just restarted my virtual server and DslStats.
Running it on a Lubuntu instance and double checked my date time timezone is correct.

I hope this has sorted it out.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Fuggi on March 31, 2015, 03:35:39 PM
Tony
       Responding to your email of multiple upload log files, Rpi version of Dslstats is the only program running.
       Nothing else has changed since restarting Pi and Dslstats on 29th March. Program stopped, will restart
       after ashort break.

Fuggi
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 31, 2015, 04:07:11 PM
I have just restarted my virtual server and DslStats.
Running it on a Lubuntu instance and double checked my date time timezone is correct.

I hope this has sorted it out.

Yup! Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 31, 2015, 04:12:40 PM
Tony
       Responding to your email of multiple upload log files, Rpi version of Dslstats is the only program running.
       Nothing else has changed since restarting Pi and Dslstats on 29th March. Program stopped, will restart
       after ashort break.

Fuggi
Nothing to worry about - you appear to have had only two today rather than 1000s as in one instance. They are automatic and won't get sent unless there are three consecutive ones , then you see the third and every minute thereafter as they occur. Reset back as soon as there is not one for a minute. Most people have one every so often for all sorts of reasons, usually a stuck process that ends in the next minute. Unusual with DSLstats though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: boost on April 01, 2015, 09:12:14 PM
Just noticed that MDWS reports a +power figure for my upstream but it appears to be a -power figure?


Reported as positive here:

Code: [Select]
DSLAM/MSAN type:        BDCM:0xa44f / v0xa44f
Modem/router firmware:  AnnexA version - A2pv6C038m.d24j
DSL mode:                VDSL2 Profile 17a
Status:                  Showtime
Uptime:                  1 day 2 hours 14 min 53 sec
Resyncs:                0 (since 01 Apr 2015 19:56:55)

Downstream Upstream
Line attenuation (dB):  5.4 0.0
Signal attenuation (dB): Not available on VDSL2
Connection speed (kbps): 79987 19999
SNR margin (dB):        18.3 23.2
Power (dBm):            13.5 13.4
Interleave depth:        1 1
INP:                    0 0
G.INP:                  Not enabled

RSCorr/RS (%):          N/A 0.0021
RSUnCorr/RS (%):        N/A 0.0000
ES/hour:                0.83 0.83


Negative here...

Code: [Select]
xdslcmd info --pbParams
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 0
Last initialization procedure status: 0
Max: Upstream rate = 36866 Kbps, Downstream rate = 122892 Kbps
Bearer: 0, Upstream rate = 19999 Kbps, Downstream rate = 79987 Kbps

Discovery Phase (Initial) Band Plan
US: (7,32) (871,1205) (1972,2782)
DS: (33,859) (1216,1961) (2793,3970)
Medley Phase (Final) Band Plan
US: (7,32) (871,1205) (1972,2782)
DS: (33,859) (1216,1961) (2793,3970)
  VDSL Port Details   Upstream   Downstream
Attainable Net Data Rate:     36866 kbps    122892 kbps
Actual Aggregate Tx Power:    -  13.4 dBm      13.5 dBm
====================================================================================
  VDSL Band Status U0 U1 U2 U3 U4 D1 D2 D3
  Line Attenuation(dB): 1.4 4.5 5.8 N/A N/A 2.6 5.7 9.2
Signal Attenuation(dB): N/A 4.1 5.0 N/A N/A 3.1 5.7 9.2
        SNR Margin(dB): N/A 23.2 23.2 N/A N/A 18.3 18.3 18.3
         TX Power(dBm): -128.0 -39.2 -13.5 N/A N/A 10.4 7.8 7.1
#

No idea which is correct!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 02, 2015, 08:10:16 AM
Just noticed that MDWS reports a +power figure for my upstream but it appears to be a -power figure?

MDWS just reports what it's sent. You need to talk to roseway (or the modem makers)....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 03, 2015, 07:27:46 AM
Server will be down shortly, not sure yet for how long....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 03, 2015, 07:52:18 AM
Just noticed that MDWS reports a +power figure for my upstream but it appears to be a -power figure?

MDWS just reports what it's sent. You need to talk to roseway (or the modem makers)....

DSLstats just reports what the modem reports. MDWS reports the total upstream and downstream powers, and these values are positive. The upstream per-band values appear to be negative dBm values, but I find it hard to believe them because they represent microscopic power levels.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 03, 2015, 08:20:47 AM
Server will be down shortly, not sure yet for how long....
Okay back up - down from 07:55 - 07:59. Running on ZyXel VMG8324-V10A now at last  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on April 03, 2015, 05:33:28 PM
DSLstats just reports what the modem reports. MDWS reports the total upstream and downstream powers, and these values are positive. The upstream per-band values appear to be negative dBm values, but I find it hard to believe them because they represent microscopic power levels.

On my Billion 8800nl modem, the "--stats" command reports 13.1dBm downstream, and -8.2dBm upstream. From "--pbParams", I get banded TXPower as 9.7, 8.0, and 6.9dBm downstream, and -22.5, -35.3, and -8.5dBm upstream - with aggregate power listed as 13.1dBm down and -8.2dBm up.

When the HG612 was plugged in, the equivalent figures were 13.0 dBm down, -7.9dBm up; and 9.6, 7.6 and 7.2dBm down with -22.1, -35.2 and -8.1dBm up - with aggregate power listed there as 13.0dBm down and -7.9dBm up.

This line is around 100m long.

On an old line (350-400m long), the HG612 would display aggregate powers as positive, but would differ in the bands: U0 and U1 would be negative, while U2 (and all Dx bands) would be positive.

On an even older line (600-650m long), the HG612 showed similar results as the medium-length line.

What I did notice is that the placement of the minus symbol differs: In the "--stats" command, it is next to the digits; In the "--pbParams" command, it is next to the digits in the individual bands, but there are spaces between the symbol and the digits for the aggregate power.

For my line, I have both DSLstats and HG612-modem-stats running, so can see that HG612-modem-stats gets the right negative value. MDWS is being fed by HG612-modem-stats rather than DSLstats, so gets it right.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 03, 2015, 06:54:24 PM
OK, I'll take another look at that.

[Later]
Yes, I'm sorry, I agree. I haven't seen negative aggregate values before, and DSLstats has been reading these as positive. This will be corrected in the next release.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 03, 2015, 10:56:20 PM
OK, I'll take another look at that.

[Later]
Yes, I'm sorry, I agree. I haven't seen negative aggregate values before, and DSLstats has been reading these as positive. This will be corrected in the next release.

Only see negatives in the US TX power on both DSLstats and HG612_modems_stats have the same value  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 03, 2015, 11:15:00 PM
Yes, but it's the aggregate data we're talking about, and these values are both positive in your examples. The error I made was in believing that these would always be positive, and only uploading positive values to MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on April 04, 2015, 04:34:55 PM
Here's what mine looks like with the negative aggregate values. Note the '-' is a long way from the '8.2' in one screenshot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: bigg on April 04, 2015, 04:38:42 PM
MDWS BST Clock settings (from earlier post this morning)

As best I can tell, these users still need to reload their copy of DSLstats to get the correct upload time:

bigg
JustAnothe
les-70
oliver602
thepfy
toulouse

TIA

Hi I have checked my raspbery pi and it is on BST with the correct time, rebooted and the website is still saying my time is not on BST, can somebody take a look ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 04, 2015, 05:04:27 PM
MDWS BST Clock settings (from earlier post this morning)

As best I can tell, these users still need to reload their copy of DSLstats to get the correct upload time:

Edit:

This is now automated and an affected user will see a message under each graph telling them that the clock is out and still on GMT. As soon as it is corrected, the message will go away on the next graph refresh,

TIA

Hi I have checked my raspbery pi and it is on BST with the correct time, rebooted and the website is still saying my time is not on BST, can somebody take a look ?

Gone now, it's manual coding, not automatic....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 05, 2015, 01:46:50 AM
Should the ES/CRC/FEC and so on in the header be populated? Mine always seem to be 0.0 even though on the specific graphs ES have been reported? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 05, 2015, 12:40:53 PM
Should the ES/CRC/FEC and so on in the header be populated? Mine always seem to be 0.0 even though on the specific graphs ES have been reported? Thanks
Yes, they are reported but they are instantaneous readings once per minute so if you only have a few the chances are you won't see any data...

Try looking at oliver602 if you can bear it  :o (and his DSLstats clock is still out) 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shadow4dog on April 07, 2015, 04:13:08 PM
When I logon to MyDSLWebStats I see "User shadow4dog - your upload data is invalid!"

What does this mean and how do I correct it? I'm running HG612 Modem Stats.

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 07, 2015, 04:48:52 PM
When I logon to MyDSLWebStats I see "User shadow4dog - your upload data is invalid!"

What does this mean and how do I correct it? I'm running HG612 Modem Stats.

Thanks
It appears to be fixed now  :) For a couple of days (3rd - 5thApril) your were uploading files with no data in. Usually upgrading HG612 Modem Stats or restarting it will fix the problem which is known.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shadow4dog on April 07, 2015, 06:13:50 PM
Thanks that makes sense. My local data is missing from that time too... but if it's known then not a big problem...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 07, 2015, 07:28:03 PM
I have just registered with MyDSLWebStats but I can only get so far. It baulks on the "Check now" with "Unable to check at present". Is this my finger trouble or is the site not working at the mo'?
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on April 07, 2015, 07:33:39 PM
I have just registered with MyDSLWebStats but I can only get so far. It baulks on the "Check now" with "Unable to check at present". Is this my finger trouble or is the site not working at the mo'?
Tony

stop recording on your software, then use check now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 07, 2015, 10:13:07 PM
No doubt there us a huge list of requests but it would be great if your user was selected automatically after logging on? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 07, 2015, 11:04:03 PM
No doubt there us a huge list of requests but it would be great if your user was selected automatically after logging on? Thanks

you have plenty of panes you can use 1 for your stats 2 for all users stats 3 for another users stats  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 07, 2015, 11:04:26 PM
I've stopped recording but it still says "unable....." when I "Check now". Any more suggestions please?
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 07:41:15 AM
I've stopped recording but it still says "unable....." when I "Check now". Any more suggestions please?
Tony

Welcome  :)

That is DSLstats presumably... Have you tried unloading the program and restarting?

If that doesn't work, probably need roseway's help as it's his baby. He'll hopefully spot this post.. It sounds possibly like it can't find an internet connection to make the check?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 07:45:23 AM
No doubt there us a huge list of requests but it would be great if your user was selected automatically after logging on? Thanks

It should be selected when you first log on, seems to work here okay - if not select yourself or another user and that user will stay with you from then on for that pane until changed...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 08:07:43 AM
I've stopped recording but it still says "unable....." when I "Check now". Any more suggestions please?
Tony

If this is DSLstats, then it's possible that this is the result of a timeout. I believe you're with Plusnet, and the MyDSLWebStats site seems to be one of the sites which get affected by the gateway delay issue. Doing a gateway hop* may clear the problem. Alternatively, if you're sure that you've entered the validation code correctly, just starting recording with MDWS set up and enabled may work OK, but with something like 5 seconds initial delay before anything happens.

*To do a gateway hop, you need to drop the PPP session with the ISP and remake it several seconds later. Most routers provide a means of doing this, with a Disconnect / Connect button in the web interface. You could just resync or restart the modem, but it's not a good idea to do this frequently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 11:50:22 AM
I have upgraded DSLStats to 5.4 (I was using 5.3) and checked on the MYDSLWebstats site that I am logged in. I can see my name in the list of registered names but I'm still not uploading. I have checked the gateway I am on and checked that I've moved after a hop but still no joy. I'm almost certain this is my finger trouble which is very frustrating. Is there anything else anyone can suggest please? DSLStats is still doing its thing fine and I have stopped and restarted it to no avail.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 12:39:06 PM
I have upgraded DSLStats to 5.4 (I was using 5.3) and checked on the MYDSLWebstats site that I am logged in. I can see my name in the list of registered names but I'm still not uploading. I have checked the gateway I am on and checked that I've moved after a hop but still no joy. I'm almost certain this is my finger trouble which is very frustrating. Is there anything else anyone can suggest please? DSLStats is still doing its thing fine and I have stopped and restarted it to no avail.
Tony

Are there any relevant entries in the Event log?
And could you take a snapshot of the DSLstats MDWS configuration page and copy it here? Make sure you haven't ticked the Reveal box when you do this.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 12:39:23 PM
Have you looked in the Event Log tab of DSLstats to see if that tells you anything?  Have you get the validation checked okay message yet on the MyDSLWebStats config tab?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 02:06:53 PM
I should have checked the event log before but unfortunately the only relevant comment in there is "MyDSLWebStats validation check failed" about 8 or 9 times and my IP address. Checked OK still says "Unable....". A copy of the config page is attached (I hope!)
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 03:52:33 PM
I think you've revealed a bug: the 'Check now' button only works when the 'Upload data to MyDSLWebStats' box is ticked. If you do that, it should work. :fingers:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 04:38:22 PM
Unfortunately I've tried that and it won't let me tick it. I'm going to be so cross I'm sure when we find out what stupidity I've performed.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 05:27:41 PM
Eric is a better person to answer this but as an idea have you tried stopping DSLstats recording first, and then trying to enable it. If that doesn't work, terminate DSLstats after stopping it and restart it then try? My copy running here seems to accept changing that checkbox at any time...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 08:05:31 PM
I have tried stopping the recording and after your suggestion I exited the program and restarted it. Still no joy. I am using a tg582 router (still on ADSL2+) and I wonder if someone else here has the same conditions as me. That is Plusnet customer, ADSL2+ and a tg 582. Be good to have a comparison.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 08, 2015, 08:17:17 PM


Quote from: tbailey2
It should be selected when you first log on, seems to work here okay - if not select yourself or another user and that user will stay with you from then on for that pane until changed...

Didn't have cookies enabled.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 10:56:40 PM
I have tried stopping the recording and after your suggestion I exited the program and restarted it. Still no joy. I am using a tg582 router (still on ADSL2+) and I wonder if someone else here has the same conditions as me. That is Plusnet customer, ADSL2+ and a tg 582. Be good to have a comparison.
Tony

Does that mean that you're using the TG582n as a modem/router? If so, then I owe you an apology, because the MyDSLWebStats functions only work with normal Broadcom-based modems, not with the Thomson/Technicolor models. The latter don't provide access to the range of data needed for MDWS.

I should have made this clear at the outset, but I confess that I simply didn't think of it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 11:09:46 PM
It was reading stats though if that makes any difference, you can see them at the bottom of the screen grab  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 11:18:39 PM
Yes, DSLstats does work with limited functionality with the Thomson/Technicolor models, but much of the data needed by MDWS is missing.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 11:25:02 PM
Yes, DSLstats does work with limited functionality with the Thomson/Technicolor models, but much of the data needed by MDWS is missing.

Okay. I thought maybe it would just upload a subset for 'challenged' modem/routers.... I did check the validation code and that is okay but nothing has ever made it up to the server.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 09, 2015, 12:46:21 AM
Thanks, everyone. It seems the problem is solved. Perhaps I should have made it clear what router I was using but since DSLStats works so well with it I didn't imagine it would not work to record my stats. This is the only reason i have registered with MyDSLWebStats. I will join the grown ups when I get proper fast broadband with a new router. Can't be long now - the exchange is upgraded but no sign of an extra cabinet by my original one.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 09, 2015, 07:03:38 AM
Once again, I'm sorry Tony. I don't like leaving you unsupported, but at present I'm having to prioritise my time spent at the PC.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 09, 2015, 12:46:59 PM
Eric
No need to apologise and absolutely no need to rush to a solution (if there is one). Sorry it took us so long to realise what the problem was.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 13, 2015, 03:48:12 PM
Sorry to bug you Tbailey2, but I'm just waiting for my validation key to arrive. Is there anything I need to do?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 13, 2015, 04:09:29 PM
Sorry to bug you Tbailey2, but I'm just waiting for my validation key to arrive. Is there anything I need to do?

It was sent at 15:04 and accepted by your mail server.... Please check your SPAM folder...

Edit: I've now sent you a copy....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 13, 2015, 06:37:51 PM
Thanks for that. I don't know what happened to it but I suppose it'll turn up eventually when Yahoo have had a good look at it :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 13, 2015, 09:08:29 PM
Incidentally, a quick check on the mail headers says that mydslwebstats.co.uk doesn't designate permitted senders, which I think means a lack of an SPF record which may lead Yahoo to bin it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 14, 2015, 08:03:59 AM
Aha, the original validation key email finally turned up after a 13 hour delay by Yahoo, presumably due to the lack of SPF record :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 14, 2015, 08:32:30 AM
Aha, the original validation key email finally turned up after a 13 hour delay by Yahoo, presumably due to the lack of SPF record :)

You seem to have received the original Registration mail immediately though as you validated quickly? There is no mail server on MyDSLWebStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 14, 2015, 08:42:46 AM
I received the one you resent to me after I posted above, and used that to upload from DSW32. The original automated one got delayed by 13 hours and arrived here at 4:00 am.

An SPF record is just a a TXT entry in your DNS and is supposed to cut down on Spam by allowing a site to say where it's own mail comes from. But a lot of people including me just have a default transitional entry:

The TXT records found for your domain are:
v=spf1 a mx ~all

I used this to query SPF records: http://www.kitterman.com/spf/validate.html
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 14, 2015, 09:48:45 AM
I received the one you resent to me after I posted above, and used that to upload from DSW32. The original automated one got delayed by 13 hours and arrived here at 4:00 am.

An SPF record is just a a TXT entry in your DNS and is supposed to cut down on Spam by allowing a site to say where it's own mail comes from. But a lot of people including me just have a default transitional entry:

The TXT records found for your domain are:
v=spf1 a mx ~all

I used this to query SPF records: http://www.kitterman.com/spf/validate.html (http://www.kitterman.com/spf/validate.html)

But you validated your e-mail via the link in the Registration server e-mail a few minutes after it was sent and it is that link that sends the second e-mail but not to worry. I haven't seen any problem from the other 27 Yahoo users we have, or else no one has reported it.

I have used that link as well but just had a look and it says there are no SPF or TXT records ...

Code: [Select]
SPF record lookup and validation for: mydslwebstats.co.uk
SPF records are published in DNS as TXT records.
The TXT records found for your domain are:

Checking to see if there is a valid SPF record.
No valid SPF record found of either type TXT or type SPF.

I just double checked at the Registrar. There is no TXT record although I had set one up at some point in the past but removed it in December when the server location was changed. The MX record is currently pointing at my own MyDSLWebStats mail account on another server, not the same one that the MyDSLWebStats server mail (via msmtp) is using unless that has something set... I'll check.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 14, 2015, 09:55:22 AM
Yes, it was the 2nd one that got delayed. I only mentioned the SPF record because of the odd delay - it may just be normal Yahoo :)
Anyway, it's all up and running well, so thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on April 14, 2015, 12:34:15 PM
Yahoo are pretty notorious for deferring mail as an antispam measure. It will come through eventually.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 14, 2015, 02:44:13 PM
Yahoo are pretty notorious for deferring mail as an antispam measure. It will come through eventually.

Well with some help from another forum user we've managed to get the appropriate DNS/SPF records added so that Yahoo! sees a fully validated sender and will not regard server generated mail as SPAM unless they are just being bloody awkward as you suggest  :mad:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 14, 2015, 03:48:57 PM
I suggest also to make sure is a valid DKIM, reverse dns, helo and smtp header.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on April 14, 2015, 04:15:37 PM
RE: Latency graph

My latency graph is missing in action...I have swapped from TBB to mousealike but to no avail.

I have also tried a CTRL-F5

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on April 16, 2015, 12:47:38 PM
Still got this problem on multiple devices......is everybody elses still showing OK?

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 16, 2015, 12:57:15 PM
Still got this problem on multiple devices......is everybody elses still showing OK?

Ian

They all look okay here inc yours from Firebrick.... No ideas currently I'm afraid

It helps if you quote your Username on MDWS please  ;)

NB all that it does is load the file on the link stored against your user name directly from TBB or wherever although I hope to change that soon....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on April 16, 2015, 01:59:08 PM
Looking at the img source I get

http://f8lure.mouselike.org/proxyfirebrick.asp?ID=55028?x=1429188722 (http://f8lure.mouselike.org/proxyfirebrick.asp?ID=55028?x=1429188722)

and when I paste that into a new browser window i get the error "File has expanded to fill drive."


Changed back (for the 4 th time) to the tbb graph and it is now working??? Strange.

Thanks again for your help.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 16, 2015, 03:49:57 PM
Weird. Sounds like the other end has run out of disk space or you have overrun a quota or :hmm: .....  It was okay here though at midnight or so.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 25, 2015, 07:55:30 PM
Hi tony has your line been hit by crosstalk as your DS SNRM as been dropping off over 20 days it's now down to 3.8dB  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 25, 2015, 09:15:31 PM
his snrm is bizarre , its on a downward slope as if there is something nearby gradually increasing interference, its a weird pattern for crosstalk.

by the way load my snrm graph for 30days, you see from around 5 april my upstream snrm now dips every afternoon.  It started when I moved my TV, which was moved further away from the modem not closer.  The only thing I can think off is the TV was shielding the modem from some upstream interference.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 25, 2015, 10:31:05 PM
by the way load my snrm graph for 30days, you see from around 5 april my upstream snrm now dips every afternoon. 

I am not confident to say thats down to your TV Chry as have noticed a few MDWS members US SNRM has fallen over the last 20 days by 0.5dB it could be down to atmospheric changes and the changes when the copper/ali cable expands as temperatures rise moving towards summer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 28, 2015, 10:08:28 AM
Hi tony has your line been hit by crosstalk as your DS SNRM as been dropping off over 20 days it's now down to 3.8dB  :-\

Sorry, been busy....

Yes, loads of crosstalk here in 14 months (~56/12 >> 32/4)

It apparently started that slow decline when I changed to the Zyxel on the 3rd April (which has been up ever since BTW). Also lost nearly 1 Mb of upstream in the process. Seems to have stabilised the drop a bit in the few days though with no changes made here.

I will change back to the old HG612/TG582n combo shortly (the router is new as the WiFi packed up on the old router, and the HG612 is also a new 3B with 08 firmware) to see what happens.. Might also try using the Zyxel as a router although it takes too long to get a new session for my liking.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kevinduke on May 01, 2015, 05:08:51 PM
Hi

I have a message on mydslwebstats saying that my emails are being bounced - please whitelist us.

Any ideas how to remove this message as mydslwebstats is whitelisted and I am receiving emails.

Thanks

Kevin
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 01, 2015, 05:57:19 PM
Hi

I have a message on mydslwebstats saying that my emails are being bounced - please whitelist us.

Any ideas how to remove this message as mydslwebstats is whitelisted and I am receiving emails.

Thanks

Kevin

Done. They were bouncing and that message is made manually. Thanks for letting us know.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 01, 2015, 06:01:57 PM
Donations

Just two to report over the past 6 weeks. They were:

AlexMUK
Starman

Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 05, 2015, 12:03:48 AM
Server Fault

There have been a number of intermittent sessions this evening and drop outs that took some hours to sort out but hopefully all is now up and running okay again as of midnight. Bed here I come ..... :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 06, 2015, 08:33:56 AM
Downtime

This is advance warning that early on Saturday morning, 9th May, the server will be down for possibly an hour or more while prepared changes are made offline to accommodate storage of G.INP data. Once restored, upload clients should reconnect without intervention but it might be worth checking you are still uploading.

There is also a web software upgrade to make Resyncs more accessible across the site plus a number of other changes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jeffers on May 07, 2015, 05:00:04 PM
Any issues with the site at the moment? Just getting a blank page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on May 07, 2015, 05:13:02 PM
Try http://mydslwebstats.co.uk/container.htm
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 07, 2015, 06:00:26 PM
Any issues with the site at the moment? Just getting a blank page.

Just had a look at the logs and hopefully fixed now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 07, 2015, 09:57:45 PM
I just got two emails from MyDSLWebStats to-day at 21:15 saying my G.INP has been disabled on my line an then another email saying G.INP has been enabled are you having issues tony ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 07, 2015, 11:22:54 PM
I just got two emails from MyDSLWebStats to-day at 21:15 saying my G.INP has been disabled on my line an then another email saying G.INP has been enabled are you having issues tony ?

I have to say though that those emails were sent to you two days ago on the 5th May..... Postman your end must have had a couple of days off  ;) Have a look in the headers and see what dates are there please.

Edit: I've checked the database entries for that time (15th at 21:15) and the row entry shows G.INP as NOT enabled - looks like a glitch, maybe the modem itself as other data is there and G.INP enabled before and after.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 09, 2015, 12:08:31 AM
Cheers Tony as that date coinsides with a auto firmware update on the HG612 it was not a manual update by me or reflashing the HG612, but the weird part is nothing changed regarding lastest firmware version only the date & time was modified in the change detection system on Ronski's GUI  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 09, 2015, 01:52:44 PM
NS. There is a problem in the detection system, I've seen it happen at work just haven't had the time to look into it. The tell tale sign is it shows as N/A, then the next entry shows the same firmware ID's as before the N/A.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 09, 2015, 07:42:45 PM
Thanks Ron that helps me relax as my mind was asking was it a update or was it not and then the dreaded thoughts of modem being compromised started to creep in.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 07:11:23 AM
MyDSLWebStats V 1.4.0 Update 17th May 2015

As well as a major update in itself, this also reflects some of the myriad of changes to MDWS that have taken place in the background since V1.3.0 was released. Please note that the Help system has NOT yet been updated as I simply haven't had the time to do it. You may need to hit F5 to get the complete updates if V1.4.0 is not already showing.

Introduction of G.INP data

G.INP works differently to non-G.INP and there's a whole new way of dealing with/avoiding errors via retransmission with much lower overhead.

Whilst this has now been somewhat upset by the decision by BT to suspend rollout, nevertheless it has taken an awful lot of time and effort by those who run the project (tbailey2, BaldEagle 1 and roseway) to sort out. At the moment, there are only two users uploading G.INP data (BaldEagle1 and roseway) and the correct versions of the upload programs for everyone else will be made available later at a date to be announced following some further trials after this upgrade.

In the meantime, you can view the 17 additional graphs that are available from the users who are uploading once you are running V1.4.0. The user names have 'G' after them in the dropdown list if this data is available. You will not see any G.INP options for users who are not uploading the data yet.

Note that if you view a G.INP specific graph for a user and then change to another user who doesn't have G.INP available, you'll see a message to that effect and need to hit Update when it will revert to the SNRM display.

Some notes:
The GINP indicator at the top left of the status bar above the graphs now reads either G.INP Active or G.INP Inactive where appropriate for that line (see this in the examples below).

G.INP Active means that it is currently implemented and running for that user and Inactive means it has been enabled at some point in the past but BT have disabled it currently.

In the data dropdown list, B0 and B1 are Bearer 0 and Bearer 1. Where both Bearers carry similar information (such as FEC/CRC) the old entries now have B0 ahead of them. G.INP specific entries have G- ahead of them.

When you start uploading data that includes the G.INP data and this is detected by MDWS, there may be a delay initially in uploading and display while some database changes are made in the background for your data. There will not be any G.INP data available prior to that time for an enabled user.

It's complicated yes - and what the new data means is a separate subject not attempted here.

Display of Resync data
You can now see Resync data for a user in several additional places. The Control Panel at left has a new dropdown list near the bottom for time-based graphs that lists all Resyncs for that user - this is the same data as is available from the Resync/LOS view. When dropped down, today's entries are in red and hovering over the entry will display (in most browsers) the same data that the Resync/LOS panel shows. This list auto updates in the background every 5 minutes.

Also, for date spans of 2 days or less, the Resyncs are now shown on the SNRM graph only. They take the form of blue spikes rising up to 3dB for each Resync. This is selectable via a check box in the Control Panel - note that this does not currently survive changes to selections other than changing to another user. And while in this mode, Zoom is not functional. The hover help by the Resync option has some more info (shown below).

Examples for the above facilities:
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fmdws-resync-snrm-data-2.jpg&hash=3cea4da1c2e8bd996a49755d9a4f0f09)

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fmdws-resync-snrm-data.jpg&hash=d9b6caace1cd80af19b3c0c57d9a30c9)

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fmdws-resync-ginp-data2.jpg&hash=1225518da9242483135215094060225a)

Data Retention/Costs/Donations

With increasing numbers of users, the amount of data being stored has necessitated more RAM being added to the server, and with very few donations lately, means funds have come out of my own pocket.

It now looks as though even more is going to be required shortly (basically to keep all the database tables in memory and avoid disk swapping) - plus offline storage costs for critical data. In the meantime, the amount of older stored data is already being reduced somewhat.

That and other costs (such as the failure of an SSD and changing to mirrored spinning disks) means that MyDSLWebStats might be moving to requiring a donation to build a fund for upgrades etc.

The alternative is this request that we need more voluntary donations please that might cover costs overall. There have only been two donations in the past four weeks so far at less than 10% of costs incurred.

The link for donations is at the top left of the main page. It helps a lot if you mention your username in the form 'user:myusername' as a message when donating. Thanks.

Other changes:

a) Database profiled and optimised several times to take average response times (the overall time taken to deliver the data from time of the request to the user to process for the majority of queries) down to 200ms or less. The baseline query is that for 24 hour SNRM. It can be as low as 70ms but the processor is only running currently at 40% of max speed for economy.

Some queries will take longer by varying degrees depending on where the data has to be fetched from.

b) Overseas users had incorrect start times to most graphs.

c) Addition of some stats at the top of the page to show how busy the server is.

d) The All User Stats entry has been moved to the BOTTOM of the list from the top.

e) Upload data is now available for all users on a rolling 12 month maximum basis. Data prior to this should be available to you locally from your upload program if you have kept it. Users who have not uploaded anything in the past three months will have all their previously uploaded data deleted although the account will remain. This is to reduce the data retention load for data that may well never be used again.

f) The upload program and version are shown at the bottom right of each graph for each user.

g) There is an additional option Mini Stats located next to the Options link near the bottom of the main window. This displays a mini version of the stats summary for the logged in user shown above graphs but in a standalone window located at the top left of your screen by default but it can be moved.

h) And lots of other little updates I've forgotten by now but which have no significant effect on running of the program

Enjoy!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 17, 2015, 08:36:56 AM
Great work Tony, would it be worth putting your Plusnet referral link on the site, that way if anybody does sign up to Plusnet by it at least  you will get  the on going commission.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on May 17, 2015, 10:26:55 AM
Great work all. Happy to help with any further trials if you need a guinea pig. I'm on the 8800NL.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on May 17, 2015, 12:34:04 PM
g) And lots of other little updates I've forgotten by now....

And this is why changelogs exist  :P (I've been here a lot, I have the memory of a hypothetical goldfish :-X)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 01:12:28 PM
Great work Tony, would it be worth putting your Plusnet referral link on the site, that way if anybody does sign up to Plusnet by it at least  you will get  the on going commission.

Oh errr... it already is I thought since it started up.

Seems though it's only enabled on the Index/Home page   :-X

Will fix shortly. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 01:28:02 PM
Also now fixed (hopefully) is a positioning problem with the graphs and extra info in the Control Box forcing the buttons out of sight (for IE, FF and Chrome/Opera but Safari [Last Win version] won't play).

One of the G.INP graphs has been renamed to G-LEFTRS at the request of BE1 who says:

I THINK that 'L' means near side, 'EFTR' means Error Free Throughput Rate, 'S' means Seconds & the data is only non-zero whenever there has been some sort of near side 'interference'?
That's good - can we have meanings for the other 16 now please  ???

F5 will get it fully implemented.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on May 17, 2015, 02:37:04 PM
One of the G.INP graphs has been renamed to G-LEFTRS at the request of BE1 who says:

I THINK that 'L' means near side, 'EFTR' means Error Free Throughput Rate, 'S' means Seconds & the data is only non-zero whenever there has been some sort of near side 'interference'?

L for local, the converse of remote, maybe?  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on May 17, 2015, 02:48:46 PM
One of the G.INP graphs has been renamed to G-LEFTRS at the request of BE1 who says:


Just noticed; the graph title could do with changing too.


Quote
I THINK that 'L' means near side, 'EFTR' means Error Free Throughput Rate, 'S' means Seconds & the data is only non-zero whenever there has been some sort of near side 'interference'?
That's good - can we have meanings for the other 16 now please  ???



I think your naming convention describes them sufficiently, apart from maybe MinEFTR.
Presumably that's Minimum (E)rror (F)ree (T)hroughput (R)ate?

I'm not too sure about 'lookback' though.
I have assumed that is related to the size of the buffer needed to store errors that require retransmission (rtx_tx) before they can be corrected (rtx_c) or left uncorrected (rtx_uc).


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 04:12:25 PM
Just noticed; the graph title could do with changing too.

Done
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on May 22, 2015, 09:13:46 AM
Tony

Has something changed; multi day seems to be not working
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 22, 2015, 10:41:34 AM
Tony

Has something changed; multi day seems to be not working
Seems okay now. The process that controls the daily update didn't fire off when it should at 00:30 but runs again at 09:30 just in case. It checks for missing days...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 23, 2015, 11:45:18 AM
Downtime

Note that the MyDSLWebStats server will be down for a while early tomorrow morning (Sunday 24th May) for some  maintenance, OS updates etc. Your uploads should resume automatically afterwards but it might be worthwhile checking your upload client just to make sure.

I'll post here again once it's running okay.

Edit: Okay back up again now as of 08:20. Thanks for waiting if you did  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 24, 2015, 10:33:06 AM
Thanks Tony, it behaved in the expected way.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 24, 2015, 11:29:11 AM
Thanks. Same here on another machine  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 28, 2015, 09:21:35 PM
Noticed a lag on MDWS i just thought is was down to new ISP and the removal of G.INP, MDWS used be very snappy just under 1 second to see stats but it can take upto 6 seconds to show stats now, have done a ping to MDWS and the average is showing up as 46ms and the BBC site as 29ms.

EDIT: Had to edit post as old Fantom posts are showing as new posts and then disappearing
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 29, 2015, 12:08:53 AM
Can't see any thing adrift from this end, delivery out to you in around 200ms and ping into server looks normal for the time of day. Base is 18ms.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 29, 2015, 11:47:40 AM
Can't see any thing adrift from this end, delivery out to you in around 200ms and ping into server looks normal for the time of day. Base is 18ms.

thanks for feedback it has to been something at end and all that has changed is different ISP and router plus g.inp removed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 29, 2015, 01:07:22 PM
If your browser tells you what it's currently loading in the status bar, see if it says 'Waiting for canv.googlecode.com...". That's the usual suspect at my end when it's slow. Unfortunately Google won't let you run it locally. DNS maybe, try something else?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 29, 2015, 10:26:20 PM
Cheers Tony have set the router to use google DNS, the Chrome status bar shows nothing apart from the rotating arrows on the top left hand corner when its awaiting information.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 31, 2015, 07:06:15 AM
DOWNTIME NOTICE - RESTART UPLOAD CLIENTS

During a server reconfiguration earlier this morning, there were a few problems and it threw off users online at the time  - you may find the site showing a 500 Server error. Hitting F5 will bring things back. Still working on the changes, some of which are fixed, but there are a couple of other things to sort out today that may cause interruptions.

It's also stopped clients uploading (possibly only HG 612 Modem Stats users?) as well so everyone needs to check their client is uploading please and restart if necessary  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 31, 2015, 07:41:49 AM
DSLstats stopped uploading as well, but recovered when MDWS came back online.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 31, 2015, 08:11:34 AM
Thanks Eric.

Mine had got stuck with Unable to login to modem/router (5.5) and had to unload and restart to get it going. However, I had pulled the Ethernet from the Zyxel o/p for a while during the sort out which won't have helped  :-X I think there are around 10-15 users not uploading currently.

Can't do much more now as other duties call...

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on May 31, 2015, 09:03:00 AM
Assuming the issue occurred at around 06:52 this morning, these appear to be the currently affected HG612 Modem Stats users:-

thermionic
ayeaye
craigv
kraven
crowroad
jizzerman
pooclah
abailey
Jasonkruys
Krazeh


I was also affected.

The symptom seems to have been that the Upload.exe program was unable to cope with some 'unusual' / unexpected messages returned from the MDWS server & ended up 'stuck'.

This in turn caused HG612_stats.exe to end up 'stuck'


ending the process in Task Manager for Upload.exe got everything running again here, but it's possible that HG612_stats.exe may also need to have its process ended.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on May 31, 2015, 04:24:17 PM
  At times, this week included I get hit by odd SES and it would be nice if they could be logged on MyDSLwebStats.

  Perhaps at low priority you could consider possibility of this -- I am assuming the SES are uploaded.

  Maybe they could be added to the ES graph in extra colours such as black downstream and blue upstream.  This should work if zero SES is not plotted and SES take priority in over writing the green and red.  I guess most would wish to see SES if they occur and most who don't get SES won't see any change.  Since SES are not that common the results should also never be too cluttered.

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on June 01, 2015, 05:39:55 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 01, 2015, 06:34:22 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian

Yes  :hmm:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 01, 2015, 06:45:01 PM
  At times, this week included I get hit by odd SES and it would be nice if they could be logged on MyDSLwebStats

Unfortunately, the data needed to plot it isn't uploaded currently in a form that can be used directly as with the other graphs. The SES data is there but would need a lot of real time calculations to get it to graph and I just don''t have the time available for some months yet to possibly have a look at it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on June 01, 2015, 09:53:31 PM
   Thanks for the response.  I do understand and am very grateful for the work that has already gone into MyDslWebStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 01, 2015, 10:24:18 PM
Hi tbailey as we have down Tot /24Hr ES graph would there be a way to see the up Tot /24Hr ES graph  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: holmbase on June 05, 2015, 02:05:06 PM
Hi. I hope no one else has reported this and I've missed it.

Since v1.4 of MDWS I seem to have gaps in my charts on an intermittent basis. I'm using DSLstats v5.5 running on Linux Mint 13.1. The gaps do not appear on the charts in DSLstats only on MDWS. My username on MDWS is hypericum. I am assuming it is something linked to v1.4 however - I upgraded from 5.4 to 5.5 of DSLstats at the same time (unknowingly) so I don't know if it is related to that rather than MDWS.

It's not a major deal and after it first happened it did settle down and become less and less frequent to the point of almost disappearing. I had to reboot my computer today and now the gaps have started again.

Anyway, I just wanted to point it out in case it's something simple to resolve.

Thanks

John

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 05, 2015, 04:00:05 PM
Are there any corresponding entries in the DSLstats event log?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on June 05, 2015, 08:19:08 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian

Yes  :hmm:
I presume you can see it is currently pointing to http://www.mydslwebstats.co.uk/Container.htm#][url]http://www.mydslwebstats.co.uk/Container.htm# (http://[url)[/url]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 05, 2015, 10:22:51 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian

Yes  :hmm:
I presume you can see it is currently pointing to http://www.mydslwebstats.co.uk/Container.htm#]http://www.mydslwebstats.co.uk/Container.htm#]http://www.mydslwebstats.co.uk/Container.htm# (http://[url=http://www.mydslwebstats.co.uk/Container.htm#)

No I can't see that I have to say... it's definitely coded to the correct link and works okay here and from a remote terminal I have access to.

.... hang on

Are you referring to what happens when you hover over the link and the URL that comes up at the bottom of the browser window? If so then that's correct, you'll see what you refer to but I assume the link is actually working correctly for you though as you quoted the destination URL in the first post.

The reason it shows the link it does is because the destination URL is loaded via Javascript and you can't see that. The hash stops the calling page reloading while letting the JS execute.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: holmbase on June 06, 2015, 04:20:49 PM
Are there any corresponding entries in the DSLstats event log?
Eric

Nothing in the log window other than snapshots taken. However, I stopped, quit and restarted DSLstats and everything now seems good. Not sure why but problem solved.

Memo to self for next time.

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 09, 2015, 08:07:51 AM
Good to see I can now sort the All User data into descending G.INP so I can see all the G.INP enabled users together. Thanks ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on June 09, 2015, 04:02:42 PM
Is MDWS down?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 09, 2015, 04:36:49 PM
Not now, but it looks as though it was down for some hours this afternoon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 09, 2015, 11:09:03 PM
Not now, but it looks as though it was down for some hours this afternoon.

I've been out all day and just seen it. Looks like the modem has thrown a wobbly as the TBB monitor is showing 92% packet loss since it went down at 13:45 or so originally. It's resynched twice since then after 54 days up for some reason (LOS)  :'(

Although everything looks okay on the server, I am going to switch it off the Zyxel for 30 mins in a moment and see if that cures it so please bear with me ...

Edit:
So it's now 06:30 and no change after the modem restart. All seems to be working okay for the server in/out - Ookla shows normal 18ms latency, sync and attainable are slightly up on normal so not sure what the problem is. Recent TBB graph attached  :o , the 'normal' part is normal and the peak was a big upload Other users TBB graphs look okay

As I wasn't around when it first happened, obviously I haven't changed anything. Maybe reflash with latest 10C0 firmware when I get a chance... Or go back to HG612 if necessary.

Ideas welcomed please...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 10, 2015, 06:56:31 AM
People's experiences with Zyxel seem to vary widely. I stopped using the VMG8324-B10A because it lost ethernet connectivity after a couple of days of operation. I don't know if something like that could explain your problem yesterday. Personally I would be inclined to replace it with an HG612 and a very good router.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 10, 2015, 07:01:07 AM
Thanks Eric.

That's my preference as well. It had been up around 54 days with no problems though which is the odd thing. I'll maybe go back to the original HG612 and a new TG582n I have spare as that at least worked for over a year. Also see if the loss of 1MB upload on the change was the Zyxel or not.

There may be a Zyxel VMG8324-B10A for sale soon if anyone wants one  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on June 10, 2015, 05:15:43 PM
I am planning to sell mine alongside a spare hg612 (whilst demand is high due to g.inp issues), I decided I want an ac68 asus router, but am now discipling myself in spending so will fund it from sale of old stuff.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on June 10, 2015, 07:16:10 PM
Quote
hover over the link and the URL that comes up at the bottom of the browser window?

Yes...I'm sure the "tool tip" did point to mdwssuu.htm; but i can't seem to reproduce it now (and there was something weird when I actually clicked on it).

All seems okay now though....thanks again.
Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 11, 2015, 10:19:09 AM
SERVICE RESTORED at 09:00

Off since 07:00 to try and sort out the problem with the Zyxel but couldn't. So now back on HG612/TG582N (both new out the sealed boxes) plus various server software updates and some rewiring etc.

All is running okay, have a bit of upstream back and downstream much as it was. Ping has now returned to normal at last.
You might want to check your upload client has reconnected although the monitor here looks okay.

Thanks for bearing with me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 11, 2015, 10:21:51 AM
It looks good now. Thanks for your efforts.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on June 11, 2015, 03:10:41 PM
didnt notice any outage :) I had an outage myself anyway.  Had to use 4g this morning as soft bricked router.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 11, 2015, 10:21:01 PM
Off since 07:00 to try and sort out the problem with the Zyxel but couldn't. So now back on HG612/TG582N (both new out the sealed boxes) plus various server software updates and some rewiring etc.

My findings seem to like the new setup as MDWS is a tad faster on my end and don't bin your Zyxel as i am still searching for an all in one unit that has the xDSLcmd built in name your price  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 13, 2015, 08:36:02 AM
Someone thinks their ECI modem is working with DSLStats and MDWS  :no:

https://community.bt.com/t5/BT-Infinity-Speed-Connection/VDSL-stats-and-interleaving-depth-Possible-fast-path/m-p/1494233#M180829
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 13, 2015, 08:57:04 AM
Someone thinks their ECI modem is working with DSLStats and MDWS  :no:

https://community.bt.com/t5/BT-Infinity-Speed-Connection/VDSL-stats-and-interleaving-depth-Possible-fast-path/m-p/1494233#M180829 (https://community.bt.com/t5/BT-Infinity-Speed-Connection/VDSL-stats-and-interleaving-depth-Possible-fast-path/m-p/1494233#M180829)

He's looking at my line - notice it says Guest :D (so he's not registered or uploading [I assume] and it's an HG612 anyway) and that's whose data it is he's posted.

Seems to have assumed that plugging in his modem automatically uploads to MDWS by some miracle of modern technology... I'm working on that but haven't got my head round it yet  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 13, 2015, 10:01:22 AM
Miracles we do immediately; the impossible takes a little longer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 13, 2015, 05:22:43 PM
Miracles we do immediately; the impossible takes a little longer.

He seems to have realised that that they are not his stats but not why....

Quote
Just realised these stats may not be true. I didn't have to upload anything on that website though, just opened it and the stats appeared. After resync, it still shows 705 depth of interleaving and 8 delay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on June 14, 2015, 12:02:07 PM
Miracles we do immediately; the impossible takes a little longer.
Have you not done it yet Tony - you're slacking man  :whip:

 :lol: :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 14, 2015, 04:05:12 PM
Well I'm sorry to say that even though I do have an award sitting on the shelf here from BT for Innovation in software design, this one still escapes me I'm afraid, must be getting past it  :silly:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on June 14, 2015, 10:10:10 PM
sigh - I'm most disappointed.  Youve really let the side down.  ::)


---
On a more serious note - keep up the good work tony..  at least the possibility of the impossible was a bit of light relief for you ;D

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 17, 2015, 07:37:35 AM
He's still monitoring your stats  :-X

https://community.bt.com/t5/BT-Infinity-Speed-Connection/Interleaved-or-fastpath/m-p/1495796/highlight/true#M181206
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 07:56:19 AM
He's still monitoring your stats  :-X

https://community.bt.com/t5/BT-Infinity-Speed-Connection/Interleaved-or-fastpath/m-p/1495796/highlight/true#M181206 (https://community.bt.com/t5/BT-Infinity-Speed-Connection/Interleaved-or-fastpath/m-p/1495796/highlight/true#M181206)

So am I as he mentions!  Maybe I ought to post on there, think I have a login somewhere.

At about 19:08 last night my VDSL2 line downstream SNRM suddenly shot up from ca 6dB to 11dB+ for no apparent reason, no resync.   Upstream is about 0.5dB better. I thought at first this was a local power outage to the South as this is typical of what happens but appears not as it's still there 12 hours later and UK Power Networks have no cuts recorded.

My achievable is now at least 10Mb higher. It's almost back to where it was a year ago and closer to the max I had when first on the cab of 57Mb.  I don't think it's a disturber gone on  hols as the most I ever lost was 1.5dB in one go through a new one. I'll leave it for now to see if DLM pokes its nose in.

I guess Newt will advise a resync to get the extra d/l but won't be good news if it's temporary and then goes away.....

Ideas??

It's an ECI cab BTW....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 17, 2015, 07:58:08 AM
Vectoring has been turned on?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 09:09:15 AM
I didn't like to suggest that  :-X but it is an ECI cab and if that is the reason  :drunk:

Somehow I doubt it but you never know... I'll ask friend across the road if anything has happened to his line.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 17, 2015, 09:10:51 AM
I think a resync may help ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on June 17, 2015, 01:53:41 PM
I think a resync may help ;)

Same here resync will help your speeds greatly :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 04:28:15 PM
Thanks for the comments and it's still there... I'll do a resync late tonight as it takes MDWS off the air of course so inconvenience fewer people.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 17, 2015, 05:28:05 PM

I guess Newt will advise a resync to get the extra d/l but won't be good news if it's temporary and then goes away.....

Ideas??


It's your crosstalk disturber they have turned off their modem and maybe went off on hols, it never last's to long 4 days max if your lucky.

It's not worth rebooting your FTTC modem as what you gain will be taken away from you when the disturber modem comes back on again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 05:38:04 PM
As I said at the start, the biggest single drop from the five disturbers I've seen in the past year is 1.5dB so I doubt they all unplugged at once, have to wait and see. It was my initial guess as well though and I did say it would be bad news if it came back to where it was and I had rebooted....

What it won't take away though is the improvement from ditching the Zyxel....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 17, 2015, 05:46:45 PM
As I said at the start, the biggest single drop from the five disturbers I've seen in the past year is 1.5dB so I doubt they all unplugged at once, have to wait and see. It was my initial guess as well though and I did say it would be bad news if it came back to where it was and I had rebooted....

I just what you to know in April we had wide spread power outage in April and my disturber took five days to come and hit me.

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 19, 2015, 09:15:51 AM
Well the SNRM went back down to 'normal' last night before I got round to resyncing so whatever it was has been switched on again as newt suggested. If it's a disturber then I can only think it has to be one that was present before I started keeping stats in May 2014 as no individual disturber has affected me by anywhere near ~6dB in one go. I think I was third on the cab at the time in February 2014 and at least one of the others is close to me.

The gradual loss of SNRM on reboot and loss of physical download/upload speed that was occurring with the Zyxel VMG8324 has now gone since ditching it and the line is stable and back up to speed again again since switching back to the HG612/TG582n combo on 11th June.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 19, 2015, 11:51:16 AM
DONATIONS

Thanks to those who donated in the six weeks since the 2nd May to support the site (some have donated multiple times) and they are listed below  :clap: :

AlexMUK
derekh
ip75
lf2k
longstaff
pooclah
valleysboy
vic0239

COSTS OF RUNNING THE SERVICE AND DONATIONS
As intimated a month ago, the physical costs of running/maintaining and upgrading the server are still not in any way reduced/countered by donations. So if the donations do not pick up quickly, the site will move to requesting a small one-off minimum donation and to restrict access to older data (back by a fixed number of days) to those users who have not donated. Basic access will otherwise remain free to Registered users. The code to achieve this is already in place but not yet implemented. 

Also, as of today, those Registered Users who have supported the site from its inception last year, either by monetary donation or through other support such as being admins, providing facilities, helping with publicity, assisting with testing and so on, will have recognition as MDWS Supporters by having their user names highlighted in green in the two lists of currently active users that appear at the bottom of the main page. This is something I've done in the past on other sites I've worked on that were supported by donations, notably Jag-lovers.  Might also have a separate list of donee usernames (only) available as there are a couple of donees who don't use the site much.

The process of recognising users who subsequently donate via PayPal is automated providing you either donate from the same e-mail you are Registered with or your registered name is uniquely identifiable or you add (in the PayPal comments/message facility) your user name in the form:

username:myusername

so it can be picked up (checked every 5 mins). Otherwise you'll have to wait until it can be processed manually.

Thanks for your support. There are currently 334 Registered Users.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on June 19, 2015, 01:53:33 PM
The process of recognising users who subsequently donate via PayPal is automated providing you either donate from the same e-mail you are Registered with or your registered name is uniquely identifiable or you add (in the PayPal comments/message facility) your user name in the form.

Is it possible to donate using alternative methods e.g. BTC?

Can you update your MDWS username and email address somehow?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 20, 2015, 07:57:47 AM
Is it possible to donate using alternative methods e.g. BTC?

Not currently, or ever likely,  I'm afraid.

PayPal is one of the few methods of payment that doesn't involve a merchant account at additional cost. Many people don't realise that anyone with a supported credit/debit card can use PayPal in exactly the same way as any online card processor, there is no need to register with them, just use the supplied link and then under Pay with Credit Card or Log In at the left, fill in the details in the usual way.

Can you update your MDWS username and email address somehow?

Not your user name I'm afraid. E-mail address you should be able to but there was a problem with the functionality and I haven't got round to fixing it yet. I'll try to get to it in between more urgent things. Or PM me any change and I'll do it for you and that applies to anyone.

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 20, 2015, 09:58:42 AM
CHANGE YOUR E-MAIL

This is now possible via the Options link near the bottom of the main page. Please check to make sure you receive the confirmation mail that will be sent to the new address else we cannot contact you.

This has proved a problem with several users who have been uploading invalid data for several months but have invalid e-mails and never logon to see console messages for them. No option but to suspend the accounts and eventually delete them.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on June 21, 2015, 02:26:24 PM
  It is not very significant and I have probably missed something, but I just wondered why the upstream FEC that occur on FTTC "fast" path don't show on MyDSLWebStats. 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 21, 2015, 03:07:46 PM
I've got an upstream interleave depth of 1, and small numbers of upstream FECs do show on my MDWS graph.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on June 21, 2015, 04:20:24 PM
  @roseway I see them on dslstats but nothing on MyDSLWebStats. I think you had zero on MyDSLWebStats prior to G.INP, I am on an ECI.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 22, 2015, 09:21:59 AM
Having been messing with Firefox for a while now I am logged out of this, however in order to login I need to remember my memorable phrase. Well as you can imagine it is not memorable enough and therefore I cannot login. Why do we need this extra level? Why is a password not good enough together with the question to try to eliminate auto logins?

So how do I recover my memorable phrase?

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 22, 2015, 09:27:36 AM
Having been messing with Firefox for a while now I am logged out of this, however in order to login I need to remember my memorable phrase. Well as you can imagine it is not memorable enough and therefore I cannot login. Why do we need this extra level? Why is a password not good enough together with the question to try to eliminate auto logins?

So how do I recover my memorable phrase?

Stuart

Resetting your password via the Log On page will also give the phrase to you...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 22, 2015, 09:35:38 AM
Fortunately the memorable phrase is in the sign up email so I have not had to change my password!

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 22, 2015, 04:04:58 PM
NEW! AUTOMATIC DLM CALCULATOR

Many of you will have seen or noticed discussions about the Kitz DLM Calculator where you put in your ES and Retrain counts and it tells you how good or lousy your line is from the DLM's perspective. The data is used by the BT DLM system to categorise your line...

This is now available via MyDSLWebStats and has a dedicated thread (http://forum.kitz.co.uk/index.php/topic,15623.msg290968.html#msg290968) for questions as well as a description of how it works

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fmdws-dlm-display-ex2.jpg&hash=ed75adef687e3ea8994c3ee71fbb54b7)

Edit:
Since first posted, there is now another set of Traffic Lights! These are in the center of the group and are for MTBE UPSTREAM error seconds. The original at left now reads DOWNSTREAM. Criteria are the same for both directions.

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fmdws-dlm-display-ex5.jpg&hash=b8ee9fc6d2d9c0f03fd22c3fddc2c2c6)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 04, 2015, 02:38:11 PM
Trouble with the recording of error seconds on my adsl connection again.

Ian

Update: 18:30  now fixed  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 04, 2015, 08:07:26 PM
Trouble with the recording of error seconds on my adsl connection again.
Update: 18:30  now fixed  ;D

There was a database table error around that time that had to be repaired so that was likely the problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: iMx on July 06, 2015, 09:23:23 AM
Good Morning,

I'm using a poor mans bonded FTTC setup (L2 VPNs over each FTTC line, bonded, to a box in the DC) - sadly it looks like the IPs from the dedicated hosting provider are blocked on your site.

The IP(s) I use are dedicated, is it possible to get an allow set up?  Happy to make a £30 donation for your time/service, but right now I can only access the site if I enable another VPN or drop the FTTC bond.

Thanks,

Ed

UPDATE: Oh, trying again this morning it seems your ACLs may have been refreshed since I tried last week - I seem to be able to access the site now?  Donation on its way as promised.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 10:09:31 AM
Good Morning,

I'm using a poor mans bonded FTTC setup (L2 VPNs over each FTTC line, bonded, to a box in the DC) - sadly it looks like the IPs from the dedicated hosting provider are blocked on your site.

The IP(s) I use are dedicated, is it possible to get an allow set up?  Happy to make a £30 donation for your time/service, but right now I can only access the site if I enable another VPN or drop the FTTC bond.

Thanks,

Ed

UPDATE: Oh, trying again this morning it seems your ACLs may have been refreshed since I tried last week - I seem to be able to access the site now?  Donation on its way as promised.
Hi and many thanks for the generous donation  ;D

Yes, I spotted it on the console monitor and removed the block...

I use Connectify Dispatch to software bond both the main VDSL2 and backup ADSL2+ lines here and works well using two NICs on my proxy server. Gives me another 9Meg download on top of the normal 33Meg (for the apps specified that can safely use it and don't need a fixed IP which the VDSL2 is)....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: iMx on July 06, 2015, 10:15:47 AM
Many thanks - I seem to have some problems with dslstats, giving the 'No data returned in the latest sample' error - left it running for 10 minutes or more.  This is using a TG589V3 in bridge mode (routing/NAT-ing setup so modems are accessible via telnet), can telnet from the Windows box hosting it just not from dslstats it seems.  Disabled firewalls etc in Windows.

Not really a Windows person, but will dig some more later and see if I can get things going - if not post in a more appropriate place.

EDIT: Just found a post that mentions about not supporting VDSL2 on this modem at the moment, will give MDWS a whirl if/when I decide to return to an HG612, although the TG589 does seem to give me a better sync rate on my lines.  Will probably just knock up a munin script for now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on July 06, 2015, 10:29:35 AM
Quote
EDIT: Just found a post that mentions about not supporting VDSL2 on this modem at the moment

The DSLstats pre-release version v5.5.4 adds VDSL2 support to the TG589vnV3, and also adds MDWS upload capability for Thomson/Technicolor modems. As with all Thomson/Technicolor modems, the support is limited by what data is available through its custom CLI.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 10:39:55 AM
Thanks Eric, you beat me to it....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 06, 2015, 10:57:44 AM
Ah, so your Avatar is Mike Hawthorn, not you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 11:27:26 AM
Ah, so your Avatar is Mike Hawthorn, not you :)

Er yes  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: iMx on July 06, 2015, 12:14:53 PM
Quote
EDIT: Just found a post that mentions about not supporting VDSL2 on this modem at the moment

The DSLstats pre-release version v5.5.4 adds VDSL2 support to the TG589vnV3, and also adds MDWS upload capability for Thomson/Technicolor modems. As with all Thomson/Technicolor modems, the support is limited by what data is available through its custom CLI.

Hi there,

Thanks for the reply, I also tried 5.5.4 and got the same problem - basic settings, default IP/username etc, technicolor box ticked.  Have knocked up a munin script for now, as I have 2 lines I want to monitor (although I appreciate this is probably not overly common).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 12:43:23 PM
The DSLstats pre-release version v5.5.4 adds VDSL2 support to the TG589vnV3, and also adds MDWS upload capability for Thomson/Technicolor modems. As with all Thomson/Technicolor modems, the support is limited by what data is available through its custom CLI.

NB I'm happily running 5.5.4 and MDWS with a TG582n although as Eric says, there is very limited data available...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 06, 2015, 10:30:12 PM
Is everyone's pop ups working on resynch data?

Mine seems to have stopped (Chrome on ChromeOS and Chrome on Windows)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 07, 2015, 09:37:04 AM
Is everyone's pop ups working on resynch data?
Mine seems to have stopped (Chrome on ChromeOS and Chrome on Windows)

I've got a feeling that didn't work originally under any Chrome based Windows browsers (Chrome/Safari/Opera) hence the statement 'most browsers will display a tooltip' that shows as a tooltip in Chrome (here anyway) when you hover over the adjacent Info icon.

Had a look around and the tooltips (they are not PopUps) are okay on IE11 and latest FireFox under Win 7 and 8.1 - the code is identical for all browsers and hasn't changed since introduced...

Edit
This has in fact been reported as a bug in the latest versions of Chrome from May 22nd. It appears an earlier fix didn't. If really interested you can wade though this lot:

https://code.google.com/p/chromium/issues/detail?id=491223

Last entry on July 1st is:

Still a problem with 43.0.23157.130 m. I really hope this gets fixed soon, we have customers who rely on these tooltips for configuration of the products we sell. Anybody heard of any workarounds for this until it's fixed??

It has happened before and may have been a problem when I set it up originally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 07, 2015, 09:40:43 PM
Tony
Thanks for the info, the tooltips were working some time ago....never mind the devs may fix it sometime.
Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 10, 2015, 10:16:20 AM
SERVER DOWNTIME

The MDWS server will be down with no web access at all early on Sunday morning 12th July while some database maintenance along with a few other jobs take place. Expected to take up to an hour or more. It's been up currently for 29 days.

I'll post again once it's online.

As always, you need to check your upload client has reconnected okay afterwards. While restarting you may receive duplicate upload error mails and these can be ignored.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on July 10, 2015, 12:44:26 PM
Do you keep track of users IP addresses in MDWS?

Are there any plans to add more graphs and dlm monitor to the mobile interface?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 10, 2015, 04:59:34 PM
The IP Address is available if needed as it's returned and logged to the server with every access to the site both by upload and the GUI as happens with all web sites... 

Haven't looked at the Mobile Interface since it was written but a Traffic Light set would be a possibility. I do use it regularly myself though when out and about.

At the moment I'm trying to finish off V2.0 of the MDWS Web UI which revamps the layout completely to make more use of available space with different sized and wider graphs available plus a number of other new features and options. The current interface will still be available as an option though.

NB: you can see your current Web GUI IP Address at the top of the Options facility.

And it's a year since the first users started testing the MDWS system concept.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 10, 2015, 06:00:59 PM
Happy Birthday MDWS  :congrats:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 12, 2015, 08:46:26 AM
MDWS SERVER RUNNING AGAIN

Back up at 07:55. I think all clients have reconnected but worth checking.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2015, 09:13:20 AM
just checked wow still no g.inp for newt.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 12, 2015, 10:43:54 AM
just checked wow still no g.inp for newt.

I think he needs to visit his Cab and make offerings of some sort to appease the all powerful deity that resides in it  :cool: Pref do it when there is no one about though  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 12, 2015, 12:26:36 PM
I'll give it thump like we did on old valve tele's  ::)

Those DLM indicators are very handy it has given me a better understanding why my line never got moved onto the so called fastpath it's allways hovering between Green and Amber.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jaggies on July 12, 2015, 01:42:52 PM
I don't know if it's just my ageing eyes, or if I am misunderstanding the purpose of the traffic light icons, but they all appear to be the same colour to me...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on July 12, 2015, 01:45:23 PM
I don't know if it's just my ageing eyes, or if I am misunderstanding the purpose of the traffic light icons, but they all appear to be the same colour to me...

they are for you, which means your line is near enough to perfect.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2015, 04:42:42 PM
what threshold is used for amber on stable?

I think ideally the threshold's used should display in the tooltip or on a help page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 12, 2015, 04:47:25 PM
what threshold is used for amber on stable?

I think ideally the threshold's thresholds used should display in the tooltip or on a help page.

Look back  - I posted the figures for Newt, might be another thread though. The Mk2 interface will give more detail. That's when I get time to finish it.

Here you go:
mtbe-vdsl-speed-red <= 30
mtbe-vdsl-speed-amber > 30 <= 299
mtbe-vdsl-speed-green >= 300

mtbe-vdsl-standard-red <= 60
mtbe-vdsl-standard-amber > 60 <= 599
mtbe-vdsl-standard-green >= 600

mtbe-vdsl-stable-red <= 120
mtbe-vdsl-stable-amber > 120  <= 1199
mtbe-vdsl-stable-green >= 1200

That's time between errors in seconds over a day (86400s). To get the Errored Secs count, divide 86400 by the MTBE figure above and vice versa. Amber = no action  AFAIAA

I think that's correct. The Chablis is having an effect  :'(

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2015, 05:03:43 PM
ok thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 12, 2015, 06:25:17 PM
Amber = no action  AFAIAA

Thats correct but it also means the users line will not get a DLM retrain for example moved to a lower interleave depth your line will need full greens for this to happen.

@Chry the location of info you need is http://forum.kitz.co.uk/index.php/topic,15623.15.html (http://forum.kitz.co.uk/index.php/topic,15623.15.html)
Reply 19
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 13, 2015, 04:48:03 AM
I would assume then amber for stable is 360 and green is 180?

curious why I have amber with under 180 ES.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2015, 06:08:32 AM
I would assume then amber for stable is 360 and green is 180?

curious why I have amber with under 180 ES.

Look back three posts I put the figures there yesterday..

mtbe-vdsl-stable-red <= 120
mtbe-vdsl-stable-amber > 120  <= 1199
mtbe-vdsl-stable-green >= 1200

So Stable is then Red > 720 ES and Green < 72 ES so Amber is anything in between

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 13, 2015, 07:42:35 AM
sorry again for missing that post, thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on July 13, 2015, 07:51:27 PM
Hi Just joined Kitz. I am trying to upload my stats but keep getting this error any ideas "Unable to upload MyDSLWebStats data (file "upload14.exe" missing)"
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2015, 09:07:09 PM
Hi Just joined Kitz. I am trying to upload my stats but keep getting this error any ideas "Unable to upload MyDSLWebStats data (file "upload14.exe" missing)"

Looks like you solved this a few minutes after posting  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on July 13, 2015, 09:14:28 PM
Thanks for the reply . Yeah it is logging now does everything look ok
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2015, 09:40:19 PM
Thanks for the reply . Yeah it is logging now does everything look ok

Need to leave it to run for 24 hours to get a good idea. The line looks very, very noisy though as very high (just short of a million consistently) Forward Error Correction (FEC) counts but this is doing a good job as CRC Errors are very low.

But no interleaving applied. Is this a new line and are you capped at 40Mb download?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on July 13, 2015, 10:49:28 PM
Yeah on Infinity 1 so capped at 40. No its not a new install been in nearly two years. The only thing I have noticed is upload will not go above 6MB. Before xmas used to be between 7MB and 8MB
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 17, 2015, 12:24:50 PM
Tony,  I was just looking at erics stats after his post here (http://forum.kitz.co.uk/index.php/topic,15753.msg293142.html#msg293142).
One thing I noticed when I looked at his Err Secs on MDWS is that there wasnt a total for the up stats. 

Bearing in mind that the DLM treat the upstream and downstream count independently, we should be aware that it is possible for DLM to apply 'old fashioned' INP and interleaving based on upstream performance.    Ive had this occur on my line a couple of times based purely on the upstream E/S.   
Now that we have G.INP and Mk2 will still be using INP based Error protection based on upstream performance, it may perhaps be an idea if possible to also show an upstream E/S day count?    G.INP Mk2 should practically remove most of the Downstream E/S so its possible that some lines may still have DLM intervention based purely upon the upstream E/S count.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 17, 2015, 05:34:34 PM
The Traffic Light system has the U/S ES correct. I'll look at it when I can on the graph but problems with the house are taking my time currently...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 18, 2015, 08:22:53 AM
Kitz

Okay, US ES Total Count is now added and working hopefully  :)

US plot if it exists is black and attached is roseway's wonderful example  :-X It may start looking cluttered on busier graphs though. Colour could be changed if it causes any problem but black seems to stand out :fingers:

I don't know if you all realise but if you hover over the colour legend squares under the graphs, it will highlight the plot for the one you are hovering over to aid finding it. If you click on the square it will outline it (needs a refresh to get rid of it) but not always clearly. This won't work on the attachment though  ;)

I should add that the ES graphs in particular are only accurate if you have a full 24Hr connection, otherwise they are going to read low and may not show what is really happening.

NB FWIW (another thread but can't find it) the All Users table currently shows two users with G.INP enabled and a US INP count > 0 (40+) but they may not have been reset to zero in the first place?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 18, 2015, 11:37:27 AM
Quote
US plot if it exists is black and attached is roseway's wonderful example

That is brilliant thank you.  It occurred to me that with the advent of g.inp on downstream, more lines should now see far less (downstream) Err/Secs, so in future the upstream E/S could become a bit more important when it comes to changes to the DLM.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 18, 2015, 11:59:40 AM
By the way I'd just like to say thank you for this service. It is proving invaluable in tracking down my (still unresolved) fault :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 18, 2015, 11:28:05 PM
Have wanted to see my 24 hour US errored seconds in a graph like the DS E/S and he has done it excellent work Tony.

Now to find away to stop people ringing my phone that would stop most of the upstream errors but they are not that bad after seeing the graph  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 19, 2015, 07:25:57 AM
Port your phone number to VOIP
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 19, 2015, 06:52:06 PM
Port your phone number to VOIP

Could you make a list of what's needed for this VOIP and i'll look into it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: michty_me on July 24, 2015, 01:21:36 PM
Hi folks,

Lokking for a bit of assistance in setting this up.

I joined mydslwebstats a few weeks back but didn't have any data going to it due to using an Asus DSL modem.
I now have a Netgear D7000 and would like to set it up. I'm running DSL stats V5.5.

I've logged in to MDWS and my username has gone. I remember seeing something that said if no data is received within so many hours, Your name is removed from the list until data is received for X amount of time. How do I go about sending my data to it? I've got an upload key but not sure what to do with it. Any help would be appreciated.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 24, 2015, 03:26:54 PM
You need to be running DSLstats or HG612-modem-stats to capture the stats from your modem then that app uploads them to MDWS. You can enter the key you received into the app.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: michty_me on July 24, 2015, 05:13:38 PM
I'm currently running DSLstats V5.5. I must of missed where you get the app. Can you point me in the direction of it please. Is it mobile app only?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 24, 2015, 05:18:24 PM
I'm currently running DSLstats V5.5. I must of missed where you get the app. Can you point me in the direction of it please. Is it mobile app only?

You sound a bit lost  :(

The DSLstats version you have up and running is fine and that's what you need. You have a username and key for MDWS.

So go to the Configuration tab on the top line and find the MyDSLWebStats tab underneath it. Fill it in and hopefully it will work first time. You haven't uploaded anything in the past.

Only just spotted this as it's in the wrong thread for support - BE1 can you move it please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: michty_me on July 24, 2015, 05:21:44 PM
Ah got it now. I was looking on the mydslwebstats website.

I was very lost.

Entered everything and clicked Check and it now stats checked OK. Thank you very much.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on July 24, 2015, 06:08:43 PM
Does anyone who has donated know if just your email is exposed or if your full postal address is also included?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 24, 2015, 06:34:28 PM
Does anyone who has donated know if just your email is exposed or if your full postal address is also included?  Thanks

I never see a postal address, just the e-mail registered with PayPal. So please feel free to donate :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 28, 2015, 10:02:09 PM
Tony

It's me again.....on 24 hour graphs when I click on the titles of the graphs to see a larger graph (on dates earlier this month 23 July) i am getting graphs with no data displayed.

Also problem selecting a range (select range 21 - 22 July)

see screenies
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 28, 2015, 11:56:39 PM
Tony
It's me again.....on 24 hour graphs when I click on the titles of the graphs to see a larger graph (on dates earlier this month 23 July) i am getting graphs with no data displayed.
Also problem selecting a range (select range 21 - 22 July)

That's an unintended side effect from a database table change made a few days ago....

The 24Hr graph PopUps are now working okay but the Range will take a little longer to sort out...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 29, 2015, 08:32:53 AM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 29, 2015, 08:50:49 AM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?

I can't immediately see any problem from here... Tried several browsers on diff terminals and correctly selected date comes up and popups are also for the correct date.

When you change the date can you see the activity cursor rotating on a tab? If not you could have a JavaScript implementation problem that is stopping the change being detected. The only other problem I can remember is that Safari on a Mac (used to have one but gave up on it) doesn't work (along with a lot of other things in Safari).

Edit:
It appears you are using a Mac and Safari. I've modded this so that if it detects a Mac, it will add in a manual refresh button just after the dropdown list plus some hover notes... Let me know if it works for you please.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 29, 2015, 09:28:30 AM
If you are having problems with latency and slow responses at the moment on MDWS then there is a major wide area BT network problem currently.

See HERE (http://forum.kitz.co.uk/index.php?topic=15831.msg294807#msg294807).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 29, 2015, 08:35:29 PM
Quote
The 24Hr graph PopUps are now working okay

Thanks very much
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 04:25:58 PM
Also problem selecting a range (select range 21 - 22 July)

That's now fixed as well  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 30, 2015, 04:36:17 PM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?

I can't immediately see any problem from here... Tried several browsers on diff terminals and correctly selected date comes up and popups are also for the correct date.

When you change the date can you see the activity cursor rotating on a tab? If not you could have a JavaScript implementation problem that is stopping the change being detected. The only other problem I can remember is that Safari on a Mac (used to have one but gave up on it) doesn't work (along with a lot of other things in Safari).

Edit:
It appears you are using a Mac and Safari. I've modded this so that if it detects a Mac, it will add in a manual refresh button just after the dropdown list plus some hover notes... Let me know if it works for you please.

Maybe I'm doing this wrong.

I've got "Current" selected in Date Options. Selecting a date from "Resync Data..." and then clicking "Refresh" doesn't do anything to the graph?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 04:46:15 PM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?

I can't immediately see any problem from here... Tried several browsers on diff terminals and correctly selected date comes up and popups are also for the correct date.

When you change the date can you see the activity cursor rotating on a tab? If not you could have a JavaScript implementation problem that is stopping the change being detected. The only other problem I can remember is that Safari on a Mac (used to have one but gave up on it) doesn't work (along with a lot of other things in Safari).

Edit:
It appears you are using a Mac and Safari. I've modded this so that if it detects a Mac, it will add in a manual refresh button just after the dropdown list plus some hover notes... Let me know if it works for you please.

Maybe I'm doing this wrong.

I've got "Current" selected in Date Options. Selecting a date from "Resync Data..." and then clicking "Refresh" doesn't do anything to the graph?

???  :-\ The Resync data list box for some graphs doesn't do anything and never has done, it's just for info.

I thought you were trying to use the 24Hr graph options list box that didn't refresh which is where I made the change?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 30, 2015, 04:48:19 PM
Why does it have an "Update" button under it then? It's a bit confusing :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 04:54:27 PM
Why does it have an "Update" button under it then? It's a bit confusing :)

That's always been there since last September and refers to the Control Box in general for the options that do need manually updating.

NB: have you tried hovering over the Info icon next to it, that does explain it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 30, 2015, 05:01:02 PM
Sorry I got confused - I won't trouble you again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 05:06:28 PM
That's okay  ;) I've modded the hover help on the listbox to make it clearer if anyone else has the same problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 31, 2015, 08:13:04 AM
Also problem selecting a range (select range 21 - 22 July)

That's now fixed as well  :)

Cheers Tony........


One other thing....my ISP seems to be visible (either just to me or publicly) and I have enable "Hide ISP from public view"


Ian (myadsl)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 31, 2015, 10:49:40 AM
Yes, they are all visible now. Had a word with a few others and no one could see any reason at all to hide them... I can put in something to reverse what that option does currently later if it really worries you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 31, 2015, 06:50:17 PM
Tony - am I being really stupid because I cant find the options link?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 31, 2015, 06:52:41 PM
Tony - am I being really stupid because I cant find the options link?

Yes I'm stupid and yes I need to go to spec savers!  :doh:   

(It was greyed out and my eyes must have skipped over it about 100 times :/)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 31, 2015, 07:18:05 PM
Followed hyperlinks could maybe do with a different colour :)

See attachment

Quote
if it really worries you

Does not worry me...but if an option is there I would like it to work as expected.

Thanks again
Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 31, 2015, 08:44:13 PM
Followed hyperlinks could maybe do with a different colour :)
Does not worry me...but if an option is there I would like it to work as expected.
Ian
Link :visited colour is now Maroon and there is no ISP option any more  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 10, 2015, 02:07:48 PM
A quick question...

Is there any way to upload the stats from my HG612 via a headless linux box? The only system I have that is on 24/7 doesn't run any GUI, and is CLI only, and DSLStats will not run on that setup.


Andy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 12:23:50 AM
yeah we need a linux tool for this as I would love to move my stats monitoring to my router.

I am considering making a shell script for the task.  But would probably need help of tony and co to add all features such as stats uploading.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 12:30:53 AM
I'd also be interested in this Chrysalis.

I'd love for my OpenWRT router to do the stats monitoring.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 11, 2015, 07:32:38 AM
I'd also be interested in this Chrysalis..

I think a lightweight script/app that purely handled collection and upload but with no local graphs etc would be great. If it were bundled as a Synology package that would make me even happier - I might even have a go at doing that side of it myself if somebody else worked on the script itself.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 11, 2015, 07:47:43 AM
I don't think there's any possibility of MDWS upload capability being incorporated in custom router firmware. A simple alternative is to use DSLstats on a Raspberry Pi. This uses tiny amounts of power, so 24/7 running shouldn't be an issue.

For security reasons, the details of how to upload data to MDWS are restricted to a very small circle of people.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 08:16:53 AM
I am talking about a script roseway, linux based routers have bash awk, curl etc. as tools to collect and process stats.  Crontab a built in function of linux is the linux version of task scheduler.

The limitation would be storage, so the log would have to be cycled/archived to keep space usage down and I would probably want to work with ronski or yourself to add support into the gui apps so those apps are a frontend with the router as a backend.

So e.g. the gui would connect to the router, ask for the stats and then display them.  It could also possibly download the log from the router and generate graphs. The router would handle the automated 24/7 data collection as well as uploading the data to MDWS.

For someone like myself, adding extra devices isnt a solution, using my pc is adequate, but the preference is using the router which is entirely logical given its an always on low powered device anyway.

To give you an idea how capable linux based routers are?

My router currently does the following tasks.

1 - Selective routing on demand VPN endpoint.
2 - Downloads malware url's, tracker url's and adds the hostnames to my dns cache which is hosted by the router.
3 - I have a proxy on the router which the dns cache may forward requests to for filtering (abit like how IWF filtering works).
4 - QoS of my traffic both directions.

Linux based routers are also commonly used for purposes such as a torrent client, NAS and other types of network hub tasks.

I think you have massively under estimated the capability of a linux based router.

I can already think of personal advantages to myself.

e.g. when I watch games on nbc sports I set my clock to the eastern us time on my pc which upsets MDWS uploads, however if my router was handling those uploads, it would be a complete non issue.

I am motivated enough now I can probably have a script made to collect all the stats within an hour of work as well as log in the same format already used by bald eagle so the log would be compatible with the graph creator, the hard bit is the uploading of data and interfacing with a gui.

So the real barriers are really.

1 - Is tony ok with a script that can upload been open source? he may have reservations against that.
2 - Will yourself or ronski be ok with updating your gui's to work as a frontend (optional feature) against a linux cli lan based backend.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 11, 2015, 09:22:02 AM
So the real barriers are really.
1 - Is tony ok with a script that can upload been being open source? he may have reservations against that.

First. you may want to choose your words much more carefully when ranting on about someone.

I think you are, and I use a mild word here, being very 'rude' to roseway about his knowledge of Linux and its capabilities. I'll leave it at that.

And may have reservations?  :o :lol: :no: It's never going to happen. 100% no way if that's clear enough for you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 09:46:53 AM
am I ranting tony?  I should know if I was and I wasnt.

Roseway clearly did misunderstand given he is talking about altering a router firmware which isnt at all required on a linux based firmware.  The advantage of linux based firmware's been you have basically a portable version of linux and a package system in the form of entware.

Sadly tho you have pulled the plug on opensource, I had a feeling you wouldnt like the idea hence I mentioned it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 09:54:54 AM
Well I just did a bit of digging on the PI you reccomend.

It's a linux device in itself.  So Clearly it is possible to have a linux based tool for this, the tool used on the PI would work on a linux based router providing the necessary dependencies are installed.

Is the PI version of dslstats written in python?  Regardless of what language its written in, basically the change needed would just be to remove the GUI elements, so the configuration would be in ini files, and it would just collect process the data, then it would work fine on any linux based router.

Since  opensource wont be accepted by tony, the answer to this is down to if eric has any motivation to do this, given many more people will have linux based router's than a uncommon raspberry device tho I would like to think there is merit to this request.

Three people in this thread alone proves the demand.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 11, 2015, 10:08:34 AM
Is the PI version of dslstats written in python?  Regardless of what language its written in, basically the change needed would just be to remove the GUI elements, so the configuration would be in ini files, and it would just collect process the data, then it would work fine on any linux based router.

It also opens up the scope to run it on other simple linux based devices, as not all of us have open source routers - Many NAS devices would fit the bill for example as these are generally left on 24/7.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 10:13:32 AM
well yeah it can effectively run on any linux device, the showstopper here for linux based routers is the gui element.  As routers dont have normal gui frontends in place.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:15:11 AM
I'm very much out of my depth here, but surely when DSLStats is running on RPi it's essentially headless? I can't see why there is a showstopper.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 11, 2015, 10:18:25 AM
I'm very much out of my depth here, but surely when DSLStats is running on RPi it's essentially headless? I can't see why there is a showstopper.

The issue is that the existing Linux/Ras Pi version relies on there being a GUI and will not run without those capabilities. Routers/Nas devices etc do not have any GUI
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:20:14 AM
So you just have to run a VNC server on your headless box?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 10:27:07 AM
Dray does a PI have a UI or is it cli only?

I assumed it has given there is even windows 10 on it now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:30:40 AM
Dunno sorry. A poster on here gave me some instructions for running DSLStats on a RPi, which included running a VNC server so I'm guessing that handles the display for X11.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 10:37:10 AM
forget what I said, seems you maybe right on VNC I didnt know that created a virtual X environment.

I still think it wont work but I may give it a go on a spare asuswrt router I got.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:53:39 AM
I think you're probably right about it not working on a router, but it's maybe the simplest solution for RPi and headless servers rather than rewriting DSLStats to an MVC pattern.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 11, 2015, 11:05:23 AM
@chrysalis: I didn't misunderstand at all. My wording may not have been precise, but the answer I gave is still the only realistic answer at present.

@Dray: once DSLstats is set up on the RPi with a VNC server (or equivalent) it can be run without a monitor, keyboard or mouse connected, and all access to it being via VNC. The RPi would of course still be running in GUI mode. It uses one of the lightweight Linux desktop systems.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 11:10:39 AM
If eric says he wont do it.  Then an idea I got is masking the script to collect the stats.
I will then have it write to a logfile in the same format as bald eagle's scripts.
I will then see if ronski (or eric) can make their app's able to import these logs for uploading to MDWS.  So uploads can still happen but wouldnt be live updates.

Or another idea is to mount a windows filesystem using CIFS on the router, the script will check for its existance, and if it exists it copies the log there.  Then could have bald eagle's tool treat that as a locally generated log and upload it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 11:12:18 AM
Ok thanks for your reply eric.

So is as I expected it works on the RI because it has a local GUI installed on it.

The question is do you think its possible for you to have the time make a cutdown version of your linux tool, where none of the GUI features exist, it just runs in a cli mode to collect stats and upload them?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 11, 2015, 11:27:12 AM
Quote
The question is do you think its possible for you to have the time make a cutdown version of your linux tool, where none of the GUI features exist, it just runs in a cli mode to collect stats and upload them?

It's a possibility, but please don't press me for a timescale. I had a little health scare earlier this year, and as a result I've had to reduce the amount of time I spend in front of the PC. I will take a look at it and see what's involved.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 04:53:36 PM
I'll stick to the trusty RPi B+ with DsLstats running it's 100% stable with zero maintenance that embedding software into router sounds like hard work and extra processing for the routers CPU.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 11, 2015, 06:47:38 PM
I will then see if ronski (or eric) can make their app's able to import these logs for uploading to MDWS.  So uploads can still happen but wouldn't be live updates.

You can't bulk upload stats, if the server receives more than one set (one minutes worth) a minute then it rejects the subsequent sets, send too many and you get a warning, keep on doing so and you get a ban. Just for the record I have no idea how to upload the stats.

Personally I can't see the problem with running a Raspberry PI, they are very cheap to buy and run, really what's the problem with one more tiny box?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 07:47:29 PM
How much space would DSLstats require on a RPI?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 11, 2015, 07:57:54 PM
How much space would DSLstats require on a RPI?

the program itself not a lot, but depending on how long you keep the stats they can build up over time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 08:09:32 PM
See this is why I keep using my laptop as it has essentially unlimited hard drive space...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 09:16:01 PM
See this is why I keep using my laptop as it has essentially unlimited hard drive space...

You just purchase a larger SD card for the RPi just like you purchase a larger capacity HD but i think 32GB is the max you can use on the RPi not sure about that.

But you can connect a usb hard drive to it.

This is the 32GB SD card memory

Code: [Select]
pi@raspberrypi ~ $ df -h
Filesystem      Size  Used Avail Use% Mounted on
rootfs           29G  2.9G   25G  11% /
/dev/root        29G  2.9G   25G  11% /
devtmpfs        214M     0  214M   0% /dev
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 09:51:02 PM
You just purchase a larger SD card for the RPi just like you purchase a larger capacity HD but i think 32GB is the max you can use on the RPi not sure about that.
Plenty of 128GB cards work http://elinux.org/RPi_SD_cards
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 10:01:43 PM
Plenty of 128GB cards work http://elinux.org/RPi_SD_cards

Thats even better Dray i just use the 32GB SD card for DSLstats and have plenty of room left after 1 year of stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 11:17:17 PM
and how much do 32 gig cards cost?

its alright just saying its one more little device, but if I brought "one more" device for every computing task, the house would be filled with them :p

But anyway thanks eric, there be no rushing you, if its done its done, if its not done so be it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 11:19:06 PM
It's just occured to me that I could power the Raspberry Pi off the router's USB port...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 11:51:49 PM
and how much do 32 gig cards cost?

My RPi came with 8GB noobs and purchased a 32GB card for £14.99 on amazon you will need to expand the file system for it to recognize the extra memory on larger card.

Don't go for the cheap stuff make sure the ram ratings match the spec.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on August 13, 2015, 06:06:26 PM
Can somebody email me my Licence key please I have deleted the email by accident
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 23, 2015, 12:00:26 AM
SERVER RESTART

This commenced at 23:43 and completed at 23:50 this evening.

Web users will have been thrown off but uploads should reconnect okay but you may want to check.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on August 23, 2015, 05:45:03 PM
Hi Tony

Last night we had thunderstorms, and MDWS was really interesting to watch the CRC and ES build. I made me think, now you have the traffic lights (which are great), with out a massive amount of code, could an option be possible to send an email if the ES exceeded a certain figure. I was thinking if it got near 2880, and I knew about it I would power off the modem until the interference had gone. I know thunderstorms may be classed by the DLM as wide area events....but I trust your software more than the DLM

Best

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 07, 2015, 09:15:42 AM
Time for a stupid question...  :-[

Where do I enter the ISP details? I have looked in the config but for the life of me I cannot see it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 09:50:09 AM
Time for a stupid question...  :-[

Where do I enter the ISP details? I have looked in the config but for the life of me I cannot see it.

That's 'cos it's not there  ::)

It's looked up for you automatically from your IP address...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 07, 2015, 10:02:24 AM
Ah.. I see... it's not there though. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 10:12:44 AM
Ah.. I see... it's not there though. :)

 ??? What isn't where? Do you know where it should be?

See attachment
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 07, 2015, 10:16:04 AM
I guess he means his ISP isn't shown.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 10:46:31 AM
Ah.. I see... it's not there though. :)

If you had said where you were looking which wasn't where I assumed you were....  :-\

You should be able to see it now along with all the other missing ones. (He's using the full page UserStats listing with everyone on it....). This was revised recently but that detail got missed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 07, 2015, 02:18:14 PM
Sorry Tony, at that moment I was getting multiple inputs from SWMBO and phones and email's pinging, so I posted it before I had really finished composing it. I had to be out of the door rapidly too so forgive me for being a little obtuse.

However, you managed to work it out, all is now well with the world!

P.S. Would be nice to see what the hardware was for each user, but I realise that could be a bit of a nightmare.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 02:22:28 PM
P.S. Would be nice to see what the hardware was for each user, but I realise that could be a bit of a nightmare.

That is coming.... If you go to the Options link then you can select your upload modem or modem/router but it isn't displayed yet as it's part of V2.0 in the future....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 09, 2015, 03:54:59 PM

That is coming.... If you go to the Options link then you can select your upload modem or modem/router but it isn't displayed yet as it's part of V2.0 in the future....

I see it. No Netgear D7000 in there yet. :)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 09, 2015, 04:14:31 PM

That is coming.... If you go to the Options link then you can select your upload modem or modem/router but it isn't displayed yet as it's part of V2.0 in the future....

I see it. No Netgear D7000 in there yet. :)

I assume that's what you are using? It isn't in the DSLstats compatibility list though.... And Eric has this note against the list:
Netgear models are no longer supported. They may work, but I don't have the resources to diagnose problems with them.

I have added it to the list though  - for now unless any objections are posted  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: LaurieR on September 10, 2015, 01:05:12 PM
MDWS Updates


...  View Image/Save still won't work with FireFox/Waterfox

It doesn't work with Edge (Windows 10 browser) either. It says "Thatís odd... Microsoft Edge canít find this page. Something on this page needs an app that isnít installed." 

It works fine with Chrome.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 10, 2015, 02:49:23 PM
Nothing I can do about it I'm afraid, someone else wrote the utility and hasn't got round to updating it. I'll block it for Edge although I have no access to it here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: renluop on September 12, 2015, 01:00:52 PM
Before I embarrass my self further, which is only too easy, may I ask if, suitable for ADSL with Billion 8800NL router; recommended recording interval?

What is purpose of memorable phrase?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Stroller on September 13, 2015, 06:45:07 PM
Hi Tony,

Any chance (when you get a moment) to add the ZyXEL VMG8924-B10A to the modem dropdown list under the MDWS 'Options link', please.

Rgds,

Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on September 13, 2015, 07:15:44 PM
I think it would be nice if you could disable upstream/downstream and only show one of them if desired.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2015, 07:15:21 AM
I think it would be nice if you could disable upstream/downstream and only show one of them if desired.

I'll add it to the list but a long way down currently...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2015, 07:15:43 AM
Hi Tony,

Any chance (when you get a moment) to add the ZyXEL VMG8924-B10A to the modem dropdown list under the MDWS 'Options link', please.

Rgds,

Chris

Done  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: renluop on September 14, 2015, 11:46:01 AM
Before I embarrass my self further, which is only too easy, may I ask if, suitable for ADSL with Billion 8800NL router; recommended recording interval?

What is purpose of memorable phrase?
Just the bold part, please! :)
I had thought it was to help remember password, but with having to use a symbol such as $, I am confused how one could construct a phrase. Anyhow aren't strong passwords meant not to include easily broken text?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2015, 12:12:01 PM
What is purpose of memorable phrase?

It has a specific purpose and shouldn't be related to the password. You would only need it when logging on for the first time or when  changing your e-mail or password. I'll leave it at that  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Stroller on September 14, 2015, 07:50:19 PM
Hi Tony,

Any chance (when you get a moment) to add the ZyXEL VMG8924-B10A to the modem dropdown list under the MDWS 'Options link', please.

Rgds,

Chris

Done  :)

Many thanks, Tony. Much appreciated. :hat:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2015, 12:24:10 PM
MDWS SERVER DOWNTIME and INTERFACE UPGRADE TO V2.0

The MDWS server will be down for a period from 07:00 on Sunday 20th September (this might change) for software and hardware upgrades and for a change to V2.0 of the user interface. How long it will be unavailable for isn't known at the moment but it is likely to be for at least three or four hours. Watch this space for a notification of service resumption! Uploads should resume automatically well ahead of the Web server User Interface being available again.

SUPPORTERS/DONATIONS CHANGES
As already mentioned as a possibility several times over the past few months, the big change is that only users who have supported the site by at least a minimum Donation will have access to the majority of the new facilities summarised below for V2.0. 

Additionally only Supporters will have access to uploaded data globally beyond the most recent consecutive 5 (FIVE) days (this only affects data access, there are no deletions for uploaders past those already in effect and well documented). Summary Data is currently available for one year maximum if you have been on the system that long and upload near continuously.

These changes still allow all users wanting to have remote diagnosis of their current stats from the resident Stats pundits  - or just to browse - to use the system as normal for recent data over the last 5 days.

It's hoped that this change will eventually allow the MDWS facility to continue to be run and maintained without there being an overall system cost deficit and enable upgrades when required.

INTERFACE CHANGES
All the extras summarised below are only available to Supporters. The 'old' pre V2.0 system will still be available to everyone if preferred but many of the changes below will be unavailable and the 5 days still applies where appropriate.

GRAPH CHANGES
Graphs are now optionally wider for Supporters and available in six different heights from very small to very large (130 to 650px - the current size is 264px). The Control Box now sits above the graph rather than at the side and this makes much better use of available space and works more consistently between browsers.  The Status Bar can be hidden if wanted to maximise the vertical space available for multiple graphs. The facilities available are much as they were before with just a few additions. See attachment.

FAILED UPLOAD MONITOR
You can now monitor your data uploads  and be notified by e-mail if they stop for some reason. The period before this happens and the frequency at which you receive mail are configurable. You can also elect to receive another mail when uploads resume. This facility isn't really suitable for those who only upload  sporadically,

ENHANCED DLM GADGET
There is an enhanced DLM gadget that gives a lot more information than the current small traffic lights by using a popup window. Available for FTTC connections only. See attachment. It's only accurate for 24 hour continuous uploads and will estimate for less.

MODEM/ROUTER DISPLAY
Users can now have their modem/router displayed along with each graph to aid remote diagnosis. While we sometimes manage the impossible, this was much more difficult and so you have to manually select the correct one from a list! This is already available via the current Options menu but not yet displayed on the graphs until the upgrade.

LATENCY MONITOR
Those who have one of the Latency monitors set up can now elect to have it publicly displayed on the Status Bar at its far right as a thumbnail above a graph with the full size graph also available as a popup (see attachment).  Again, this is available as an Option currently but not displayed yet.


There still hasn't been time to update the Help system unfortunately but I'll post a more detailed guide to the changes here in a few days time and confirm the downtime.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on September 17, 2015, 12:43:40 PM
Nothing like new active development to remind me to donate. What is the preferred minimum donation?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: myusername on September 17, 2015, 12:59:10 PM
Hello,

I signed up for mydslwebstats a few days ago and have noticed in my firewall logs that the web server is trying to initiate connections on port 143 (NetBEUI)with alarming regularity. Could someone investigate and see what's going on please?

Firewall logs (sanity checked and a small sample) below.

Thanks.

Code: [Select]
33 2015 Sep 17 12:30:07 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
34 2015 Sep 17 12:30:05 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0x80 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
36 2015 Sep 17 12:29:08 Attack warn last message repeated 1 times in 1 seconds
37 2015 Sep 17 12:29:07 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
38 2015 Sep 17 12:29:05 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0x80 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
40 2015 Sep 17 12:28:36 Attack warn last message repeated 19 times in 29 seconds
41 2015 Sep 17 12:28:07 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
42 2015 Sep 17 12:28:02 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
44 2015 Sep 17 12:28:00 Attack warn last message repeated 2 times in 8 seconds
45 2015 Sep 17 12:27:52 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
46 2015 Sep 17 12:27:50 Account warn last message repeated 1 times in 0 seconds
48 2015 Sep 17 12:27:50 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on September 17, 2015, 01:07:41 PM
Isn't port 143 for IMAP ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: myusername on September 17, 2015, 01:12:49 PM
It is, No idea where my brain was when i typed 143 :D destprt is 137 which actually is NetBEUI as in the logs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on September 17, 2015, 01:13:23 PM
Nothing like new active development to remind me to donate. What is the preferred minimum donation?  Thanks

I have just donated and think the prefered minimum is £10
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2015, 04:07:38 PM
Hello,

I signed up for mydslwebstats a few days ago and have noticed in my firewall logs that the web server is trying to initiate connections on port 143 137 (NetBEUI)with alarming regularity. Could someone investigate and see what's going on please?

Firewall logs (sanity checked and a small sample) below.

Thanks.


It's a Windows based server and the reason you see it is because Windows is trying to resolve the remote host via NetBIOS (on Port 137)  name as well as with DNS. Perfectly normal and is the default setup on a card although I can see your concern, it does look a bit frequent... I'll disable it on the NIC and see what happens, hopefully nothing untoward (now done).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2015, 04:08:52 PM
Nothing like new active development to remind me to donate. What is the preferred minimum donation?  Thanks

I have just donated and think the prefered minimum is £10

Yes, there's a link at top left of page but don't let that hold you back  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 17, 2015, 05:20:20 PM
guess its time for me to stick that hg612 on ebay which I said i would send some of the proceeds to MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: myusername on September 17, 2015, 05:24:45 PM
Hello,

I signed up for mydslwebstats a few days ago and have noticed in my firewall logs that the web server is trying to initiate connections on port 143 137 (NetBEUI)with alarming regularity. Could someone investigate and see what's going on please?

Firewall logs (sanity checked and a small sample) below.

Thanks.


It's a Windows based server and the reason you see it is because Windows is trying to resolve the remote host via NetBIOS (on Port 137)  name as well as with DNS. Perfectly normal and is the default setup on a card although I can see your concern, it does look a bit frequent... I'll disable it on the NIC and see what happens, hopefully nothing untoward (now done).
Hi, thanks for taking swift action, but this is far from normal. There's a whole discussion to be had about how serious NetBIOS over the internet is, but it'll suffice to post these links explaining. Source: I'm a network security engineer for a blue chip company.

https://www.grc.com/port_137.htm
https://isc.sans.edu/forums/diary/Is+it+time+to+get+rid+of+NetBIOS/12454/
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 17, 2015, 11:29:52 PM
MDWS SERVER DOWNTIME and INTERFACE UPGRADE TO V2.0

I don't see any issue using 1.4.0 it's been very stable indeed the added enhanced DLM gadget will be very welcome for users who don't understand the DLM threshold for there line it becomes very clear when you click on it  :)

A years worth of stats is excellent it's just some stats analysts may find it to be confined i am just happy to see 7 days worth of stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on September 18, 2015, 01:19:03 PM
Any chance of you removing the reference to Plusnet on your DLM gadget or it there any option for the End user to remove it ?
Just that it isn't unique to Plusnet ,other ISP's use the DLM Speed stability option too, As if i were to be a donator i would appreciate that it be free of Branding & ads
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 18, 2015, 01:27:23 PM
Tommy, I'm sure that's there because that example was from a Plus Net connection, yours will show your ISP.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 18, 2015, 01:47:41 PM
Any chance of you removing the reference to Plusnet on your DLM gadget or it there any option for the End user to remove it ?
Just that it isn't unique to Plusnet ,other ISP's use the DLM Speed stability option too, As if i were to be a donator i would appreciate that it be free of Branding & ads


 :hmm: It's the ISP of the user you are currently looking at as Ronski says ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on September 18, 2015, 02:52:37 PM
Ok,  :blush:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 18, 2015, 04:18:19 PM
Hope it goes smoothly Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 19, 2015, 11:00:08 PM
NOTES ON ACCESSING V2.0.0 from Sunday 20th September 2015

Other things have got in the way of creating a comprehensive guide but as much of the day to day operation is the same but laid out differently, users should adjust pretty quickly. This post concentrates on the major changes.

So this is just a short guide on how to access and use V2 as it may not be immediately obvious. Please see the earlier post for more general info...

Once active with the server back up, the Version at the top the main page should read V2.0.0 (hit F5 or whatever forces a refresh if it doesn't) you should see very few immediate changes as it will effectively be running V1.4.0 (see the attachments for screen grabs of what follows). BUT on the line of links below the Social Media icons there is a new dropdown labelled Graph Size. If it says Not Available then you don't qualify as a Supporter currently and you need to for access (see earlier post). If it says this, it will operate just like V1.4 but with some limitations.

Otherwise it should read Original. Original is the display you are used to seeing with the Control Box at the left of the graphs. With the list box dropped down you'll see Vy Small - Small - Medium - Standard - Large - Extra Large as graph size options for vertical height.  Standard is a little larger than the old system (you can return to this earlier display version at any time if you want using Original.)

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.wpocomms.co.uk%2Fimages%2Fgraph-size.jpg&hash=2546f9536328f6c24aa2c6382570e268)

If you open more then one pane, all the graphs are the same size - it should in a future release be possible to mix graph sizes amongst panes. The larger the graph the less you can see at once but there is more vertical resolution. At the smaller end you can likely see a lot on screen at once but detail goes and also various labels vanish at the smallest size. The Legend for the various graph colours is now above the graphs rather than below.

So picking a graph size will refresh the whole display and the graphs now occupy the whole width of the MDWS GUI.

There still a maximum of three items in each pane - Stats Summary at the top, then the Control Box, then the graph or listing. You can turn off the Stats Summary to have more vertical space (for all panes displayed) by checking the option right of the Graph Size dropdown. Some of the info in the Stats Summary is then transferred to the Control Box including the DLM traffic light status and other info is then repeated on the graph itself. There is no obvious indication currently by colour if the line is down and the Stats Summary is hidden but that will come...

Here is a typical display with and without the Summary Stats (note the option to remove the Stats Summary has been withdrawn temporarily):
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.wpocomms.co.uk%2Fimages%2Fstatuswithandwithout.jpg&hash=f00cf51df920c551f5b1ad5db6bc6d73)

If the user has allowed it (via options), then you may also see a thumb of their Latency graph at right of the Stats Summary as in the top graph. Selecting it will display it full size. It is NOT displayed if there has been no update recently.

The Control Box is much as it was but now horizontal and the green button at right replaces the old Update button - one extra checkbox option for SNRM is Hi Res for periods of 48 hours and less - this lets the chart define the vertical limits without starting at zero and may or may not increase the vertical resolution depending on how Google feels. Here's a comparison when it does work:

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.wpocomms.co.uk%2Fimages%2Fhi-resplus-small800.jpg&hash=7a5f3e5842657eddf2bdf5743cc39ed7)
And at the bottom is the smallest graph height with hi-res enabled.

Note that the View/Save button is now hidden for browsers that do not support it (Firefox/Waterfox/Edge). There is no solution for this currently except to use a screen grabber or other utility such as Lightshot or Snipping Tool.

DLM GADGET
Here is another (there is also one in the original upgrade post) example of the popup DLM display that hopefully gives much more detail and clearly shows which traffic lights (hopefully) apply to your line. This example is for a pretty awful line!

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.wpocomms.co.uk%2Fimages%2F3-dlm-gadg-bad-example-800.jpg&hash=26eaadf986d6f43e21e56c332b565239)
Users cannot make any adjustments to this display as it is automated (and thanks to Kitz for helping with the layout :) ). The circular meter at right needs to be up in the yellow or preferably the green part to be accurate - it displays the percentage of minutes data available for the user from the 1440 there should be over 24 hours.  It will close automatically when it loses focus.

ZOOMING
Due to some changes with the Google charts, zooming is now only possible by drag selecting an area and not by clicking on one of the highlight circles/blobs. Try to highlight an area with the center as the point of interest. You can do this multiple times and a right click reverts to the original scale.

I've probably missed some things so please yell if you need assistance - also check the earlier post as that has additional info on some other options including displaying your modem and upload failure notifications.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 20, 2015, 10:03:45 AM
It all seems to be working properly (although I haven't checked every detail of course) so well done Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 10:13:14 AM
It all seems to be working properly (although I haven't checked every detail of course) so well done Tony.

Thanks

There's a pile of hair sitting next to me though....  :-X

The only immediate problem I see is that the graphs don't quite fit within their containers properly, too close to the bottom line but I'll find and fix.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 10:13:57 AM
I don't no if it's a glitch but saying I can only view 5 days stats because I have not donated , I did donate a few days back and my user name shows in green

Cheers
Chris

Um, it takes effect within 5 minutes of doing it. I'll have a look now...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on September 20, 2015, 10:46:27 AM
Hi Also donated username is shown in green but still saying not avaliable for new options
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 10:47:03 AM
The DLM data popup is not showing on my screen, no matter how long or where I hover my mouse. If I hover over the traffic lights I do get a small black popup with text display but that's all. What am I doing wrong?

Stuart (broadstair on mydslwebstats)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 11:01:32 AM
Looks good  :) - thanks.  Only issue here is that you seem to have tick "show status" each time you open it.  Other settings seem to be remembered.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 20, 2015, 11:13:32 AM
Great stuff Tony really great interface

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 20, 2015, 11:14:55 AM
The DLM data popup is not showing on my screen, no matter how long or where I hover my mouse. If I hover over the traffic lights I do get a small black popup with text display but that's all. What am I doing wrong?

Stuart (broadstair on mydslwebstats)

Click on the traffic lights.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 20, 2015, 11:19:01 AM
I did its great  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 11:30:26 AM
Okay, more hair has fallen out  ???

Hopefully the problem with donees not being recognised for the new interface has been sorted so if those affected can refresh the whole interface and see if it works as it should please and let know.... Really stupid bug but next to impossible to find quickly (an extraneous space appended to user names.  :-X ...)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on September 20, 2015, 11:35:42 AM
Hi

Yes new options seems to be working fine on mine now thanks a lot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 11:37:24 AM
Looks good  :) - thanks.  Only issue here is that you seem to have tick "show status" each time you open it.  Other settings seem to be remembered.

Under what conditions please? It survives an interface reload here.....

Edit: Can you check that your Cookies are set to NOT expire when you close the browser or end a session please? They need to be persistent.

And I was going to add are you using the wider graphs as it doesn't work on the original ones but you have discovered that...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on September 20, 2015, 11:56:47 AM
all seams to be working here , i can get more info about the traffic lights if i hover my cursor above but how do i get the full interface that is shown on your post about the update please

cheers
chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 11:58:14 AM
all seams to be working here , i can get more info about the traffic lights if i hover my cursor above but how do i get the full interface that is shown on your post about the update please

cheers
chris

Click on the traffic lights... Does it show a hand cursor if you hover over them? Have you got popups enabled?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 11:59:18 AM
  It is Chrome on XP! . All settings look fine and everything else is remembered OK.  No expiry is set.   The status setting is lost when ever new page or tab is opened.   I also have just noticed that if I open MDWS in one tab and enable it, then when second tab opens MDWS  then both tabs don't have the setting set. Opening the second tab resets the first tab status to off.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 20, 2015, 11:59:45 AM
FYI I couldn't get the info from the traffic lights on a tablet before. V2 :) now works on both Android and Apple
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 12:00:28 PM
Click on the traffic lights.

That does nothing, on my screen (Firefox in Linux) does not show the traffic lights as a link. However I see the new screen on my W7 PC and it does work. I have cleared the cache in Linux but still shows the old layout.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on September 20, 2015, 12:06:54 PM
all working, I had to change graph size from original to standard  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:07:27 PM
  It is Chrome on XP! . All settings look fine and everything else is remembered OK.  No expiry is set.   The status setting is lost when ever new page or tab is opened.   I also have just noticed that if I open MDWS in one tab and enable it, then when second tab opens MDWS  then both tabs don't have the setting set. Opening the second tab resets the first tab status to off.

I have to say if it's XP then not a lot I can do IF that is the problem......

You can't/shouldn't have two tabs open with MDWS and never have been able to successfully as they share the same settings since there is no sure-fire way of identifying tabs in use. Even worse with this version as you'll get mismatched container and graph sizes after a while if one is different to the other....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 12:12:12 PM
This is great and very fast though show status tick is not saving the setting  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:21:22 PM
This is great and very fast though show status tick is not saving the setting  :-\

See post below. It does via a persistent cookie but maybe you have two tabs open and then the second one will negate the first and you shouldn't have two tabs open anyway, it isn't supported and never has been.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 20, 2015, 12:21:58 PM
Click on the traffic lights.

That does nothing, on my screen (Firefox in Linux) does not show the traffic lights as a link. However I see the new screen on my W7 PC and it does work. I have cleared the cache in Linux but still shows the old layout.

Stuart

I'm afraid I can't explain that, Stuart. I'm using Firefox/Linux and the function works properly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:30:39 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 12:47:33 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?

Tony it worked without any alterations or new options on W7 in Firefox, but no I've not tried that in Linux but i would not have expected to change anything since W7 worked with no changes. I'll try that later on Linux as I'm using W7 right now as that PC is on 24x7 (runs my weather station and DSLStats).

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:57:22 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?
Tony it worked without any alterations or new options on W7 in Firefox, but no I've not tried that in Linux but i would not have expected to change anything since W7 worked with no changes. I'll try that later on Linux as I'm using W7 right now as that PC is on 24x7 (runs my weather station and DSLStats).

Stuart

Okay but what does the Graph Size option currently read on both OS?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 20, 2015, 02:57:55 PM
All seems ok here.   Prefer the new style layout - thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 03:51:22 PM
See post below. It does via a persistent cookie but maybe you have two tabs open and then the second one will negate the first and you shouldn't have two tabs open anyway, it isn't supported and never has been.

Just using the one tab i use 2 panes, how do you set a persistent cookie on Chrome ?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 04:32:48 PM
See post below. It does via a persistent cookie but maybe you have two tabs open and then the second one will negate the first and you shouldn't have two tabs open anyway, it isn't supported and never has been.

Just using the one tab i use 2 panes, how do you set a persistent cookie on Chrome ?

Settings > Advanced > Content Settings > and make sure for Cookies that the first radio button is set, not the others. The last checkbox is up to you but I always check that ....

However, I think the problem probably lies somewhere else ... I just ran it on Chrome here  (I normally use Waterfox as it's more stable for me) and closing/restarting it doesn't lose the Show Status setting...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 04:45:53 PM
Settings > Advanced > Content Settings > and make sure for Cookies that the first radio button is set, not the others. The last checkbox is up to you but I always check that ....

However, I think the problem probably lies somewhere else ... I just ran it on Chrome here  (I normally use Waterfox as it's more stable for me) and closing/restarting it doesn't lose the Show Status setting...

Thanks Tony have been at this all day to find a cure/fix well i did watch F1 it could well be a Vista thingy i'll check out windows 8.1 later and see how that fairs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 04:48:58 PM
Thanks Tony have been at this all day to find a cure/fix well i did watch F1 it could well be a Vista thingy i'll check out windows 8.1 later and see how that fairs.

Likewise, there's a rather large peak in my latency graph as a result via Sky Go. Shame about Lewis  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on September 20, 2015, 04:51:46 PM
  It is Chrome on XP! . All settings look fine and everything else is remembered OK.

I get the same on Chrome/XP - when going into the website I need to select the 'show status' button each time.

If I close the browser, reopen it, go to http://www.mydslwebstats.co.uk/ and press continue, the status button is showing as not selected

My settings are set as per the default - i.e. for Chrome to remember any cookies..
.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 05:03:21 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?
Tony it worked without any alterations or new options on W7 in Firefox, but no I've not tried that in Linux but i would not have expected to change anything since W7 worked with no changes. I'll try that later on Linux as I'm using W7 right now as that PC is on 24x7 (runs my weather station and DSLStats).

Stuart

Okay but what does the Graph Size option currently read on both OS?

On W7 it said standard and on linux it said original and I dont remember changing either or playing with either at any time. Now I've changed Linux to standard it works and if I change it back to original it disappears again.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 05:06:12 PM
Thanks Tony have been at this all day to find a cure/fix well i did watch F1 it could well be a Vista thingy i'll check out windows 8.1 later and see how that fairs.

Likewise, there's a rather large peak in my latency graph as a result via Sky Go. Shame about Lewis  :-\

You noticed that to on sky go i had to reboot the router to stop the buffering, Lewis will win the championship  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 05:09:45 PM
On W7 it said standard and on linux it said original and I dont remember changing either or playing with either at any time. Now I've changed Linux to standard it works and if I change it back to original it disappears again.
Stuart

Yes that would be so. It doesn't work under Original (V1.4 code) as it isn't an option and never was so your results are as expected now....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 05:31:18 PM
  I also find the status option is not saved with Chrome on an Android tablet.  I will try windows 7 as promised later, I just have dig out my login details.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 06:28:22 PM
  Just the same with Chrome in windows 7.   I have gone to running with "original" - this seems to remove the status option and effectively set it on.  Just to repeat  - everything seems to be perfectly remembered apart from the status.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 06:41:33 PM
  Just the same with Chrome in windows 7.   I have gone to running with "original" - this seems to remove the status option and effectively set it on.  Just to repeat  - everything seems to be perfectly remembered apart from the status.

As I said earlier, there is no such option in 'Original' so it will always be on anyway as you can't turn it off... Bear in mind that Original is V1.4, not the new one.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 08:39:30 PM
Status Option

Having looked at this for some time, I think a better option would be to default it to On and not set it from where it is currently but via the Options menu as that will isolate it from being affected by other changes...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 09:10:11 PM
 Thanks for a possible fixup  :) .  I think that would best for me and probably others with trouble saving the setting.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 10:37:37 PM
Thanks for a possible fixup  :) .  I think that would best for me and probably others with trouble saving the setting.

For the moment I've fixed it on and removed the option to change it so the Status Bar is always there now. That also solves another problem I spotted and I suspect this would be most peoples choice anyway. You will need to reload the main page (F5 or whatever) or change graph size to implement it..... I'll come back to it at a later date.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 22, 2015, 08:31:48 AM
Thanks for a great upgrade Tony; I have just spotted an anomaly with the Mini stats page.

The horizontal scroll bar is always present, see screenie.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 22, 2015, 09:12:39 AM
Thanks for a great upgrade Tony; I have just spotted an anomaly with the Mini stats page.

The horizontal scroll bar is always present, see screenie.

Ian

Can't get that to happen here and nothing has changed in the code for it. It's set to have no scrollbars as well and yours is also the wrong height.

It's also set to be resizable so you should be able to make it narrower.... I know Chrome has problems with it and sometimes it shows a blank container on some terminals but no idea why. Matter of interest, which Browser (looks like Chrome) and OS please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 22, 2015, 01:13:58 PM
Quote
which Browser (

Chrome on chromeOS...Only noticed the horizontal scroll bar yesterday, it is resized to my prefered dimensions and zoom level.

Very strange  (I have tried zoom 25% full screen width and still the scroll bar is there), I don't think an upgrade to the OS has been pushed the last few days.

It's a mystery.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on September 24, 2015, 02:07:37 PM
@tbailey2

I understand that support for the MyDSLStats webpage is through this forum. I have an issue in that after making my £10 donation last night, the emal came back saying it was credited to the wrong user account. I clearly wrote username:tenbyboy2 in the message part of the paypal message section.

Can this please be rectified?

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 24, 2015, 03:12:51 PM
@tbailey2

I understand that support for the MyDSLStats webpage is through this forum. I have an issue in that after making my £10 donation last night, the emal came back saying it was credited to the wrong user account. I clearly wrote username:tenbyboy2 in the message part of the paypal message section.

Can this please be rectified?

Thanks.

The system credited an account you registered last year using the e-mail address you donated from this time and that is checked first.... The username is a backup in case the e-mail fails (but not now)!

Changed now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on September 24, 2015, 03:46:07 PM
Thanks for the quickly reply and for sorting it.

Reason I created a new account is because I forgot the password and then when I tried to reset it, it said my memorable word was incorrect - even though I know it was as I still have the original email.

Is there any chance you can delete that old account now for me please? Also, I'm sure I had that problem before and there is also a tenbyboy acount.

Many thanks. It won't happen again as I have now made a not of all the details of the new account.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 24, 2015, 04:39:28 PM
Thanks for the quickly reply and for sorting it.

Reason I created a new account is because I forgot the password and then when I tried to reset it, it said my memorable word was incorrect - even though I know it was as I still have the original email.

Is there any chance you can delete that old account now for me please? Also, I'm sure I had that problem before and there is also a tenbyboy acount.

Many thanks. It won't happen again as I have now made a not of all the details of the new account.

Okay done, do you want to lose the other one as well? There will be a user option for this soon.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 24, 2015, 07:46:14 PM
tony I got my hg612 up on ebay and my old asus router, when the first of them sells will send a donation.

When I checked ebay the guy who got my zyxel couldnt set it up and was asking how to do it but sadly I couldnt send the link to kitz site as ebay times out the messages :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on October 04, 2015, 05:02:55 PM
Team,

Firstly, thanks for the great work on this.

One request and some feedback for you.  I am using a Netgear D7000.  mydslwebstats is sent from a Windows 7 PC.

1) My request (if its not already there!) is to be able to look at a linear graph showing the cumulative CRC errors.
2) Observation: While listening to internet radio via a web browser, everytime the app sends data to the web, there is a short break in transmission. Is there any way round this

Cheers

David
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 05, 2015, 07:31:58 AM
Team,

Firstly, thanks for the great work on this.

Thanks

Quote
I am using a Netgear D7000.  mydslwebstats is sent from a Windows 7 PC.

1) My request (if its not already there!) is to be able to look at a linear graph showing the cumulative CRC errors.

2) Observation: While listening to internet radio via a web browser, everytime the app sends data to the web, there is a short break in transmission. Is there any way round this

1) It's not one that is currently there and I'm not sure it would have any benefit to you or anyone else? It is not a parameter that is currently monitored as such by the line management system (DLM) which looks primarily at Errored Seconds (ES) and Resyncs/LOS.

CRCs are responsible for generating ES though and it's the ES you need to keep an eye on. My observations would be that, in your case, the CRCs are very low as are the daily ES totals and nothing to worry about. You would need to see 1440 ES/Day or more for the DLM to take action, you have had a daily maximum of 52 over the last 10 days with other days being much lower.

2) You'd need to get roseway or others to comment as he looks after DSLstats that you are using for uploads. It's not something I've seen reported before - but it may have been. The upload for MDWS though is under 1k in size (except around the hour when it's a bit more). Since your router is working a bit harder at those times delivering telnet info to DSLstats then it's possible the processor can't cope at those moments? Does the interruption last for the duration of DSLStats showing Sampling?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 05, 2015, 09:43:13 AM
Concerning (2), I've had a look at the CPU load on my system during sampling, and it rises to about 14% of one CPU core for about one second in each minute. This is on a fairly powerful quad core i5 machine, so I guess on a much less powerful machine (Raspberry Pi for example) it could saturate the CPU for a second or so.

I'm not sure that I can do anything about this. During sampling there's quite a lot of processing of data, and although the relevant code could probably be optimised for minimum CPU load, I doubt that there's a great gain to be made. And there would be plenty of scope for introducing new bugs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 07:29:12 AM
Just a note that the MDWS server is being rebooted for software upgrades very shortly. Shouldn't be down for very long.

Edit:
Okay back up but will be slow for some time while 16GB of database is loaded into memory...

Also there will be a change to logins shorty. Web users will need to login every 7 days rather than be kept logged in.  This is one of a number of background security changes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 08, 2015, 10:17:59 AM
Well I've got to say that's going to be a pain, fine on my PC but I have a tab open on my phone and tablet  so I can have a quick and having to log back in every 7 days is going to get annoying. It's actually easier to login to my bank from my phone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 11:00:19 AM
Well I've got to say that's going to be a pain, fine on my PC but I have a tab open on my phone and tablet  so I can have a quick and having to log back in every 7 days is going to get annoying. It's actually easier to login to my bank from my phone.
Oh dear - and also when the browser session is lost....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 08, 2015, 01:58:23 PM
Also there will be a change to logins shorty. Web users will need to login every 7 days rather than be kept logged in.  This is one of a number of background security changes.

Suggest option for donators to control this? E.g 7d,14d, 30d, 90d, Never?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 04:10:22 PM
Tony

I'm getting "Pop up not available in original mode" when clicking traffic lights. Have re logged in as I was logged off

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 04:12:18 PM
Tony - My fault seems it went back to original mode. Changed to standard and all working. Will it loose these settings every time a logout is forced ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 04:17:00 PM
I'll have a look shortly....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 04:50:03 PM
I'll have a look shortly....

Can you remember if the physical graph size was reflected in what the selection list said or did they differ? If they were different it's buried somewhere and will take a while to find.  It may reset to Standard after a forced logout if it was wide originally and does so here.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 04:53:09 PM
I think it looked like standard but the box said original.

Hope that helps

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 05:17:42 PM
Okay. I need to debug it again, at least you know how to solve it  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 08, 2015, 05:49:59 PM
tony I feel you either need to make the login process easier or ease up on the 7 day thing as its a bit of a pain to login.

What was wrong with the long lived session?  Forcing relogin is false security.

What about a compromise of 28 days?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 05:55:36 PM
Perhaps we should be sensitive to the fact the server lives with Tony, and he should be able to take whatever measures he feels happy with. Try asking Apple of MS to alter their Logon on parameters :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on October 08, 2015, 06:56:40 PM
tony I feel you either need to make the login process easier or ease up on the 7 day thing as its a bit of a pain to login.

What was wrong with the long lived session?  Forcing relogin is false security.

What about a compromise of 28 days?

+1.......7 days is going to be a pain on my mobile...it means keeping the passphrase somewhere so i can copy and paste it.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 06:59:31 PM
I cant understand what actually is the problem with logging on again. It only needs a username and password, not the passphrase or capture stuff we had previously.

Have I missed something here as I cant in my mind see what the issue is ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 08, 2015, 07:02:46 PM
I always have to input the phrase and the city as well as the username and password
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 07:05:49 PM
I have just logged in on my iPad. Only wanted username and password
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 08, 2015, 07:11:59 PM
Same here, it's user name, password, memorable phrase and the capitol city of Wales. At least that is what comes up on IE, on Firefox I can just about see the memorable phrase box, but the rest is strangely not displayed, actually they appear when I tab through them.

So on my phone/tablet I have to open my password manager and enter my master password, then search for MyDSLStats, copy the password, back to the web browser, enter my username, paste the password, flick back to password manager and copy the phrase, switch back to the browser, paste the phrase, type Cardiff and then log in. For me it's just not worth the hassle, and if I'm not going to be using it as much then I'm not going to be donating again
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 08:17:22 PM
Those of you who are having to enter the additional two fields that shouldn't be necessary, might care to read the Logging on section of the MDWS Help system (link near bottom of main page) which notes:

Cookies
For MyDSLWebStats to run correctly, you must have Cookies enabled and they MUST be selected to expire when they expire, NOT when your browser is closed. Failure to set this correctly will mean it is more difficult to logon and this will occur more often - you should only need to enter your username and password after logging on the first time.

As well as your browser, there are many extensions etc that can also handle cookies and these can easily override your browser settings. Make sure that any such are set to, possibly, never expire or similar for MyDSLWebStats.

I have eight devices here plus every browser under the sun (except Edge) and everything works fine if you observe the above.

Hope that helps. Also, if you actively use the system the 7 days gets reset every so often, I forgot to mention that  :-\

Edit:
I see I have to change the Country as well now  :( Namibia will be good choice...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 08, 2015, 08:38:43 PM
Ah that explains it, I have cookies set to expire when the browser closes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 08, 2015, 10:19:39 PM
Just had the new change this evening and the browser had the username & password all set up and just clicked on login and straight into MDWS

I'll be going offline for 10 hours on MDWS due to DLM maintenance see ya all soon  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 10, 2015, 04:49:35 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 10, 2015, 06:42:22 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks

Yep it's still there just used a few minutes ago.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 10, 2015, 06:56:18 PM
I cant understand what actually is the problem with logging on again. It only needs a username and password, not the passphrase or capture stuff we had previously.

Have I missed something here as I cant in my mind see what the issue is ?

Tony

still needs the phrase.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 12, 2015, 12:23:59 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks

Yep it's still there just used a few minutes ago.
Just in case anyone else has the same issue I think you need to be using one of the supporter graphs to see this option.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 12, 2015, 12:45:53 PM
DSLAM is being detected as Huawei but it is an ECI cab. I have tried restarting modem and dslStats Pi but it is still showing as Huawei.  It has been showing as ECI but I do not know when the problem started.  Anything else I should be trying? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 12, 2015, 01:23:32 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks

Yep it's still there just used a few minutes ago.
Just in case anyone else has the same issue I think you need to be using one of the supporter graphs to see this option.

Correct. It's documented in Help and elsewhere
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 12, 2015, 01:24:14 PM
DSLAM is being detected as Huawei but it is an ECI cab. I have tried restarting modem and dslStats Pi but it is still showing as Huawei.  It has been showing as ECI but I do not know when the problem started.  Anything else I should be trying? Thanks

Probably a glitch in the uploaded data. I need your username to fix it. PM if necessary please.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 12, 2015, 03:47:43 PM
DSLAM is being detected as Huawei but it is an ECI cab. I have tried restarting modem and dslStats Pi but it is still showing as Huawei.  It has been showing as ECI but I do not know when the problem started.  Anything else I should be trying? Thanks

Probably a glitch in the uploaded data. I need your username to fix it. PM if necessary please.

Thanks - done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 12:33:53 PM
Hi all, I'm new here and just looking for some info on my line.

I'm with Sky Fibre and have been since 2013.  I've been using an SR102 but picked up an HG612, flashed with the firmware and installed DSLStats to check the line.

I recently had a few issues with the SR102 sky router (they buggered up the last firmware update) which caused massive amount of re-syncs.

I think my line has stabled now, but just to make sure, can anyone please check out my DSL webstats Angel-Rex and let me know if it all looks 'OK' for my line?

If you need any other info or have any questions please let me know.  Many thanks and amazing tool!


EDIT : My ping was always 8ms to bbc.co.uk, however I have noticed in the last 3 days this has doubled to 16ms.  Can anyone see why this is based on that info?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 13, 2015, 01:20:13 PM
Looks ok but the upstream is a bit low. Are you using the SR102 with the HG612 modem or another router?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 05:04:44 PM
Looks ok but the upstream is a bit low. Are you using the SR102 with the HG612 modem or another router?

My line is approx 800 meters (to fibre cab) hence the low speed.

I am using the HG612 as modem and using the SR102 still.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 13, 2015, 07:10:02 PM
Is the upstream speed around the same as the estimate then?

So does the SR102 plug straight into the modem with no setting changes and do you have to use the LAN port marked with the green bar or does any one work?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 07:50:10 PM
Is the upstream speed around the same as the estimate then?

So does the SR102 plug straight into the modem with no setting changes and do you have to use the LAN port marked with the green bar or does any one work?

The HG612 can plug into any of the sr102 lan ports and just work.

as for the speed :

High   Low   High   Low      
FTTC Range A (Clean)   42.2   32.4 /   8.1   5.7   --   Available
FTTC Range B (Impacted)   35.7   20 /    8.1   4.3   --   Available


That is from the BT adress checker.  I was say im getting what was predicted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 13, 2015, 08:40:01 PM
Yes looks fine. Thanks for the info.
I can only think the increase in ping is either down to a change in routing or increased interleaving on your connection.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 10:02:19 PM
Cheers. I'm guessing routing as all the other settings look the same as they did 16 days ago!

There are loads of the options In the stats I dont understand, wanted to make sure nothing was standing out wrong :-)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 14, 2015, 12:48:00 PM
Is MDWS down? Scrub that it loaded the page but was painfully sllllooowww over 1 minute
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2015, 12:53:59 PM
I'm going to take down the server - it crashed a couple of hours ago and keeps doing so and is running at about 5% its normal speed. Looks like an auto AV update may have started this as that's what the crash dump analysis says.

No idea how long though and it may need several reboots.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2015, 04:48:33 PM
I'm about to run a restore of a daily backup image from 06:30 this morning from a few hours before whatever happened occurred as I've been unable to fix it. This means the system will be down.

Assuming this solves the current problem, it will then be some further time before the system can be brought back up though, possibly tomorrow as there is a separate crisis in my life that has managed to coincide with this so apologies. In the meantime it's running but a page refresh is taking 8-10 secs or more instead of 200ms or less  :-X
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 14, 2015, 06:38:08 PM
Sorry to hear about your problem, Tony. I'm sure people will understand.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 14, 2015, 07:02:29 PM
Unacceptable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 14, 2015, 07:16:38 PM
The only unacceptable thing here is your pointless and irrelevant comment, Alec. If you have nothing constructive to say, then I recommend that you say nothing.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2015, 08:54:04 PM
The stats bar at the top are updating fine on MDWS it is only when the graphs are being built up for display that's when it starts to bog down.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 14, 2015, 09:26:45 PM
It is taking 20 seconds before it actually starts to load/display the page and takes around 30-35secs before any stats are visible for me,  at around 45secs page loading is complete for me,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 14, 2015, 09:59:19 PM
Unacceptable.

What an totally inappropriate comment
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2015, 11:10:26 PM
Unacceptable.

What an totally inappropriate comment

even worse he/she does not seem to a be user of MDWS anymore so why complain if your not using it  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 14, 2015, 11:24:00 PM
Wow nobody here can take a joke!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 14, 2015, 11:25:24 PM
Quote from: NewtronStar link=topic=14361.msg302460#msg302460
even worse he/she does not seem to a be user of MDWS anymore so why complain if your not using it  :-\

Stop stalking my Internet usage, it's creeping me out.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 14, 2015, 11:37:15 PM
Your 'joke' was not funny. Tony already mentioned that he's having to deal with another crisis, so your thoughtless comment got the reaction you should have expected. Drop it now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2015, 11:43:12 PM
Quote from: NewtronStar link=topic=14361.msg302460#msg302460
even worse he/she does not seem to a be user of MDWS anymore so why complain if your not using it  :-\

Stop stalking my Internet usage, it's creeping me out.

Could you expand on your statement please and how would you know if i was or was not looking at your stats ?

if information is being passed onto you from the developer of MDWS this could be a breach of confidentiality  :o
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 15, 2015, 06:31:25 AM
Wow nobody here can take a joke!

I suspected it may be a joke, but without a smiley how was any body really supposed to know for sure. It's so easy when you only have words on a screen  that something can easily be taken the wrong way, the inclusion of a smiley or even [/joke] would better convey your intent.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 15, 2015, 07:22:43 AM
I disabled my uploads to ease the stress since I am guessing its not helping having all the clients trying to connect to upload stats.

Will turn back on after its fixed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 15, 2015, 08:02:44 AM
That's a good move.

Tony is now working on fixing his server, and he'll notify us when it's up and running again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 15, 2015, 09:45:08 AM
I disabled my uploads to ease the stress since I am guessing its not helping having all the clients trying to connect to upload stats.

Will turn back on after its fixed.

I think that's an excellent suggestion. I'm doing the same, perhaps others will follow suit
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 15, 2015, 12:29:45 PM
I'll also disable mine when I'm home later :)

Hope it doesn't cause you too much hassle Tony and again, appreciate the service!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 15, 2015, 04:47:12 PM
Your 'joke' was not funny. Tony already mentioned that he's having to deal with another crisis, so your thoughtless comment got the reaction you should have expected. Drop it now.


This forum is lifeless because everything here is so serious.

I make a joke and get told to shut up, I guess this forum just doesn't understand jokes. I guess if you sit on the computer all day and never get outside you don't have much human interaction.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 15, 2015, 05:54:30 PM
Very disappointed to have to intervene after being alerted to this thread by other means.

The people you are criticising are those that give up many hours of free time to code and write things like dslstats and help members of the broadband community.

As already mentioned use of a smiley goes a long way to show that a joke was intended.  With a history of criticising  ISPs, BT, the way this forum is run, and consistent negative posts, it's no surprise that it wasn't realised it was a joke. :(

--
Now if you excuse me, but I have other things to do right now, things that have nothing to do with PCs or broadband.   I don't even have a PC or network atm.  In fact after a water leak, I have no bathroom, no kitchen ceiling, no lighting and just about every room in the process of being redecorated and under an inch of plaster dust.   

Don't push me,  on top of my own chaos I'm attempting to assist my father to come home for his final days which is his last wish so I'm having to assist and prep a room with special equipment as he has spinal cancer progressing rapidly to the point were he can't even now be moved without specialist care.  I can't even hug him now for fear of spinal neuro shock so don't say anything to me about life outside of the PC...  The mood I'm in right now after just a few hours ago being told by the docs 'not long' means I'm hardly likely to be tolerant about anything...  and I will be very blunt and you will not believe how much willpower it's taken to make this post without resorting to stronger words.  I made it clear about a week ago why I wasn't around so I'm not a happy bunny to be alerted to this thread... and why I am not in the mood to be anything other than serious.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 15, 2015, 07:47:36 PM
To everyone

For various reasons, part of which is the server failure, currently irrecoverable without a lot more more work than I can currently undertake, but primarily due to changes in my own circumstances in the past week, I regret to say that the MyDSLWebStats facility is closed down as of now although the mail server will continue running for a while yet.

If you are uploading to MDWS then you need to disable it a.s.a.p please. I'll update the web site to reflect the cessation of the project to run for for a few weeks and get a minimal index page online.

FWIW there was never any financial reward from operating it, just a deficit of four-figures overall for the hardware and running costs since inception that I can't keep covering. Recent donations have lowered the deficit quite a bit for which thanks - I'll refund  all those who did so recently and have had little benefit from doing so. Anyone else who would like their donation back then please PM me via this forum.
Hope it helped some of you with your stats analysis although I suspect it also created a few obsessed users as a result  ???

Many thanks also to Kitz for allowing use of the forum for MDWS support for the past year.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 15, 2015, 07:56:08 PM
Sorry to hear you're having problems, and I hope that whatever it is that it improves.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 15, 2015, 08:21:32 PM
Is there any way to transfer it to the public domain?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 15, 2015, 09:50:47 PM
Hope it helped some of you with your stats analysis although I suspect it also created a few obsessed users as a result  ???

Many thanks also to Kitz for allowing use of the forum for MDWS support for the past year.

Tony

Yes it has Tony it is an invaluable tool and to see and compare others stats against your own line has helped me understand VDSL2 lines much more .

There is also a downside to stats analysis it can become an obsessed hobby and that's why Openreach locked down the modem  ;)

No need for donation refunds from me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on October 15, 2015, 11:51:05 PM
Sad.

Makes me wonder whether a particular crass comment was the final straw that confirmed to Tony that he was making the right decision?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 16, 2015, 12:54:03 AM
You're not too far from the mark jelv and hence my post above. :(

I can empathise with Tony who has other things going on atm too.  It only takes a final straw to think wth do I bother doing this?

The final insult is the implication you sit on a PC all day and need to get a life, with little respect for the huge amount of hours that are put into development of something for no reward is the reason you are online.

There comes a point when you think why the hell do I put myself through this and pull the plug... and as per the implication you get on with 'real life stuff'
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on October 16, 2015, 01:23:17 AM
I found MDWS useful and interesting, and a nice complement to the dslstats running on my pc (which isn't always on). I'm sorry it's ending, but I understand the reasoning. It was good while it lasted, and thank you for the work you put into it, Tony. Sorry I never had enough free money to donate to you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 16, 2015, 03:28:49 AM
Tony sad days, dont worry about my donation, I didnt donate for perks, but felt I had to do it for your effort.

However I have a proposal, I know you want to keep it hosted in the uk so if you want I can maintain the hardware costs my end and provide the hosting whilst you just maintain the software side (will keep it in the uk) let me know, if this is ok for you, (you also keep any donations, I will do for free).

Or an alternative if you dont want to even maintain the software perhaps send over the current software to me and I will just run that with no updates.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: doughnut on October 16, 2015, 09:22:05 AM
So sorry to hear Tony.

I'm with Chrysalis here and open to help to get the project back online and maintainable for the long haul, cant do the financing because i'm currently in my own startup phase building BSS systems for telcos
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 16, 2015, 09:46:02 AM
Tony

My best wishes and thanks for all the efforts. Its ben an interesting project. I hope the other issues might clear themselves. I'm glad to have been involved.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Steveh on October 16, 2015, 10:00:15 AM
Tony

Thank you for your time and effort, I could not do anything like webstats.
I do not want my donation back, you deserve it.

Kind regards
Steve
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on October 16, 2015, 10:03:52 AM
I'm also with Chrysalis on this one. Great plan if it comes to fruition :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 16, 2015, 10:23:26 AM
Hiya all,

I would also like to add my name to the growing list which considers MDWS to be too valuable a resource for it to disappear. I will happily contribute both time, hardware (if required) and money to help continue this very worthwhile project.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on October 16, 2015, 10:42:48 AM
Count me in too.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 16, 2015, 10:47:28 AM
I'll support with a donation.
Only just started using the site and loved it. - NO I DON'T WANT MY DONATION BACK :-)

As a short term measure I have set up a Raspberry pi running DSLSTATS that I can VNC into from any device. The Pi is low power consumption and footprint so no need for a pc/mac being left on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on October 16, 2015, 10:49:14 AM
@kwillers

I've done the same with my Weather Station RaspberryPI as it's on permanently anyhow :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 16, 2015, 01:42:37 PM
I too would consider supporting the project further if it was a possibility.

But thanks to Tony for his hard work and commitment to this project which has been invaluable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on October 16, 2015, 01:51:27 PM
No need to return my donation either.  I certainly had my moey's worth.  And, if one of the tech-savvy team can take this on, I'll gladly contribute again.  I am missing my obsession already!

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Cloudane on October 16, 2015, 02:02:43 PM
Further proof how rubbish the comment of "it's just the internet" is when someone decides to hide behind a keyboard trolling, like it somehow means it's impossible to do any harm.

Thanks for a valuable service Tony, it will be missed.  Best wishes for whatever's going on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: bart613 on October 16, 2015, 02:57:45 PM
That's very sad to hear, Tony.  Best wishes - I hope whatever is going on will improve soon!

Also, thank you for providing the fantastic tool for the community.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: MikeZ on October 16, 2015, 04:16:20 PM
Only just seen this so have now disabled uploads. Best wishes and thanks for all you have done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on October 16, 2015, 04:32:24 PM
Thanks for the service Tony, I will miss it although as others have said, it became strangely addictive.

Hope your trials and tribulations sort themselves soon.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 16, 2015, 05:08:56 PM
I have webspace and unlimited throughput if required.  I was going to donate as I've only just set this up and started to use it^^

Sorry to hear about your situation, but please keep in mind should you decide to continue I'll happily donate hardware or monies :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on October 16, 2015, 06:41:40 PM
Thanks for the service Tony but sad to see it go , let's hope it can be rescued , not long since  donated but not required  back
Cheers
Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 16, 2015, 07:39:39 PM
I've released an update to HG612 Stats GUI which removes anything MyDSLWebstats related from the GUI and automatically turns off the uploads. Hopefully this will disable uploads for people who haven't seen this thread who are using HG612 Stats & the GUI program.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on October 16, 2015, 11:21:51 PM
Sorry I am late to this thread, on hols and missed the OP.
Thanks Tony for your hard work on MDWS to date, very much appreciated by many including myself.
I also hope something can be done to preserve your work and keep the service going.
I appreciate that 'life' can get in the way and priorities have to be made but ask if you can find the time to consider the options that have been offered.
The efforts you have made deserve to be 'rescued' if possible.
Thanks in advance and I hope that your circumstances improve soon.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: chris6273 on October 16, 2015, 11:35:14 PM
Very sad, this facility was extremely useful :( . Thank you for all your time and effort that you have put into this Tony.

I'd like to also put an offer on the table to keep this going if possible; I am a Network Engineer who has access to very powerful & reliable hardware within a data center which is used for hosting various communities.

Tony if you have any intention of transferring this facility to someone, I'm more than happy to take on the hosting part of it. Hardware costs would not be an issue as they are already paid for and the system is maintained by myself.

Let me know if you want any more details.

Cheers,
Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: IMgoRt on October 17, 2015, 07:50:49 AM
Very sad but hear this Tony, hopefully things will get resolved for you personally.

Good to see others offering their support to continue your excellent work for this community.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 17, 2015, 12:41:26 PM
I've heard from Tony, and he's aware of all the messages of support, for which he's extremely grateful. He's taking a little bit of time to think about possibilities and to sort out some private matters, but he is hopeful that, one way or another, the service can be resumed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 17, 2015, 12:49:15 PM
Thanks Eric that is absolutely brilliant news. I think we all hope that Tonys troubles are soon resolved.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: valleysboy on October 17, 2015, 03:19:39 PM
Having just returned from holiday, I'd like to add my message of thanks and support to Tony. This has been a great resouce, and many will have appreciated the time, effort, and money it must have taken to develop and maintain the site.

I will miss my daily fix, recognising that my ocd level has risen  ::), but its only the internet and needs to be put into perspective against all the other pressures of life.

So thanks again Tony, and I hope things sort themselvea out for you soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on October 17, 2015, 03:31:35 PM
Very sad to lose MyDSLWebStats. I am more than happy to donation and help to bring back MyDSLWebStats. I think everyones should support it and donation it if they wish to keep it.  :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 17, 2015, 03:59:48 PM
I'd be more than glad to give a donation for any coding/programming/debugging as this is my background as well as support for hardware and software. I'd also be willing to give a donation to bump start the project again, as well as a monthly fee.

Hope everything is OK with Tony personally :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: big360 on October 17, 2015, 04:41:19 PM
Thanks for all the hard work Tony.  MDWS was invaluable in diagnosing my broadband issues. Fingers crossed it can return some day.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on October 22, 2015, 02:24:29 PM
I have only just seen this as I have been away since the 11th, and was only alerted by DSLStats crashing and refusing to upload when restarted.

I too will miss it and, having read through the last few pages, I can completely understand why Tony felt he had no alternative. I also do not want my donation returned.

Tony I hope your life gets back on track soon and things work out for you.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 22, 2015, 03:20:07 PM
Early this morning the site was up for a brief period,no doubt doing some testing , and the home page now says temp home page server under repair, so things are hopefully starting to look like it will be returning when fixed
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 24, 2015, 08:38:43 PM
I see that Tony has re-enabled uploads to the site on the MDWS home page :) more to follow I'm guessing :) Thanks for his hard work ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 24, 2015, 09:04:35 PM
I still get a temporary home page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 24, 2015, 09:12:48 PM
Attached, below, is a screen-scrape.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 24, 2015, 09:54:29 PM
its working again at least in some capacity. as g.inp emails are resumed. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 24, 2015, 10:29:41 PM
I still get a temporary home page.

It's here: http://www.mydslwebstats.co.uk/Container.htm (http://www.mydslwebstats.co.uk/Container.htm)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 24, 2015, 11:12:10 PM
Hi all  :)

Thanks to all of those of you who left comments, it was these that persuaded me to have a go at getting it going again after getting rather upset and despondent at some remarks that were left initially after the server disastrously crashed.

Yes, it is (nearly) all running again and should be back on line tomorrow. It's taken a while beavering away in the background due mainly to having to fit in totally rebuilding the server from scratch and upgrading the basic software in the process and that had a number of knock-on effects. Just a couple of things still to fix, for instance the latency monitor isn't working at the moment. It hasn't been available publicly as I have been restarting it all frequently and has been down for hours at a time.

The holding page you get depends on where you come in from but wasn't intentional and I'll try to fix later.

There are about 30 people currently uploading, some never stopped!

I'll post more when it's available again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on October 24, 2015, 11:21:42 PM
Welcome back!!

Glad you decided to not go.  ;D ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 24, 2015, 11:23:43 PM
Thanks for all your good work, Tony, and as a reward you can have an extra hour in bed tomorrow morning. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 24, 2015, 11:29:53 PM
Thanks for all your good work, Tony, and as a reward you can have an extra hour in bed tomorrow morning. :)

That reminds me the RPi / Raspbian does not see the extra hour in bed  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 24, 2015, 11:44:26 PM
Welcome back Tony ;D

Hope the donations page will be the first one to be going back up live :)

I'd be intrigued to know if you've found out what caused the major failure of the server? :no:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on October 24, 2015, 11:53:21 PM
Good news and thanks for all your hard work and giving it a go at getting it back up and running.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2015, 07:16:21 AM
That reminds me the RPi / Raspbian does not see the extra hour in bed  ;)

I'm slightly ashamed to admit that DSLstats doesn't handle it unless you close it down and restart it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 25, 2015, 07:40:05 AM
Great news Tony, thank you very much  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on October 25, 2015, 08:07:04 AM
Excellent Tony good to see you back running this ....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on October 25, 2015, 09:09:37 AM
Great news to hear MDWS is coming back!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 09:15:08 AM
That reminds me the RPi / Raspbian does not see the extra hour in bed  ;)

I'm slightly ashamed to admit that DSLstats doesn't handle it unless you close it down and restart it.


Thats funny that your embarrassed about such a minor issue :-)
But as a penalty the sun will go down an hour earlier tonight for all of us   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 09:19:06 AM
Hi all  :)

Thanks to all of those of you who left comments, it was these that persuaded me to have a go at getting it going again after getting rather upset and despondent at some remarks that were left initially after the server disastrously crashed.

Yes, it is (nearly) all running again and should be back on line tomorrow. It's taken a while beavering away in the background due mainly to having to fit in totally rebuilding the server from scratch and upgrading the basic software in the process and that had a number of knock-on effects. Just a couple of things still to fix, for instance the latency monitor isn't working at the moment. It hasn't been available publicly as I have been restarting it all frequently and has been down for hours at a time.

The holding page you get depends on where you come in from but wasn't intentional and I'll try to fix later.

There are about 30 people currently uploading, some never stopped!

I'll post more when it's available again.

Started uploading again can't wait to see the site back fully - great work Tony 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 09:33:54 AM
MyDSLWebStats IS BACK ONLINE  :yay:

Or should be...

Some Important Caveats

Based on some tests on a remote terminal from here:

Once you get a page up, I suggest you hit Ctrl+F5 (or whatever is appropriate for your OS) to pull fresh pages in.

If things look odd when you are connected, it would be a good idea to Log Out (menu link near page bottom) and then Log In again.

Otherwise post here or PM me. If it's security related please do NOT post on the forum please PM me instead  :-X

Things not working:
The large All User Stats monitor page - [now fixed]
Latency Thumbnail graphs
No Upload Warnings - too many people offline currently!

The Latency problem is third-party software related and it's a Sunday... There is a link to view your live graph directly though if it's enabled.

CLOCKS
MDWS thinks many of you have moved to Europe overnight!! Please check your clocks are not in DST any more if you have an asterisk next to your username in Current Uploaders (and are not in Europe!) . RPis need a manual reset.

Have fun! More to come no doubt.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2015, 09:40:47 AM
No problems here so far. I had to log in again, but apart from that everything came up as it should.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on October 25, 2015, 09:42:54 AM
Looking good, great to see it back, Tony. Many thanks for your sterling efforts.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 25, 2015, 09:54:21 AM
Reset the Pi and Dslstats this morning so all should be good from my end now.

Logged in no problem and its all looking good Tony! ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 10:03:32 AM
Welcome back Tony ;D

Hope the donations page will be the first one to be going back up live :)

I'd be intrigued to know if you've found out what caused the major failure of the server? :no:

Yes, that page is working well, I tested it earlier myself  :lol:

The crash was complicated but basically I had uninstalled an AV (Webroot Secure Anywhere that I've sued for some time) a few days before due to it slowing down the server and not being able to exclude anything from scanning, and then restarted the server to eliminate it totally.

BUT the b*** thing still had a process running that fired off and Blue Screened the server since all its files had vanished by then.

It was also in the process of writing to the database and a lot of things got screwed up. Then despite having some 130 backups, it proved impossible to restore them,  something I'm having a debate with the makers over as they say it shouldn't have happened... Hence the rebuild which should have solved all these problems. Certainly the restore works as it's running one at the moment.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on October 25, 2015, 10:14:59 AM
I've started logging again and the site asked me to login which I did and so far all looks good....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 10:16:56 AM
Most people will need to login in again due to the 7-day expiry having passed now - but if you use the web site then that shouldn't be necessary very often if at all.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 25, 2015, 10:49:20 AM
Yes, that page is working well, I tested it earlier myself  :lol:


Yes I just tested it too, I've just donated a starting amount to the kitty :) :drink:

The crash was complicated but basically I had uninstalled an AV (Webroot Secure Anywhere that I've sued for some time) a few days before due to it slowing down the server and not being able to exclude anything from scanning, and then restarted the server to eliminate it totally.

BUT the b*** thing still had a process running that fired off and Blue Screened the server since all its files had vanished by then.

It was also in the process of writing to the database and a lot of things got screwed up. Then despite having some 130 backups, it proved impossible to restore them,  something I'm having a debate with the makers over as they say it shouldn't have happened... Hence the rebuild which should have solved all these problems. Certainly the restore works as it's running one at the moment.

Hmm sounds like a real pain and frustration, but interesting that the uninstall failed and caused that much destruction as a result :-\ Glad its back up and running without too much hair loss ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on October 25, 2015, 12:06:26 PM
Itís only been back for a short while, but already proving itís worth. My reported FECs were sky high:

Total time = 64 days 14 hours 41 min 56 sec
FEC:            3357822873              10399
Latest 15 minutes time = 11 min 56 sec
FEC:            7950353         0

Didnít think this could possibly be right, so restarted my 8800NL and now back to normal.

Total time = 36 min 5 sec
FEC:            790             3

 :thumbs: :clap: :dance:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 12:22:08 PM
Despite resetting my password I still can't login   :-[
DSL Stats claims to be uploading my data though so I'm halfway there

Feeling all alone  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2015, 12:30:19 PM
Your data is showing there, so your uploads are working.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 12:33:22 PM
I know - but I'm getting invalid username when i try to log on to the website 'weird' as that the same username I have in DSLStats to upload my data

I'll wait until Tony has chance to read this and hopefully he can help me figure out whats wrong - I suspect he will embarrass me with a 'USER ERROR' issue  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 12:38:37 PM
I know - but I'm getting invalid username when i try to log on to the website 'weird' as that the same username I have in DSLStats to upload my data

I'll wait until Tony has chance to read this and hopefully he can help me figure out whats wrong - I suspect he will embarrass me with a 'USER ERROR' issue  ;D

Can you PM me your password pse and I'll trace from this end (no I don't know passwords)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 12:43:45 PM
Thanks Tony
Just sent
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 25, 2015, 01:51:04 PM
Something minor I just found, clicking the Latency monitor at the top if you don't have one sent, directs to a broken linky.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 25, 2015, 03:46:19 PM
Tony possible to make 28 day cookie expiry a donater perk?

and welcome back :)  will resume uploading today.

--edit-- seems this time I didnt have to answer extra questions to login.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on October 25, 2015, 03:59:36 PM
 Thanks Tony,  the return is much appreciated and being put to good use.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 04:16:01 PM
I know - but I'm getting invalid username when i try to log on to the website 'weird' as that the same username I have in DSLStats to upload my data

Interestingly, this just happened to me  :-\ I think it's a case of CONFUSED_BROWSER syndrome. Changed to another browser on same terminal and logged in straight away. Probably need to flush out the browser, history cookies/restart etc etc but haven't tried yet.

If you want to try this yourself you'll need to reset your password again for the original account as I've done so several times....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: garypower on October 25, 2015, 04:36:16 PM
I've released an update to HG612 Stats GUI which removes anything MyDSLWebstats related from the GUI and automatically turns off the uploads. Hopefully this will disable uploads for people who haven't seen this thread who are using HG612 Stats & the GUI program.

I assume this needs reversing as no way to restart uploads now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 04:52:18 PM
Ronski just posted elsewhere

Until I reinstate the options,  which probably won't be until Tuesday night you have two options.

1. Roll back to a previous version of the GUI, which if you've not disabled the backup option will be in the backup folder, then don't update until I release another update.
2. Edit the ini file manually and change the option for upload to YES. Then don't run the GUI until I release an update.

Hope that helps.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: garypower on October 25, 2015, 05:01:08 PM
Ronski just posted elsewhere

Until I reinstate the options,  which probably won't be until Tuesday night you have two options.

1. Roll back to a previous version of the GUI, which if you've not disabled the backup option will be in the backup folder, then don't update until I release another update.
2. Edit the ini file manually and change the option for upload to YES. Then don't run the GUI until I release an update.

Hope that helps.


Thanks - did not think about the backup versions - all sorted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: underzone on October 25, 2015, 05:37:58 PM
I am VERY happy to see this back online! *** Donated ***
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 25, 2015, 05:59:25 PM
Why o why is SKY GO bufferibg with Sky Sports F1 are you seeing this to Tony ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 11:05:09 PM
Why o why is SKY GO bufferibg with Sky Sports F1 are you seeing this to Tony ?

Complete PITA - Silverlight kept crashing out at the F1 Race Big Screen Party I was running this evening and had to reinstall it - no buffering though.

Great Race and Result - Lewis is Champion Again  :congrats: :clap: :yay: :yay: :congrats: :congrats:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 25, 2015, 11:44:15 PM
Anyone having issues logging in with Chrome on Android? It just says invalid user name? Working fine in Firefox on my desktop.  Have tried clearing all data in Chrome and it does not help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on October 26, 2015, 12:36:28 AM
Yes just watched the BBC highlights well done Lewis  good race still no showdown between the two of them maybe nexterm season. Will say  one thing bit of miss him not joining in the celebrations Paddy had to spray his champagne
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 26, 2015, 07:56:06 AM
Anyone having issues logging in with Chrome on Android? It just says invalid user name? Working fine in Firefox on my desktop.  Have tried clearing all data in Chrome and it does not help.

Working fine on my Android tablet with  Chrome.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: JamHam on October 26, 2015, 08:58:49 AM
Hi Tony,

Thanks for bringing this back. Its a great tool.

However I'm also having the same "Invalid User Name!" issue.

I've tried 3 different browsers, cleared all the history, cookies, saved info etc and reset my password plenty of times now, but still cant get in  :(

Have you any other ideas I can try?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2015, 09:16:01 AM
Hi Tony,

Thanks for bringing this back. Its a great tool.

However I'm also having the same "Invalid User Name!" issue.

I've tried 3 different browsers, cleared all the history, cookies, saved info etc and reset my password plenty of times now, but still cant get in  :(

Have you any other ideas I can try?

Thanks

Please try again now, think I've found out why it's failing for some ...

Edit: if it failed try again, missed something at 09:20
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: JamHam on October 26, 2015, 09:17:34 AM
Hi Tony,

Thanks for bringing this back. Its a great tool.

However I'm also having the same "Invalid User Name!" issue.

I've tried 3 different browsers, cleared all the history, cookies, saved info etc and reset my password plenty of times now, but still cant get in  :(

Have you any other ideas I can try?

Thanks

Please try again now, think I've found out why it's failing for some ...


Thats worked a charm,

Straight back in.

Thanks for your help, and again thanks for bringing this back.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2015, 09:48:03 AM
We'll get there eventually  ???

If you are stuck on a Guest login with nowhere else to go then hit F5/whatever to reload and you should end up at the Log In screen. From then it will hopefully work   :'(

You might also need to clear your cache in Chrome I am told.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 26, 2015, 10:43:00 AM
Anyone having issues logging in with Chrome on Android? It just says invalid user name? Working fine in Firefox on my desktop.  Have tried clearing all data in Chrome and it does not help.
Working for me now also.  Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 26, 2015, 12:49:52 PM
All working here now for me  :clap: :clap:

Thanks to Tony for some first rate support
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2015, 05:47:17 PM
CLOCKS [AGAIN!]

Just a reminder that MDWS thinks many of you have moved to Europe since the clocks went back!!

Please check your clocks are not in DST any more  - if you have an asterisk next to your username in the user lists at page bottom (and are not in Europe!) then your clock still needs sorting.

RPis need a manual reset and DSLstats needs a restart/reload.

NStar for the RPi says:
I use the command sudo dpkg-reconfigure tzdata and select Europe and London it does take a few minutes for the RPi to initiate the new settings.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 26, 2015, 06:56:35 PM


CLOCKS [AGAIN!]

Just a reminder that MDWS thinks many of you have moved to Europe since the clocks went back!!

Please check your clocks are not in DST any more  - if you have an asterisk next to your username in the user lists at page bottom (and are not in Europe!) then your clock still needs sorting.

RPis need a manual reset and DSLstats needs a restart/reload.

NStar for the RPi says:
I use the command sudo dpkg-reconfigure tzdata and select Europe and London it does take a few minutes for the RPi to initiate the new settings.

On my Rpi2 typing tzselect option 8 option 8 again showed the time was correct and both the same gmt/utc.  Could not get the "sudo dpkg... tzdata" command to work.  I needed to close and reopen dslstats to make the change apply - I may have been impatient though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 26, 2015, 09:57:13 PM
Strange I don't remember changing the clock on my RPi but its showing the right time
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 26, 2015, 10:49:07 PM
It should do if it's set up properly. But DSLstats doesn't change with it unless you close it down and restart it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 26, 2015, 10:55:01 PM
It should do if it's set up properly. But DSLstats doesn't change with it unless you close it down and restart it.

Yes had to restart DSLStats but the RPi was fine

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 26, 2015, 10:55:19 PM
MDWS is back. Yay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: doughnut on October 27, 2015, 10:10:49 AM
Yippee :)

Tony, can you mark me as a paid donator please?

I paid up just before it went down, so there is a potential those updates were lost in the DB.

No hurry though

Alan
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 27, 2015, 11:52:42 AM
Done but you'll need to hit F5 to get the facilities....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: doughnut on October 27, 2015, 02:10:56 PM
Done but you'll need to hit F5 to get the facilities....

Thank you very much Tony  :yay: :yay: :yay: :yay: :yay:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 27, 2015, 08:04:14 PM
For those of you who are using HG612 Stats, and have the GUI version which disabled MyDSL Stats functionality I have released an update to reinstate MyDSL WebStats fuctionality, note this will not automatically enable stats upload, you'll need to check to ensure it's enabled after installing the update.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 28, 2015, 04:43:45 PM
Just to say that the Upload Monitor facility is running again on MDWS if you want to be mailed if and when your data upload fails (reachable to set on or off (default) via Options) ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 28, 2015, 05:21:46 PM
Is it just me or are the stats at the top of the page wrong?

Are the stats at the top full term or just from when you login to mydslweb stats?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 28, 2015, 05:32:56 PM
Is it just me or are the stats at the top of the page wrong?

Are the stats at the top full term or just from when you login to mydslweb stats?

Stats at the top are your live stats, the most recent you've uploaded.

Although sometimes it take a while for them for update - so it may be 30seconds behind your uploads
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 28, 2015, 05:40:20 PM
Stange mine are wrong My CRC/FEC/ETC are showing as much lower than what i am seeing from my local stats

Even the Grafs are showing more
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 28, 2015, 06:17:31 PM
Stange mine are wrong My CRC/FEC/ETC are showing as much lower than what i am seeing from my local stats

Even the Grafs are showing more

Difficult to tell without more info on what exactly you are looking at your end when you mention graphs and stats...

Do you realise your local clock is running 11 hours ahead of the current time  :o . When you reset it, you'll not upload any new data for 11 hours BTW..  [Uploading from an Orange UK address]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 03:43:20 PM
Apologies for any hiccup/lost connection etc noticed in past few minutes - I managed to crash the Apache process (Web Server) due to an over-ambitious live database backup run :-X :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 29, 2015, 04:06:07 PM
Hello Tony,

Great to see you and your wonderful creation back again.

It looks as if my updates haven't been happening since around 15:29. Do I need to do anything or will it pick up again

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 04:11:19 PM
Reload whatever isn't working please  :'(

Edit: yup that worked, you are uploading again. RPis don't seem to recover as well as other devices.
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 29, 2015, 04:43:24 PM
Is it possible to request that the HiRes option is remembered in a future version?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 29, 2015, 06:56:18 PM
Tony -- A small request from The Cattery, please. Would it be possible for the selected "Graph Size" to persist?  :-\

On every occasion when I use your utility to view A.N.Other's statistics, the "Graph Size" has defaulted to "Standard" even though I had previously selected "Large".
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 07:23:33 PM
Is it possible to request that the HiRes option is remembered in a future version?  Thanks

Yes but it would be set globally and via the Options popup.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 07:26:44 PM
Tony -- A small request from The Cattery, please. Would it be possible for the selected "Graph Size" to persist?  :-\

On every occasion when I use your utility to view A.N.Other's statistics, the "Graph Size" has defaulted to "Standard" even though I had previously selected "Large".

I think that is just a display problem and it says 'Standard' when it's actually displaying the graphs in the size you last selected.

Anyway it's fixed now and should display the correct size. If, for some reason there is no size set (loss of the cookie holding the value) it defaults to Standard.

If it persists can you describe a sequence that reproduces it please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 30, 2015, 04:33:50 AM
Thanks for the heads up Ton
i was using a old armhf device that was very slow unstable...

I am now using my centos linux server

need to the let the system read my line for some time i am getting very high numbers of ES for some reason and gent seem to find the cause maybe REIN Or Maybe RFI or heating or PIR light wish i had a VDSL test meter to Do live tests on the Line...

Are the Errors i am seeing anything to be worried about?
can you have a little look at my webstats thanks and let me know what you think :fingers:..
I just cant get my head around the errors/stats i am seeing ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 30, 2015, 08:14:34 AM
Are the Errors i am seeing anything to be worried about?
can you have a little look at my webstats thanks and let me know what you think :fingers: ..
I just cant get my head around the errors/stats i am seeing ???

Don't get paranoid over these stats now you can see them  :silly: This facility seems to cause that problem when visible errors are involved.

There are others who can comment better than I can but I wouldn't be over worried about what you are seeing. The Dynamic Line Management system (DLM) will only take drastic action on your line when you hit 2880 ES/day - and you are running at 600/day at the moment which it will not worry about - although you only have 18 hours worth of data currently - so you could hit 800 at 24 hours.

After all you are synced at 80/20 - what more do you want and have quite a bit of overhead in hand to cope with problems (how full is your cab and how long have you had FTTC, you may not be seeing crosstalk yet though?).  Get rid of all the errors and you'll still be syncing at 80/20 after all  :shrug2:

I'll happily swap with you if you are really worried - but 34/5 isn't quite the same as you have currently....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 30, 2015, 10:40:53 AM
Is it possible to request that the HiRes option is remembered in a future version?  Thanks

Yes but it would be set globally and via the Options popup.
Great same for "Show Total Averages" would be fantastic  
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: beardedwonder on October 30, 2015, 12:09:18 PM
Hi,

Would just like to say thanks, these stats have really helped me supply proof to my ISP that I have been experiencing problems. Am running the stats on a Rpi.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 30, 2015, 02:20:36 PM
Thanks for the reply tom
I have had fttc from 25/sep
I see the Es/day are going up slowly
i see now a am now amber amber red.
Its good to know i's nothing to worry about ;D
I was The thirst one on the cab so don't think cross talk is an issue YET :-X
i will keep an eye on the Stats Its great be able to Monitor the stats the way your service provides
Thanks for the great service i will one day understand the errors a little more :graduate:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 30, 2015, 03:44:37 PM
i see now a am now amber amber red.

Actually you are Amber Green Green - the lights read horizontally just to be awkward, the others are for different profiles  that get stricter as you go down the set  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 30, 2015, 06:13:36 PM
Anyway it's fixed now and should display the correct size. If, for some reason there is no size set (loss of the cookie holding the value) it defaults to Standard.

If it persists can you describe a sequence that reproduces it please?

Thank you Tony. I'll see how it now behaves for me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 31, 2015, 07:33:48 AM
UPDATES

By popular demand, for V2 the check boxes that lose their settings can now be set persistently. They are:

HiRes SNRM Graphs
Totals/Averages for Errored Seconds Graphs
Show Resyncs on SNRM Graphs


The old checkboxes are still there but are now disabled, just showing the current settings which are now made via the Options menu instead.

Changes will take effect immediately and globally on the next graph refresh but the setting may not initially display correctly for the checkboxes unless you hit the green refresh button in a pane or F5 for a complete reload.

Usual caveats still apply for the results on each (see Help), especially having both Resyncs and HiRes enabled as with the former the latter will not work even if checked (unless there are no resyncs in the time period when it will work - sometimes!) or if the timeline display is not complete,

I'll see if I can move these settings to the bottom of the main window eventually rather than have them on options as this would be more convenient. Edit: I have done this now but as it involves a lot of knock-on changes, I'll leave it running here for a while to check there are no unexpected side-effects.

Enjoy  ;D

NB: Thanks for all the donations - quite inspiring  :drink:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 31, 2015, 05:02:22 PM
Anyway it's fixed now and should display the correct size. If, for some reason there is no size set (loss of the cookie holding the value) it defaults to Standard.

If it persists can you describe a sequence that reproduces it please?

Thank you Tony. I'll see how it now behaves for me.

It now appears to be maintaining my selected pane size. So I'll say that is a job well-done.

Thank you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 31, 2015, 05:16:46 PM
Noticed a small bug with the show averages error seconds pane today , it seems greyed out so i cant select it to get the average error rate, also the data loading in each pane is maybe a little slower than it was earlier in the week ,using latest version of ff btw
Just found the new check box in options to enable it, though i didn't have any issues with  the way it was i have got used to ticking the check box if i wanted to see the average /total error second count, the slow loading of the data  seems to be limited to the initial or full page reload
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 31, 2015, 06:57:30 PM
The wee RPi just stopped uploading to MDWS and unable to connect to modem/router on Dslstats at 16:50 the only way to get it working again was to reboot the RPi very odd but it's uploading again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 31, 2015, 11:11:54 PM
I went back 120 days on MDWS it says waiting i take it our history is unsalvageable since the server crash ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 31, 2015, 11:34:28 PM
I went back 120 days on MDWS it says waiting i take it our history is unsalvageable since the server crash ?

No, database is all still there from the daily backups - mind you you did ask me to delete your account  :D

Works fine here on SNRM at 120 days and back 360 days as well...

I would guess you just had a timeout somewhere en-route as the server came back with 250ms to get the data out on its way to you for that query.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 01, 2015, 12:09:03 AM
I went back 120 days on MDWS it says waiting i take it our history is unsalvageable since the server crash ?

No, database is all still there from the daily backups - mind you you did ask me to delete your account  :D . Looking at what?

Works fine here on SNRM at 120 days and back 360 days as well...

Your a cheeky wee monkey but i love you  :D
funny my 120 days came back on MDWS after the first post  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on November 01, 2015, 01:45:51 AM
newt you wanted account gone?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 01, 2015, 03:27:36 PM
newt you wanted account gone?

Only to see if i could survive without MDWS for a week  ;D
and just by chance the server went down for few weeks and no withdrawal symptoms  :blush:

It's just a great site and the GUI on V2.0.0 is just a dream it looks so professional.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 09:49:42 PM
SNRM not showing history above 3 days on MDWS using PC 32 bit windows with Chrome Version 46.0.2490.80 m
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 05, 2015, 09:55:43 PM
SNRM not showing history above 3 days on MDWS using PC 32 bit windows with Chrome Version 46.0.2490.80 m

As I said on the original thread (http://forum.kitz.co.uk/index.php/topic,15998.msg304144.html#msg304144), no problem here under FF and Chrome under 8.1 but it may have something to do with Vista at your end as I've never tried it on that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:17:02 PM
Have rebooted PC into Windows 8.1

I am using Windows 8.1 and IE11 and same result roseways SNRM history will not go above 2 days the MDWS window just says waiting.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 05, 2015, 10:23:10 PM
Just tried on Firefox, Chrome and IE11, could view Roseways SNRM db graphs without problems on all 3, for any number of days. (W7 Pro 64bit)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:29:56 PM
Just tried on Firefox, Chrome and IE11, could view Roseways SNRM db graphs without problems on all 3, for any number of days. (W7 Pro 64bit)

It is very odd I can see others SNRM over 3 days apart from Roseways
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:42:06 PM
Just tried on Firefox, Chrome and IE11, could view Roseways SNRM db graphs without problems on all 3, for any number of days. (W7 Pro 64bit)

It is very odd I can see others SNRM over 3 days apart from Roseways

Sorry that is incorrect I can't see anyone's SNRM above three days only 2 days worth of SNRM  ???

This must be a issue with my account on MDWS  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 05, 2015, 10:44:17 PM
It certainly works for me.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:53:38 PM
It certainly works for me.  :)

It sure does B*CAT I am now sure my MDWS account has a problem and it's nothing to do with vista or win8.1 or type of web browser apart from IE9 that does not work on MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 05, 2015, 10:58:46 PM
The only suggestion I have to make is to clear the cookie(s) for MDWS and the browser cache.  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:07:53 PM
The only suggestion I have to make is to clear the cookie(s) for MDWS and the browser cache.  :-\

hate doing that I'll lose all my log in details and then have re-enter them for all my favourite web sites and that's what I call a last resort.

Give Tony a few hours to look into this issue remember he did give me back my history so what ever he did this could be the place to start looking into.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:21:37 PM
Same for BaldEagle1 SNRM anything above 2 days it goes into a waiting state

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:30:22 PM
found the problem it's in the options under Check to show SNRM graph Resyncs if it's ticked then I don't see the SNRM graphs above 3 days.

give me a gold medal  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on November 05, 2015, 11:34:13 PM
Same for BaldEagle1 SNRM anything above 2 days it goes into a waiting state


Works for me, but I can only go back 5 days
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:40:29 PM
Same for BaldEagle1 SNRM anything above 2 days it goes into a waiting state


Works for me, but I can only go back 5 days

Cheer BE1 think we have found the issue on MDWS  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 07:48:49 AM
found the problem it's in the options under Check to show SNRM graph Resyncs if it's ticked then I don't see the SNRM graphs above 3 days.
give me a gold medal  ;D

I'm outa Gold Medals at the moment but yes, you've thankfully found the problem  :D and of course that option was turned off here  :doh: ....
Now fixed for > 2 days. Cheers  :clap:

Edit: Also found some more similar ones in the 'Original' graphs for ES and Resync checkbox facilities. All fixed.
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 04:03:11 PM
THOMSON/TECHNICOLOR ROUTERS - NEED V5.6.2 (or later) of DSLstats

There are a number of new users using one of the above routers to upload to MDWS - if you do use one PLEASE make sure you are using V5.6.2 (or later) of DSLstats as there is a bug in V5.6 that causes the stats figures to be reversed for uploads and downloads with ensuing strange results.

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BritBrat on November 06, 2015, 05:50:29 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking closer it says it is 5.6.0, confused.

I am using DSLstats, should I be using something else?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 05:54:39 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking at your stats, you are not running a Thomson/Technicolor router/modem as there is data there that they do not provide.... You can display your router/modem via the Options link at the bottom of the main page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BritBrat on November 06, 2015, 05:55:40 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking at your stats, you are not running a Thomson/Technicolor router/modem as there is data there that they do not provide.... You can display your router/modem via the Options link at the bottom of the main page.

I am not and never had one.

EDIT: MyDSLWebStats.Co.Uk + DSLstats_W32 V5.6
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 06:00:13 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking at your stats, you are not running a Thomson/Technicolor router/modem as there is data there that they do not provide.... You can display your router/modem via the Options link at the bottom of the main page.

I am not and never had one.

EDIT: MyDSLWebStats.Co.Uk + DSLstats_W32 V5.6

No but the comment about 5.6(.0) and DSLstats was addressed to Thomson/Technicolor users only...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BritBrat on November 06, 2015, 06:02:25 PM
Oh sorry. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 06:55:16 PM
DOWNTIME Saturday 7th November

There will be downtime of around 30 - 40mins tomorrow morning starting sometime between 07:00 - 07:30 to change the batteries on the server UPS which expired a few days back (replacements just arrived), and also make some software/hardware changes while the opportunity is there.

Upload clients should reconnect automatically but worth checking. I'll post when it's back up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on November 06, 2015, 07:48:45 PM
Oh no! I am going to die without your site.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on November 07, 2015, 12:31:15 AM
Alec.   Stop it please..   or I will stop it for you.
I'm getting quite fed up of negativity and sarcasm of late which is coming across as troll like. 

This is twice now Ive had to respond to moderation issues, (1) when I'd gotten home late after having been at my dads bedside during his final days, and now (2) when I'm mourning his death.  There was also I believe another incident on the day he died which my mods had to deal with...

I am not amused.  >:(  In fact Im down right peed off.   
Tony does what he does for the benefit of others.   I run this site for which Im also well out of pocket this year.   I'm not paid to put up with your crap.  Take it elsewhere. 
I warned last time I would be blunt and that I dont find it in the least bit funny...  any more snipes at helpful members of the community and either I or my mods will bring the hammer down.

I requested that people play nice whilst Im not around.  Neither Eric, nor b*cat who are doing me a favour helping looking after the forums, shouldn't have to deal with it either.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 07:45:11 AM
System is back up now and all seems okay - panic while it took 10 mins to get the modem to sync though as that was down as well  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 07, 2015, 07:54:40 AM
Yes, DSLstats resumed at 7:40 here. Good job, Tony. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on November 07, 2015, 08:14:00 AM
Yes all working fine here also. Great work Tony

That moment when I issue a reboot of a server its always a 'will it won't it moment' for me
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 07, 2015, 08:08:45 PM
I hate to bring this to your attention the Resyncs and HiRes options are greyed out in SNRM and in the Errored Seconds graph the Show Totals/Averages is greyed out even if I select them in the options menu and do a F5 refresh the option show as saved.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 09:33:39 PM
Okay, they are meant to be like that unless I'm missing something.

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg303802.html#msg303802) ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 07, 2015, 10:58:31 PM
Okay, they are meant to be like that unless I'm missing something.

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg303802.html#msg303802) ...

That's ok it's just a bit of hassel to turn on/off the ES total/averages from within the options and save then hit F5 rather than click on and another click off from the GUI it was so simple you had it set like this before.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 07, 2015, 11:06:10 PM
 ???  b*cat has looked in the options (bottom of the page) and finds that he only has the means for changing his e-mail address and for changing his password.

There is nothing else present . . .  Confused.  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 11:15:17 PM
In your case, I can guess why that is (to do with no recent uploads) and I'll fix it in the morning and rearrange the order of the options a bit...

Edit: Try it again now.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 07, 2015, 11:24:22 PM
In your case, I can guess why that is (to do with no recent uploads) and I'll fix it in the morning and rearrange the order of the options a bit...

b*cat smiles inscrutably and performs one of his best Japanese-style bows.  :)

I only really use the service to view the status of others' circuits. I seem to recall that it was Chrysalis who originally prompted me to sign up (as he wanted an opinion on his circuit's well-being) and it was yourself who urged me to upload (so that Eric had someone testing the upload function of the Linux variant of his DSLstats utility).  :angel: 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 11:29:07 PM
Okay, they are meant to be like that unless I'm missing something.

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg303802.html#msg303802) ...

That's ok it's just a bit of hassle to turn on/off the ES total/averages from within the options and save then hit F5 rather than click on and another click off from the GUI it was so simple you had it set like this before.

Yes, but it didn't work properly as it was...

As noted it'll be available from below the current link list at the bottom of the page shortly where there will also be some rearrangement as per the attachment... No reload, instant change but graphs need refreshing or wait until they do so automatically

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 08, 2015, 09:29:01 PM
I have noticed what maybe a small bug with the DLM error count, the upstream appears to work ok, but the DS  is hanging on to 1 error second even after several days with no ds error seconds reported ??
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 08, 2015, 10:12:13 PM
Edit: Try it again now.....

Just a quick note to confirm that all is now good. Thank you.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 08, 2015, 10:51:23 PM
I have noticed what maybe a small bug with the DLM error count, the upstream appears to work ok, but the DS  is hanging on to 1 error second even after several days with no ds error seconds reported ??

Yes, now fixed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 08, 2015, 10:51:47 PM
Edit: Try it again now.....

Just a quick note to confirm that all is now good. Thank you.  :)

Great  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 09, 2015, 08:17:09 AM
Well the 1 error second that had been lingering for days has finally gone, so everything seems to be working as intended as far as i can tell, which is nice
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2015, 07:35:08 AM
V2.0.1 MINOR UPDATE

This is now available and will need an F5 or appropriate main page refresh/reload to fully implement.

It moves the persistent checkbox options to below the options menu at the bottom of the main MDWS window making them easier to change and so they are no longer available in the Options popup. As a result, these checkbox options are no longer displayed within the graph panes themselves. There is also some rearrangement of the links to make them tidier with Help now a link.

The change is implemented instantly without any refresh but you will need to Refresh (using the button by that name) any graphs that are affected or wait for them to auto refresh to pick up the new setting. The current setting is stored against your user name so is global for all affected graphs. It may be possible to automate the graph refresh later.

There are a number of other background changes and minor bug fixes.

GOOGLE SLOW

I notice for the past few days that Google is being very slow to respond at times making it appear that MDWS is hanging/not responding - you can check using the status bar that should be at the bottom of your browser window and will say waiting for www.google.com or canv.googlecode.com or similar. It's very bad at the time of posting this and may time out eventually leaving a blank graph.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on November 15, 2015, 09:09:06 AM
Thanks for the update  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 15, 2015, 03:55:58 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2015, 04:20:38 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D

Why  :hmm:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 15, 2015, 04:47:42 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D

Why  :hmm:

I'll be using the F5 button on keyboard more as I switch on/off the ES totals
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2015, 05:16:59 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D

Why  :hmm:

I'll be using the F5 button on keyboard more as I switch on/off the ES totals

You only need to hit the Refresh button on the graph in question to reload that, NOT reload the whole page!

I do have it working automatically now locally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 18, 2015, 10:34:10 AM
V2.0.2 MINOR UPDATE

This is now available and will need an F5 or appropriate main page refresh/reload to fully implement.

It removes the need to Refresh any graphs manually after changing the checkbox options at the bottom of the window.

Any affected graphs currently visible will now refresh automatically within a second or so of changing any checkbox.
 
Also, Supporters now have the option of removing the display of much of the information normally shown at the bottom of the main page if wanted. There are two additional links available near the bottom of the main page. One will Show or Hide the list of currently active Users and Uploaders, the other does the same for the general information shown at the bottom of the main window. Both will refresh the whole window when changed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 18, 2015, 06:02:10 PM
Many thanks Tony it works very well  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 20, 2015, 02:37:28 PM
Latency Graphs Working Again  :)

This fixes the last remaining thing that had failed when the server crashed.

The small thumbnails that appear to the far right of the User Status display above the Wide graphs (only) will appear automatically if available - they can be up to 48 hours old after which they won't display. The date/time they were saved is available by hovering over the thumbnail image. Selecting shows the current full size image.

The larger thumbnail for your own graph is also available again at top right of the main page if enabled. If the graph you currently see has no time under it and/or cannot be selected to show the full size graph then you need to F5 (or as appropriate) the main page once to pick up the code changes. The thumbnail image autoupdates every 5 mins or so.

The attachment shows some examples.

This facility is set up via the Options link and you will need to specifically allow others to view your graph within the User Status display.

Please note that several users have specified speed results or other irrelevant image for the Latency facility. These will be deleted shortly. Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 22, 2015, 08:52:36 AM
Is there a problem haven't  been able to login  since yesterday afternoon
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 22, 2015, 09:18:49 AM
Working ok here, although I didn't need to login.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 22, 2015, 09:35:48 AM
Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.

Could you not monitor the IP which is uploading the data and automatically disable the latency graph when you see a change?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on November 22, 2015, 10:13:17 AM
Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.

Could you not monitor the IP which is uploading the data and automatically disable the latency graph when you see a change?
Could TBB not fix their system to support dynamic IP's as there are quite a few around?
Mouselike.org supports them.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 10:48:59 AM
Is there a problem haven't  been able to login  since yesterday afternoon

You don't seem to have tried to logon since yesterday afternoon? Do you mean connect rather than logon although I can't see any reason why you shouldn't be able to.

Are you seeing any fail etc messages at all in your browser?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 22, 2015, 10:53:56 AM
I can't even get to the website just says failed to connect either from wired or a wireless device. Just tried my mobile on o2 that takes me straight in but no upload since about 12.30 yesterday.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 10:56:19 AM
Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.

Could you not monitor the IP which is uploading the data and automatically disable the latency graph when you see a change?
Could TBB not fix their system to support dynamic IP's as there are quite a few around?
Mouselike.org supports them.

Bear in mind they are uploaded to and hosted by ThinkBroadBand, not MDWS. However, since they are pinging your modem then the IP will be the same as the upload IP.

Probably not a very worthwhile thing to do as there is no monitoring of IPs changing as such - and even if there was, there's no guarantee that the user hasn't immediately uploaded a new graph location so it gets complicated to handle (I'm on a dynamic IP on one of my lines and do the change automatically after a resync).

There is a facility coming up to view User's latency graphs in one window (like the AllUserStats window) but only if you have selected public visibility for your Latency Graph via the Options link. Currently 62 users have latency graphs registered but only 20 have made them publicly available.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 10:59:40 AM
I can't even get to the website just says failed to connect either from wired or a wireless device. Just tried my mobile on o2 that takes me straight in but no upload since about 12.30 yesterday.

Can you find out your IP address please and PM it to me?

http://whatismyipaddress.com/

You accessed the web site at 10:47 just now on an Android device but didn't seem to load much.... 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 22, 2015, 11:05:45 AM
Yeah that was my mobile. Just checked  the server and that has internet connection and  software running. OK Tony will do
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 01:45:51 PM
Yeah that was my mobile. Just checked  the server and that has internet connection and  software running. OK Tony will do
Just confirmation this is now fixed...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 22, 2015, 02:56:32 PM
I did a cleanup using CCleaner yesterday and ever since doing this i have lost the stats pane in graph size standard it shows up ok if i select original and have looked for a setting to turn it back on again but cannot seem to find it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 03:35:24 PM
I did a cleanup using CCleaner yesterday and ever since doing this i have lost the stats pane in graph size standard it shows up ok if i select original and have looked for a setting to turn it back on again but cannot seem to find it.
I think you'll find using CCleaner and other Windows 'Registry Cleaners'/PC Optimisers etc is a total waste of time and energy and doesn't achieve anything other than cause problems like you have now. I have an adversity to letting a free 3rd-party program loose on my PC to delete whatever it feels shouldn't be there even if you can select from loads of options... What is considered unnecessary to CCleaner may be vital to something else (as you may have discovered)...

What exactly do you mean by 'stats pane'? The whole pane or maybe the Status part of the pane only? Screen grab would be helpful.

Edit:
I've removed a bit of code that looks for a cookie that might have been deleted by CCleaner and isn't recreated very often. See if it works now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 22, 2015, 03:57:29 PM
Probably not a very worthwhile thing to do as there is no monitoring of IPs changing as such - and even if there was, there's no guarantee that the user hasn't immediately uploaded a new graph location so it gets complicated to handle (I'm on a dynamic IP on one of my lines and do the change automatically after a resync).

If you were inclined to implement such a feature that would be easy to deal with: store the TBB URL and the IP address has changed but the TBB URL hasn't it should be removed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 04:17:36 PM
Probably not a very worthwhile thing to do as there is no monitoring of IPs changing as such - and even if there was, there's no guarantee that the user hasn't immediately uploaded a new graph location so it gets complicated to handle (I'm on a dynamic IP on one of my lines and do the change automatically after a resync).

If you were inclined to implement such a feature that would be easy to deal with: store the TBB URL and the IP address has changed but the TBB URL hasn't it should be removed.
Yes I realise that but the needed info isn't there currently as I said. I'll add it to the list.

Edit:
I've added some extra config to do this now and coded it in. Just need to test if for a few days to make sure mailing the user to remind them to change it works as intended (but only if they haven't changed it by the time the check is made every so often)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 22, 2015, 05:20:53 PM
Edit:
I've removed a bit of code that looks for a cookie that might have been deleted by CCleaner and isn't recreated very often. See if it works now.

Cheers Tony that has it working again  :)

EDIT:

I don't remember seeing two DLM Error Stats Indicators when using the standard  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 05:48:48 PM
Has the other one gone now?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 22, 2015, 05:51:39 PM
Has the other one gone now?

Yes it has and many thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 22, 2015, 11:42:56 PM
Hi Tony

I have been uploading to MDWS using DSLStats on Windows and I will take a look at the web-interface every now and again to see if anything's happening. However, as I'm on a perfectly healthy VDSL2 connection on a very short-line, little is "happening" as I put it... it has become quite boring in-fact! Anyway, my unexciting stats aren't the issue

I've noticed for a week or two now that I cannot access the MDWS website in my browser, the page just times out. I ignored it at first as I know you were making some changes but then I realised that DSLStats couldn't validate or upload either. I first blamed my messy PC and tried an alternate browser, checked my AV, checked host-files, etc... but quickly realised that none of my devices on my connection could access MDWS. I figured DNS problems so I changed the DNS on my connection back to my ISP's defaults but this didn't work either - the page still times out in any browser, on any device on my connection


As I'm uploading from Ireland, is there a geo-block or is my ISP (Vodafone Ireland) blacklisted perhaps? I can browse the MDWS site without issue on other ISP's so I assume maybe it's an ISP issue?



Thanks in advance and keep up the great work! I hope to make a donation in the coming days

condi (< same as my MDWS username)



EDIT: as it happens, I'm currently accessing the site without issue... but I'm toying with Google's Data Saver plugin for Chrome which is proxying the site around my connection. Without the plugin, the issue is as described above
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 23, 2015, 08:14:19 AM
Tony this morning I was sent an email by MDWS saying I was uploading again, this happened at 00:06 today but the thing is I had not had an upload failure message or a retrain, my PC sending the uploads was rebooted about 24 hours ago and I do not see any gaps in my graphs. Not concerned but thought I'd mention it.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 23, 2015, 09:22:32 AM
As I'm uploading from Ireland, is there a geo-block or is my ISP (Vodafone Ireland) blacklisted perhaps? I can browse the MDWS site without issue on other ISP's so I assume maybe it's an ISP issue?

Can you PM me your current IP Address please (the one that's giving the problem, not proxied though)

http://whatismyipaddress.com/ (http://whatismyipaddress.com/)


Thanks

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 23, 2015, 09:31:24 AM
Tony this morning I was sent an email by MDWS saying I was uploading again, this happened at 00:06 today but the thing is I had not had an upload failure message or a retrain, my PC sending the uploads was rebooted about 24 hours ago and I do not see any gaps in my graphs. Not concerned but thought I'd mention it.

Stuart

Well the message was quite correct - you had resumed uploading after a 17mins downtime from 23:48 - 00:05....

Just had a look and you have your Notify After set to 15 mins. Due to check timings not quite coinciding etc. I'd say it was probably about to send you a downtime message but the resume one got there first  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 23, 2015, 09:45:23 AM
Does the resume email say when it went down?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 23, 2015, 09:59:14 AM
No the message just says uploading again and no upload failure message was received before or after. Looking at the timing that is a very busy time on the PC which runs DSLStats. DSLStats does not show any break in what it was doing in the event log. This PC runs my weather station and although it is an Intel I5 it probably does get busy around this time because the weather program is busy doing end of day stuff, the forecasting program is busy doing the last forecast of the day. To be honest I doubt that this PC would get busy enough to cause a break in transmission of this length. As I say there is zero indication that anything failed on the PC itself.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 23, 2015, 10:12:15 AM
Can you PM me your current IP Address please (the one that's giving the problem, not proxied though)

http://whatismyipaddress.com/ (http://whatismyipaddress.com/)


Thanks

Hi Tony,

I've sent off my current dynamic IP as requested but surely enough, just as I sent it... all's working again!!

DSLStats is uploading (it told me I had an invalid key) and the MDWS website is opening again


Many thanks :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 23, 2015, 10:17:39 AM
Okay  :)

I can't find anything that would affect that range but just in case I've allowed it anyway (but after you sent your mail!)...

NB: You have an interesting U/L sync at 20480.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 23, 2015, 10:21:52 AM
Quote
DSLStats does not show any break in what it was doing in the event log.

When MDWS uploads fail, DSLstats may not detect the failure. Hence the absence of any event log entries. This is down to the fact that it uses an external program (curl) to perform the uploads, and the timeout mechanism doesn't always work if curl hangs. For the same reason the local DSLstats graphs will display a straight line during the down period.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 23, 2015, 10:33:22 AM
I have various alerts set to display in the event log so I might expect something if these monitored values change significantly. I can also see graph entries during the so called failing period for things like snrm and crcs. It is possible that the curl program is timing out for some reason which would cause a problem but I guess that does not log anywhere at least not in Windows 7 which is what this PC runs. (Sadly at present I cannot find a Linux weather program which does all I need  :( ). So as I say I can see no obvious cause unless it was curl which I cant check.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 23, 2015, 10:34:55 AM
Okay  :)

I can't find anything that would affect that range but just in case I've allowed it anyway (but after you sent your mail!)...

NB: You have an interesting U/L sync at 20480.....

Thanks Tony

It's certainly bizarre but it's all up and working here at the moment so I'll keep an eye on it for the next few days

Re. my upload sync - I'm on VDSL2 at about 200 meters from the exchange. The current attainable noted on my modem is 25 Mbps and the engineer got over 35 Mbps on his hand-held. 20 Mbps is the max upload speed available on eircom's, now open eir's VDSL2 network. The max download speed available is 100 Mbps when vectoring is used or 70 Mbps when non-vectored. Vectoring is limited to cabinet installs for now but I believe they are trialling exchange based vectoring in some areas at present. I'm non-vectored as I'm exchange based but my attainable downstream is currently showing 120 Mbps so I'm certainly looking forward to any developments around exchange-based vectoring
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 23, 2015, 03:25:31 PM
When I am here, this is a question concerning both MDWS and DSLStats

Would it be possible to support uploading back-data to MDWS... as in data that wasn't uploaded due to a missed or failed upload or data collected over a short period but not uploaded. What spurred the thought was a case I've seen on a poor connection where the link is on it's way to dropping, where the data channel falls but the DSL link stays active for a short time afterwards before collapsing also. As the data channel has failed, the last few moments of particularly interesting data from the DSL link are lost as they failed to upload. My thinking is that if DSLStats could temporarily cache those last few moments of data locally when an upload fails and then upload it to MDWS once the connection allows

I see DSLStats is storing some MDWS data in local ZIP and .log files so my innocent thinking is that it could build the cache here and then upload the lot on the next upload. However, I also recall reading about the importance of accurate clock times when using MDWS so perhaps uploading old data is a complete non-runner? I know it's a big ask either way so it's more just curiosity as to if it can be done
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 23, 2015, 04:42:32 PM
Unfortunately I think it's a non-runner for the reason you stated - the timing of uploads. Of course, in principle these things could be dealt with but it would require redesign at both ends, and at the moment I'm struggling to find the time to do the jobs which are already on the todo list.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 24, 2015, 01:26:30 PM
I've moved the very interesting but off-topic discussion of OpenEIR to http://forum.kitz.co.uk/index.php/topic,16506.0.html
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 24, 2015, 01:50:37 PM
I've moved the very interesting but off-topic discussion of OpenEIR to http://forum.kitz.co.uk/index.php/topic,16506.0.html

Apologies roseway and thanks for moving it

Back to MDWS :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mavelot on November 24, 2015, 03:09:58 PM
Hello, I am a new member from Italy.
I would point out that I think there is a bug in the status bar.
As you can see from the attached image, the attenuation value upload (highlighted in yellow) is incorrectly printed in the box of the ES.
I encountered the same problem also looking at the statistics of other users.
I hope I was helpful
Thank you

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fs24.postimg.org%2Fyf9edss41%2FCattura.jpg&hash=1d5b58a49c08a04bd56eb3943557de38) (http://postimg.org/image/yf9edss41/)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 24, 2015, 03:46:07 PM
Hello, I am a new member from Italy.
I would point out that I think there is a bug in the status bar.
As you can see from the attached image, the attenuation value upload (highlighted in yellow) is incorrectly printed in the box of the ES.
I encountered the same problem also looking at the statistics of other users.
I hope I was helpful


Hi and Welcome!

You are quite correct and the U/S ES and Attenuation columns have been reversed for about a year! I've corrected it now so thanks for pointing it out.

NB: not all modems report an U/S value.

I'll also welcome our New Zealand user while I'm at it.... I had to check on where the +13 hours time offset was coming from  ???

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mavelot on November 24, 2015, 05:55:14 PM
Hi and Welcome!

You are quite correct and the U/S ES and Attenuation columns have been reversed for about a year! I've corrected it now so thanks for pointing it out.

NB: not all modems report an U/S value.

I'll also welcome our New Zealand user while I'm at it.... I had to check on where the +13 hours time offset was coming from  ???

thanks for the quick support tony!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 12:47:31 PM
V2.0.3 MINOR UPDATE

This is now available and will need an F5 or appropriate main page refresh/reload to fully implement if you don't see the extra menu entry.

1) This adds the original fail date/time to Upload Resumed emails

2) When a Latency Graph on a Dynamic IP has a change of IP address, this now invalidates the entry if you have one (for TBB graphs only) and you'll need to get and enter a new graph reference from TBB. You can elect to be mailed as a reminder if this happens via a new setting in the Options menu

3) A new facility is now available to Supporters with an extra entry in the menu links at the lower part of the screen of Latency.

This allows a view of anyone's Latency graph who has allowed their graph to be visible publicly (via an existing checkbox in Options).

This opens in a new window and has the options of viewing Small or Large thumbnails with various refresh frequencies. The graphs are stored on the server and updated every 5 mins. The attachments shows what it looks like for the two sizes. Selecting a thumbnail shows the original graph in a PopUp as usual.

There are some 60+ users with Latency graphs available but only 20 have allowed them them to be public currently.

Downtime Advance Notice
UK Power Networks are going to leave this location powerless next week (Monday I think) for "approx six hours" - although last time they did this it lasted a lot longer..... As the UPS only lasts about an 90mins the system will be taken down before they intend to start.

More details this weekend if they don't cancel as has happened before.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 25, 2015, 01:25:35 PM
Excellent work Tony!

It's just taken me three attempts to find the correct TBB URL to enter. I wonder if others had issues trying to set theirs so perhaps some guidance notes might be in order (it's a URL ending png not html).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 02:00:17 PM
Excellent work Tony!

It's just taken me three attempts to find the correct TBB URL to enter. I wonder if others had issues trying to set theirs so perhaps some guidance notes might be in order (it's a URL ending png not html).

Didn't MDWS tell you the html link was invalid?

Edit:
No it didn't but it will now and I've added a note under the URL field...

From Help:
Latency Monitor
This sets up the Latency Graph (Ping) facility and allows you to specify the graph location for supported graph types. Please make sure that you only use the graph link provided and that it is not an embedded link (it should end in .png or whatever format the image is in). When you select Save Settings you should see the thumbnail graph - if not then check your typing/source.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 25, 2015, 03:38:24 PM
Great work Tony, would be possible to show the user's ISP, and perhaps filter by ISP as well?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 25, 2015, 03:41:12 PM
Quote
would be possible to show the user's ISP

It does show the user's ISP, but the user has to enable it first (it's in the options, under the graphs). You can see mine, for example.

[Edit] Sorry, I'm talking rubbish, which isn't unusual. I was thinking of the modem type when I posted that. :paperbag:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 04:03:10 PM
Quote
would be possible to show the user's ISP

It does show the user's ISP, but the user has to enable it first (it's in the options, under the graphs). You can see mine, for example.

 :hmm: Er, there is no restriction or option on displaying the user's ISP - it's always shown above the live graphs at far right of the graph panel itself. I think there might have been when we first started MDWS though...

@Ronski
Do you mean on the Latency graphs themselves, say above or below the thumbnail? Or just the large version as it would then fit alongside the User Name
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 25, 2015, 04:23:59 PM
I've corrected my nonsense.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 04:26:14 PM
I've corrected my nonsense.

 from one  :oldman: to another  :oldman:

 ;)

I've also started saving a dated graph every day around midnight so there can be a historical option sometime...
 
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 05:41:16 PM
The Latency facility now shows ISPs and later there will be a filter to select them out...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 25, 2015, 06:46:00 PM
That's it, and the filter will allow us to see just graphs for that ISP. Useful for seeing if something is affecting all users on a given ISP.  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 25, 2015, 09:28:09 PM
I'll keep my ICMP ping turned off thankyou very much  :)

"Why is my graph completely red (showing 100% packet loss)?

This may be due to firewall settings or because your IP address has changed. If you have a firewall, ensure that it allows ICMP ping. You will also see 100% packet loss if the address we are monitoring is disconnected from the Internet. You can find out how to configure your router or firewall "
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 26, 2015, 05:16:25 AM
And your point is? Or are you hinting at the security implications?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 08:11:28 AM
Tony I am wondering if it might be an idea to alter the frequency of emails when uploads fail. Mine started last night after I had gone to bed and this morning I had 20+ emails about it. Perhaps you could adapt the frequency of emails according to how long uploads have failed for, so for the first hour you send 6, after that only sending maybe one per half hour for a couple of hours and the hourly if still has not restarted. If this happened while I was on holiday it could be days before I saw it and would flood my inbox on the server with emails.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 08:36:32 AM
Tony I am wondering if it might be an idea to alter the frequency of emails when uploads fail. Mine started last night after I had gone to bed and this morning I had 20+ emails about it. Perhaps you could adapt the frequency of emails according to how long uploads have failed for, so for the first hour you send 6, after that only sending maybe one per half hour for a couple of hours and the hourly if still has not restarted. If this happened while I was on holiday it could be days before I saw it and would flood my inbox on the server with emails.

Stuart

It's a lot easier if you set a longer repeat interval in the first place please to avoid this happening.... After all you get a resume message if it comes back before the next fail message was due. I may default it to an hour anyway to avoid this problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 09:06:57 AM
It's a lot easier if you set a longer repeat interval in the first place please to avoid this happening.... After all you get a resume message if it comes back before the next fail message was due. I may default it to an hour anyway to avoid this problem.

To be honest I forgot it was an option  :( I will indeed do that.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 26, 2015, 09:14:34 AM
Tony, Would it be possible to have a 0 mins or Off option for the repeat which turns the repeat emails off?

I don't have the warnings enabled as the PC running HG612 modem stats is turned off over night and I don't want half a dozen or more emails telling me what I already know. I would like to be alerted if it fails during the day. A single email when it fails would be fine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 10:25:22 AM
Further changes to V2.0.3

1) There are now additional Configuration intervals for the repeat Upload Fail messages through to 24 hours to avoid too many messages if preferred. The repeats can also be turned Off completely if you want. You'll still get the initial message if the facility is enabled. If repeats are set to Off, you'll need to check the Notify after Uploads resume box if you want to know when the line comes back up.

2) All User Latency View - this now allows you to select the ISP so the graphs can be viewed for just one ISP (needs an F5 or whatever if already running to see the added list).

Note: The ISP list is only updated when the whole page refreshes (F5 or change Interval or Graph Size) and reflects all ISPs for all latency graphs in the system. Since not all users will allow a view of their latency graph, there may be no currently visible graphs for some ISPs...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 10:34:39 AM
Just wondering about the fail emails some more. I had to turn the power off yesterday to do some work here which means ofcourse that there will be no uploads even though my laptop running DSLStats will still operate for an hour or so on battery but the router is off. Now currently this will trigger a fail email after my initial period (currently 15 mins). Is there any way DSLStats could tell MDWS that uploading has stopped deliberately? That way I could stop DSLStats trying to record for the duration of the outage, something I dont bother with right now. Just a thought.....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 26, 2015, 10:35:45 AM
!!!***!!! Tony - that was quick!

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 10:43:27 AM
Just wondering about the fail emails some more. I had to turn the power off yesterday to do some work here which means ofcourse that there will be no uploads even though my laptop running DSLStats will still operate for an hour or so on battery but the router is off. Now currently this will trigger a fail email after my initial period (currently 15 mins). Is there any way DSLStats could tell MDWS that uploading has stopped deliberately? That way I could stop DSLStats trying to record for the duration of the outage, something I dont bother with right now. Just a thought.....

Stuart

Even if it was possible, which is unlikely, Eric has little time available to do anything currently. You'll just have to manage it yourself with the current options. Possibly just turning off the monitoring completely is the best idea if you can't cope with it as it is.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 12:48:02 PM
Thats fine Tony I'll turn it off when I go away. I'll just leave those thoughts as an idea which might happen in the future if it is decided it's worth it.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gazaai on November 26, 2015, 03:28:54 PM
Hi Ive just started using myDSLwebstats and its great. I am running a Billion 8800nl with DSLStats on raspberry pi. Although I have noticed two things:

-I don't seem to have any G.INP stats on the site
-And why does my sync rate highlight in yellow even tho its only 4kbs from the attainable. A little too sensitive if you ask me

My username on myDSL is: GaZaai
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 03:59:55 PM
Hi Ive just started using myDSLwebstats and its great. I am running a Billion 8800nl with DSLStats on raspberry pi. Although I have noticed two things:

-I don't seem to have any G.INP stats on the site
-And why does my sync rate highlight in yellow even tho its only 4kbs from the attainable. A little too sensitive if you ask me

My username on myDSL is: GaZaai

Your G.INP stats will be there now but only starting from now as the process that handles these had been hung up for some days....

The yellow background is only an alert..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gazaai on November 26, 2015, 05:42:02 PM
OK cheers, and yeah I know.. I'm just a bit OCD and don't like seeing the alert for something so little, if you know what I mean haha
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2015, 07:40:50 AM
OK cheers, and yeah I know.. I'm just a bit OCD and don't like seeing the alert for something so little, if you know what I mean haha
There is now an arbitrary 5% tolerance on U/S and D/S before it puts the warning on so see how that goes :) This will also remove the warning on some (but not all) G.INP lines where the Attainable is often a lot higher than the current Sync rate.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 27, 2015, 08:05:52 AM
I don't know how modems calculate the attainable figures, but in my case (with G.INP enabled) the attainable downstream is about 18 Mbps less than the actual speed. So I'm sure it's right to ignore the attainable speed when G.INP is enabled.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2015, 08:13:18 AM
I don't know how modems calculate the attainable figures, but in my case (with G.INP enabled) the attainable downstream is about 18 Mbps less than the actual speed. So I'm sure it's right to ignore the attainable speed when G.INP is enabled.
Yes, it's set to warn when the Sync is greater than the Attainable - which is the same as you are finding! I'll see if I can turn it off completely for G.INP enabled lines..

Edit: Done
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 27, 2015, 08:17:10 AM
I seem to be having problems viewing 24 hr graphs*, both of my accounts only show up to 24 November, Roseways is the same, Pauleagles only goes up to 25 November. Others are fine. As far as I'm aware both my accounts have been uploading, as I've had no emails.

*Actually I there are no dates past the 24 November in other graphs as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2015, 08:27:34 AM
Ah you mean the 24 hour multi graphs not the single 24 hour graphs.... I can see that and will have a look when I get back later.

Edit: now fixed.

Would it make more sense to have these graphs as rolling 24 hours to current time? And there really isn't enough vertical space to view them as wide graphs in the smaller heights currently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 27, 2015, 10:10:13 AM
All fixed thanks,  yes it would make sense to have the current days graphs showing the last 24 hour period up to the current time.

I'll sort you out another donation soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gazaai on November 28, 2015, 01:32:01 AM
Thanks for the quick edits, works excellent now :)

Edit: Just noticed that my DSLAM doesn't seem to have a value? I have a billion 8800nl and I have an Huawei cabinet, do you think its not uploading the information of my DSLAM?. Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 29, 2015, 11:38:18 AM
DOWNTIME MONDAY 30TH NOVEMBER 2015 from 10:00 or so

The MDWS server will be down from around 10:00 - 15:00 (or later) as UK Power Networks are pulling the power from our substation to finish renewing some overhead supply wiring. Maybe they'll remember not to disconnect the street lights permanently this time  ???
 
Edit: this never happened and no explanation as usual. Hopefully they'll tell us when they try again. Maybe.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 29, 2015, 11:52:14 AM
Thanks for the warning Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mikecrawford71 on December 01, 2015, 12:40:45 PM
Please can you advise if the Netgear D6400 can be added to the list for Upload Modems?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2015, 12:43:55 PM
Please can you advise if the Netgear D6400 can be added to the list for Upload Modems?

If it works okay, yes....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mikecrawford71 on December 01, 2015, 12:58:48 PM
If it works okay, yes....

Hi Tony, I'm currently using DSLstats_W32 V5.6 to query the info from the modem (I've set the modem in DSLstats to a Netgear DGND3700 and that setting seems to get everything it needs from it).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2015, 01:10:30 PM
Okay done. Wasn't sure if you were asking if it would work, hence the question...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 02, 2015, 05:13:00 PM
Registration Failures

Anyone trying to Register since the 27th November will have failed with the page just reloading on submission but with no reason why being offered.

The page has, as required by current EU Law, a system that gets you to consent to the use of Cookies before continuing and it uses some Javascript code from another site to do this. Unfortunately, the host decided to move the code to another location as it was so popular they couldn't afford to host it for free (I know the feeling) - but without any visible error being generated which wasn't very helpful at all  :rant:

The facility is currently disabled until I can find a reliable solution which is to host it locally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on December 03, 2015, 03:48:12 PM
why didnt you host the javascript locally? using a 3rd party you have no control over for code is a big security risk no? not to mention bad for performance with an extra dns lookup.

Or is there something I am missing. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 03, 2015, 03:55:32 PM
why didnt you host the javascript locally? using a 3rd party you have no control over for code is a big security risk no? not to mention bad for performance with an extra dns lookup.

Or is there something I am missing. :)

It is hosted locally now but couldn't be originally.  Haven't implemented it live yet though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: deanwade on December 04, 2015, 10:15:23 AM
Good morning Tony,

In the notification email that can be configured, would it be possible to include or add an option for the public IP address after a resync/restart please?

I think this would be a useful feature for when one is away from home and ones DDNS service fails preventing remote access (as has just happened to me!).

If this is considered a security vulnerability then perhaps the public IP address could be displayed in the users account information.

I am using DSLstats_RPi V5.6 currently but hope to run the Linux DSLstats version on my Synology RS812+ NAS. ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 04, 2015, 10:36:46 AM
I think this would be a useful feature for when one is away from home and ones DDNS service fails preventing remote access (as has just happened to me!).
Just sign up to an additional DDNS service.

I certainly don't want my IP address bandied about in emails.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: deanwade on December 04, 2015, 10:56:03 AM
Whatever you would be comfortable with then.

A second DDNS service would suffer with potential common mode failures in the client machine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 04, 2015, 10:58:07 AM
I use the DDNS capability provided by my router which is more reliable than a client machine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 04, 2015, 11:56:11 AM
Good morning Tony,
If this is considered a security vulnerability then perhaps the public IP address could be displayed in the users account information.
It is already displayed at the top of the Options popup - or at least the address you are using for the web site is. Conceivably, it may not be the address you are uploading from though if you have multiple lines or aren't at home/work.

Edit: I've modified to show both the current IP Address being used by the browser and also the last upload's IP Address.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: deanwade on December 04, 2015, 10:34:28 PM
Tony,

That's great... many thanks!  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 04, 2015, 10:56:18 PM
Brilliant  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 05, 2015, 11:44:52 AM
Further changes to V2.0.3 now available

These only apply to the wide (Supporter available) graphs.
NB although not mandatory, if you have the 24 Hour Graphs facility already running, you might want to reload any such panes using the green Refresh button if anything looks strange.

24 Hour Graphs


1) The current day's graphs are now displayed for a rolling 24 hours (rather than from midnight to the current time) updating every 5 mins. If the equipment is running at around midnight then the stats will carry on rolling into the next day

2) The SNRM graph now supports the HiRes option (it was previously always HiRes). PopUps similarly.

Note that the green Refresh button now always pulls back a Rolling 24 hour graph for the current day as does changing the selected user. All other graphs are static and do not refresh once displayed.

BTW, if during the data collection for the eight small graphs, anything times out for whatever reason, the graphs do not display. The green Refresh button will hopefully pull them back.


All User Latency Monitor

This now has an archive ability which allows you to look back at individual latency graphs for up to 8 days back beyond the current one. The archive images are displayed as very small thumbnails in a row under the main thumbnail and selecting one displays a PopUp as normal (see attached images to help explain the description!).

For Small main thumbnails there are FOUR archive images and for Large there are EIGHT (currently), and they are displayed in descending date order starting with the previous day. If any graph is unavailable, it will show a red cross on it.

NOTE that it can take a long time (maybe 30 seconds) to bring up the initial display after making a selection change depending on how many users/images you are displaying. After that auto refresh takes over and the refreshes are much quicker as they use Ajax (a specialist Javascript library) to cache the revised display while loading.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on December 08, 2015, 10:27:11 AM
I should probably know the answer to this, but I'm not sure. On my stats (user=toulouse), the upstream sync rate is showing as 5999 highlighted in yellow. The max attainable is 5895. Could someone please explain the significance, if any, of this situation.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 08, 2015, 10:30:58 AM
It just means that the sync speed exceeds the max attainable. The max attainable is a calculated figure based largely on the SNR and indicates that if you were to resync now, your sync speed would fall to around the max attainable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on December 08, 2015, 10:39:29 AM
Hey, thanks Dray. So it's nothing to be too concerned about.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 08, 2015, 02:48:55 PM
I should probably know the answer to this, but I'm not sure. On my stats (user=toulouse), the upstream sync rate is showing as 5999 highlighted in yellow. The max attainable is 5895. Could someone please explain the significance, if any, of this situation.
toulouse


If you hover over the upper part of that section it explains what it means....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 08, 2015, 02:50:02 PM
DOWNTIME

Briefly at 15:00 while I down the server and change UPS battery that has expired with the replacement just arrived...


Back up but seem to have a problem with a Cisco switch that doesn't start up again properly when power has been off (it starts up but little or no data flow on some ports). Has happened before but forgot....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: aesmith on December 08, 2015, 07:39:30 PM
How do you have the switch ports configured?   Default spanning tree can be slow to go to forwarding state,  use "portfast" if you can be sure of no loops.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 09, 2015, 03:03:35 AM
Seeing slow loading of the graphs again although it seems to be randomly loading slowly and sometimes the whole thing is slow to resolve , also sometimes one of the panes fails to load giving the connection was reset message from firefox
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 07:53:08 AM
How do you have the switch ports configured?   Default spanning tree can be slow to go to forwarding state,  use "portfast" if you can be sure of no loops.
Thanks. From memory it's as it came (about two years old) straight out of the box since visually it was doing what was required for the ports. The server is on port 8 and I could see zero LED activity yesterday until powered on/off whereas other ports were actively passing data. I'll dig out the instructions when I get some time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 08:14:14 AM
Seeing slow loading of the graphs again although it seems to be randomly loading slowly and sometimes the whole thing is slow to resolve , also sometimes one of the panes fails to load giving the connection was reset message from firefox
I can't see anything untoward in the logs from that time period - data to you was delivered in 280ms at worst and from then on it's mostly up to your end and the routing involved.

Likely cause is possibly Google, there were long periods yesterday morning where the browsers here were waiting ages for the various Google servers involved in delivering the graph data to respond. Google's Terms of Service do not allow the needed code libraries to be downloaded and saved locally unfortunately. Personally I find Chrome works a lot better with MDWS than Firefox....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 09, 2015, 07:20:24 PM
Have noticed on the SRNM graph there are small gaps of 10mins without any upload it seem to have started yesterday at 15:00, what I have done is to reboot RPi and router to see if it fixes this issue but no.

Is there anything else I should try like change the DNS server the router is set to use Google DNS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 07:57:33 PM
That looks to be more generic than just you but not everyone is affected at the same time. It roughly coincides with the last server restart. I've restarted the server database and web server at 19:53. If that doesn't help I'll do a total machine restart later.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 09, 2015, 09:20:17 PM
I am having a look at SNRM at 20:29 on both MDWS and on the RPi there is still some missing bits on both, now even this is showing up on the DSLstats V5.6 graph on the RPi that would suggest it's the uploading program  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on December 09, 2015, 09:58:40 PM
Have noticed on the SRNM graph there are small gaps of 10mins without any upload it seem to have started yesterday at 15:00, what I have done is to reboot RPi and router to see if it fixes this issue but no.

Is there anything else I should try like change the DNS server the router is set to use Google DNS

I'm seeing this too for around the same time frame?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 10:16:22 PM
Have noticed on the SRNM graph there are small gaps of 10mins without any upload it seem to have started yesterday at 15:00, what I have done is to reboot RPi and router to see if it fixes this issue but no.
I'm seeing this too for around the same time frame?
Don't forget that the server was intentionally down yesterday from 15:00 on and off for 40 mins while the UPS was sorted and some other changes made. The current problem is different but does seem to be primarily affecting DSLstats users as Newt observed. My own uploads are also made using DSLstats and that is running on the server and thus directly into the database. That is fine and makes me think this is not a server problem. I'll eliminate cables and switch in an hour or so.


NB I use OpenDNS here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 10, 2015, 06:14:39 PM
If i select  the option that displays both up and down stream snr's  i see a lot of small gaps in the snr traces, this displays on less than 24hrs  or up to the 2 days mark,

But if i select to view up or downstream only snr's there are no gaps displayed So it would appear to be a cosmetic issue and not a data upload issue IMO
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 10, 2015, 07:31:31 PM
If i select  the option that displays both up and down stream snr's  i see a lot of small gaps in the snr traces, this displays on less than 24hrs  or up to the 2 days mark,
But if i select to view up or downstream only snr's there are no gaps displayed So it would appear to be a cosmetic issue and not a data upload issue IMO


Afraid not.... The SNRM display up to 2 days is the only graph that displays missing uploads using a load of inserted nulls to override the default chart behaviour... And that is to just join up any missing points with a straight line as DSLstats normally does. If you look at the downstream SNR carefully at the same point where there is a gap on SNRM you'll see the cursor jump over the missing data..


Most of the day has been spent trying to trace this with not a lot of luck as there is no consistency to it or anything much in common between those affected. The server was eventually restarted at 16:33, the switch appears to be configured and working as it should. But I can't spend a lot more time on it though at the moment due to other commitments and generally it's still working as intended.


NB Dray and ray-dorset look like you need to restart DSLstats  as you have both been uploading empty files since 03:00 or so. (two of the four tone related files uploaded hourly)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 10, 2015, 08:09:55 PM
Probably another windows update direct hit. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 10, 2015, 10:54:55 PM
If it is a result of a Windows Update you can remove thoses updates and test it will require a reboot, just had look at update tuesday on vista and have 12 updates most seem explanatory but the other updates i'll have to digg deep.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 10, 2015, 11:03:01 PM
I just unzipped the ini file from the backup
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 11, 2015, 05:40:58 PM
mmm, seems to be working without any gap's since around 2am for me,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 11, 2015, 08:42:10 PM
mmm, seems to be working without any gaps since around 2am for me,


The same applies to the great majority of others as well - but I was asleep at the time. ::)


I suspect it was something external to the server, what I have no idea.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 11, 2015, 08:44:26 PM
No SNRM gaps for two hours since RPi & DSLstats was turned off/on at 17:59  :fingers:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on December 12, 2015, 09:09:45 AM
Wish I had checked this thread first... I've beeen searching for a problem with my firewall, switches or server for days trying to find the cause of the missing data.  :-[
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 12, 2015, 10:36:30 AM
Apologies. What I will try and do is set up some form of summary Notice Board on the main page (at the top) that can be read/hidden as needed to alert to problems/resolutions/changes like this and link to a post in this thread.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on December 12, 2015, 10:55:56 AM
No need to apologise Tony, however that's a good idea.

Having had problems with my line and various internal network issues, now all resolved I hope, I've been watching the 24 hour profile monitor to see if it every goes to 24.00 :)

At present it's at 23.83.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 21, 2015, 08:34:10 AM
DOWNTIME


The MDWS server was down from about 07:45 to 08:10 this morning - around 10 users have not reconnected for upload so you might want to check your client is running and restart if necessary if you don't have a failed upload alert mail set up.


Merry Christmas and a great New Year and 2016 to everyone, especially those who have supported the project to date  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andy265 on December 26, 2015, 11:32:18 PM
It's more cosmetic than anything as they are the same company now, but my current IP (79.67.98.xx) is showing up as Tiscali on MDWS but I'm on TalkTalk. I think it's more their fault for reusing a block of IPs and not updating the whois details.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 26, 2015, 11:43:30 PM
It's more cosmetic than anything as they are the same company now, but my current IP (79.67.98.xx) is showing up as Tiscali on MDWS but I'm on TalkTalk. I think it's more their fault for reusing a block of IPs and not updating the whois details.
Well the IP lookup comes back with both - the main entry used for getting the ISP is for Tiscali but the abuse@ contact mail is for TalkTalk....!! I'll change it for you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 27, 2015, 07:44:11 AM

DATA DELETION

From Jan 7th 2016, additional uploaded data deletion is going to take place on top of that already in place to keep on top of growing storage requirements.

Currently, anyone who has uploaded in the past but hasn't uploaded any data in the past 3 months has all their previously uploaded data deleted but with account details and settings left in place.

From 7th January, anyone who uploads and is not a Supporter will only have 5 days of rolling data retained on the live database system, regardless of how much there is stored.

Similarly, anyone who uploads and isn't a Supporter and hasn't visited the web site in the past 3 months will only have 5 days of rolling data retained, regardless of how much there is stored, on the assumption that the older data is of no interest. There are a fair number of users who appear to have just forgotten they are uploading and have lost interest/never visit the main web site to look at their data, a number going back over 10 months and many more over 3 months....

There is a notice on the main MDWS page for those affected. If you are affected and want to keep your data, then you need to become a Supporter by Jan 7th 2016 if older data is to be retained.

Thanks go to those who have Supported the site to date. The continuous subscriptions from some are much appreciated and it all goes towards the running costs and reducing the operating deficit.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on December 27, 2015, 06:26:44 PM
Can you confirm that there is no impact for supporters?  Supporters will not have any data removed even if they don't login?

Could you consider adding the ability to have a special url to login? Could you generate a 32/64 char string and use that to allow users to login without any passwords / secrets / questions?

You could add this for supporters only?

Thanks for providing the service.  Knowing I have stats going back is essential if anything goes wrong with my line again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 27, 2015, 07:02:25 PM
The "hasn't uploaded for 3 months" applies to everyone, Supporters or otherwise. That's been in operation for some time. Often deletes a couple of users' data a day.

Neither of the other deletions apply to Supporters - I've modified one to make that clear.

There will also now be a 10 day advance warning e-mail sent to affected users so giving time to take any action they may want to. There are users with invalid e-mails so it's a good idea to keep these up to date as otherwise no contact is possible.

There aren't any plans for the other suggestions at the moment since very few people need to login frequently these days - you certainly shouldn't need more than a username and password  - and not even need to login again for at least a month, if at all, if you use the site at least once a week. Adding other means of logging on purely as a convenience just duplicates what's already there.

Edit: Honorary Donees
Also need to say that there always have been a number of users who have not necessarily donated (although many have) but have assisted in some valuable way with the creation and/or upkeep of the site since its inception in July 2014. These are, of course, exempt as well and currently regarded as honorary Donees. Shortly, these will be distinguished in the various color coded lists at the bottom of the main page with an additional Exclamation Mark (!) after their username as well as being shown in green text.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 27, 2015, 08:40:32 PM
There is no excuse any more for not uploading stats 24/7 if you are serious about your line stats a simple Raspberry Pi will do the job with a negligible impact on electric bills the RPi will use 0.02p per day * 7 days = 0.14p * 4 weeks = 0.56p * 12 months = £6.72

PS it's time for a donation from me this friday  ;)
here is a nice an easy watts Calculator
http://www.rapidtables.com/calc/electric/electricity-calculator.htm (http://www.rapidtables.com/calc/electric/electricity-calculator.htm)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on December 27, 2015, 10:33:45 PM
How much would it cost to put a Pi together to do it?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andy265 on December 27, 2015, 10:39:13 PM
Just looking at Amazon, the raspberry pi is £26, so with a case, psu and sd card, probably around £40.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on December 28, 2015, 09:35:49 AM
I bought this starter kit from Amazon, has everything you need to get up-and-running including a Wi-Fi adapter. http://www.amazon.co.uk/dp/B00T53135O/ref=pe_385721_37986871_TE_item (http://www.amazon.co.uk/dp/B00T53135O/ref=pe_385721_37986871_TE_item). It's been running quite happily since February.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andy265 on January 04, 2016, 10:16:53 PM
It's more cosmetic than anything as they are the same company now, but my current IP (79.67.98.xx) is showing up as Tiscali on MDWS but I'm on TalkTalk. I think it's more their fault for reusing a block of IPs and not updating the whois details.
Well the IP lookup comes back with both - the main entry used for getting the ISP is for Tiscali but the abuse@ contact mail is for TalkTalk....!! I'll change it for you.

I've got a new IP that's done the same thing - 79.67.112.xxx - guess they've reused the whole of that former Tiscali block for TalkTalk.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on January 19, 2016, 12:18:35 PM
Some education please.

MyDSLstats ID - pdes

1) A few days ago, my U/L SNR suddenly went from 6.1db to 15.3db.  The U/L speed dropped by 50% (an awful lot when the max is 1Mb!!).  Today, I was notified of a re-sync with this message:

Reason: 1 Remote Defect Indicator/DLM. 

What does this actually mean?  Is there a line fault?  Has the DLM kicked in (or out)?

2) I have attached a bits per tone snapshot. Does this look normal?

Thanks

David
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 19, 2016, 07:21:25 PM
The 1 Remote Defect Indicator/DLM seem to happen when there has been a large change in SNRM be it on the upstream or downstream in the last 24 hours.

So its just a guess the DLM is trying to normalize the SNRM back to what is was before the change :-\ 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 19, 2016, 08:24:43 PM
Database Unavailable... at 20:23 on MDWS  :o
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on January 19, 2016, 08:26:42 PM
Database Unavailable.. Is MDWS fighting some gremlins tonight Tony? edit, now it's back up again??
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 23, 2016, 11:28:38 AM
Database Unavailable.. Is MDWS fighting some gremlins tonight Tony? edit, now it's back up again??

Sorry missed these two posts....  Yes, there was a problem with TCP socket allocations and the server ran out of them  :(

Fixed quickly and being monitored but haven't seen any problem since.

I haven't been around a lot as we had to say goodbye to our faithful doggie companion (Charlie, an Old English Sheepdog) of over 12 years on the 4th Jan and haven't felt like doing much since. He had lost all his hind leg muscles over the past year and could no longer get up without collapsing so it was the kind thing to do. He was surrounded by friends at the end - but aged 14 1/2 (he was a rescue) so had a good innings. I've attached a piccy from 2007 of him.


Anyway, there is a new facility going on shortly that I started on New Years Day but only just finished....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 23, 2016, 08:40:59 PM
Having pets who's live span is shorter than our own is always going to end up with the owner grieving it is not fair and you think yourself I'm not going to go though that again no more pets any-more, but six months or a year later we do it all again with a new kitten or puppy and fall in love all over again.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 24, 2016, 08:13:44 AM
NEW FACILITY - UPLOAD PERCENTAGE

This doesn't need any restarts so is on as an addition to V2.0.3

I did this for myself originally but thought others might find it useful. For the wide graphs only, there is now a small information box next to the traffic lights in the Status display above each graph that shows a colour-coded percentage of uploads made for any user in the past rolling 24 hours (i.e. 1440 will show 100%). See attachment for some examples.

Obviously it's ideal to have 100% uploads all the time for best accuracy where counts matter (particularly ES for the DLM display). Since it's almost inevitable that a few will possibly be missed during a 24 hour period for a multitude of reasons, there is an allowance of 5 missed uploads and will still show 100% on or below that (to avoid a plague of 'where did my upload at 16:43 go to - is there a fault?' posts. I do restart the web server quite frequently for various updates and an upload might be missed due to this for a start.

The boxes are defaulted to being shown all the time. If you do NOT want to see these boxes, you can turn them off via the Options menu. They'll disappear automatically within a minute. And turn them back on in the same way.

SSL (Encrypted Connection)
The server now has a GeoTrust/RapidSSL SSL Certificate on sensitive pages so you can be sure you are connected to the correct server when logging on and the traffic is encrypted. It's sole purpose is currently for server identification and sensitive data encryption only.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on January 24, 2016, 09:35:52 AM
Nice touch. Any other nice touches or updates in the pipeline. Keep up the good work much appreciated Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 24, 2016, 09:49:04 AM
Nice one, Tony. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on January 24, 2016, 04:28:23 PM
Sorry to hear about Charlie  :'(
Pets are part of the family so I can fully sympathise.

__

Thank you for the MDWS update.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 24, 2016, 04:47:18 PM
Amazing to see so many MDWS members who are able to make use of the Infinity 2 service 40+ Mbps all the way upto 80 Mbps and even more members on 70 Mbps than last year Oprenreach must be doing something right.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on January 24, 2016, 07:59:58 PM
just Haewei cabs not ECI cabs. Us ECI cab users are still hopping for G.inp
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 24, 2016, 08:37:08 PM
just Haewei cabs not ECI cabs. Us ECI cab users are still hopping for G.inp
Yes, as an ECI user I'm hopping - mad  >:D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on January 25, 2016, 03:32:11 PM
Hi

I hope you don't mind, but I read you have a geotrust SSL

I'm sure you know already, but just in case you did not, you can get a free SSL from startssl (startssl.com) and renew free.

There is also lets encrypt, who offer free SSL

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 25, 2016, 04:02:55 PM
Hi

I hope you don't mind, but I read you have a geotrust SSL

I'm sure you know already, but just in case you did not, you can get a free SSL from startssl (startssl.com) and renew free.

There is also lets encrypt, who offer free SSL

Many thanks

John

Thanks. Yes, I wasted  several days talking to a StartSSL free support person (who was worse than Plusnet's support in understanding what was wrong) trying to get it working properly (it ran sort of okay but the certificate chain was broken and FireFox didn't like it) and gave up in the end....

I believe Lets Encrypt doesn't run under Windows though.

The RapidSSL one worked first time and has some other advantages - they even phoned me from the States this morning to check it was working okay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on January 25, 2016, 04:16:59 PM
Hi

Many thanks, and sorry I didn't realise lets encrypt could not be used in Windows

Have you looked at positivessl, if it helps we can give you a positive SSL but you would need to register on our portal so you have full control over it

I know positivessl works very well in Linux and Windows

If you would like to take me up on my offer, please PM me and I'll give you the details

I hope you don't mind the offer, and please disregard if you would prefer not too

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on January 26, 2016, 04:07:22 PM
tony come renewal time if you to save money pm me, I will help you on startssl, I deployed it to a website a month ago and its fine in all browsers I tested it in including firefox.  I plan to migrate more to startssl when they expire also since paying for automated cert's is a con.

The internet is moving to free cert's since as a whole there is a push to a https only web which is only viable if signed certs are free.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2016, 04:17:18 PM
Thanks but already covered.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 08:29:49 AM
VERSION 2.0.4 UPDATE

There has been an update affecting background code that means you need you to reload the main page (F5 or whatever) to pick some of it up (affects the updating of the graphs when the checkbox options are changed). You should see a warning to do this if your running version needs upgrading.

Also, missing up until now,  MDWS can now show Severely Errored Seconds (SES) in graphical format. Further post to follow explaining this.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 09:48:40 AM
SEVERELY ERRORED SECONDS AVAILABLE!

This data hasn't been available until now since the data isn't uploaded in the usual format. It's now calculated and stored on MDWS locally though and has been available for a few days. Examples attached.

Available only in Wide graph format and limited to the Current Date/Time range. It function pretty much the same way as Errored Seconds, with data being updated every hours at 3 minutes past the hour. Data is available back about two months currently. The entry appears immediately after Errored Seconds in the dropdown list as Severely ES.

The Status bar (which shows the current minute's instantaneous figures) above the graphs also shows SES adjacent to ES. To help spot any, the SES section takes on a coloured background when any are detected - yellow for any at all and reddish when 10 or greater. Rather than the instantaneous count, SES displays the total for the past 5 minutes instead to maintain visibility.

The SES count also appears on the dedicated All User Stats page, again totaled over for 5 minutes. It can't be ordered by that column though as the data isn't in the same format but ordering by Errored Seconds will usually also show SES at the top.

I believe I'm correct in saying that ONE Errored Second results from at least ONE code violation (CRC for example) within any second OR at least one Loss of Service event occurred  - and that ONE Severely Errored Second has at least TEN code violations in any second. So lots of ES does not necessarily mean a corresponding increase in SES. And that the DLM system possibly takes more immediate notice of continuing high SES counts.

Also, thanks to all those who donated in the past month to help keep the system running  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on February 01, 2016, 10:17:12 AM
I got the upgrade banned and F5'd.  The graphs reloaded but I am still on 2.0.4 without the Serious ES.

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 10:47:49 AM
Try hitting the Green reload button and check the list again - bear in mind it's not in alphabetical order and is listed after Errored Seconds in the dropdown. I can see others using it. 2.0.4 is the latest version.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on February 01, 2016, 12:30:43 PM
Nope, not in my drop down! :no:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 12:54:07 PM
Quote
Parse error: syntax error, unexpected 'endif' (T_ENDIF) in <Path removed> on line 650

Doesn't look good :(


Admin edit: path info removed for confidentiality reasons Thanks ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on February 01, 2016, 12:58:06 PM
Yes, I'm seeing that error as well.

Any ideas anyone ?

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:04:17 PM
Fixed, dropped  a cup (empty) on the KB....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:23:54 PM
Nope, not in my drop down! :no:

Well I can see 12 others with the entry okay..

Can you just refresh any wide graphs please that you have open (using the Green button) and should be able to see what's happening from this end...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 01:28:16 PM
I thought SES was Severely Errored Second.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:37:54 PM
I thought SES was Severely Errored Second.
I guess so when there's only one...

Kitz defines them as plural as are Errored Second(s)...

I also note:

Ten consecutive SES's will trigger a UAS event, and will remove the path from use. The path will become usable again after 10 consecutive seconds with no SES.

A count of UAS events can be triggered by a LOS event and will continue to accrue for each second that the system is up and the path is unavailable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 01:46:50 PM
I thought SES was Severely Errored Second.
I guess so when there's only one...

Kitz defines them as plural as are Errored Second(s)...

I also note:

Ten consecutive SES's
Apologies. What I mean is you have them as Seriously, but I think they're Severely.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:54:39 PM
I thought SES was Severely Errored Second.

Oh er  :-[  I need to make some amendments a bit later it seems.... Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 02:07:41 PM
No worries mate :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on February 01, 2016, 02:36:50 PM
Nope, not in my drop down! :no:

Are you looking at the wide graphs as shown in the attachment to reply #1134??

Quote from: Reply #1134
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fforum.kitz.co.uk%2Findex.php%3Faction%3Ddlattach%3Btopic%3D14361.0%3Battach%3D18825%3Bimage&hash=351f4472a4ba7d1dd5e7b40b266453c9)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 03:27:53 PM
No, he appears to be looking at the original ones according to the debug info....

Edit:
Also as of 3rd Feb, he is still running V2.0.3 or some of it. Needs a Ctrl+F5 or similar.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 10:57:50 AM
Help! Where is the download file for this? Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 02, 2016, 11:11:53 AM
Hi

You register an account with the website, but there is no download

You download dslstats or similar program and use the credentials for the website, which uploads the information

If you search the forum for ddlstats you'll find a lot of information on what to do

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 11:14:31 AM
Thanks. The line stats are now online! MDWS ID: Grimers.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 01:15:23 PM
Hi, I've messed the data up a little bit on the DSL web stats. I have a number of resyncs that aren't true (turning the router off and on) is it possible to delete the resyncs and data?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 02, 2016, 04:15:02 PM
There is nothing wrong with your data, except that you haven't uploaded very much for some reason - your last upload was at 13:09....

The resync events shown are correct, one gets generated each time you turn off/on your modem/router. They are shown as Reason 0 Loss of Service (LOS) events. That means the modem has to renegotiate the connection or resync it and resets the line Uptime it keeps a record of to zero. You can see this via the Uptime graph and it is that is used to work out the time of the resync.

The second one shown did change the Upstream speed, but there isn't always a change in sync speeds. The resync events won't show on your graphs as you don't have enough uploaded data yet (hover over the little blue icon by the checkbox for showing these and it will explain).

There are no ways of deleting data, it's all useful.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 04:26:29 PM
There is nothing wrong with your data, except that you haven't uploaded very much for some reason - your last upload was at 13:09....

The resync events shown are correct, one gets generated each time you turn off/on your modem/router. They are shown as Reason 0 Loss of Service (LOS) events. That means the modem has to renegotiate the connection or resync it and resets the line Uptime it keeps a record of to zero. You can see this via the Uptime graph and it is that is used to work out the time of the resync.

The second one shown did change the Upstream speed, but there isn't always a change in sync speeds. The resync events won't show on your graphs as you don't have enough uploaded data yet (hover over the little blue icon by the checkbox for showing these and it will explain).

There are no ways of deleting data, it's all useful.

Ok, thanks Tony.

So, do the resyncs logged only count when the program is running and are these stored infinitely?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 02, 2016, 04:37:31 PM
Ok, thanks Tony.
So, do the resyncs logged only count when the program is running and are these stored infinitely?
No, they are held for up to a year. They'll be recorded even if the program is not running but only when the downtime is an hour
or less (from memory). If the downtime is longer some or all that occurred during that time may be lost.

I see you are running again now...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 04:45:22 PM
Ok, thanks Tony.
So, do the resyncs logged only count when the program is running and are these stored infinitely?
No, they are held for up to a year. They'll be recorded even if the program is not running but only when the downtime is an hour
or less (from memory). If the downtime is longer some or all that occurred during that time may be lost.

I see you are running again now...

That's interesting, because I must've turned the router off and on several times today and it's only recorded two.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 02, 2016, 04:54:47 PM
Ok, thanks Tony.
So, do the resyncs logged only count when the program is running and are these stored infinitely?
No, they are held for up to a year. They'll be recorded even if the program is not running but only when the downtime is an hour
or less (from memory). If the downtime is longer some or all that occurred during that time may be lost.

I see you are running again now...

That's interesting, because I must've turned the router off and on several times today and it's only recorded two.
They were the only ones in the timeframes you have been uploading, but may have missed something in the downtime gap (about 4 hours in all) although it doesn't look like it from the stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 06, 2016, 11:17:39 AM
All User Stats changes

This applies to the full page version, not the one embedded in the graph container, the latter will be retired soon. 

It is now possible to sort by more columns with Upload Prog, ISP and DSLAM added as well as Power which was added a few days ago.

Additionally, if an Upload Prog entry has an asterisk after it then if you hover over it you'll (hopefully in most browsers) see the Modem type being used if the owner has configured it.

It's also possible to separate out ADSL users when ordering by DSLAM as they don't have DSLAM entries. However, there are a few VDSL2 users who haven't uploaded any Bits/Tone data so they also have no DSLAM shown.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on February 06, 2016, 12:29:20 PM
Thanks tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 13, 2016, 08:53:14 AM
TONE RELATED GRAPHS

I only noticed a few days ago that three of the tone related graphs (Hlog, QLN and SNR/Tone) were not functioning as they should be.... They are supposed to give you details of the exact frequency for any point if you hover over them but that was only happening on the rightmost plot. It's now fixed on all of them and should help determining the exact frequency of any problem such as interference...

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fqln-hover.jpg&hash=2291e6a4b5718c43ae52dec8eaa531e9)

These graphs can also be drag-zoomed - despite what it currently says on the graph! - if you want to get in closer:

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.mydslwebstats.co.uk%2Fimages%2Fqln-hover-expand.jpg&hash=f8e5fae760f55b04f362bc621b0f9f9e)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 13, 2016, 09:49:06 AM
G.INP
A note that the G.INP detection and notification system has been malfunctioning for the past 10 days  :-X  I didn't notice as I don't have G.INP (ECI cab)  :'(

It's now working again but is having to catch up over the next few hours so those affected may see additional or duplicated e-mails concerning G.INP. It's also possible that for a few people, any stored data for G.INP over the past 10 days may have been deleted and is starting over again (this causes a series of duplicated mails).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 15, 2016, 11:25:43 AM
Hi tony

I hope you don't mind, but there's 2 things as follows

Firstly - your website is dropping out of secure once logged in. I don't know if this intentional but I would think not

Secondly - I like your new layout, just took me a while to work out where to change graphs, but this is my age I think, getting too old

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 15, 2016, 01:14:58 PM
Hi tony

I hope you don't mind, but there's 2 things as follows

Firstly - your website is dropping out of secure once logged in. I don't know if this intentional but I would think not

Secondly - I like your new layout, just took me a while to work out where to change graphs, but this is my age I think, getting too old

Many thanks

John

The drop back to http: is currently intentional  - the link, if you have one, to the latency graph is not secure and partly invalidates the page security.... TBB don't have a secure version. I have a solution to keep the certificate validity, just need to transfer it from the development system to live once I fix a small problem...

Thanks for the observations, I'm probably even older  :oldman:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 15, 2016, 05:18:01 PM
I've just been looking at the stats for MDWS ID: Gary M. It shows that he has a Downstream SNR Margin of 3.6 dB. As far as I know, the target SNR Margin for FTTC is 6 dB, so how is he reporting a Downstream SNR Margin of 3.6 dB?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 15, 2016, 05:23:21 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 15, 2016, 05:26:47 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.

Wow, it must be a good modem then to hold at such a low SNR Margin for so long.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 15, 2016, 07:53:50 PM
Hi tony

Many thanks, much appreciated

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on February 15, 2016, 08:12:57 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.

Wow, it must be a good modem then to hold at such a low SNR Margin for so long.

Not necessarily,  theres a lot of lines which will hold 3db, it all depends on the amount of fluctuation.   He's only fluctuating 0.5 dB between 3.6 and 3.1 if it spikes.   Over a year ago aardvark used to keep his line up for months, he'd get a new crosstalker, his SNRm would go down a bit, then another crosstalker etc.   iirc this went on for many months until he got to about 2dB.  Then DLM forced a resync.

The technology behind adsl and vdsl is the same.  Im sure Ive show you one of my old mrtg graphs showing holding 3dB for many months without a resync... it would do the same at 2dB.   In fact just for laughs I took it down to 1.5db and here you can see it held for 5 weeks before I took it back up to 3.   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 16, 2016, 12:12:53 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.

Wow, it must be a good modem then to hold at such a low SNR Margin for so long.

Not necessarily,  theres a lot of lines which will hold 3db, it all depends on the amount of fluctuation.   He's only fluctuating 0.5 dB between 3.6 and 3.1 if it spikes.   Over a year ago aardvark used to keep his line up for months, he'd get a new crosstalker, his SNRm would go down a bit, then another crosstalker etc.   iirc this went on for many months until he got to about 2dB.  Then DLM forced a resync.

The technology behind adsl and vdsl is the same.  Im sure Ive show you one of my old mrtg graphs showing holding 3dB for many months without a resync... it would do the same at 2dB.   In fact just for laughs I took it down to 1.5db and here you can see it held for 5 weeks before I took it back up to 3.

That's interesting. I haven't seen that graph before. On my line, the Upstream SNR Margin can drop below 5 dB for quite a long time and the line doesn't resync.

I was going to say, for some reason I have a lot of missed uploads to MDWS even though it was been running constantly all night. Any ideas?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: S.Stephenson on February 16, 2016, 02:46:19 PM
It may be going into hibernation William, if it is change the power management settings.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 16, 2016, 03:11:00 PM
Some people using DSLstats do miss uploads every so often but why is a mystery in most cases.

One reason though as suggested can be Sleep or Hibernation as it happened to me on an ADSL line on a machine that slept overnight but unloading and reloading DSLstats afterwards stopped it happening (until next time). I am not aware of any problems with the overall system that cause it, the occasional upload just does not arrive at the server for some people. I don't believe the DSLstats logs show anything in these cases though.

I don't see any missing data when uploading directly to the server or on another line I monitor have that is remotely connected 24 hours a day, both using DSLstats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 16, 2016, 03:18:29 PM
Some people using DSLstats do miss uploads every so often but why is a mystery in most cases.

One reason though as suggested can be Sleep or Hibernation as it happened to me on an ADSL line on a machine that slept overnight but unloading and reloading DSLstats afterwards stopped it happening (until next time). I am not aware of any problems with the overall system that cause it, the occasional upload just does not arrive at the server for some people. I don't believe the DSLstats logs show anything in these cases though.

I don't see any missing data when uploading directly to the server or on another line I monitor have that is remotely connected 24 hours a day, both using DSLstats.

Yes, my PC never hibernates, it's always on as hibernation caused a problem on another program I have used.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 17, 2016, 04:30:29 PM
I have another question. I had 3 CRC's at 13:16 but this didn't count as 3 ES. Any ideas?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 17, 2016, 04:38:37 PM
Quite possibly because those three CRCs all occurred within one second. An errored second (ES) is a second in which one or more uncorrected errors occurred.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 17, 2016, 04:47:14 PM
Quite possibly because those three CRCs all occurred within one second. An errored second (ES) is a second in which one or more uncorrected errors occurred.

Ah, but it shows 0 ES on the ES graph not even 1.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 17, 2016, 06:05:36 PM
Ah but it does show 1....

As explained on the graph when the running totals are displayed (and in a post somewhere), the figure for 13:00 is actually the ES for the period 13:00- 13:59 and that shows the one single ES. The far right plot is always inaccurate until the next hour starts or the day ends. Usually it's of no consequence in practice as we are only worried about ES counts in the high 100s or even 1000s for the DLM to react at the end of the day.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 21, 2016, 08:41:34 PM
May I ask but does the ES graph use data from accumulated real time data or from history e.g. is my ES wrong for today due to data problems?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 09:32:01 PM
May I ask but does the ES graph use data from accumulated real time data or from history e.g. is my ES wrong for today due to data problems?

I think it does the way TB has set this up if you have 1 errored second at the time you switch off your modem say for 8 hours it will equal 1 errored second for each hour = 8 ES during the modem off period in that case it's not real-time data as the modem has been off.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 09:45:03 PM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 10:02:56 PM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.

That is not the way are graphs see it for example ES it increases DS/US keeps increasing when we stop logging into MDWS

example below

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 10:41:34 PM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.


That is not the way are graphs see it for example ES it increases DS/US keeps increasing when we stop logging into MDWS
Nope, that is not what is happening. You appear to be misreading the way graphs are constructed.

If you have two points to plot, a Google Line Chart just connects a straight line between them so if the gap is umpteen hours and the second point has some error seconds, there will be a slowly rising line between the two which is what I believe you are seeing and the system has been like that since day one.

Try running your cursor along the line of an ES plot with missing data such as William's. You'll only see plot points where there is data, not in between on the hourly divisions as there would be if you were correct. The value plotted are taken straight out of a database table and if no data was uploaded, there is no data to retrieve from that table.
 
The only place this does not happen is with the SNRM graphs for the shorter time periods where I spent a LOT of time rewriting the Google code to remove the joining up during periods of no uploads so it was clear when there were no uploads (which is why you can often see gaps!)  It has been explained before I believe.

It's clearer if the chart is drawn as a Column chart rather than a Line chart as the gaps are then obvious - but Google is a bit weird with the width of the bars and they are often very thin which is why they are currently shown as Line charts. See attached examples.

BTW this is off my local dev system and this has flags for each user's Country. I am considering putting this live with options to hide them or not show your own etc etc.

We have quite a few overseas users - notably one currently in the Cayman Islands (steubing @ -5 hours) who seems to have an example of a totally unmanaged FTTC line with enormous error counts but no form of divine or man made intervention....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 11:18:04 PM
If you have two points to plot, a Google Line Chart just connects a straight line between them so if the gap is umpteen hours and the second point has some error seconds, there will be a slowly rising line between the two which is what I believe you are seeing and the system has been like that since day one.

Sorry to be the one to tell you the google line chart saves the last point of reference then accumulates this point each hour and so on after the user has logged off.

If you had 2 DS errored seconds and switched off for 24 hours the google graphs would show 48 errored DS seconds

you had it right before where it was just showing a straight line when the user was offline just seems the google prediction thingy is weired which we don't need as most users are on 24/7
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 11:32:44 PM
Well if that's what you want to believe then fine.  I suggest though that whatever you are on you stop taking it  ???

Edit:
To demonstrate that on the attached graph, on your theory the earlier ES count of 16 at 08:00 would have risen, by the time the next available plot at 17:00 was reached  9 hours later, by 144! It's actually gone up by 2 as that was the count for that partial hour and has been added on...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 11:42:19 PM
I suggest though that whatever you are on you stop taking it  ???

Cipralex 10mg would need to consult with DR before I cease the treatment   ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 11:59:25 PM
Um... I think maybe you don't realise that the black line is a CUMULATIVE total, not hour by hour. The latter is the green line at the bottom with the same join between the available hours and zero at times..  :-\  Of course, if the second highlighted point had no errors, it would be a straight line joining them as expected ....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 22, 2016, 12:16:10 AM
Lets say I cease uploading to MDWS now at 00:15 hours for 24 hours will my DS errored seconds show zero during that time period ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 22, 2016, 07:43:45 AM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.

Ah, I see! Thanks for explaining.

[Edited by roseway to remove inappropriate comment]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 22, 2016, 08:27:14 AM
Lets say I cease uploading to MDWS now at 00:15 hours for 24 hours will my DS errored seconds show zero during that time period ?
You appear to have done just that. Here follows a longer explanation while I partake of the third cup of tea of the morning.. ;)

Correct, as long as the period between 00:00 and 00:59 has no ES (which it doesn't, it's 0) then there will be nothing plotted between there and the next plot on that day or the next day. There can't be as MDWS will not have defined any data above zero for that period  since the database table entries will all say 0 - it will though have defined zero for each hour where there was no data to preserve the timeline on the graph plot.

Have a look at your own attached line for the past 24 hours. The cumulative US (BLACK - GREEN on the none-cumulative version) plots starting from the left which is at 00:24 through to 06:00 are all zero (as are DS)  since there were no ES, then at 07:00 there is one ES from where it starts accumulating. On the ordinary graph there are peaks and troughs.
I'm not sure where you get the idea that Google Charts are in any way intelligent from  ::) . They just make it somewhat easier for a programmer to draw complex live graphs with automated hover info etc.

Each data point for any graph has to be constructed in code by MDWS on the server so that it can be sent to and then drawn by your terminal using Javascript by the way - there is nothing automatic at the Google end about this data generating part. So a full day's data from SNRM for 24 hours has 1440 (actually less but we won't go into that here) sets of data that look like this extract, you can see the two SNRM figures at the right in this instance (NB Google months have January as zero before someone says the date is wrong):

Code: [Select]
[new Date(2016,1,20,Number('07'),Number('51'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('52'),00), 4.9, 18.0,],
[new Date(2016,1,20,Number('07'),Number('53'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('07'),Number('54'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('07'),Number('55'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('07'),Number('56'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('57'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('58'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('59'),00), 4.6, 18.0,],
[new Date(2016,1,20,Number('08'),Number('00'),00), 4.7, 18.0,],
[new Date(2016,1,20,Number('08'),Number('01'),00), 5.3, 18.0,],
[new Date(2016,1,20,Number('08'),Number('02'),00), 4.9, 18.0,],
[new Date(2016,1,20,Number('08'),Number('03'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('08'),Number('04'),00), 4.4, 18.0,],
[new Date(2016,1,20,Number('08'),Number('05'),00), 5.4, 18.0,],

Some graphs have more data for additional popup info, or for more data points than the two above:
Code: [Select]
new Date(2016,1,21,Number('09'),00,00), 0, 15, 1, 0.1, 24],


Hope that helps - though I believe Cipralex makes it difficult to think clearly at times....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 23, 2016, 10:51:18 PM
Hope that helps - though I believe Cipralex makes it difficult to think clearly at times....

That is a great explanation into the workings on MDWS yeah I took it offline for 1 day then thought give it another 24 hours as there is nothing interesting happening on this line and also gave the RPI a new case.

The only side effects of Cipralex we have noticed is my heart has become tachycardia so will need a ECG but they are sure it's the down to the meds
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on February 25, 2016, 03:06:17 PM
What is the XTR tab about, and what are the stats within that, as i can't fathom out what they mean
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 25, 2016, 03:26:19 PM
What is the XTR tab about, and what are the stats within that, as i can't fathom out what they mean
See here for now, caught up with house repairs currently:

http://forum.kitz.co.uk/index.php/topic,17106.msg314386.html#msg314386 (http://forum.kitz.co.uk/index.php/topic,17106.msg314386.html#msg314386)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 28, 2016, 08:51:52 PM
Hi Tony

I am not sure if this is a hg612stats issue or mydsl but I am having issues with my hlog not being displayed on the website. The Hlog graph is present on the software when viewed locally so could you offer some advice please.
Many thanks
mydsl user "skytester"
modem type 8800nl
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 07:59:29 AM
@skynewb

If you look back at your historic Hlog entries, you'll see that they were fine up until 12:00 yesterday (they upload once every hour, as do all the Tone related files - see the Help system and previous posts here for more). Then your line was down for some time and when the next upload occurred at 16:00 they stopped displaying properly.

I've been through your data as best I can here and there appears to be a problem with your Hlog upload files now (the other are okay) - they apparently have some corrupted or extra data in (although I can't visually see exactly what) and they are not decoding properly and then stop the chart actually displaying due to a Javascript error.

Since nothing has changed at this end with the code for that, I suspect that something has at your end. Try unloading the stats program and starting it up again and see what happens at the next hour upload. If still a problem, then power down the modem for 30 mins and restart and see if it's okay then. Past that, I don't have any ideas currently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 09:43:01 AM
Ok thanks Tony. I will reinstall and try again. The modem was rebooted yesterday so it might be something else. The pc was restarted too. I will try a couple of things tonight and see if any joy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 29, 2016, 06:30:22 PM
Hi Tony I don't seem to be getting 100% uptime due to 4 of 5 gaps per day thought it was upload software versions but still the same , taken RPi offline for maintenance plenty of on-board ram only 30% used and done some stuff to memory card and also gave the router a new PPPoE connection.

I am starting to think this issue is on my side how does it look from your end ?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 06:33:17 PM
@skynewb

If you look back at your historic Hlog entries, you'll see that they were fine up until 12:00 yesterday (they upload once every hour, as do all the Tone related files - see the Help system and previous posts here for more). Then your line was down for some time and when the next upload occurred at 16:00 they stopped displaying properly.

I've been through your data as best I can here and there appears to be a problem with your Hlog upload files now (the other are okay) - they apparently have some corrupted or extra data in (although I can't visually see exactly what) and they are not decoding properly and then stop the chart actually displaying due to a Javascript error.

Since nothing has changed at this end with the code for that, I suspect that something has at your end. Try unloading the stats program and starting it up again and see what happens at the next hour upload. If still a problem, then power down the modem for 30 mins and restart and see if it's okay then. Past that, I don't have any ideas currently.

Hi Tony - so I tried rebooting, re-install but still no hlog. However I have created a new user called skyECI. I let the update run by itself and everything uploaded bar hlog.

If I choose Hlog from mydsl  drop down box the graph box reports
"Waiting for Google response..."

Any ideas why this happening?

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 06:53:52 PM
Ok thanks Tony. I will reinstall and try again. The modem was rebooted yesterday so it might be something else. The pc was restarted too. I will try a couple of things tonight and see if any joy.
I see it was still the same on your new username  :(

Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 07:09:22 PM
Ok thanks Tony. I will reinstall and try again. The modem was rebooted yesterday so it might be something else. The pc was restarted too. I will try a couple of things tonight and see if any joy.
I see it was still the same on your new username  :(

Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.

Thanks very much looks to be working - any chance of transferring my donation status to my new ID (skyECI) please as I won't be going back to old  profile.   ;)

thanks

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on February 29, 2016, 07:13:08 PM
Hi Tony,


Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.


I may have missed something so could you please confirm what the issue is/was regarding the offending tone (15) of skynewb's Hlog data?

It does seem odd that correct/valid data was being consistently uploaded previously & now it consistently isn't.

If it's anything to do with the HG612 Modem Stats program, I'd rather fix it than simply mask a potential error.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 07:16:31 PM
Hi Tony I don't seem to be getting 100% uptime due to 4 of 5 gaps per day thought it was upload software versions but still the same , taken RPi offline for maintenance plenty of on-board ram only 30% used and done some stuff to memory card and also gave the router a new PPPoE connection.

I am starting to think this issue is on my side how does it look from your end ?

I can't add anything to this above what I've said in the past. A few lost minutes are not abnormal and that happens to quite a few people but certainly not everyone. The 100% uptime allows for 5 lost minutes. There are some people who it happens to all the time (but you are okay some days). I don't see any errors that say an upload failed (there are loads of error traps) and when I've put a monitor on a user, that always says that they do not arrive at the server in the first place.

The only thing I can point out is that if the server has a problem (other than an Apache restart which usually just results in queuing for a few secs, or actual full restarts etc) I don't see errors on my upload directly to the server on the server itself (i.e. not via the internet or router/switch). But I have an ADSL2+ line as well from another provider uploading in the same way as everyone else and that hardly ever shows any lost minutes. Both use DSLstats, currently 5.7.1. Both on Windows 24/7 machines, Win 7 and Win 8.1 FWIW. Not so good though if I hibernate the Win 7 machine then DSLstats gets very erratic after wake up. Stopping and restarting stats cures it a bit Eric is aware of this as noted on another current thread.

It might be interesting to find people with missing minutes and see what stats prog they are using if you have an idle few minutes (use 12 hour as it's more obvious and that has all the minutes plotted). I can't remember if it happens with both HG612 Stats and DSLstats.

I'm pretty confident that it is is occurring due to something en-route though. I watched carefully the other evening when the server had a record number of uploaders and users and couldn't see anything of note. The server is never heavily loaded either currently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 07:30:45 PM
Thanks very much looks to be working - any chance of transferring my donation status to my new ID (skyECI) please as I won't be going back to old  profile.   ;) 
Done  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 07:32:24 PM
Hi Tony,


Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.


I may have missed something so could you please confirm what the issue is/was regarding the offending tone (15) of skynewb's Hlog data?

It does seem odd that correct/valid data was being consistently uploaded previously & now it consistently isn't.

If it's anything to do with the HG612 Modem Stats program, I'd rather fix it than simply mask a potential error.

Just to add it just seemed to stop working when I  rebooted the modem (8800nl) yesterday, well took if off line for couple of hours - I made no other changes to the software or my setup..

Thanks Tony for sorting my status..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 29, 2016, 08:25:07 PM

I'm pretty confident that it is occurring due to something en-route though. I watched carefully the other evening when the server had a record number of uploaders and users and couldn't see anything of note. The server is never heavily loaded either currently.

That is also my conclusion after ruling out software and hardware the next step will be to change DNS server from google back to the ISP's default

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 04, 2016, 10:47:12 AM
Tony

Just spotted something odd, On the 24 hour graphs...Click on the SNR margin.....The legend reads "dB up - MyDSLWebStats.Co.Uk"

and when you hover over the line, the legend again has the extra (unwanted) text.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 04, 2016, 11:07:42 AM
Ok thanks. Fixed and was only happening on the original narrow graphs  :)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 05, 2016, 11:05:43 AM
Tony

Can you add TP-Link W9970 to the list of modem/routers please.

Thanks in advance
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 06, 2016, 07:25:03 AM
Can you add TP-Link W9970 to the list of modem/routers please.
This was added about two minutes after you asked but had to go out for rest of the day....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on March 07, 2016, 06:32:06 PM
Would be great if you could add a slightly different colour to make eci ginp users noticeable and a link to the full page all users stats on the graph page would also be great :) thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 07, 2016, 11:17:09 PM
How about making the User Name on the All User Stats page link to that user's other stats page
i.e. link HG612-MultUsersLivei.htm to Container.htm
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 08, 2016, 08:20:53 AM
Would be great if you could add a slightly different colour to make eci ginp users noticeable and a link to the full page all users stats on the graph page would also be great :) thanks

ECI now has a light yellow background. The graph-sized User Stats window (which already has a link to the full page version) is being withdrawn soon and the entry will open the separate tab/window by default.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 08, 2016, 08:23:36 AM
How about making the User Name on the All User Stats page link to that user's other stats page
i.e. link HG612-MultUsersLivei.htm to Container.htm
That isn't currently feasible but I'll add it to the list of possible features yet to come.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 08, 2016, 07:51:21 PM
Hi Tony

One week ago G.INP and vectoring was enabled on my line. Therefore I realized there is no information about the vectoring state available on MDWS.
Wouldn't it be interesting to see which lines already got vectoring enabled?
I don't know the situation in UK. Are there already a lot of vectoring enabled lines available or will it be deployed in the future?

DSLstats and HGWin would need a little update to provide this information.

What do you think about it?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 08, 2016, 08:03:42 PM
Where is the vectoring data presented?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 08, 2016, 08:15:04 PM
You can use the following command:

xdslctl info --vectoring

Quote
xdslctl: ADSL driver and PHY status
Status: Showtime
Last Retrain Reason:    1
Last initialization procedure status:   0
Max:    Upstream rate = 37534 Kbps, Downstream rate = 93184 Kbps
Bearer: 0, Upstream rate = 11007 Kbps, Downstream rate = 55039 Kbps
Bearer: 1, Upstream rate = 0 Kbps, Downstream rate = 0 Kbps
Vectoring state: 1
VCE MAC Address: 0:10:fc:20:0:0
Total error samples Ethernet pkts sent: 131290
Total error samples Ethernet pkts discarded: 0
Total error samples statuses sent: 65645
Total error samples statuses discarded: 0

I don't know all state codes but on my line I saw this:

Vectoring state: 1 vectoring enabled
Vectoring state: 5 without vectoring (Without vectoring "VCE MAC" and "Total error samples" are all zero.)

Maybe codes 2,3 or 4 indicate vectoring friendly mode.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 08, 2016, 08:34:52 PM
There are some vectoring states defined in the AdslMibDef.h file that can be found in the source code released for various Broadcom modem/routers. This is from the TP-Link VR900v1 code:
Code: [Select]
#define VECT_WAIT_FOR_CONFIG  0
#define VECT_FULL             1
#define VECT_WAIT_FOR_TRIGGER 2
#define VECT_RUNNING          3
#define VECT_DISABLED         4
#define VECT_UNCONFIGURED     5

Looking at the strings in the xdslctl binary, it might also give "Vectoring is disabled" or give a "VCE IP Address".
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 08, 2016, 08:56:12 PM
For "xdslcmd info --vectoring" I get

Vectoring state: 5
VCE MAC Address: 0:0:0:0:0:0
Total error samples Ethernet pkts sent: 0
Total error samples Ethernet pkts discarded: 0
Total error samples statuses sent: 0
Total error samples statuses discarded: 0
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: morphium on March 08, 2016, 09:08:03 PM
This means vectoring isn't enabled on this line.
I think because the command is available the firmware supports vectoring. You only have to wait until it gets enabled.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on March 11, 2016, 07:40:47 PM
Is it possible for MDWS to display/monitor the chipset version used by each DSLAM?

It would be interesting to see how/when they change during the rollout of a new version.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on March 11, 2016, 09:13:05 PM
Hi, I donated to MDWS but now I've created a new ID, I can't seem to access the additional features. Do I need to donate again?

I've noticed a bug with MDWS. For some reason, when I select the Errored Seconds graph, the scale is in years not hours!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 13, 2016, 08:25:39 PM
Hi, I donated to MDWS but now I've created a new ID, I can't seem to access the additional features. Do I need to donate again?

If you want the additional features it would be normal to do that, yes, but only when you have several lines and require two log ons.

But you only have one line I believe and yet you are on your third Registration since you joined. One Registration seems enough for 99% of users.

Anyway I've transferred your donation to the latest registration now on the assumption you don't want use of the old one.

Quote
I've noticed a bug with MDWS. For some reason, when I select the Errored Seconds graph, the scale is in years not hours!

Can't see anything wrong here. But beyond 4 days the x-axis reads, for example, Mar 11 2016, at the start of each day as there isn't room for more. Longer periods have larger intervals.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 14, 2016, 11:25:10 PM
On the All User Stats page, the View Active Only dropdown appears to have been disabled.
Or is it just me?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2016, 11:29:28 PM
Yes, it's been disabled as it was causing problems....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 15, 2016, 12:12:02 AM
Thanks ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: LaurieR on March 21, 2016, 04:34:34 PM
I'm getting "Fatal error: Function name must be a string in . . . on line 8" for most data options.

[Moderator edited to remove the quoted path, as requested.]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 21, 2016, 05:20:58 PM
Fixed - thanks...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on March 24, 2016, 08:56:50 PM
General question, if we would like to see some kind of mdws support for hacked eci modems what would need to happen? Is there anything us users could do to help? As ginp is rolling out to eci cabs and giving better sync speeds using an eci modem some mdws support is wished :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on March 24, 2016, 09:03:55 PM
General question, if we would like to see some kind of mdws support for hacked eci modems what would need to happen? Is there anything us users could do to help? As ginp is rolling out to eci cabs and giving better sync speeds using an eci modem some mdws support is wished :)

I have my hacked eci running munin for some output graphs - example attached. Jsamuel got this going - it runs on  oracle virutal box within my win10 - little data as I literally only got it going tonight after connecting the modem up
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 24, 2016, 09:07:22 PM
General question, if we would like to see some kind of mdws support for hacked eci modems what would need to happen? Is there anything us users could do to help? As ginp is rolling out to eci cabs and giving better sync speeds using an eci modem some mdws support is wished :)
You'd need to ask in the respective threads for HG612 Modem Stats (http://forum.kitz.co.uk/index.php/topic,15483.0.html) and DSL Stats (http://forum.kitz.co.uk/index.php/topic,17106.0.html) really, as it's those two programs which harvest the stats and upload them to MDWS.

In theory if you can telnet into the ECI modem then it should be possible, but I suppose it depends on how much work it'll take and the time available to the authors.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2016, 08:07:52 AM
SERVER DOWNTIME

There is a problem with the server that started about 07:52 and I've had to kill the web server process. The main database table seems to have a problem so will need to rebuild it.

While I'm at it, I also need to carry out a number of updates to the server so expect it will be down for an hour or two but this is well overdue anyway.

And BACK UP AGAIN

Okay, all looks okay from this end. Quite a few people haven't reconnected for uploads though so you might want to check if you don't have failed alerts email enabled...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on March 27, 2016, 04:05:33 AM
Looks like something has happened as all users are reported as being down by MDWS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 27, 2016, 07:13:49 AM
Data is still being uploaded and showing in the graphs, but is reported as being down since the present time. This is presumably related to the time change, and I know that DSLstats doesn't handle the time change properly, and is probably an hour out until it's stopped and restarted. But as you say, this seems to apply to everybody.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 27, 2016, 08:57:34 AM
Having seen these comments this morning I restarted DSLStats and then got the upload OK message from MDWS.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on March 27, 2016, 09:24:04 AM
Had an GMT error msg on MDSLS - restarted DSLSRpi and forced a manual fresh of the website - error disappeared :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 27, 2016, 09:26:05 AM
Okay I admit guilt - there is a clock change calendar and it was a day out (tomorrow)  :-[

Okay now BUT there are some 45 users with the clock an hour slow (mostly DSLstats) so you need to stop and restart that assuming the equipment clock is set okay. The list of uploading users at the bottom of the main window will show a double red asterisk against a user name if the clock is one hour slow (which is an invalid time zone) username**
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 28, 2016, 07:59:41 AM
POWER OUTAGE 01:40 - 07:15

Had to disappear out on on a crisis yesterday and got back to find the power had gone down at 01:40 this morning after the UPS gave out when our sub-station tripped. Back up now okay at 07:15 but winds still have potential for it to happen again before this afternoon. Trees down all over the place here.

Most people have reconnected but there are still loads of people with bad clock times who are still on GMT. Mostly DSLstats where you will need to close down the program and restart to fix (known bug).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on March 28, 2016, 08:37:02 AM
Given the winds today around the country I can't say I'm surprised :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on March 28, 2016, 07:09:50 PM
Hi,

I don't seem able to change my password for logging on. Once I have used the reset email details and enter a new password I always get the error message invalid memorable phrase? - I know its the right one as the reminder page tells me what I used originally..

Any help appreciated as I keep on having to use a temporary password..
thanks

   Invalid Memorable Phrase
Password Change   Enter your Memorable Phrase   

Enter your new Password   

Repeat your new Password   

 Change Password   min 8 max 18 chars
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 28, 2016, 08:17:31 PM
I don't seem able to change my password for logging on. Once I have used the reset email details and enter a new password I always get the error message invalid memorable phrase? - I know its the right one as the reminder page tells me what I used originally..
This is/was a problem that was fixed earlier this month but your registrations precede the fix. The Memorable Phrase is now enforced as unique amongst all users but wasn't when you registered. You have two registrations so it's coming up with the wrong user when it tries to ID you....

I've changed your current skyECI one and will PM you...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 28, 2016, 11:03:39 PM
and I know that DSLstats doesn't handle the time change properly, and is probably an hour out until it's stopped and restarted. But as you say, this seems to apply to everybody.

Even my RPi clock was off by 1 hour so don't just put this down to your software the RPi is supposed to update it's clock via on line ethernet but it does not during time changes.

The only way is to use the command sudo dpkg-reconfigure tzdata think I posted this the last time the clocks changed and select Europe and London this will correct the time shown on the RPI
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 29, 2016, 06:11:20 PM
Apologies if this has been suggested before, but wouldn't it be better to store all the times in UTC (which doesn't change for summer time), and display them to the user in their local time zone?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2016, 07:10:46 PM
Apologies if this has been suggested before, but wouldn't it be better to store all the times in UTC (which doesn't change for summer time), and display them to the user in their local time zone?

It can be very confusing with software as the UK uses DST daylight saving time from March to October or even called BST British Summer time.

even selecting UTC/GMT when using calculators and converters for the UK will lead to incorrect results during the summer months when DST is in use.

I have seen rumours that GMT might be abandoned.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2016, 07:58:33 PM
Apologies if this has been suggested before, but wouldn't it be better to store all the times in UTC (which doesn't change for summer time), and display them to the user in their local time zone?
An idea but would take a totally inordinate amount of time and effort to implement and it wouldn't fix a problem caused twice a year by a bug in 3rd party software/hardware (that of the RPi). It works as it stands except for the RPi being unable to return the correct time after a GMT/BST change without manual intervention....
It would be far easier to ban the Rpi from MDWS if it's a problem for anyone  >:D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 29, 2016, 08:22:34 PM
I changed my own stats scripts to record everything in UTC to avoid problems with the time jumping forward or back.

Also I just switched on my Pi 2, it had the correct time and timezone (BST). But then I installed Fedora on it rather than Raspbian.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2016, 09:04:17 PM
Also I just switched on my Pi 2, it had the correct time and timezone (BST).

You have just given the answer the RPi will change the time to +1 hour when it has been rebooted or switched on from a cold boot, it's when the RPi has been up and running during the clock change it will not adjust the time automatically.

It would help if the RPi had a chronometer built in then software and hardware could interrogate each other and come up with the right time
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 29, 2016, 09:17:29 PM
I can't really see why the RPi wouldn't - it's keeping the clock running in software, and it knows the date and time and timezone. But I'll check in about 6 months.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 29, 2016, 10:56:47 PM
It's presumably a bug in the NTP software (or more likely, its configuration) in the RPi. Raspbian is based on Debian Stable, which is what I use on my main desktop PC (this one) and which runs 24/7. The clock changes at the correct time without manual intervention.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2016, 11:14:27 PM
I'll try this command on October the 30th -> sudo service ntp restart or sudo service ntpd restart

https://support.rackspace.com/how-to/using-ntp-to-sync-time/ (https://support.rackspace.com/how-to/using-ntp-to-sync-time/)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on March 30, 2016, 12:21:40 AM
Couple of queries/requests please (Trying to update the days eci g.inps)

1)Would it be possible to include a direct link to the Multi-user view.

Presently the way I get to it is > Select User Stats > It opens in the iframe > Click the full page version <here>
Then I want to get rid of that window to go back to the previous stats I was looking at so I click the red X, which takes me to tbailey SNR stats, so then I have to reselect user again and the type of graph I wanted to see.

It seems a bit long winded or am I missing something.   Could you put a link to multi-user from say the top under the TBB monitor image.


2)Tonight Im wanting to check a few people stats who have since gone offline, but I need to check say their cab type.   The main window doesnt show it me (eg James11223), so I go to the multi-view - but I find that I can only select stats for currently active -  Im sure I used to be able to view info if someone was offline too.   
The only option I have from the 'View Active Only' drop down box is YES.


TIA

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 30, 2016, 08:20:06 AM
1)Would it be possible to include a direct link to the Multi-user view.

2)Tonight Im wanting to check a few people stats who have since gone offline, but I need to check say their cab type.   The main window doesnt show it me (eg James11223), so I go to the multi-view - but I find that I can only select stats for currently active -  Im sure I used to be able to view info if someone was offline too.   
The only option I have from the 'View Active Only' drop down box is YES.
TIA

1) I'll do something in a while - but as I've said before the small All User Stats is being retired to just use the full page one and the dropdown will then take you directly to it.

But James 11223 isn't showing a cab for some reason in the stats although he has one defined. It's an Huawei

2) Use the Range graph view rather then Current as the dropdown then shows all users who have uploaded in past 3 months whether currently uploading or not. it's been asked before but Inactive was removed as it was using too many resources. I've hopefully fixed it so will check and put it back if okay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 30, 2016, 04:58:06 PM
Couple of queries/requests please (Trying to update the days eci g.inps)

1)Would it be possible to include a direct link to the Multi-user view.

You could bookmark the link.


[Admin note - url removed]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on March 31, 2016, 12:33:00 AM
Thanks Tony :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 04, 2016, 07:54:50 AM
DOWNTIME

The MDWS server will be down for around 30 mins shortly for some maintenance...

EDIT: Back up at 08:31....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 04, 2016, 03:05:06 PM
Is it possible to suggest two new features to help detect when new functions may be enabled by BT?

1. Vectoring On/Off
2. 3db Target

Perhaps a new column and/or colouring?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on April 04, 2016, 03:40:11 PM
You can sort the snr column on the all users chart, then just pick out the ones that are on fttc.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on April 07, 2016, 12:29:09 PM
Tony does MDWS store the actual F/W for a users CAB and if so can it be currently displayed anyway on the website please?

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 07, 2016, 12:35:57 PM
Tony does MDWS store the actual F/W for a users CAB and if so can it be currently displayed anyway on the website please?
Stuart
No it's not uploaded by either of the stats gatherers...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 10, 2016, 06:39:38 AM
Hi Tony

Would it be possible to add a column on the all user stats for modem type being used provided the modem type has been set. I know you can see it if its been specified on the individual users page but it would be handy to see a list on the all users stats page alongside the cabinet data type

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 10, 2016, 07:16:33 AM
If you hover over the "Upload Prog" entries with an asterix the modem is displayed in a tooltip
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 10, 2016, 07:20:49 AM
Ah great. Thanks for that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 05:27:58 PM
I see only blank page when I open https://mydslwebstats.co.uk . Why?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by