Kitz Forum

Broadband Related => Router Monitoring Software => Topic started by: tbailey2 on August 27, 2014, 09:44:11 AM

Title: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 27, 2014, 09:44:11 AM
Hello All,

This is to announce the availability of MyDSLWebStats v 1.0, a free to use collaboration project between the Kitz and ThinkBroadband Forum users BaldEagle1, tbailey2, RONSKI and roseway. With the right equipment and software to automatically upload data to the server via a Windows PC, you can then monitor your own DSL Line statistics from home or anywhere in the world using MyDSLWebStats on any browser on a Mac, PC or Tablet (a specific Android/iPhone app is an unlikely prospect currently). Linux should also be available but via DSLStats later.

The idea behind it was to enhance and expand the statistics that BaldEagle1's HG612 Modem Stats collects by putting the data collected from the modem into an online, internet based database.  This means that just about anything you want to know about your past and current connection history is potentially available without having to store masses of graphs and images and wade through them to locate what you want! The modem data is automatically stored on a new dedicated remote server and accessed via the MyDSLWebStats Home page using the Registration/Log On system.

MyDSLWebStats can display a summary of your connection details in real time (in the same way as roseway's DSLStats does - and Eric is in with us on this project for his application) and, depending on various factors, you will also be able to view other users' data (and see it updated in real time if the data is current) as well for comparison. Multiple panes (see attached image) allow you to carry out several monitoring or investigative tasks at the same time.

Our Home Page has more details. There is no extensive help yet (under development) as it is still being developed but there are various hover-help icons scattered around that will give some guidance.

Please post queries/bug reports etc to this thread on this forum and someone will answer when we have time.

There are currently some 17 different data graphs available (more get added quite often) - the restriction on what is available is by the data that is currently uploaded.

What you can do is look at any of the timeline graphs available for today or a period of many days in the past on a LIVE basis updating every minute or a period of your choice. Then you can choose any two dates between the first available and last available and see a summary graph of the whole period (1st Jan 2014 to today in one case). Clicking on a point of interest will zoom in on many graphs - right down to a period of a couple of hours or so very quickly. All interactive graphs and charts are courtesy of Google Charts . Note that they do NOT look like those you may be used to from current applications themselves due to limitations within the system and the way we present the data but they do suit their purpose.

The only graphs that are not available per minute  are the tone related ones - Bits/Tone, Bits/Tone SNR, Hlog and Quiet Line. They are available every 15 mins of the hour for 2 days, then every hour for 4 days and then once per day (this may well change).

If interested, please have a look at www.MyDSLWebStats.co.uk (http://www.mydslwebstats.co.uk/). There is guest access by following the links if you don't have a Log On. Guest access is intentionally very limited with only a few stats graphs available and one live line to monitor.

Log Ons are currently available after Registration (http://www.mydslwebstats.co.uk/mdws-rg.htm) but we may put a restriction on these temporarily! There is a limit of 10 characters on a User Name so you  may need to adjust yours if you want to use one similar to your forum name.

A Log On gets you full access to various users who have data on there - tbailey2 and BaldEagle1 are currently live along with five other users. To actually get your data up to the server needs a modified executable file that will be supplied as part of the GUI install/update of HG612 Modem Stats (not currently available at the time of posting though and will be v 4.0). Note that this is a Windows executable and thus needs Windows to run under. However, Eric is currently working toward providing the same stats via his DSLStats program for both Windows and Linux users.

Preferred Browser is Chrome or  Firefox. Safari also works. IE can be used but has to be v10 or later. You will need both Javascript and Cookies enabled for it to work.

ALSO PLEASE BE AWARE that you are uploading data and also downloading a small amount. We estimate it at about 30MByte per month currently for the basic modem log that provides the majority of the stats but this increases quite a lot if you upload the additional optional Bits-related  files. If you have limited bandwidth and your ISP includes uploaded data in the total then please keep an eye on what you are using. The system can handle both ADSL (limited tests so far currently) and VDSL2+ systems - up to 80/20.

Have Fun

Paul & Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: boost on August 27, 2014, 10:32:00 AM
Great stuff :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 27, 2014, 10:43:02 AM
Just a quick note as I'm at work, I've released a beta update to the GUI interface which allows entry of the required settings, simply use the automated update feature with beta updates enabled. Any problems with the GUI side of things please post in that thread.

Please note BE1 has not yet released an update to enable the stats to be sent to the server.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 27, 2014, 12:01:46 PM
dammit lol I was planning on doing something like this :P

good idea though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 27, 2014, 04:40:59 PM
registration doesn't appear to work, just says required symbol char missing with no indication of where.

also the captcha is useless, it's unreadable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 27, 2014, 05:24:54 PM
registration doesn't appear to work, just says required symbol char missing with no indication of where.

also the captcha is useless, it's unreadable.
That would be the password:

Password:
min 6 max 18 chars
Must have at least one
Upper Case letter and
at least one of (* - $ &)
and at least one number

I've added the fact it's the password it's missing from in the error response so thanks for pointing that out.

The captcha appears to work okay (unless you have cookies disabled when it will never work) and others have registered successfully, one while I was typing this. It's not designed to be easy else there would be no point in having it (I reckon it's much easier than the Kitz one myself). We've already had one brute force attack on the Registration earlier this morning and captchas help to defeat them.

If you request a new image you'll get one that is  much easier to read at some point if you are having trouble. The length varies to confuse automated attempts.

We hope to have the required new executable available in the next few days and it will be installed via the GUI as RONSKI pointed out.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 27, 2014, 05:47:26 PM
I know what captchas are for, but when they're unreadable by humans they fail to fulfil their purpose and become a frustration. I also think your password policy is a bit restrictive. Requiring symbols is fine, but why limit it to those 4 only? There's a whole keyboard full of symbols that can be used.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 27, 2014, 06:11:16 PM
Personally I found some of the captcha's hard to read (as I do on other sites), I have a very hi res monitor and glasses, but I just refresh the image until I find one I can read.

Also I find the password requirements a lot stronger than a lot of other websites that should be stronger.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2014, 05:45:41 PM
A bug fix: users may have noticed a long delay between hitting the manual Update button and anything happening.

Cause has been found/fixed and a manual Update should now be virtually instantaneous as far as starting to load the graph goes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on August 28, 2014, 06:26:00 PM
I can confirm that it is indeed much quicker now  :)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 28, 2014, 07:18:30 PM
make my line the freebie for guest users :) its a circus today.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2014, 07:22:13 PM
make my line the freebie for guest users :) its a circus today.
Mine is already and has been fun, on Fast Path for the first time in 6 months
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2014, 07:23:00 PM
I can confirm that it is indeed much quicker now  :)
Great!

A note for new Registrations. You won't see yourself in the selectable User list as you don't yet have any uploads. Once the new V4 executable is available and set up via the GUI, you'll be able to upload.

As you'll want to see your own data as soon as possible, be aware that the system checks the user list for new uploads every 3 minutes and at around 30 seconds into that minute. Users with new uploads are then added to the selectable list when it's next refreshed either via Update or through changing one of the other parameters available.

Once uploading the graphs won't make a lot of sense until after about 15 mins. The Stats Summary at the top of the pane will update very quickly though if you are watching your own stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 31, 2014, 09:04:42 AM
BE1 has now released V4 beta programs which will enable the upload of data to My DSL WebStats.

To download this please ensure you have beta updates selected, and then check for and install updates.

You'll also need to ensure that you've correctly entered your settings for My DSL WebStats. Once the new programs have been running for 15 minutes you should be able to see data starting to appear on the website.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on September 01, 2014, 07:24:37 AM
Many thanks for this great facility.

I have registered and my data has started uploading.

It does seen to be a bit 'laggy' at first, although that may be my PC as I am getting lags sometimes on other pages.
(I need to investigate what this could be ???. My PC is i7 930 with 12G Ram so not exactly slow.)

Please keep up the good work, much appreciated.  :clap: :clap: :clap:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 11:30:09 AM
A few updates.

USER REGISTRATIONS

Almost everyone that has Registered has been seen online here okay but there are several of you that haven't fully completed the process. If you feel you are missing the information needed to do so then please post here.

TBB PING/LATENCY GRAPH

A few of you had trouble when putting the link to the image into the OPTIONS menu at the bottom of the page. Please make sure you use either of the IMAGE links and NOT the SHARE link. And also make sure you haven't also put double quotes around the link.

NEW FACILITY

There is a new facility in the list now and that is All User Stats. This shows every user who has uploaded anything and their current status in one table - this is the one that appears at the top of each pane but simplified onto one line per user. It automatically updates every 30 secs. See HERE (http://www.mydslwebstats.co.uk/images/alluserstats.png) for an example screen grab image. You can find it in the Graph to Show list.

It is ordered so that anyone offline (no uploads in last 5 mins) appears at the top.

Note that it currently will NOT show you unless you have uploaded since about 10:15 this morning due to the way it collects the data.

Users have also asked what the yellow background in the SYNC ACTUAL data means. It's because your ATTAINABLE sync rate is LESS than the current actual sync rate. The chances are that if you resync for any reason, you'll then lose some download speed. (see the attached image for examples). An ORANGE background in the ONLINE section means there's been a recent resync.

GET YOUR STATS CHECKED!

One of the big advantages of the system is that you don't need to capture and upload images or paste data to get comments on your stats. Just post here (with your MyDSLWebStats User Name if necessary) and ask and one of the experts will hopefully reply after looking at them (as has happened the other way round already)!

Please also note (in light of certain comments made elsewhere) that most of us also have other jobs and are doing this out of the goodness of our hearts to help others for free so might not be around for a while to answer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 11:40:31 AM
Thanks  ;) Comments such as this are very much appreciated by us after several months solid work!

Can you be a bit more specific please as to where you think it's 'laggy' and what you do that causes this? Some of the stats take time to plot as there, for instance,  with the Tone related data over 4000 possible points to retrieve and then plot and then return. SNRM and so on are or should be pretty instant.

One of the problems is that we had hoped to refresh the graph plots using Ajax Javascript code which would seamlessly update them without you seeing it - they would 'just change'. While this works quite happily elsewhere (the summary stats at the top of the page and the new 'All User Stats' table, Google Charts will just not play ball despite enlisting help from recognised experts who came up with all sorts of devious solutions that work with anything else - except our graphs! It worked with Google Image Charts  but they have been withdrawn. There are other charting facilities out there but non as versatile as Google's.

Many thanks for this great facility.

I have registered and my data has started uploading.

It does seen to be a bit 'laggy' at first, although that may be my PC as I am getting lags sometimes on other pages.
(I need to investigate what this could be ???. My PC is i7 930 with 12G Ram so not exactly slow.)

Please keep up the good work, much appreciated.  :clap: :clap: :clap:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on September 01, 2014, 12:58:40 PM
Looks very impressive. I'll have to take a look some time :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jaggies on September 01, 2014, 02:11:10 PM
Hard work much appreciated - thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 01, 2014, 07:37:15 PM
I tried and abandoned a registration under shamus and managed to complete registration as  shamus7
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 08:01:02 PM
I tried and abandoned a registration under shamus and managed to complete registration as  shamus7
I can't see any clue as to why that may have failed. What was the problem?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 01, 2014, 08:03:38 PM
unable to view graphs--message from web page---

this operation not supported by this version of grChartimg library


I use IE9 is this the problem
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 01, 2014, 08:06:02 PM
probably me messing up the security system
you can just delete   "shamus"   account if you want
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 08:15:57 PM
unable to view graphs--message---

this operation not supported by this version of grChartimg library
I use IE10 is this the problem
That message is from the utility that saves the graphs as images via a popup window. I've never seen that message but then I don't use IE unless I am feeling really like I need to annoy myself. The pages though are generally ok with IE10 and up and there are some tweaks made when using it. Why the username affects it I have no idea at the moment. (I believe MS are going to try and force everyone to use the latest version of IE in the future.....)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 01, 2014, 08:18:11 PM
probably me messing up the security system
you can just delete   "shamus"   account if you want
Okay, have done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on September 02, 2014, 12:12:22 AM
Can you be a bit more specific please as to where you think it's 'laggy' and what you do that causes this? Some of the stats take time to plot as there, for instance,  with the Tone related data over 4000 possible points to retrieve and then plot and then return. SNRM and so on are or should be pretty instant.

It does seen to be a bit 'laggy' at first, although that may be my PC as I am getting lags sometimes on other pages.
(I need to investigate what this could be ???. My PC is i7 930 with 12G Ram so not exactly slow.)

Sorry Slow reply:
The laggy performance is NOT at your end.

I am experiencing some stop-start lags when browsing in Firefox & Chrome.

I think the Anti-Virus / Anti-Malware etc proggies are fighting each other  ??? and causing bursts of extreme computation which kills everything else !!!
I run multiple programs to provide coverage in depth and hopefully what one misses the other catches.

I think I need to rationalise all the extra software running in the background.
[Anti-virus/Anti-Malware/Firewall/+Dslstats+/+HG612_Modem_Stats+/+++ .....]
I will add it to my list of things to do !!!  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 02, 2014, 10:04:47 AM
Okay thanks.  I had similar problems on a fast Intel machine I use. In the end I settled on MalwareBytes and MS Security Essentials (Win 7). I was using WebRoot but depending on what it had for breakfast, it has a habit of blocking everything it doesn't like and difficult to find out why and how to unblock. It doesn't like HG612 Modem Stats though. Fine on other machines on Win7/8.1. I don't use the machine (it runs 24/7) for mail or general web browsing so I think the MS one is enough.

I'll give MS credit as it found a trojan that had been on both of my NAS backups  - since 2009!! Nothing else had found it. I did check it out before obliteration and some really nasty JavaScript posing as a png file...


Sorry Slow reply:
The laggy performance is NOT at your end.

I am experiencing some stop-start lags when browsing in Firefox & Chrome.

I think the Anti-Virus / Anti-Malware etc proggies are fighting each other  ??? and causing bursts of extreme computation which kills everything else !!!
I run multiple programs to provide coverage in depth and hopefully what one misses the other catches.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 02, 2014, 10:26:45 AM
remember with malwarebytes to turn on the rootkit detection, by default its off.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 02, 2014, 03:41:36 PM
remember with malwarebytes to turn on the rootkit detection, by default its off.
Oh, didn't know that, will do. Thanks....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on September 02, 2014, 07:53:39 PM
I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 02, 2014, 10:17:07 PM
I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
[/quote
I'll PM you
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 03, 2014, 08:00:07 AM
I see you are online okay now  :)

I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
[/quote
I'll PM you
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on September 03, 2014, 11:19:19 AM
I see you are online okay now  :)

I have not completed the process as I still have not received the email.....
Sent from my Lumia 1520 using Tapatalk (with free typos)
[/quote
I'll PM you

Indeed! Many thanks 😊
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shamus on September 07, 2014, 03:38:52 PM
I deleted all the program  and re-downloaded, updated and accepted all defaults and graphs appear ok
I abandonded sharing as I keep getting password wrong
thanks for help TB
will get round to sharing soon
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2014, 04:43:20 PM
Okay but if you don't log out you won't need to log in again for a long time.... It's really only there to stop others using it if you want.

I deleted tall the program  and re-downloaded, updated and accepted all defaults and graphs appear ok
I abandonded sharing as I keep getting password wrong
thanks for help TB
will get round to sharing soon
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 08, 2014, 10:11:26 AM
I have got everything up and running and been sharing my stats for a couple of days. The information means very little to me (Trying to learn what it all means). How do they look to the trained eye. Anything I should be looking out for?

Thanks for a fantastic service  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 08, 2014, 10:22:21 AM
My eyes are not very well trained when it comes to interpreting stats, but they look very good to me. You're on a 40/10 service but would clearly achieve the full 80/20 sync speeds, with a little to spare. You're also on fast path.

Only thing I have noticed is some very brief dips in your attainable figures, which seems to affect upstream more. I'm sure some one more knowledgeable will take a look.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 08, 2014, 10:54:30 AM
My eyes are not very well trained when it comes to interpreting stats, but they look very good to me. You're on a 40/10 service but would clearly achieve the full 80/20 sync speeds, with a little to spare. You're also on fast path.

Only thing I have noticed is some very brief dips in your attainable figures, which seems to affect upstream more. I'm sure some one more knowledgeable will take a look.

Yes I am on Sky's 40/10 offering or 38/10 as they advertise it. Thanks for the feedback  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 10, 2014, 11:35:13 AM
One thing I have noticed when reviewing my stats is my SNRM is higher than everyone else. Am I correct in thinking with FTTC connections a higher SNRM is better than a low figure like ADSL?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 10, 2014, 11:56:21 AM
its better if you at the cap of the product.

However if you not hitting the cap and your snrm is high it suggests you may be banded or you have highly variable snrm.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 10, 2014, 11:58:50 AM
its better if you at the cap of the product.

However if you not hitting the cap and your snrm is high it suggests you may be banded or you have highly variable snrm.

ok thanks for clearing that up
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 10, 2014, 12:07:07 PM
with that said I would certianly prefer higher snrm to interleaving if the line cannot handle a normal snrm with fast path.

I think openreach have listened finally as does seem a new DLM profile now that enables FEC on fastpath.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 13, 2014, 06:58:47 PM
Hi

I have registered, but not yet received an email. I don't think its gone in any Junk, as I have checked. Perhaps your system is manual and takes time and not auto generated.

Looks magnificent work :P
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2014, 12:38:43 PM
Hi

I'll resend it. If you don't see it inside a few mins then ask again and I'll PM it. There are two e-mails overall,
 haven't seen any bounces...

Thanks for the nice comments  ::)

Hi

I have registered, but not yet received an email. I don't think its gone in any Junk, as I have checked. Perhaps your system is manual and takes time and not auto generated.

Looks magnificent work :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 14, 2014, 12:46:36 PM
Really Odd nothing received, and I use Message Labs and there is nothing in there also

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2014, 12:53:03 PM
I've PMd it - they bounced it as SPAM! I'll get on to them

Really Odd nothing received, and I use Message Labs and there is nothing in there also

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2014, 05:31:14 PM
It is all automatic (unless mail bounces of course although I should see it and have only just discovered why I'm not  :( ).


Hi

I have registered, but not yet received an email. I don't think its gone in any Junk, as I have checked. Perhaps your system is manual and takes time and not auto generated.

Looks magnificent work :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 14, 2014, 05:32:48 PM
Your email is registered now, perhaps you could try a test when you have a moment to me address Cheers Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 15, 2014, 11:13:50 AM
Do you have any plans to release a linux or Raspberry pi edition of the uploading program. It would be great as they are so cheap to run 24*7.

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 15, 2014, 01:19:34 PM
Roseway is working on the uploading side of things with DSL Stats, and I'm sure he produces a Linux version,  although I don't think it runs on the Pi, it used to though.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 15, 2014, 01:39:03 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 15, 2014, 01:44:16 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.

Thats great, a RPi version would be very useful  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 15, 2014, 03:52:18 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.

Hadn't thought of using an RPi as the host but that would be a very cheap way of getting 24/7 uploads obviously. Hope they keep a reasonably accurate clock time though!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: spadge007 on September 15, 2014, 04:10:49 PM
DSLstats is working with MyDSLWebStats now (you can see my stats on the site - user name: roseway). We just have to clear up a couple of protocol issues, then I'll be releasing it.

In principle I can also produce a RPi version, but it may not be immediate.

Hadn't thought of using an RPi as the host but that would be a very cheap way of getting 24/7 uploads obviously. Hope they keep a reasonably accurate clock time though!

I'd not thought of that, you can buy boards to add RTC functionality and I suspect you could enable NTP deamon and have it check the time regularly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 15, 2014, 04:53:50 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 15, 2014, 06:38:13 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.

Pretty much any box can use NTP - I've got it running on Linus, FreeBSD, Windows XP Pro, Windows 7 Pro 64bit, Windows Server 2008 (x86) and Windows Server 2008 R2 (64bit).
The FreeBSD box is in the NTP Pool at Stratum 2 (until I promote it to Stratum 1 by adding a GPS/PPS to it), and serving time to thousands outside my network, as well as my own machines.

I'm now set up on MyDSLWebStats (same username as here) now I have a Billion BiPAC 8800NL (recommended, by the way).

Many congratulations to all who contributed to getting it all working - it's a great resource.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on September 15, 2014, 07:08:52 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.

I can confirm that a R-Pi, although lacking a RTC, will synchronise with appropriate time-servers via ntpd upon boot. (That statement assumes a typical Linux-kernel based OS is in use.)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 15, 2014, 10:57:11 PM
Any Linux based system should be able to use NTP. I'll check this on my RPi the next time I fire it up.

I can confirm that a R-Pi, although lacking a RTC, will synchronise with appropriate time-servers via ntpd upon boot. (That statement assumes a typical Linux-kernel based OS is in use.)

Indeed it can, and with a GPS/PPS module can make a very nice little Stratum 1 NTP server, with maximum offset and jitter keeping it within 5uS (yes, that's five millionths of a second) of true UTC.

Link to details of how to do this (http://www.satsignal.eu/ntp/Raspberry-Pi-NTP.html)

You can do a little better with a machine with a true serial port instead of translating it through USB, but I'd say that getting into the 100nS range (at 5 times the cost and 10 times the energy use) is overkill for most purposes :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 15, 2014, 11:21:17 PM
That's very interesting, but rather off topic. For any discussions of the above please start a new thread.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 16, 2014, 12:22:46 PM
First let me congratulate Tony again these stats are fantastic.  :P

I think I may be now suffering from paranoia as I can see so much detail. I have noticed my SNR falls at night. This I know is normal, however I'm surprised by the size of the drops and times. last night just after 4PM and similar the previous nights large drops. At this time there is certainly no electrical activity in our home or I expect in any others between here and the cab.

I know other are able to see our stats, so appreciate any information for interest sake. ??? Fortunately even with SNR falling below 3db I'm staying in sync. Incidentally, I'm only 600m from the cab, but unfortunately part of that at the beginning is on AL cable not copper hence the poor speeds. I'm also on a busy cab.

I'm in IT so would like the benefit of more experienced knowledge in this area.

Thanks

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 16, 2014, 04:34:53 PM
had a look at your 5 day history of snrm, that looks concerning to me, I dont think its due to what you might call the usual external radio interference, for 2 reasons, its not consistent every night and its excessive on its worst nights.  My gut guess it is some external device been used occasionally at night causing interference of some sort.  Its giving you FEC spikes so might be the difference between fast path and interleaving but on your current interleaving its not giving you any changes of note on CRC so looks like isnt affecting your stability, so from me its good and bad news.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 16, 2014, 04:49:22 PM
Thanks, that sort of confirms what I thought. I'm not sure how I might trace that, I guess it started around the beginning of June when I went from Fastpath to 407 Interleaved. Given the times of the spikes I really have no idea. I don't think its in the home, unless I've overlooked something. There isn't much between here and the cab as its all residential, except the line path goes over a railway bridge (non electric). I'm not aware they are doing anything at night on the railway line.

I guess If it gets worse and the DLM kicks my speed down below the BT minimum, then I can get PlusNet to look, otherwise I don't suspect I can get anywhere.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 02:09:59 PM
SITE UPGRADE   :)

The web software has now been upgraded to V1.1.0 - if you are actively running it you will want to hit F5 to pick up all the changes. We currently have 50 people registered and more joining every day. Don't forget that if you want comments on your stats and be able to keep a view of them while away from your base then this is the way to do it!

Sign up at MyDSLWebStats (http://mydslwebstats.co.uk)

These notes are also available in the Change Log link at the bottom of the MyDSLWebStats window:

1)  Addition of RESYNC, LOS, LOF and LOM data.  This takes the form of a set of tables rather than graphs that list the dates on which these events occurred, most recent at the top. For the currently selected user, there is a table for each of the above events with appropriate data for each, all in the same pane.
   
Then below, another table with the most recent RESYNC data for every user with available data. Events for the current day are highlighted in red.
       
There is also a list of RESYNC codes and what they mean.
   
LOM and LOF data _may_ possibly help in identifying problems at the cabinet when an engineer is working on the wiring.
   
This pane auto-updates every minute.

2)  RESYNC E-mails. You will, by default, receive an e-mail when a RESYNC event occurs on your line. This gives detail of the time (which is accurate to +/- 1 minute), the current SYNC rates and the reason for the RESYNC. You can elect to turn these e-mails OFF using an entry in the Options menu at the bottom of the MyDSLWebStats window.
   
3)  All User Stats. This option has been updated and now shows more Users and  also allows you to list the data ordered by various parameters (SNRM, Sync, FEC, Offline etc etc) and in either Ascending or  Descending order.

This pane auto-updates every 30 seconds.   

4)  Assorted bug fixes and improvements in displayed data.

5)  The frequency at which the various Bits and Tone related files are uplodaed has been changed. They are now (if selected in the GUI) uploaded every 15 mins and then later, after two days deleted to leave one every hour and after 5 days, to one every day. This keeps the number of stored files down for data that  really isn't needed at the old frequencies. The Historical  option for these will pick up which files are available.

6)  Addition of 'proper' Apple Touch Icons for those with Apple devices for creating shortcuts to MyDSLWebStats.

Enjoy!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 17, 2014, 03:49:56 PM
I can't seem to get the all users graph to sort via order.  Changing the order by and direction both seem to refresh the graph, but it stays the same, update also has the same results.

I've also noticed on the 24hr graph that there is some text left at the bottom of the pane "Please wait a few seconds while the graphs loads"

This in Chrome on my tablet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 04:51:18 PM
I just checked the FTP log and a file transfer failed. Should be okay now if you hit Update. And a lot quicker as well.

I don't see that text in Chrome or Opera here on my tablet or two PCs - can you post a screen grab please? I know the text but it should be behind the graph, not under it or wherever.


I can't seem to get the all users graph to sort via order.  Changing the order by and direction both seem to refresh the graph, but it stays the same, update also has the same results.

I've also noticed on the 24hr graph that there is some text left at the bottom of the pane "Please wait a few seconds while the graphs loads"

This in Chrome on my tablet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 05:11:50 PM
Ah I thought you meant the normal 24 hr graph, not the 24Hr selector... That is meant to be there and there is more text under it that you can scroll up to see.  It says

Please wait a few seconds while graphs load....
Once loaded you may select a title to see larger graphs (you'll need Pop-ups enabled)

It wasn't intended to be invisible after loading. I don't see it here at all as it's just outside the visible area on my display. I seem to remember I was going to make the graphs smaller vertically to show it.

Edit: which I have now done.

==

I've also noticed on the 24hr graph that there is some text left at the bottom of the pane "Please wait a few seconds while the graphs loads"

This in Chrome on my tablet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 17, 2014, 05:28:47 PM
I can confirm it's now working, and all the text is visibl, nice improvements,  thanks.

I may not have the fastest connection, but we do seem to get the most FEC errors on our works connection.

I take it that quite a few users have opted to keep their stats private, a quick count only shows 29 users?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 05:44:49 PM
Private stats isn't an option currently as no one has asked. The others are Registered but just watching currently.

I can confirm it's now working, and all the text is visibl, nice improvements,  thanks.

I may not have the fastest connection, but we do seem to get the most FEC errors on our works connection.

I take it that quite a few users have opted to keep their stats private, a quick count only shows 29 users?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 17, 2014, 05:54:57 PM
can we have an option to make our own stats allow guest access?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 08:25:26 PM
can we have an option to make our own stats allow guest access?
Basically, no. It's not possible the way it's set up at the moment, nor likely to be an option in the future.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 17, 2014, 10:10:31 PM
is this due to policy rather than technical reasons? as your stats work for guest access.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2014, 11:06:33 PM
Because that's how I coded it as there was no one else using it at the time that was on 24/7....

Why are you so keen for everyone to see your stats then?

is this due to policy rather than technical reasons? as your stats work for guest access.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 18, 2014, 04:24:42 AM
got a few friends I want to show but they dont want to register just to view my stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 18, 2014, 07:09:07 AM
Well if they can't be bothered to Register then that answers that....

got a few friends I want to show but they dont want to register just to view my stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 18, 2014, 07:11:00 AM
g3uiss
Thanks for the Donation to the cause! Much appreciated  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 18, 2014, 06:10:10 PM
First let me congratulate Tony again these stats are fantastic.  :P

I think I may be now suffering from paranoia as I can see so much detail. I have noticed my SNR falls at night. This I know is normal, however I'm surprised by the size of the drops and times. last night just after 4PM and similar the previous nights large drops. At this time there is certainly no electrical activity in our home or I expect in any others between here and the cab.

I know other are able to see our stats, so appreciate any information for interest sake. ??? Fortunately even with SNR falling below 3db I'm staying in sync. Incidentally, I'm only 600m from the cab, but unfortunately part of that at the beginning is on AL cable not copper hence the poor speeds. I'm also on a busy cab.

I'm in IT so would like the benefit of more experienced knowledge in this area.

Thanks

Tony

I wonder if anyone between you and your cabinet is using cheaper night electricity to run dishwasher, washing machine, immersion heater, etc.
Thermostats opening and closing or motors switching on and off can create some nasty RF spikes if not properly suppressed (a capacitor across the contacts does it - which sometimes fails and makes the relay suddenly become noisy.

I'm not sure how you'd track it down, unless you watch for the interference starting and then go on street patrol with an AM radio tuned between channels.  Even if you find it, I'm not sure how you'd persuade the owner to fix it unless it's affecting anything of theirs as well.
You could try pointing out that the contacts will fail if it isn't fixed (which is true, although it takes quite a while).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 18, 2014, 07:31:32 PM
Well if they can't be bothered to Register then that answers that....

got a few friends I want to show but they dont want to register just to view my stats.

to be fair I avoid registering on various sites because its a hassle.

The need to register and have a very complex login page as well just to view stats seems excessive.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 19, 2014, 02:59:06 PM
Thanks for the comments. I think its likely a house that is having very major extensions and they are still living in it. I guess perhaps lots of electrical kit used nightly is temporary and may be the evening drop. I've also noticed a spike every night at 0500 so I'm sure that's some sort of timer. Looking over the last week its marginally better each night, interested to see if weekend is worse. The path of my line goes right in front of this property. I recon another 2 months ( its been 6 already) and it will be completed. If after then I might think again.

Thanks for the input it confirms my thoughts

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on September 21, 2014, 01:27:14 AM
Is there a reason for a dual-password setup for the login page?

The "memorable phrase" defeats my lastpass setup, which is the place I assign password memory to - and by doing so, makes sure I generate really obscure passwords for sites where it works.

Unfortunately, this means my "memorable phrase" tends to be very un-memorable, and means I have it written down somewhere - and then have to scramble to find that when the website croaks and logs me off (such as this evening). This is partly exacerbated because my favourite "memorable phrase" is actually too long to be stored in the 18-character limit.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 21, 2014, 01:51:24 AM
I have same issue WWWwombat, its hard to quickly login.  Firefox is entering a cached value into the wrong box.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 21, 2014, 07:08:17 AM
  It is not that bad as once you login the first time a cookie ensures that in future there is no login if you go straight to the display page.-just straight there
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 21, 2014, 07:43:20 AM
Those cookies seem to expire, if I try to go straight to the page after a while I am guest.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vs1 on September 21, 2014, 02:03:30 PM
I'm working on something similar to this for my own personal use. I didn't know anyone was interested in doing a service like this. Good job. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 21, 2014, 11:36:21 PM
Those cookies seem to expire, if I try to go straight to the page after a while I am guest.
I'll attempt to answer several queries at once here.

Cookies don't expire until 28 days or more after creation and will occasionally be extended.  If they appear to be deleted or expiring then something is deleting them, they don't just vanish unexpectedly, and it won't be the website either (which has been up for 58+ days with no problems) nor should a connection loss have any effect.

Specifically logging out will though make you log on again and you really only need to do that if you don't want someone else on your terminal using it.

You may have discovered also that once you've logged on a few times, the logon requirement becomes much simpler. The cookies will (should) survive shutting down the terminal and/or closing the browser and restarting if everything is set up correctly.

No cookie(s) and you become a guest as observed. Also, if you repeatedly get told your Memorable Phrase is incorrect (which, being easily remembered you won't get wrong) then you are almost certainly not setting any cookies in the first place and you'll never be able to log on.

Both of you affected are using FF32 so maybe it's not set up correctly? Cookie phobia on the browser developers part seems to mean we'll delete them if we get the chance without you knowing...

To set FF up to keep cookies, open the Tools, Options menu. Then select Privacy, and under History change the dropdown list to read Use Custom Settings for History. Then check Accept Cookies from Sites and change Keep Until to read they expire. Then select Exceptions. Enter mydslwebstats.co.uk in the text box and select Allow. Then also add and Allow www.mydslwebstats.co.uk Then Close and then Okay the original dialogue box. Without these settings you may well be deleting cookies.

Make sure you don't have extensions like Self Destructing Cookies or the like that will still delete cookies.

The Memorable Phrase is NOT a password! It's just what it says, a phrase that you can easily remember. It would usually be plain text like 'I love carrots' or 'dogs hate cats' or whatever but not a character concatenation that is impossible for you to memorise. Now you have mentioned that, the reason FF is treating it as a password is because the box you are typing it into is defined as a password box, hence the hidden characters. So I've changed it to a text box, can't say I'd really noticed though as I can easily remember my memorable phrase....

Personally, I don't trust LastPass or it's ilk in the same way that I no longer trust Roboform that I had been using since I found out that it sends your supposedly private master password back to its creators!

Hope that helps  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 22, 2014, 08:10:49 PM
Tony

Any more info on this statement

Quote
Cookies don't expire until 28 days or more after creation and will occasionally be extended.

any chance these can be set for xxx months/years.

LAst pass is not compatible with the login page...it seems to replace the mem phrase  with the password proper; i have unticked the autofill option (in the lastpass "site") and hopefully that will work next time i have to login.


Tony these are not complaints..just comments/help for other users....your website saves me having to remote desktop into my pc to see the stats and is much appreciated.

Ian



Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 22, 2014, 09:53:50 PM
Ian

I've changed the cookies to 6 months. Just hope you aren't still using it in 2038 when the world ends (or at least the 32-bit world)

Also had a look at the way the Log On page is coded and have removed/renamed anything that could possibly make LastPass think that there is another password field there for the Memorable Phrase. See if that helps please.

Also note that there is a problem with the current way of detecting resyncs. Some are being missed. I've coded a new way of doing it that solves the problem but need to find a way to get this into the existing page code. Hope it doesn't do what happened during original testing when I woke up to find every user had had a resync every minute all through the night after 00:00....  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 22, 2014, 11:01:36 PM
thanks, I will check if its my browser expiring the cookies.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 22, 2014, 11:13:37 PM
Mine expired tonight...  which is the 2nd expiry since I began using it.   

Ive struggled both times to re-login. Couldnt recall my password -grr damn hyphen - then forgot my memorable phrase.  and by gawdd I cant tell you the number of times I refreshed the capcha either  :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 23, 2014, 04:42:48 AM
:) kitz

as it so happens When I clicked continue my cookies were working, which is good but I had noticed I only set to allow mydslwebstats.co.uk cookies whilst www. was session only, so now both on full allow.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2014, 07:57:48 AM
:) kitz

as it so happens When I clicked continue my cookies were working, which is good but I had noticed I only set to allow mydslwebstats.co.uk cookies whilst www. was session only, so now both on full allow.
Sorry I forgot some browsers need both the root domain AND the www sub-domain to be treated separately. I've updated the original suggestion in this thread to add both. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 23, 2014, 09:06:51 AM
I think firefox by default treats both same not sure tho.

I am using cookie monster extension which has much finer control over cookies.  I dont know if normally in firefox a sub domain of primary domain counts as third party or not.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2014, 09:47:12 AM
I think firefox by default treats both same not sure tho.

I am using cookie monster extension which has much finer control over cookies.  I dont know if normally in firefox a sub domain of primary domain counts as third party or not.
I think you'll find it has to be a separate root domain to be 3rd party.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 25, 2014, 06:05:27 PM
Have found IE9 is somewhat lacking in the graphing department and by using Google Chrome with mydslstats the graphing is working fine on vista, it should be ok with windows 8 IE11 i'll check that later after a reboot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 25, 2014, 06:32:54 PM
All my devices seem to be working better now, I haven't need to log back in since I think the v1.1 update on any of the browsers I use.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 25, 2014, 10:29:10 PM
I am really injoying using mydslstats,can even see some users suffering the evening RFI at 18:00 same as me, with all that info to hand you get clearer picture into how the distance from exchange/FTTC cabinet effects the end users stats  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 25, 2014, 10:46:22 PM
yes and let us watch your line also please :)

even if its only partial data.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 25, 2014, 10:58:43 PM
yes and let us watch your line also please :)

even if its only partial data.

Ha Ha i did say from the start the data collected will only be when the PC is ON and the data usage is not that bad as first thought, unless I get a laptop and also go unlimited this offline and online is not going to change  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 26, 2014, 07:58:36 AM
yes and let us watch your line also please :)

even if its only partial data.

Ha Ha i did say from the start the data collected will only be when the PC is ON and the data usage is not that bad as first thought, unless I get a laptop and also go unlimited this offline and online is not going to change  :)

Glad you like it now we've got there  8)

Well I have my Raspberry Pi here ready for testing 24/7 when the code is available. That consumes under 2A at 5v max on its own (so the data says). Hopefully I can do a beginners guide eventually (I am very much one as I'm not a Linux user and have never even installed it on anything) as to how to set it up (and probably what not to do as well).

The raw board is around £30 for the B+ model and you can get a small 3 inch touch screen that sits on top for just over the same price.

Eric can probably make some relevant comments as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 26, 2014, 12:53:42 PM
  My appreciation and thanks to the developers of myDSLwebStats, I find it a valuable resource.  At risk of immediately being thought of as Oliver Twist I wonder if you could think about adding something extra? 

   It would very useful to be able to see the average errors rates over time more clearly than with the bar charts, especially if like me your PC is not always running. (I hope I am not missing something).

As a suggestion, and to clarify what I might mean, one suggestion would plotting the average error rate/hour since the last resync (starting one hour after the last resync).

This could be plotted as a continuous line on each of the current bar error plots e.g. ES and CRC.  I don't know exactly what is uploaded to myDSLWebstats but this average is easy to calculate if you have the results of "info --stats" using the "since link time" stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 26, 2014, 03:24:25 PM
  My appreciation and thanks to the developers of myDSLwebStats, I find it a valuable resource.  At risk of immediately being thought of as Oliver Twist I wonder if you could think about adding something extra? 

   It would very useful to be able to see the average errors rates over time more clearly than with the bar charts, especially if like me your PC is not always running. (I hope I am not missing something).

As a suggestion, and to clarify what I might mean, one suggestion would plotting the average error rate/hour since the last resync (starting one hour after the last resync).

This could be plotted as a continuous line on each of the current bar error plots e.g. ES and CRC.  I don't know exactly what is uploaded to myDSLWebstats but this average is easy to calculate if you have the results of "info --stats" using the "since link time" stats.

Thanks. Anything is possible in the future. You can already get a visual idea of error trends over a period using the 'Period to show' option set to look further back than 24 hours, it can go back 120 days currently. Or use the Range option for any two dates between 1st Jan 2014 (a couple of users have this) and today. The only 'Bar' Chart is ES - although it's actually a Column Chart. The others are mainly Line Charts.

I have to give this project a rest for a while though for real work that pays money. Been pretty well flat out since June working on it when I first had the idea.

There is one major new option to come though I'm just working on now. There is also a finished graph for Uptime that has yet to be released.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 27, 2014, 04:29:18 PM
  Please could you say how errored sec/hour are dealt with in the plots when there gaps in the samples received?  For those with continuous data it looks like a average every hour is plotted but with switching PC's on an off some intermediate times appear along with some whole hours. 

 I assume crc/min is just that whenever two consecutive  samples are received.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 27, 2014, 10:15:13 PM
After a few days using mydslstats it would seem the shorter lines 79000 kbps DS sync with 19999 kbps US sync have really nothing to complain about as your stats are static (boring)  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 28, 2014, 09:45:55 PM
Please dont take this the wrong way, but when did you start displaying ISP information.   For me its not really applicable as Im sure most people know which ISP Im with..  but I do have some slight concerns that anyone can register to lurk and check out info on other people lines without them actively partaking in the project themselves.

Im not criticising your hard work.. I think what youve done is a brilliant idea...  Im just not sure about the ISP and whether that is relevant for people of the lurker type to know.  Thoughts by others?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 28, 2014, 10:16:52 PM

Please dont take this the wrong way, but when did you start displaying ISP information?  For me it's not really applicable as I'm sure most people know which ISP I'm with..  but I do have some slight concerns that anyone can register to lurk and check out info on other people lines without them actively partaking in the project themselves.

Im not criticising your hard work.. I think what youve done is a brilliant idea...  Im just not sure about the ISP and whether that is relevant for people of the lurker type to know.  Thoughts by others?

When? About three hours ago after collecting them all over the past week as I thought it would be of general interest.... It's there for a specific purpose, as well as general info, which is looking for possible ISP specific faults that might occur as will become apparent in the next update. I can easily remove it if there is concern now that you've publicly raised the possibility but I'm not convinced it's of any benefit to the type of person you mention, and I am very aware of them - other than it's apparent that the majority of people on MDWS use one particular ISP, if it was an IP address then yes, there would be a problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 29, 2014, 05:03:35 AM
OK, I've set it all up, I've been viewing results, and it all looked good - then I had a problem with my FTTC.
So I swapped out the Billion 8800n for the HG612 and TG582n, just to eliminate that.
The program kept running, but couldn't get anything from the (still locked) HG612.
Since changing made no difference I changed back, and now appear to be getting valid data again - which I assume is going up to the MyDSLWebStats site, via my registration.

But I can't log in - Even when clicking the link in the GUI which should take me there.  If the GUI can store the required information to push data onto the site, it certainly should be possible to use the same information to read what you've pushed up there!
All it takes me to now is the guest page.
My browser has remembered my password, but there's so much other faff involved in fighting my way into the login screen that I just can't remember (Is it really necessary to have username, password, memorable phrase, Captcha AND a Q &  A on what the capital of England is?

Having all that stuff is contrary to all basic tenets of decent security, since the result is that you HAVE to write it down somewhere - and that is a security risk.

Once registered, a user should only need username and password, with complexity requirements on the password if you feel the need to be more secure than average.
Captcha is only necessary for registration.
And I was under the impression when I registered that the other stuff would only ever be needed if I lost my password, which is saved in my browser and backed up (unlike that of any site with properly sensitive data on it, btw - I keep a strongly encrypted file with a record of all of those, stored somewhere else with an air-gap between it and the internet).

Do you really think you need stronger security than paypal or most banks?
Or the MOD (for whom I have set up security, so some well qualified people other than myself seem to think I know just a little bit about it).

AND THERE'S NO FACILITY FOR RESETTING LOGIN INFORMATION WHEN IT GETS LOST!

fix it please, as it is useless in it's current form.

Once you make the mistake of logging out, you can never get back in!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 29, 2014, 07:20:31 AM
The link on the GUI is not supposed to log you back in, the GUI doesn't know your username or password, only the info needed to upload stats.

On the occasions I've had to log back in I've had no problems,  maybe I've had to refresh the captcha a few time though. Since the v1.1 update I haven't had to log back in on any of my devices. As long as you don't log out a cookie should be stored on your device, this seems to be working very well for me. There is an earlier post detailing all this.

With reference to our ISP's being displayed, it doesn't bother me at all, there's plenty of places on the net where I make it clear enough whom I'm with, and I've also used the Plus Net ping graph pages when I've had a problem to see if it's affected others. However I can see that some may see this as a problem, so the simple solution would be to allow people to opt out of having their ISP shown.

I am curious as how he's worked out who our ISP'S  are? I know this information is available when doing a speed test, so must be available somehow.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:23:12 AM
Quote
I am curious as how he's worked out who our ISP'S  are? I know this information is available when doing a speed test, so must be available somehow.

In most cases your IP address identifies your ISP, and this can be read by every website you visit. It's certainly not a secret.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:28:32 AM
@TimeBandit: please remember that MyDSLWebStats is a free service set up by someone at his own expense, and he even took time off paid work to set it up. Logging in may be slightly complicated, but it's not a big problem, and lots of us are using it every day without difficulty. Give the man a break. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 29, 2014, 09:08:51 AM
I suggest making the isp info be controllable by the account holder.

I also agree with the login page comments, I consider captcha and the q&a overkill.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 29, 2014, 10:59:07 AM
Hi

I also access the MyDslWebstats via my mobile and other peoples/clients broadband connections and noticed that my isp was showing as VodafoneUK ie. the IP addy I was accessing the website by not the ISP of my upload PC.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2014, 11:36:41 AM
But I can't log in etc etc etc etc

As Ron says, the GUI has no idea how to log you in so that will just take you directly to the Registration page. There is no code in there other than links that would take you directly to any other page - unless you successfully Log On.

Can I please strongly suggest that you ask for help first on what the problem might be next time rather than hurl your toys out of the pram and scream and shout in public. If there is a problem for you that others apparently don't have, we can locate and fix it if possible.

In answer to your question, your uploads ceased with the last one being at 08:17 this morning - you might want to check the upload terminal details as the web site Log On data has no connection with the upload at all. One person recently changed their username inadvertantly but that causes loggable errors and there haven't been any from you. It was working for you so something apparently has to have changed and there have been no changes with the upload side code for some time now. Unless you have disabled it since posting of course.

As said before, if you have cookies that are not destroyed when you finish the session, close the browser or whatever, then you should NOT have to log on again for a long time if atall. And if you do you'll only need to enter your UserName and Password, again as I've said before - all providing you have permanent cookies. It sounds like you do not I'm afraid. But I could be wrong of course.

The captcha IS needed when first logging on in my opinion - it is an easier server entry point than the Registration. I have also worked on programming including security for Government and other entities over the past 22 years and am very conscious of the need for it after servers have been compromised. It isn't primarily to protect the data as such, which as you say is not particularly sensitive. It's there to protect the server itself as you should well know if you have worked in security. When you have the ability to see tens of thousands of continuous root (and other account) automated login attempts caught and the IPs banned by cPHulk, it tends to bring the risk home.

The blanket statement it is useless in its current form is untrue, it's your own opinion of your own experience. Since yesterday morning nine people have logged on at the first attempt and two have failed through invalid passwords but succeeded on 2nd attempt. Other people have mailed to say they have no problems.

As explained before at some length, please check that you are retaining Cookies permanently for the site. IE11 is particularly agressive in this repect. I don't think I've logged in on any of the browsers and terminals I use (4 workstations and 2 laptops, each of which has up to 5 browsers available for testing this and other projects etc).

Please bear in mind that this is currently a FREE access project for everyone out there (with an option to Donate to keep it going that is being pretty well ignored except by one kind soul) that four people have given up their time and energy, also for free, over the past three months to get it going after the initial idea came up.

There were a lot of problems that had to be worked around, at one point we had to give up and start again with the uploads to find a much more secure method that otherwise threatened the entire project.

I fund the dedicated server myself out of my own pocket and like to protect it from the nutters out there as far as possible as you might possibly imagine.

There is also now a monitor on the Cookies and their expiry dates in an effort to see if anything unexpected might be happening and to see why yours might be failing if you want to try again. There should already be specific evidence of this in the logs but I can't find anything at the times you were trying.

So. if you want help PLEASE ASK FIRST. I don't see any major problems with the security requirements looking at the logs that would cause me to change the requirements at this moment, certainly the extra effort needed initially is not a valid reason. Changing your account details etc is underway but needs some more work that I could have continued attended to had I not spent hours working on this reply in between other chores/mails/phone.

Ron: re ISP details. As roseway says, a Host lookup on the the IP Address that is returned to the server by everyone (and I have a massive cache of Host lookups) will return enough info to determine it in 90% of cases, the others need a bit more work - such as our Swiss LIVE user. And OK on it as an option which I may well do. Most people on TBB state their ISP in their sigs anyway, not so much though on Kitz. I've removed them for now until I can attend to the user comments later.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2014, 01:06:14 PM
@TimeBandit: please remember that MyDSLWebStats is a free service set up by someone at his own expense, and he even took time off paid work to set it up. Logging in may be slightly complicated, but it's not a big problem, and lots of us are using it every day without difficulty. Give the man a break. :)
Thank you Eric. A rather more compact version of my post I hadn't spotted beforehand  ::) 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 29, 2014, 02:45:34 PM
 :-\   Please remember this isnt TBB.  I can sense frustration on both sides. :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 29, 2014, 02:54:23 PM
my issue's with captcha's are is that they only serve to frustrate, bots get by them anyway and it can block human's who struggle to read them.

yes its not a major issue given the cookies last a long time now, but I find your point interesting you say it can help prevent the server been rooted somehow, given I also work in server security I have interest in that comment.

I remember not been able to register on palemoon's forum due to the captcha, the admin eventually gave in and manually registered me after he seen I had over 20 failed attempts. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on September 29, 2014, 03:19:29 PM
But I can't log in etc etc etc etc
... Please bear in mind that this is currently a FREE access project for everyone out there (with an option to Donate to keep it going that is being pretty well ignored except by one kind soul) that four people have given up their time and energy, also for free, over the past three months to get it going after the initial idea came up. ...

Thanks for the prompt re: Donations

Something is on its way with thanks.

*** Please Support Tony et al & Kitz for their hard work and time given freely to us all ***
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2014, 03:53:35 PM
my issue's with captcha's are is that they only serve to frustrate, bots get by them anyway and it can block human's who struggle to read them.

That can be frustrating - a bit like people who put apostrophes everywhere they are not needed....  :graduate:  (sorry I proof read publisher's drafts as one of my activities)

yes its not a major issue given the cookies last a long time now, but I find your point interesting you say it can help prevent the server been rooted somehow, given I also work in server security I have interest in that comment.

You are reading into what I said - I was making the general point that security overall is there to protect the server as well as the specific data you are trying to access, not that captchas can do anything directly.

I remember not been able to register on palemoon's forum due to the captcha, the admin eventually gave in and manually registered me after he seen I had over 20 failed attempts. :)

Um that's interesting. Doesn't that maybe indicate a visit to the opticians might be needed if you've had such trouble elsewhere with reading captchas? Two or three tries maybe but 20  :no:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 29, 2014, 05:18:21 PM
no because captchas are deliberately made to be hard to read, but different sites have different captchas some can be incredibly hard to read with letters overlapping, covered by lines and shapes etc.  I also dont know if the palemoon registration had some kind of bug or not but regardless I kept getting fail's on the captchas.

Some developers try to get best of both worlds, an idea is to not initially show the captcha but if there is say 3 failed attempts in a row then require the captcha to login from the 4th attempt onwards, google do it that way, and yes I may or may not have an eye issue, although whenever I get tested doc's always say is fine. Although I probably dont have the same vision as an 18 year old.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 06:14:29 PM
Have to say I quite like the ISP tag and have not had to use the captcha since the registration was succesfull and let the username & password save to the browser and all you need to do is click logon and your in.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 29, 2014, 06:25:25 PM
Quote
Um that's interesting. Doesn't that maybe indicate a visit to the opticians might be needed if you've had such trouble elsewhere with reading captchas? Two or three tries maybe but 20

eke... I dont wear glasses..  but I mentioned previously that I did find the login precess & captcha difficult.   I certainly refreshed well over 20 times and I did have considerable problems logging back in (http://forum.kitz.co.uk/index.php?topic=14361.msg270271#msg270271).  The extended use of cookies should remedy this to a large extent.

At the end of the day, it is tbailey's baby so the choice of security is entirely down to him.  Its also up to him whether he takes on-board feedback and constructive suggestions.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 07:18:25 PM
Since I moved from HG612_Modem_stats to dslstats to upload the data to mydslstats have noticed my DS FEC/Min count is mirrored on the US FEC/Min count don't think that sould be the case  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 07:24:50 PM
Since I moved from HG612_Modem_stats to dslstats to upload the data to mydslstats have noticed my DS FEC/Min count is mirrored on the US FEC/Min count don't think that sould be the case  ???

I'll check that out - it's probably my error.

[Later] Yes, it was an error on my part, now corrected.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on September 29, 2014, 07:38:36 PM
I can confirm this. Also the upstream crc errors are completely missing in MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 07:52:37 PM
Since I moved from HG612_Modem_stats to dslstats to upload the data to mydslstats have noticed my DS FEC/Min count is mirrored on the US FEC/Min count don't think that sould be the case  ???

I'll check that out - it's probably my error.

[Later] Yes, it was an error on my part, now corrected.

Thanks Roseway
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on September 29, 2014, 07:55:54 PM
TBH, CRC errors in MDWS are slightly redundant.
They are there as legacy data from when my original HG612 Modem Stats scripts/programs didn't report US data.

CRC & OHFErr (or SFErr for ADSL connections) are basically the same.

Take a look at the CRC & OHFErr graphs.
DS will be pretty identical in both & the OHFErr graph also reports US data. 


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:08:12 PM
TBH, CRC errors in MDWS are slightly redundant.
They are there as legacy data from when my original HG612 Modem Stats scripts/programs didn't report US data.

CRC & OHFErr (or SFErr for ADSL connections) are basically the same.

Take a look at the CRC & OHFErr graphs.
DS will be pretty identical in both & the OHFErr graph also reports US data. 

People will be more familiar with the term 'CRC', so perhaps the OHFErr graph should be renamed 'CRC errors'.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on September 29, 2014, 08:18:35 PM

People will be more familiar with the term 'CRC', so perhaps the OHFErr graph should be renamed 'CRC errors'.

Or maybe even CRC (OHFerr) to also confirm they are one & the same?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on September 29, 2014, 08:27:40 PM
Or maybe even CRC (OHFerr) to also confirm they are one & the same?

Yes, that is a good idea!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2014, 08:28:00 PM
... except that on ADSL it's called SFErr.

I suppose it's up to Tony how it's labelled, but I certainly think it would be best to remove the confusion in some way, and have only one graph for these values.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 29, 2014, 08:44:59 PM
use OHFerr and call is CRC DS & US/Min  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on September 29, 2014, 09:02:50 PM
But I can't log in etc etc etc etc

As Ron says, the GUI has no idea how to log you in so that will just take you directly to the Registration page. There is no code in there other than links that would take you directly to any other page - unless you successfully Log On.

But each time up until now just going to the site has taken me straight to my stats page.

Can I please strongly suggest that you ask for help first on what the problem might be next time rather than hurl your toys out of the pram and scream and shout in public. If there is a problem for you that others apparently don't have, we can locate and fix it if possible.

Well, I thought this was the preferred place to look for help.
I'm sorry if I was rather irate about it, but Id been up all night fighting with routers, modems and reconfiguring networks to ensure that there weren't any  problems on my own internal network (there weren't as I suspected).
That may sound trivial, but it isn't when you can't walk unaided and the router and modem are not within reach of the PC, and at a height which means dragging myself upright and wedging myself in a rather painful position so I have my hands free to swap cables around.

In answer to your question, your uploads ceased with the last one being at 08:17 this morning - you might want to check the upload terminal details as the web site Log On data has no connection with the upload at all. One person recently changed their username inadvertantly but that causes loggable errors and there haven't been any from you. It was working for you so something apparently has to have changed and there have been no changes with the upload side code for some time now. Unless you have disabled it since posting of course.

I did mention, I think, that I'd had to change back to the locked HG612 and TG582n combination, to be able to eliminate any fault with the modem/router.  I wouldn't expect uploads to have continued after that.

As said before, if you have cookies that are not destroyed when you finish the session, close the browser or whatever, then you should NOT have to log on again for a long time if atall. And if you do you'll only need to enter your UserName and Password, again as I've said before - all providing you have permanent cookies. It sounds like you do not I'm afraid. But I could be wrong of course.

I still have cookies stored in my browser for mydslwebstats.co.uk - FID1, FID2, FID3, FID4, FID5, User, Theme, and PHPSESSID.

The captcha IS needed when first logging on in my opinion - it is an easier server entry point than the Registration.

I'm seeing exactly the same as when I was first registering.
Which took about a dozen tries, but I got there in the end.
As stated, I'd never even seen the login screen after that - each time I'd connected it just went straight to my stats page.

I have also worked on programming including security for Government and other entities over the past 22 years and am very conscious of the need for it after servers have been compromised. It isn't primarily to protect the data as such, which as you say is not particularly sensitive. It's there to protect the server itself as you should well know if you have worked in security. When you have the ability to see tens of thousands of continuous root (and other account) automated login attempts caught and the IPs banned by cPHulk, it tends to bring the risk home.

Well, disabling root login from the web interface would seem to be the simplest way of avoiding that - and restricting SSH (or whatever remote control you  do use, if it's not a local machine), to specific IP addresses owned by or known to you.  Anything else will just see a closed port, or no port at all if it's properly stealthed.

The blanket statement it is useless in its current form is untrue, it's your own opinion of your own experience. Since yesterday morning nine people have logged on at the first attempt and two have failed through invalid passwords but succeeded on 2nd attempt. Other people have mailed to say they have no problems.

As explained before at some length, please check that you are retaining Cookies permanently for the site. IE11 is particularly agressive in this repect. I don't think I've logged in on any of the browsers and terminals I use (4 workstations and 2 laptops, each of which has up to 5 browsers available for testing this and other projects etc).

I'm certainly retaining cookies (I'm using firefox, and didn't try a different browser as I'm aware that they wouldn't have the cookies which would allow them to be "remembered").

Please bear in mind that this is currently a FREE access project for everyone out there (with an option to Donate to keep it going that is being pretty well ignored except by one kind soul) that four people have given up their time and energy, also for free, over the past three months to get it going after the initial idea came up.

I fully intend to donate as the concept is a good one.
But I really think the over aggressive security has some problems - I note from other posts on here that I'm not the only one to have had problems registering, so there seems to be something a bit awry - repeated attempts got it working for me.
The fact that it's dropped me back to the registration style page seems to confirm this.
This isn't intended to be a rant, but constructive feedback to help you fix whatever the problem is.

There were a lot of problems that had to be worked around, at one point we had to give up and start again with the uploads to find a much more secure method that otherwise threatened the entire project.

I fund the dedicated server myself out of my own pocket and like to protect it from the nutters out there as far as possible as you might possibly imagine.

I'm in full agreement with the need to protect it, but I do think that you are going about it the wrong way.
You send an email with the validation key for uploading data anyway - couldn't the same key be used to validate an interactive user?
Once you are getting validated data from an IP address, it shouldn't be necessary for much more than username and password (which my browser have remembered) in the way of validation for login attempts from that same address.  Maybe a bit more if they attempt to log in from somewhere else - I can see that has some benefit.

There is also now a monitor on the Cookies and their expiry dates in an effort to see if anything unexpected might be happening and to see why yours might be failing if you want to try again. There should already be specific evidence of this in the logs but I can't find anything at the times you were trying.

So. if you want help PLEASE ASK FIRST. I don't see any major problems with the security requirements looking at the logs that would cause me to change the requirements at this moment, certainly the extra effort needed initially is not a valid reason. Changing your account details etc is underway but needs some more work that I could have continued attended to had I not spent hours working on this reply in between other chores/mails/phone.

OK, tell me please what I need to do to get back in, because at the moment I'm stumped
You have my email address, so if you need to send a validation token or something, you can.
Putting an "I've forgotten my password" link on the login page to automate this would seem to be a sensible precaution as the site grows - this could just mail a temporary password (with a change requirement) to the email address associated with the account.

Ron: re ISP details. As roseway says, a Host lookup on the the IP Address that is returned to the server by everyone (and I have a massive cache of Host lookups) will return enough info to determine it in 90% of cases, the others need a bit more work - such as our Swiss LIVE user. And OK on it as an option which I may well do. Most people on TBB state their ISP in their sigs anyway, not so much though on Kitz. I've removed them for now until I can attend to the user comments later.

I'm not worried who knows I'm with Zen :)
But it would seem more sensible to use the IP address that the data comes from for the ISP lookup, rather than the one the user is logging in from.
Not a bad idea to make it optional though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 29, 2014, 10:54:57 PM
Tonight I swapped from using HG612_modemstats to DSLstats to send records to mydslwebstats and I noticed a slight issue when recording attenuation which Ive raised with eric in the relevant thread. 

However its also brought to my attention the fact that mydslwebstats is recording Line Attenuation but not Signal attenuation and I wondered if it may perhaps be better to monitor Signal attenuation rather than Line attenuation (or even both? ). 

Line attenuation should rarely change as its only measured during the sync phase, but its possible that Signal attenuation can change at any time.   When I had a line fault, my signal attenuation was all over the show - yet my line attenuation never changed. Difference between Signal Attenuation & Line Attenuation (http://www.kitz.co.uk/adsl/linestats.htm#Signal_v_Line_Attenuation).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 30, 2014, 04:42:06 AM
what is the actual difference between the 2?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 08:25:40 AM
Tonight I swapped from using HG612_modemstats to DSLstats to send records to mydslwebstats and I noticed a slight issue when recording attenuation which Ive raised with eric in the relevant thread. 

However its also brought to my attention the fact that mydslwebstats is recording Line Attenuation but not Signal attenuation and I wondered if it may perhaps be better to monitor Signal attenuation rather than Line attenuation (or even both? ). 

Line attenuation should rarely change as its only measured during the sync phase, but its possible that Signal attenuation can change at any time.   When I had a line fault, my signal attenuation was all over the show - yet my line attenuation never changed. Difference between Signal Attenuation & Line Attenuation (http://www.kitz.co.uk/adsl/linestats.htm#Signal_v_Line_Attenuation).

Are/were you a teacher or police officer or other official in public life :graduate: :police: ? Brought to my attention sounds very official and reminds me of the day when .....  :-X  :-[ :'(

I am trying to answer several posts at once here in summary before I have to go out. I seem to have a failing disk on my main workstation (this one) and an attempt at a restored backup to another disk is apparently corrupted so I need to sort that out promptly

Signal Attenuation can be available, I'll add it to the list of things to do, currently running at 25. There are over 140 possible individual graphs that could be drawn from the data available to MyDSLWebstats and the, now over 2 million, uploaded records.

I hadn't intended to but after working on this until 03:30, I will enable facilities to Reset a lost/forgotten Password and also to Change a Password. These are fairly complex to get right and catch all sorts of failures and other possible problems but are now hopefully working. They will be available via the Login page for the Reset and the Options menu for the Change.  Changing your e-mail will come later on.

There are no other Security changes apart from those I mentioned in an earlier post. The ISP revelations have gone for now and other comments on these are noted.

And thanks for the little flurry of Donations from some users  :clap2: I'll acknowledge these here later.

I'll announce here when the Password options are available, I need to check them one last time. So please don't post saying you can't find them  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 30, 2014, 08:27:29 AM
I plan to donate also but you may need to remind me if I forget.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: G.DMT on September 30, 2014, 02:35:01 PM
First off - a huge thanks to all involved for creating this superb free service.   ;D
Well done!  :clap2:

And now for a small observation / feature request.

When I registered at: http://www.mydslwebstats.co.uk/mdws-rg.htm
 I was not allowed to enter my Kitz username  (G.DMT) because it contains a '.'

Could you enlarge the set of allowed characters slightly so as to not prohibit legal usernames from kitz.co.uk (and also, I suppose, http://forums.thinkbroadband.com)

That would make the service even more purr-fect than it is now.

[edit: added suggestion for which characters could be considered for inclusion]

 I performed a quick check on the Kitz registration page:
http://forum.kitz.co.uk/index.php?action=register

I didn't want to go creating loads of junk users so I tested only the interactive (javascript) validator.

Allowed characters included:
`¬|!£$%^()-+_{}[]:;@'~#,.?/

Rejected characters included:
\|"&*=<>

Looking quickly through the Kitz members pages I do see
#-._[]

If the space character ' ' is to be disallowed in usernames then it would seem to me to be even more important to allow the use of the underbar '_' character instead.

 I hope my small contribution may be of some use.  :)

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 03:19:38 PM
I'll announce here when the Password options are available, I need to check them one last time. So please don't post saying you can't find them  ;)

So here is the announcement.

LOST/FORGOTTEN PASSWORD
The Logon page now has an extra line under the Log On button:

Forgotten your password? Select HERE

Doing so takes you to another page where you can enter your Registered e-mail address. Doing so and providing it is Registered will send you an e-mail with a Reset link in it, otherwise you'll see an error. There is of course (as it says in the e-mail) nothing to stop anyone putting in/ guessing your e-mail who knows it and you'll get a mail that you can ignore if you didn't ask for it as nothing will happen - this is in common with many other reset mails on sites. There are some other questions one could ask to get round this but I hesitate to do so.

NB the earlier problems with e-mail have now been resolved after a lot of agro with Symantec, Message Labs and Microsoft.

If you select the mail link, and as it warns you several times in the mail, your password will be reset IMMEDIATELY to a random one chosen by the system and meeting the criteria. This is displayed to you ONSCREEN on the next page you see (some people get very upset if they get passwords by e-mail) so you need to write it down or copy it so you can then use the Log On page (via the link you'll see) to type or paste it in and actually Log On.

Change Password
Of course, you might want to be able to remember it so if you then go to the Options menu at the bottom of the MyDSLWebstats window, there is now a Change Password option. You'll need your (easily) memorable phrase I'm afraid (for reasons I will not explain at length) and the new password twice which has the same criteria as the original Registration entry.

Once successfully changed that's it (as long as you remember what you changed it to). No need to Log Out or do anything else. You'll probably want to tell or confirm the change to your Password Manager if you use one.

I'll add an option to change your e-mail later.

OHF ERRORS
While I am here (as I now definitely need to rebuild this machine so will be out of action for a while) someone mentioned a lack of upstream OHF/CRC errors. Upstream CRC errors are in fact already reported using the uploaded upstream OHF Error values as the upload doesn't have that data for CRCs (at least from HG612 Modem Stats). However, I checked and no values have ever been uploaded or recorded in the database, they are all zero. Hence why there are no values seen. Why I don't currently know. Edit Wrong  Date being imported  :-[ now corrected but there isn't very much of it anyway

Also I notice that some of you are physically logging out - doing so will make you Log On again but doing so does NOT also reinstate the need for the much-loved captcha etc (as long as your Cookies are not being destroyed).

And I do take notice of comments and useful suggestions but many are not always practical or advisable for reasons I may not choose to explain.

G.DMT noted, I'll have a look - hadn't occurred to me I'm afraid.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: G.DMT on September 30, 2014, 04:02:18 PM

Quote
G.DMT noted, I'll have a look - hadn't occurred to me I'm afraid.

 8)
 I was editing my post and I see that they crossed in flight there...

TLDR: Suggestion for which characters could be considered for inclusion

#-._[]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 30, 2014, 07:23:26 PM

Are/were you a teacher or police officer or other official in public life :graduate: :police: ? Brought to my attention sounds very official and reminds me of the day when .....  :-X  :-[ :'(


No..  but Im well used to being in a tech environment where willy waving and bragging seems to be the norm.   I was however brought up with manners and with the ethos that you treat others with respect.  You'll find quite a few members here dont go for the one one-upmanship, sniping & smart ass replies that is so apparent on some other tech forums.. and for that reason alone avoid TBB - hence my earlier comment.  We are actually pretty laid back..  but I can bite.   

Sorry if my style of posting doesnt meet with your standards.  But at least I can take on-board suggestions by others.... so I'll try to refrain from using anything 'brought to my attention'  to you again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 08:38:45 PM

Are/were you a teacher or police officer or other official in public life :graduate: :police: ? Brought to my attention sounds very official and reminds me of the day when .....  :-X  :-[ :'(


No..  but Im well used to being in a tech environment where willy waving and bragging seems to be the norm.   I was however brought up with manners and with the ethos that you treat others with respect.  You'll find quite a few members here dont go for the one one-upmanship, sniping & smart ass replies that is so apparent on some other tech forums.. and for that reason alone avoid TBB - hence my earlier comment.  We are actually pretty laid back..  but I can bite.   

Sorry if my style of posting doesnt meet with your standards.  But at least I can take on-board suggestions by others.... so I'll try to refrain from using anything 'brought to my attention'  to you again.

I don't know what to say to that totally unwarranted response, I did try but deleted it and will leave it at this in case it gets misinterpreted again. It was a joke after all.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2014, 08:51:47 PM

Quote
G.DMT noted, I'll have a look - hadn't occurred to me I'm afraid.

 8)
 I was editing my post and I see that they crossed in flight there...

TLDR: Suggestion for which characters could be considered for inclusion

#-._[]

Thanks. Can't have underscore or the [] as they are already used as delimiters in parsing various things. - (hyphen) is already specifically allowed. The other two are probably okay for new users but I'd have to check.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 01, 2014, 09:27:57 PM
Notice a large spike of FEC/min errors in the range of 900000 at 19:21 and also noticed on MDWS quite a few users also on interleaved had the FEC/min spike at around this time  :o
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: TimeBandit on October 04, 2014, 07:48:02 PM
My MyDSLWebStats login problems are all now resolved (many thanks, Tony), and I'm now able to view the statistics on-line again. ;D

Now I just need to do battle with BT, who have apparently reported the fault to Zen as a chargeable one   :angry:

Since it was their side of the master socket, in a cable joint that their original line installer had made (against my advice, I might add - he double punched into a shallow patch panel IDC instead of using crimps) I don't believe they have any grounds for this.
Not only that, but if it hadn't been on their side of the master socket (which I'd been warned off tampering with) I'd have probably found and fixed it myself. 
It's not as if I don't know how punch-down connections work (or don't, as in this instance).  I've built enough networks, some, ironically, for BT themselves (which is why I knew that IDC was too shallow to safely take two wires).
The problem was simply that the second wire had come loose, as the IDC wasn't deep enough to hold onto it properly.  It was something or a miracle that it was working at all, never mind that it had held on for over 6 years.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 06, 2014, 09:23:25 AM
Thanks to the following for donations to go towards keeping the MyDSLWebStats server running, they are much appreciated  :drink:

:clap: Aardvark
:clap: burakkucat
:clap: Chrysalis
 :-X Anon by request

Currently with 71 Registered Users and 41 Uploaders.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 06, 2014, 11:55:51 PM
We had two very brief power cuts at work today, the modem and network gear are all on a UPS as is my PC, so you can see the effect in the stats. The SNR went up to 13, and the maximum attainable went from 39Mbps to 52Mbps. The power outage was at 14:04 and lasted two minutes, the second power cut lasted less than a minute and the power came on just before the stats were harvested at 15:26. Also the FEC errors shot up after the power cut. User name Ronskiwork

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 07, 2014, 12:12:28 AM
Hello Ronski

Have to say I am still a little concerned with your constant high FEC/errors in the work place yet it does not seem to impact the DLM at all, to me it looks like you have ethernet powerline adapters on this line.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 07, 2014, 03:31:13 AM
The DLM doesnt count FEC's.  They just prove that interleaving and error correction is working as it should.

A very busy connection with many users and lots of data flowing through (such as a workplace/business) will tend to show lots of FECs.   The more data that goes through the connection, then the higher the FEC count will likely be - as long as its in proportion to the total traffic then its fine.   Err Secs are the ones to watch for and from a quick glance, they seem fine :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 07, 2014, 06:22:06 AM
There isn't that much data, we use around 50 to 60 GB a month. My thoughts are that the telephone cables come into the building where the 3 phase power does, and this causes interference. Many years ago I was also told the lines were in poor condition. Plus they also pass various other businesses, and we have a factory behind us. I often see the FEC errors step up or down and then stay that way for a long time, normally this occurs on a resync. I do have the highest FEC errors on MDWS though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 08:18:27 AM
The DLM doesnt count FEC's.  They just prove that interleaving and error correction is working as it should.

A very busy connection with many users and lots of data flowing through (such as a workplace/business) will tend to show lots of FECs.   The more data that goes through the connection, then the higher the FEC count will likely be - as long as its in proportion to the total traffic then its fine.   Err Secs are the ones to watch for and from a quick glance, they seem fine :)

Interestingly, and this is listed on Kitz elsewhere some time back by roseway, Reason 3 for a resync is:

High Upstream FEC (actually TooManyUsFEC)

It's used in MDWS as the reason when/if that error occurs. Is there some later data that would negate that or offer a different reason? Or, maybe it only occurs on ADSL lines?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 07, 2014, 08:20:51 AM
I expect the higher FEC's that whenthe powercut happened, the modem bitswapped into new available tones thinking this is cool, then those tones were lost again and as a result there was more errors to fix.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 07, 2014, 09:39:34 AM
I see requirement R.VDSL2.17 in SIN 498 indicates that FEC seconds are reported by the modem for DLM.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 07, 2014, 10:21:13 AM
Interestingly, and this is listed on Kitz elsewhere some time back by roseway, Reason 3 for a resync is:

High Upstream FEC (actually TooManyUsFEC)

It's used in MDWS as the reason when/if that error occurs. Is there some later data that would negate that or offer a different reason? Or, maybe it only occurs on ADSL lines?


The posting you refer to is here:

http://forum.kitz.co.uk/index.php?topic=12504.msg236038#msg236038

This of course is not related to DLM, it's just a list of recognised reasons for the connection to re-sync.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on October 07, 2014, 11:00:50 AM
I imagine that DLM doesn't care about the number of FEC's when it is trying to make a decision about whether further intervention is required: FECs represent success for DLM, showing that the current settings are appropriate for the noise environment.

It is only the CRC count, and the associated ES and SES values, that continue to represent failure to DLM - so it will continue to monitor these.

However, when DLM is choosing to remove intervention, there is the possibility that the FEC level is considered. If DLM only looked at whether the ongoing ES and SES levels are low enough, it might decide that FEC+Interleaving is no longer required - when a high level of FECs (or FEC seconds) could be a contra-indication. In those circumstances, service would flip-flop back and forth.

DLM could sensibly use FECs in this way, but I'm not sure it does.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 12:10:52 PM
Interestingly, and this is listed on Kitz elsewhere some time back by roseway, Reason 3 for a resync is:

High Upstream FEC (actually TooManyUsFEC)

It's used in MDWS as the reason when/if that error occurs. Is there some later data that would negate that or offer a different reason? Or, maybe it only occurs on ADSL lines?


The posting you refer to is here:

http://forum.kitz.co.uk/index.php?topic=12504.msg236038#msg236038

This of course is not related to DLM, it's just a list of recognised reasons for the connection to re-sync.

Thanks Eric. Yes that's exactly what I was pointing out I thought? I purposely didn't refer to the DLM as the cause, just that there can be a resync caused by high FEC == Reason No 3, by whatever piece of equipment initiates the resync in that instance - which would be?

I just want to get the reported MDWS cause of High Upstream FEC for the resync correct if it isn't.

Incidentally resync mails are currently disabled.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 01:54:21 PM
Multi User Monitor

There is a new page available in MyDSLWebStats that a few have asked for. It's different to normal in that it is a standalone page (or tab) that occupies a whole page. There is a link to it within the Control Box All User Stats monitor now when displaying that but that is getting difficult to use as the number of active uploaders rises.

This standalone version of it shows every user at once depending on your screen resolution. It still updates every 30 secs but only currently lists sorted by User Name. It should be possible to add some additional column sorting later. There is a larger display font as well.

All the ISPs have been collected from the upload data now and for new users as they appear and once the facility to allow use of this for each user is in, they can appear on this page as well. This will then offer the option to list the stats by ISP rather than User which might reveal trends when large area problems occur.

There are other standalone pages coming along of the multi-monitoring type plus additional standard line graphs for the panes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 07, 2014, 05:18:20 PM
Multi User Monitor

A slight change, rather than control the display paramter/order from the new page, it now picks up the current settings from the original pane-based facility. If you change that, the full page version will pick up the change at the next 30s refresh.

The smaller version does not have to be running to view the larger one unless you want to change any of the settings.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 08, 2014, 11:28:27 PM
Can I just say tbailey2 your MyWebStats site is excellent  :)
It extends BE1 + Ronski's and Roseways programs for us the users to gain more knowledge and the only way for me is to compare others stats against my own.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 09, 2014, 03:26:58 PM
Can I just say tbailey2 your MyWebStats site is excellent  :)
It extends BE1 + Ronski's and Roseways programs for us the users to gain more knowledge and the only way for me is to compare others stats against my own.

Thank you for that, much appreciated  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 09, 2014, 04:03:29 PM
Raspberry Pi uploading to MyDSLWebStats

For those interested in using a Raspberry Pi to upload data, I've managed to get one working and actively uploading, although I need to tidy up the wiring that is currently going all over the place  :(

I have never used a Linux command in my life having worked with Windows since the dawn of time so it was a bit of an experience.  With help from Eric, roseway, and a few aborted installs, it now runs reliably.

You can see it logged on as Crusty-rpi and it is using the same data as my own username but uploaded at a different time within the minute. It's using dslstats32RPi-5.1.2. OS is Raspbian running directly from an image on the 8gB SD card.

This is the basic B+ model running off a USB supply and HDMI o/p to my main PC currently. I also have a 3.2" LCD colour plug-in touchscreen for it but have yet to set that up. My desktop screengrab is attached from which you can see that it runs MyDSLWebStats okay as well in the Epiphany browser (the other one doesn't seem to have Javascript support that I could find). It is a bit on the slow side rendering the graph though as you might expect.

What I'll do is develop a page or two over the next week on my experience of setting it up and installing it and the pitfalls I encountered in the process. Eric will also kindly contribute as there are things I still need to do.

Hopefully this will then help anyone who wants set up a 24/7 low power 5v machine for the purpose. I'll measure the current consumption when I can find my USB V/A meter!

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 09, 2014, 07:47:09 PM

What I'll do is develop a page or two over the next week on my experience of setting it up and installing it and the pitfalls I encountered in the process. Eric will also kindly contribute as there are things I still need to do.

Hopefully this will then help anyone who wants set up a 24/7 low power 5v machine for the purpose. I'll measure the current consumption when I can find my USB V/A meter!

That would be very helpfull indeed tbailey2  :) had a linux partion on the PC drive and used it for 6 months it's the RPi hardware & software setup that may confuse me and this moniter only has VGA and DVI outputs (DVI in-use) looks like i'll also need a HDMI to VGA adapter.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on October 09, 2014, 08:05:26 PM
That would be very helpfull indeed tbailey2  :) had a linux partion on the PC drive and used it for 6 months it's the RPi hardware & software setup that may confuse me and this moniter only has VGA and DVI outputs (DVI in-use) looks like i'll also need a HDMI to VGA adapter.

HDMI is digital, VGA is analogue. Can't convert between them without a powered box of electronics which will be quite expensive.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 09, 2014, 08:21:46 PM
it would be awesome if a asuswrt router can be made to manage/upload data :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 09, 2014, 08:40:17 PM
That would be very helpfull indeed tbailey2  :) had a linux partion on the PC drive and used it for 6 months it's the RPi hardware & software setup that may confuse me and this moniter only has VGA and DVI outputs (DVI in-use) looks like i'll also need a HDMI to VGA adapter.

HDMI is digital, VGA is analogue. Can't convert between them without a powered box of electronics which will be quite expensive.

It's not that expensive £6 to £8 Connector: HDMI male to VGA female
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 09, 2014, 09:33:43 PM
You don't need to go to that trouble. Just Remote Console into the RPi and with a WiFi dongle on it, all's you need is power to the RPi, no other leads...

Edit:
As for installing software problems, it would be possible for someone to get a basic working setup running and then image the SD card (less the DSLStats logon details) (using Win32diskimager on Windows say) and pop that image onto Dropbox for download. Put that image onto your own SD card using the same software, pop it in, power on and off you go....  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ducky on October 10, 2014, 10:12:36 AM
Am I being a 'bit fick' here, but how have the people got their systems configured who are uploading stats?  I have to have my monitoring laptop plugged into my 612 on Lan2 to access the stats/web interface, but then it doesn't have any internet connection (Lan1 is the uplink to my BT router).

Are people changing the gateway on their 612 to run on their internet network? i.e. from 192.168.1.254 to say 192.168.2.254 (what my internal network is on)? 

thx
:)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 10, 2014, 10:17:18 AM
Change the address of the HG612 to match your LAN and connect LAN2 to your LAN, then your stats should be available to any PC.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 10, 2014, 11:39:26 AM
Am I being a 'bit fick' here, but how have the people got their systems configured who are uploading stats?  I have to have my monitoring laptop plugged into my 612 on Lan2 to access the stats/web interface, but then it doesn't have any internet connection (Lan1 is the uplink to my BT router).

Are people changing the gateway on their 612 to run on their internet network? i.e. from 192.168.1.254 to say 192.168.2.254 (what my internal network is on)? 

thx
:)
This may help  I've unlocked my HG612.  How do I get my linestats? (http://www.kitz.co.uk/routers/hg612unlock.htm#hg612_linestats) - Follow the diagram :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 10, 2014, 11:55:34 AM
I think all the devices on the network need to be on the same subnet. If the rest of the network is on 192.168.2.x, then to get the stats from the HG612 it will need to have a 192.168.2.x address as well. Of course I might be talking nonsense.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 10, 2014, 11:57:54 AM
System Outage  :'(

There was an outage from about 11:35 - 11:52 earlier during which no uploaded records were collected while some emergency maintenance was carried out. All should be back to normal now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ducky on October 10, 2014, 12:42:04 PM
That's what I thought, I don't use the default 192.168.1.x on my home network so need to adjust the 612 to match.  Cheers peeps! :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2014, 07:34:04 AM
V1.2.0 Update October 12 2014

You may need to hit F5 to see all updates - there should be a message
telling you this if everything isn't already updated.

1) ISP is visible again per user IF you enable it for yourself via the
    Options menu at the bottom of the window. This appears in various
    places and is now derived from the upload data Host. It will update
    within three minutes if you change ISP.

2) Resync e-mail is enabled again and should only be going to
    those who want them now.
      
3) Addition of several new graphs:
    a) Signal Attenuation per band Down and Up
    b) Line Uptime
    c) and CRC Upstream errors now show the data for OHF Upstream
    errors as they appear to be the same thing. CRC graphs could
    probably be removed at some point. These are Delta error counts -
    that is the difference between the previous and current total
    CRC/OHF error counts reported by the modem.
    d) Already annnouced on Kitz and active, the All User Stats option in
    a pane now has a link to open a version in a new window/tab
    so you can see them all without a lot of scrolling. It has a larger
    font as well and also shows the program that was used to Upload data
    to the server. This latter option will soon also show the flavour
    of DSLStats used to upload - i.e. Windows, Linux, Raspberry Pi etc.
    The settings are controlled by the smaller version and the full page
    option will pick up changes within the 30 second auto refresh period.
    The original pane does not need to be in use unless you wish to update
    the settings of the larger one. The settings can get out of sync if
    you sleep or hibernate your terminal though.

4) When a user is offline, the graphs are currently shown with a
    straight line connecting the last and next available data points.
      
    As an experiment, for the SNRM Current graph options only at the moment,
    there is now a gap with no plot between such points whenever they
    occur - this can show odd looking graphs if the user has only
    uploaded occasional data! This entails a lot of additional
    calculations so the graphs may be a bit slower to render. The only
    proviso is thet the user has to have at least 15 mins of data available
    in the displayed period, otherwise it will revert to the original
    behaviour.

5) Several people have commented that if you look carefully at the
    24 hours and longer plots, you can't see all the minute plots.
    That's simply because there aren't enough pixels to plot them all.
    If you zoom in (drag an area horizontally) then you'll see more
    of them. This applies to the time periods below 3 day spans. Above
    those, points are actually removed from the plots to keep the
    rendering and calculation times within limits.
      
6) User names can now have periods and hash symbols in them. This
    is not possible retrospectively though unless you register with
    a new User Name and start a complete new data set.

7) Just because you see the Log On window doesn't mean you HAVE to
    Log On. If you were logged on and haven't lost your cookies,
    the Continue option should take you back to the setup you last
    had.

This will likely be the last update to the site for a while now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 13, 2014, 01:51:34 PM
thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ducky on October 13, 2014, 06:08:43 PM
Just a quick one, I'm not sure if it's a glitch or something but when viewing my stats it looks to be a day out.  It says I'm offline, but when I view a specific stat it's showing the current time at the top left, and a day behind on the graph?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2014, 09:31:50 PM
Just a quick one, I'm not sure if it's a glitch or something but when viewing my stats it looks to be a day out.  It says I'm offline, but when I view a specific stat it's showing the current time at the top left, and a day behind on the graph?

Hi

Just had a look and the database is showing your upload data is timed a day out.

So I captured one of your stats log uploads which starts:

12/10/2014 21:17

and it should be reading

13/10/2014 21:17
 
That's the time that goes into the database so your device has a clock that's a day out  :o
Fix that and all will return to normal - except you'll have an apparent one day hole in your data.....

NB: Windows users note that in 7 and 8/8.1 time syncing is NOT enabled by default despite what MS tell you. It's disabled by default. If you do a manual time sync via the net it will then sync (but only every 5 or 10 days or so I think but you can change that via the Registry) - until you restart then it will be off again. To have it on permanently you need to enable it via the Task Scheduler. MyDSLWebStats really needs the time to be accurate within a minute if possible.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 13, 2014, 10:19:49 PM
That is a concern as the RPi does not have a Bios RTC battery you will need a time sync from an online time provider from the ethernet.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2014, 11:15:09 PM
That is a concern as the RPi does not have a Bios RTC battery you will need a time sync from an online time provider from the ethernet.

I believe the ntpd daemon is launched at boot time and syncs the clock automatically via ntp as long as there is a network connection which there should be if you are uploading. Mine seemed to be keeping within visual sync of the other machines here with no problem (it helps to see that if you set the RPi clock to show seconds rather than just hours/minutes). They all have the NetTime app on them using UK pool ntp servers rather than the Windows inbuilt system.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 14, 2014, 09:20:20 AM
Hi Tony

The new version is great thanks. My stats seemed to have not uploaded this morning from around 2-4AM. I cant see why at my end . Anything you can shed a light on. Uploading has been fine since ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 14, 2014, 09:55:34 AM
Just had a log at the Logs, seems there were 2 instances of HG stats running during that period, the PC was not in use and it cleared by 0400 on its own, any thoughts why that would happen appreciated ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2014, 02:47:02 PM
Just had a log at the Logs, seems there were 2 instances of HG stats running during that period, the PC was not in use and it cleared by 0400 on its own, any thoughts why that would happen appreciated ?

Tony

Hi

You need to get BaldEagle1's attention as HG612 Modem Stats is his baby  - but I haven't heard from him in nearly a fortnight now.

I am no expert on his code but it may have something to do with the speed of your PC  - too fast or too slow - for the current program settings. So it's taking too long to process everything (if it is atall, it can get stuck trying to get data from the modem) and hasn't finished inside a minute when another instance starts up. The logs will tell him. Sorry. I may be totally wrong though. One of the others who has had this problem (Chrysalis?) might be able to suggest something.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2014, 09:45:43 PM
I have the RPi running DSLstats fine but MDWS is not showing me as online, username @password looks ok upload data is ticked.

Need help.

EDIT sorted it was a key mistype  :blush: so thats me using the very small Raspberry PI as the stats collector and uploader  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: VDSL2User on October 15, 2014, 09:09:17 AM
Hi, been using the site since it went live and it is great.
Well done to all involved for creating a great place to store, view and compare DSL service statistics.
I do however have one issue that has just come to light.
I enabled the option to show my ISP and saved it a couple of days ago.
It appears to be showing me (VDSL-User) as BTW (BT Wholesale) however I am on a static
IP address with PlusNet, switch from BTW on 7th October 2014.
Any idea why this has not updated ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 15, 2014, 10:36:56 AM
Hi, been using the site since it went live and it is great.
Well done to all involved for creating a great place to store, view and compare DSL service statistics.
I do however have one issue that has just come to light.
I enabled the option to show my ISP and saved it a couple of days ago.
It appears to be showing me (VDSL-User) as BTW (BT Wholesale) however I am on a static
IP address with PlusNet, switch from BTW on 7th October 2014.
Any idea why this has not updated ?

Thanks for the nice comments....

Sorry, I disabled the update side for some reason I can't now remember. It's enabled again and auto-picked up the change at 10:30....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 15, 2014, 02:56:30 PM
whats the rdns of your ip?

I am guessing he either uses the rdns or a ip database of some sort.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 16, 2014, 08:57:54 AM
Chrysalis

I understand you might have had this problem At between 1-3AM each morning the HG612V4 stops logging. The Logs show 2 instances of the stats program running. It only started a few nights ago (see post). Tony suggested you had this ? Its running on a Server 2008R2 that is doing noting else. There are no backups or any log activity.

Perhaps you might have seen this, and found a resolution. Its strange it happens at the same time each early morning. I have the delay settings at 0 and 10 secs.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 05:15:30 PM
Tony

I've been trying to find why my stats stop at 0101 every day until 0301. It seems the failure is just after its uploaded to your server. I am not getting a curl return = 0 . After that tyhen the HG612 doesn't close. At 0301 I get a curl = 53 which then allows the proper closure of HG612 and then all returns to normal. Can you perhaps look and see if there is anything in your logs that might indicate why the upload hangs at this time and release later. I'm willing to believe that if I disable the upload, it wont stop the logging locally in the night.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2014, 06:02:43 PM
Tony

I've been trying to find why my stats stop at 0101 every day until 0301. It seems the failure is just after its uploaded to your server. I am not getting a curl return = 0 . After that tyhen the HG612 doesn't close. At 0301 I get a curl = 53 which then allows the proper closure of HG612 and then all returns to normal. Can you perhaps look and see if there is anything in your logs that might indicate why the upload hangs at this time and release later. I'm willing to believe that if I disable the upload, it wont stop the logging locally in the night.

Tony

I don't think this is the reason as it apparently doesn't affect anyone else but at 01:00 the server is locked for all access while an automatic backup takes place (since it went live). Because of this, no uploads are collected until after 01:01 and they will fail upload anyway due to the lock. The lock is released after about 1m 30s which will allow the 01:01 logs to be collected. There are no other indications of failures in any of the six logs I can look at for you (or anyone else that I can see).

I would see if BE1 can help via your local logs but he seems to be away at the moment.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 06:10:32 PM
Tony

Thanks. It's really interesting that its at the same time, but unless you changed something it's odd it started this Wednesday AM.

I've moved the logging to a PC from the server, and if it fails again, I can try disabling the upload.

If BE1 sees this perhaps he could PM me and I can send the local logs for the periods.

Unless I've misread them it's the Curl that's failing to exit the keeps the HG stats running its instance.

Thanks for the info

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 06:37:56 PM
All

On further thought, I suspect Curl is hanging because it can't login. I'm not sure why this has just started to happen, maybe a slight time difference or something that stops it exiting with an error as you would expect if the server were locked.

I'm not sure of the significance of the two hours exactly when it finally exits with the code that indicated the server was locked and not straight away. That may be an OS issue, that the change I have made today might prove. Comments are welcome

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2014, 06:57:32 PM
All

On further thought, I suspect Curl is hanging because it can't login. I'm not sure why this has just started to happen, maybe a slight time difference or something that stops it exiting with an error as you would expect if the server were locked.

I'm not sure of the significance of the two hours exactly when it finally exits with the code that indicated the server was locked and not straight away. That may be an OS issue, that the change I have made today might prove. Comments are welcome

Tony

Just to confirm that I haven't made any changes to the upload processing for some weeks. Your uploads are timed normally within the first 15 seconds of the minute.

You could try installing DSLStats V5.2 as well and then temporarily turn off HG612 uploading while you try it and see what happens. They both use curl.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 18, 2014, 07:06:30 PM
Tony thanks. I will see if the change of OS makes any difference. If it still fails tomorrow at the same time, Sunday I will turn off uploading late evening and see if the collection localy doesn't stop.

I did think of trying DSL Stats but I guess I need to try one thing at a time. Pity I can't force the error and it's always on the 0102 instance.

I pretty convinced it's hanging when your backup takes place and its not releasing, but no idea why !

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 10:37:09 AM
Update

Move to a W7 PC with a clean install and setup last night.

No logging again between 0101 and 0301, when Curl hung presumably at the time the Website backup started. To  confirm my thought, this is what's causing the 2 instances starting and stopping local logging I am going to disable the upload tonight. If that allows my local logging to continue, I'm going to have to wait for some more support, unless Tony B can see anything more on his server.

Thanks all

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 19, 2014, 11:17:00 AM
Update

Move to a W7 PC with a clean install and setup last night.

No logging again between 0101 and 0301, when Curl hung presumably at the time the Website backup started. To  confirm my thought, this is what's causing the 2 instances starting and stopping local logging I am going to disable the upload tonight. If that allows my local logging to continue, I'm going to have to wait for some more support, unless Tony B can see anything more on his server.

Thanks all

Tony

There is one other user with the same problem (clystron) that I spotted after a search specifically for it last night You'll see his problem  is identical to yours if you run his SNRM graph). Backups have been happening automatically in the same way since early September when it went live. A way round it with would be for the two upload programs to not upload at 01:00 and probably 01:01 as well. This would lose some records. Could maybe be a user choice for those affected.

Still no sign of BE1 for whatever reason. I suspect your logs will show him the cause but I have to get him to decipher mine....

This change may be unnecessary as we are going to hopefully move to a new server and URL in the next few weeks and that one doesn't lock in the same way during backups AFAICT.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 11:44:49 AM
Tony. That's really assuring as looking at his stats it started on the same night as mine .I wonder what's common ?

 I suppose the way would be as a workaround to have 2 scheduled tasks. One that ran say 0105 for 23 hours evey minute daily and one at 0006 to run for 53 minutes every minute daily if I have my maths right !

I have cut down version's of the logs ready for when BE1 can look at them

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 05:15:52 PM
Tony

I have given this a bit more thought today.

Firstly, I monitor the SNRM as I have a problem in the early hours with noise, with CRC in a pane below. Your great improvement showing the "gap" in this graph, made the lack of logging obvious, otherwise I might not have noticed. If "clystron" is not looking at SNRM it may not be obvious he has the same issue.

Secondly, I'm convinced this issue arose after the MS patches on Tuesday they involved a lot of security issues especially with SSL and certificates. I've already had some MS Exchange credential issues since, might it be that only 2 of us are using this weeks patches on windows boxes ?

Thirdly I have setup up two scheduled tasks now to avoid the "Lockout Period" 01:04 - 23:59 = 22:58:00 and 0001 - 0059 = 00:58:00. I'm happy to provide an xml file to import these if any one needs them. I trust you think my maths is correct here.

Finally, is the scale on the SNRM "x" axis different to all others as it appears so on my display ?

Hope this information is useful and I will confirm if the "Gap" between 00:59 and 01:04 stops the issue tomorrow (The gap between 00:59 and 00:01 was intentional to avoid task scheduler issues)

Tony

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 19, 2014, 05:31:07 PM
I'm running mine on Windows Home Server 2011, which is Basically Windows Server 2008. Mine is fully patched and up to date, no problems here at the moment.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 05:44:37 PM
That blows my theory then !

Thanks for the input Ronski
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 19, 2014, 05:47:12 PM
Tony

I have given this a bit more thought today.

Firstly, I monitor the SNRM as I have a problem in the early hours with noise, with CRC in a pane below. Your great improvement showing the "gap" in this graph, made the lack of logging obvious, otherwise I might not have noticed. If "clystron" is not looking at SNRM it may not be obvious he has the same issue.

Secondly, I'm convinced this issue arose after the MS patches on Tuesday they involved a lot of security issues especially with SSL and certificates. I've already had some MS Exchange credential issues since, might it be that only 2 of us are using this weeks patches on windows boxes ?

Thirdly I have setup up two scheduled tasks now to avoid the "Lockout Period" 01:04 - 23:59 = 22:58:00 and 0001 - 0059 = 00:58:00. I'm happy to provide an xml file to import these if any one needs them. I trust you think my maths is correct here.

Finally, is the scale on the SNRM "x" axis different to all others as it appears so on my display ?

Hope this information is useful and I will confirm if the "Gap" between 00:59 and 01:04 stops the issue tomorrow (The gap between 00:59 and 00:01 was intentional to avoid task scheduler issues)

Tony

Thanks.

Yes, SNRM is different as it now covers the requested period exactly rather than using what data is available and can be incomplete. It can get a bit out though if the user is on and off air a lot (excuse the analogy!). If you stack several users graphs on top of each other they should all match for SNRM. I do have an experimental page that can display 16 users graphs at once for comparison and that works well with SNRM.

The scheduled tasks look fine to me although I would guess 01:02 would work at the moment. Um, I haven't run this week's updates yet on my Win7 terminal.... Maybe I won't for a while  :no:

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 19, 2014, 05:58:49 PM
Yes I saw the SNRM graphs matched, just slightly out with other measurements, still its brilliant anyway.

I might change to 0102 after it runs OK. I have a couple of ESXi hosts here so I could run up an unpatched W7 machine and test that also, just useful to know why!

I guess I could force the lockout by changing the password slightly  for testing ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 20, 2014, 08:35:22 AM
The split of the schedule tasks worked perfectly and apart from missing a few minutes it carried on normally. I had a drop for there minutes at 0418, but I see a couple others did. The curl error was  7, couldn't connect to host. I guess a network blip.

Thanks, if anyone has a similar problem use the task times I suggested above.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 06:56:36 PM
The errored seconds look different from bar chart to line chart it will take a bit of getting used to  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 20, 2014, 07:32:51 PM
The errored seconds look different from bar chart to line chart it will take a bit of getting used to  :)

As posted elesewhere here, there seems to be a bug in the Column Charts where if the errors exceed a certain value and count, the bars just don't display, especially Upstream. For the moment, and I know everyone is used to viewing bars for ES, the charts for now display as Line Charts like all the other ones but at least all the values are now visible for the longer periods - even if they do look like a map of the Pyrenees at times
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 09:09:56 PM
Hmmm this may be a hard question to answer tbailey2 do you know how much upload is sent per minute / sample to server it's just as I'm now running the stats 24/7 on the Raspberry Pi it would help me calculate the usage per month as I only have 40GB monthly allowance.

Cheers NS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 20, 2014, 09:56:52 PM
is uploading even counted in your allowance?

I havent measured it but this wont be an issue, you uploading small text files.  Not movies.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 10:04:07 PM
is uploading even counted in your allowance?

I havent measured it but this wont be an issue, you uploading small text files.  Not movies.

Yes Download and Upload are both connected to the allowance, for example you could download 20GB per month and upload 20GB you have then reached your 40GB limit.

Info from the router the 0.1GB transmitted data has been like this for 3 days  :-\

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 20, 2014, 10:57:57 PM
According to my calculations the uploaded amount will be less than 2 MB per day for a VDSL2 connection. It will vary a bit, depending on the user's system.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 20, 2014, 11:09:21 PM
According to my calculations the uploaded amount will be less than 2 MB per day for a VDSL2 connection. It will vary a bit, depending on the user's system.

Thanks Roseway

With that info the upload total for a month will work out as 392 MB upload data for a month thats good news  :dance:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 21, 2014, 09:52:30 AM
There are two new graphs available at the top of the Data to List dropdown just under the normal SNRM entry. Hit Update if you don't see them at first on a pane or F5 to update all panes at once.

SNRM/Band DS for the three available downstream plots by dB
SNRM/Band US for the three available upstream plots by dB

These may be useful for spotting problems that the normal SNRM graph doesn't show. As per the attachment which is somewhat awry (kitz)  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 21, 2014, 11:41:01 AM
Brilliant - thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 21, 2014, 11:55:32 AM
Agreed  :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 21, 2014, 12:54:04 PM
Thanks for the comments  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 21, 2014, 12:58:55 PM
I think the errored seconds is much more clear and useful.

My only complaint is this can lead to compulsive obsessions about stats.

I hated them once  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 21, 2014, 01:01:52 PM
for user Evga

If they are reading this, if not I'll e-mail him/her. Many of your graphs are blank as, since you are in France, your decimal places in say the SNRM data are being uploaded as commas and not periods. The system wasn't designed for this and so doesn't know how to display the data so gives up. We do have a user in Switzerland though who uploads the correct data so I don't know if you are able to change to use periods (full stops) to solve the problem please? I guess this would be in the Regional settings on your equipment.

For now, I've intercepted the SNRM data (only) and changed the commas to periods so the data displays. As others will notice, you are also an hour ahead of the UK so the graphs appear timed incorrectly here but likely look okay where you are?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 21, 2014, 10:54:29 PM
I would be interested in any views why my SNRM is so wobbly at the noisy times ? I appreciate and understand the effects of noise in the evenings when the cabs are busy, and also early morning when it starts to get busy again before daylight calms the noise. What's odd about my SNRM compared to most others is the large fluctuations over very short periods of time.

Not that I could do anything, I doubt its in my home. I have about 900m to the Cab and part is aluminium. The path runs by a railway station and a substation....not ideal I guess. The good thing is I have a low CRC error and error'd seconds so its not all bad news

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 08:25:57 AM
Tony

Had the same gap last night, I see my gap from 0058 to 0104 but then it stopped at 0105 until 0303 perhaps my time was not synced with your server ? I see Cryston had the same issue ?

Can you see anything at your end, did the server close a bit later perhaps ???

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 08:46:38 AM
Tony

I see from others stats it seems to have been closed to around 0109. Is that going to be the norm as I will alter my delay ? Perhaps the backup is taking longer

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 23, 2014, 09:24:19 AM
my gaps are deliberate, I am disabling the task when playing ff13 as it makes the game stutter.

When bald eagle shows up (or can ronski do this?) I will request a low priority task option.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 23, 2014, 09:33:25 AM
Tony

Had the same gap last night, I see my gap from 0058 to 0104 but then it stopped at 0105 until 0303 perhaps my time was not synced with your server ? I see Cryston had the same issue ?

Can you see anything at your end, did the server close a bit later perhaps ???

Tony

Yes, there was some sort of event on the server that lasted from 01:00 until 01:08 or so. Couldn't get new locks on anything and the process that runs stats collections (which was locked) took 6 minutes to run rather than under 5 secs... No idea what, possibly the backup overran. Haven't seen it before though AFAICR.

I'll also mention that from today if anyone hasn't uploaded data in the immediate past 48 hours, they will disappear from the Users listing on the panes and will reappear when 15 mins of recent data has been uploaded.

Also, should be able to display SES records soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 09:35:34 AM
Tony

Thanks until BE1 can tell me why some of us get locked out, I will leave my collection gap a little longer. That way I don't lose 2 hours worth.

Thanks for clearing that up

Cheers

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 23, 2014, 09:45:43 AM
Tony

Thanks until BE1 can tell me why some of us get locked out, I will leave my collection gap a little longer. That way I don't lose 2 hours worth.

Thanks for clearing that up

Cheers

Tony

If the server is locked the local prog won't able to log on (at the server end) to transfer the files and will likely hang trying but why it should do it for hours I have no idea. Maybe have a look in your logs for clues? BE1 seems to be AWOL last heard from him 22 days ago...  Or try DSLStats for a day or two?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 23, 2014, 09:48:05 AM
Tony

Yes it does the Curl upload program hangs and I don't get an exit for 2 hours then its the expected exit code. I'm happy to extend the period its not collecting which I have now until 0110.Seems easy solution until we hear from BE1 again.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on October 24, 2014, 05:37:37 PM
I've been away on holiday for a while.

Now I'm back, please post some relevant log extracts or email them to me.

My latest version of HG612_stats.exe (v 4.0.0.6) does have a timeout of 20 seconds for the Curl program.

Are you using an older version than that?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 24, 2014, 07:34:52 PM
Welcome back BE1, hope you had a good one  :)

Your latest version may well be 4.0.0.6, but the latest available is 4.0.0.2  :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on October 24, 2014, 08:04:24 PM
Quote
Your latest version may well be 4.0.0.6, but the latest available is 4.0.0.2

+1  :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 24, 2014, 10:24:51 PM
Welcome back BE1, hope you had a good one  :)

Your latest version may well be 4.0.0.6, but the latest available is 4.0.0.2  :P

+1 but also I Cannot do snapshot graphs currently :)  so a new bug.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 25, 2014, 09:33:12 AM
Version 4.0.0.6 is now available for download. Thanks BE1
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 31, 2014, 09:16:49 PM
The errored seconds graph seems to have become funky thats the only word that comes to mind when looking at it, the total errors over 24h just jump out and the es per hour are hidden away in the background.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on November 01, 2014, 07:45:03 AM
  The new graph is actually the best for judging the error state of the connection.  :) The 24 hour is the most important stat.  I agree that the hourly values are harder to see at the bottom, although a good indication is given by the local slope of the 24 hour plot.  The cursor still gives the exact values should they be wanted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on November 01, 2014, 08:06:05 AM
Quote
I agree that the hourly values are harder to see at the bottom

I think it may require another option to switch the running total and average off. ;)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: bigbossa on November 01, 2014, 11:14:28 AM
Help!
I have registered on the  MyDSLWebStats but cant log on as I have forgotten my memorable phrase , on resetting via the "forgot password" facility I get "Password reset has failed - please go back and try again....";  through the email
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 01, 2014, 03:42:31 PM
Help!
I have registered on the  MyDSLWebStats but cant log on as I have forgotten my memorable phrase , on resetting via the "forgot password" facility I get "Password reset has failed - please go back and try again....";  through the email

Please try the link again, it should work for you now, took a while to puzzle the failure out. I've PMd you separately.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 02, 2014, 03:51:15 PM
Quote
I agree that the hourly values are harder to see at the bottom

I think it may require another option to switch the running total and average off. ;)

Ian

Done, there is now a checkbox to click on for an instant with and without  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on November 02, 2014, 04:12:33 PM
Thanks again Tony.

You really are a star. ;D ;D

One more option you may care to think about implementing; as I am on a dynamic IP address and am unable to switch to a static one, I use the ping monitoring graphs from http://f8lure.mouselike.org/ (http://f8lure.mouselike.org/) a static png is produced just like the TBB ones http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705 (http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705) or http://f8luresig.mouselike.org/sig.png?/53705.png (http://f8luresig.mouselike.org/sig.png?/53705.png)


Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 02, 2014, 10:27:37 PM
Yeah sometimes to much info can be distractive and it's nice to have the option to filter out what you need and don't at that time.

Good Job Tbailey2  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 02, 2014, 10:39:00 PM
HG612 Modem Stats V4.0.0.6

Just a reminder that those of you using BE1's software with MyDSLWebStats should upgrade to this latest version to overcome various problems relating to timeouts and occasional uploading of files full of zeros. There are about a dozen active users who need to do this, in particular WWWombat, Mike-IG and spadge007....

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 10, 2014, 08:34:22 AM
MyDSLWebStats is Moving next Sunday 16th November 2014

For a number of reasons but primarily due to a lack of enough donations from our 90 registered users (63 of whom currently upload) to support even the first month of the £120 a month that the dedicated server rental for this facility costs, MyDSLWebStats is moving to a new web site URL and much cheaper server next Sunday 16th November 2014 at 10:00 GMT.

There is a danger that the new server will not cope but that remains to be seen as it's only been possible to carry out limited stress tests. The current server monthly rental expires on 19th November and it hasn't crashed/failed or been overloaded since it was started up back in July.

However, IF any of you out there who find the facility useful want to help keep the current server going via donations for at least a couple more months to evaluate a way forward then that is a possibility and the change could be avoided, possibly permanently. And many thanks to those who have donated so far.

If the change goes ahead, the site will still be known as MyDSLWebStats but the access URL from the 16th will be:

http://www.livedslstats.co.uk/

This new site is active but there is just a holding home page at the moment until the 16th.

This will inevitably result in some disruption but this will be minimised as much as is possible. If you are uploading then you need to read this post carefully as you MUST make changes if you are to continue uploading.

The changeover will start at 10:00am local time. From then on you will automatically be diverted to the new site holding page as far as viewing results go. The holding page will auto update every few minutes and change to the normal Home page with a Log On link etc when it is available again. Everyone using the site to VIEW data will then need to Log On on and set up their pane(s) again. All other user data is still there, you do NOT need to Register again. The site should then operate as before for you.

Please make sure that you are permitting Cookies from the new site (as www.livedslstats.co.uk).

If you are UPLOADING then then there are ESSENTIAL additional changes...

At 10:00 GMT, no further uploads will be accepted by www.mydslwebstats.co.uk and nothing will be processed. Your upload program will appear to have lost connection to the site and you may as well switch uploads off.

In the background, there will be a lot going on to finish the remaining transfers to the new site, much of which is already done and tested.

While this is happening, YOU MUST UPGRADE YOUR STATS PROGRAM BEFORE YOU CAN UPLOAD AGAIN.

Both HG612 Modem Stats and DSLStats will have new versions available by 10:00 GMT. After upgrading PLEASE WAIT until 10:15am before trying new uploads which will then automatically go to the correct place only IF you have upgraded. Before that they will likely be ignored unless the database is available earlier, but there are no guarantees with the availability time. The site itself may not be available until later for viewing.

There will be more info available on the upgrades from Bald_Eagle1/Ronski and roseway nearer the time.

If you hit any problems after the upgrade, or nothing happens at 11:00, please don't post a multitude of Help! It isn't working messages here as we probably know about it! There will be a post in the Kitz MyDSLWebStats thread if there is a hold up or as soon as it is available.

If for any reason the time or date changes or the change is cancelled then there will be a another post made.

Thanks for bearing with us and those of us on the development end hope you find the facility useful.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on November 12, 2014, 11:09:47 PM
Admin note - Ive moved all discussions about donations to the other thread started by Tony here (http://forum.kitz.co.uk/index.php?topic=14663.0). 

Please continue any discussions about donations to MDWS in the other thread (http://forum.kitz.co.uk/index.php?topic=14663.0), and leave this one for technical discussion/help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2014, 07:48:28 AM
MyDSLWebStats Server Move on 16th Nov CANCELLED

Just a note that the proposed move will NOT now take place until the hosting is sorted out. More later when anything is available....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 23, 2014, 09:24:43 PM
noticed around 16:24 with all users there was no uploading until 16:59 a gap of 35 minutes  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2014, 08:09:21 AM
noticed around 16:24 with all users there was no uploading until 16:59 a gap of 35 minutes  :-\

Only just spotted this - the server was still running okay at that time so looks like a lost database connection at the data centre end... There was another one a few hours before but with shorter duration.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2014, 08:14:05 AM
There is now a MyDSLWebStats Mobile Edition (http://forum.kitz.co.uk/index.php?topic=14737.0) that allows you to get your basic stats on the move.

This has a separate thread on the link above.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on November 30, 2014, 01:37:30 PM
   It seems very likely that SES as well as ES are counted by the DLM.  Assuming that it is uploaded I wondered if at some stage SES could be added to the ES plot in a maybe in  a different colour and perhaps as narrow bars and not a joined up line.   For most people they will be infrequent and most often zero so I don't think they will add to much confusion to the plots.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2014, 01:22:57 PM
Thanks again Tony.

You really are a star. ;D ;D

One more option you may care to think about implementing; as I am on a dynamic IP address and am unable to switch to a static one, I use the ping monitoring graphs from http://f8lure.mouselike.org/ (http://f8lure.mouselike.org/) a static png is produced just like the TBB ones http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705 (http://f8lure.mouselike.org/proxyfirebrick.asp?ID=53705) or http://f8luresig.mouselike.org/sig.png?/53705.png (http://f8luresig.mouselike.org/sig.png?/53705.png)


Ian

This does now basically work with either of the mouselike.org graphs you linked, sort of.... The thumbnails are a bit challenged in width due to space available and the popup is either too large or not wide enough depending on which version you use  :( Now fixed mostly but width is a bit browser dependant.

There seemed to be a problem with the thumbnail refresh anyway but that is hopefully now working with a fixed 3 minute refresh period currently. I'll try and fix the other problems when I get a moment and the code can tell which graph it's loading...

You will likely need an F5/Refresh or get the refresh time and popup working properly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on December 01, 2014, 06:25:42 PM
 :drink: :congrats: :clap:

That is working fine.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 14, 2014, 09:47:37 PM
Thanks for increasing period to show from the max of 10 days to 30 days thats very helpful  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 14, 2014, 11:27:25 PM
Thanks for increasing period to show from the max of 10 days to 30 days thats very helpful  :thumbs:

That's okay thanks  :)   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 20, 2014, 10:31:06 AM
Thanks for increasing period to show from the max of 10 days to 30 days thats very helpful  :thumbs:

And you now have 60, 90 and 120 days as well  :)

Note that with 60 days, each plot point is about 2 hours apart (pro-rata for the others) so you lose all the detail (ES are handled to total correctly) but good for an overview of many stats. Also depressing to see what's happened to the line in many cases....

The 24 Hour graph option now displays the correct thumbnail graphs for ES and FEC. Again, note this is 24 Hours as in the current day starting 00:00 so will mostly not be the full 24 hours.

NB the Range option is not very usable currently over longer period and needs a rewrite. I may remove it temporarily.

As the new server and its revised database is between 2 and 10 times faster overall than the old one at delivering data back to you to process locally (the graphs are actually calculated and plotted on your local machine if anyone wondered - which is why a Raspberry Pi takes forever if you try it), the 24 Hour set of graphs can probably be made to auto refresh now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 21, 2014, 04:02:42 PM
(the graphs are actually calculated and plotted on your local machine if anyone wondered - which is why a Raspberry Pi takes forever if you try it),

Thats why i just let the RPi gather the stats and use the PC to look at the stats  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 23, 2014, 03:49:13 PM
Donations

A bit late but a Christmas Thank You to those users who kindly donated some much needed extra funds to help keep the old (expensive) MyDSLWebStats server going until the replacement was ready and a for few more recent donations. The new server has now been up and running for two weeks and the old one retired.

Thanks go to:

g3uiss pooclah (twice) roseway plutox myadsl

 :clap2: :clap: :clap2: :clap: :clap2: and a Merry Christmas and Happy New Year to all users  :drunk: :drink:

Donations will still be gratefully received of course
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on December 24, 2014, 10:14:15 PM
Tony, is there a problem atm.  I dont seem to be able to get any SNRm stats for more than 5 days.

Ive tried using both range and current, but neither work and I get the date Jan1 00:00 keep coming up - see attached.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on December 25, 2014, 11:31:14 AM
  I can confirm that there is an problem with SNRM. 

 I have a quick question -- I am away for Xmas but left things running via raspberry pi and dslstats.  I notice that data upload to  MDWS seems to have ceased exactly from the time that I logged into MDWS yesterday from another location.  A ping monitor is still running so I assume the house has not burnt down!!. 

   Could logging in from another location cause any issue with the upload and logging?

  I am not expecting a reply any time soon as I expect you will have other Xmas priorities.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 25, 2014, 04:20:29 PM
Tony, is there a problem atm.  I dont seem to be able to get any SNRm stats for more than 5 days.

Ive tried using both range and current, but neither work and I get the date Jan1 00:00 keep coming up - see attached.

I knew I shouldn't have checked in here   ::)

Couldn't see anything wrong from my location but using a proxy server shows the problem.  I've put back some code that was changed late yesterday in the area where the data is fetched and that seems to have fixed it viewing via the proxy so I'll try to find out what's causing it later. 

Back to Christmas now  :sleep:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 25, 2014, 04:51:16 PM
  I can confirm that there is an problem with SNRM. 

 I have a quick question -- I am away for Xmas but left things running via raspberry pi and dslstats.  I notice that data upload to  MDWS seems to have ceased exactly from the time that I logged into MDWS yesterday from another location.  A ping monitor is still running so I assume the house has not burnt down!!. 

   Could logging in from another location cause any issue with the upload and logging?

  I am not expecting a reply any time soon as I expect you will have other Xmas priorities.

Hopefully SNRM is fixed.

There is no relationship at all between the data upload operation and logging on/off/changing IP for a user so that wouldn't be the cause.

Also, your last data upload was 13:47 while your logon with a changed IP was at 14:21...

Maybe a glitch at the moment you accessed the server. See if the DSLStats log shows anything? My own RPi seems to recover quite happily from connection glitches though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on December 26, 2014, 09:12:09 AM
  Many thanks for the info.  I have not had my Rasp pi stop logging before and I did did not get round to enabling remote access from outside the lan.   I will have to see what has happened when I get home next week.  As I mentioned ping to the router from TBB is working so the house must still be there.  I also can't see any resyncs on the TBB ping.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on December 26, 2014, 09:44:01 AM
Quote
Hopefully SNRM is fixed.

Thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on December 27, 2014, 09:15:27 AM
Loaded up the mobile version to check my stats this morning and noticed a formatting problem with the date (see screenie).

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 27, 2014, 10:40:09 AM
Loaded up the mobile version to check my stats this morning and noticed a formatting problem with the date (see screenie).
Ian

Oops!  :-[

Thanks and fixed - it was showing the truncated year as the day's date.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 30, 2014, 09:02:40 PM
Tried setting it up tonight but I keep getting the following error...

Error code 2 while uploading MyDSLWebStats data

Not sure what I've missed, if anything.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 30, 2014, 11:05:45 PM
Error code 2 while uploading MyDSLWebStats data

Well nothing is arriving at MyDSLWebStats so that error is coming from the local client but unfortunately I don't recognise it. You need to get the attention of either Bald_Eagle1 (if he's still around as have heard nothing from him for 6 weeks or more) if it's HG612 Modem Stats or roseway if it's DSLStats (I'd guess the latter).

The usual problem is using your password as the validation code for uploading (which should have arrived as a separate e-mail after validating your own e-mail). DSLStats should validate that for you though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 30, 2014, 11:19:38 PM
I'm using DSLSTATS 5.3 with my username and validation code from the email received (in DSLSTATS it says Checked OK in green).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ardsar on December 30, 2014, 11:23:37 PM

I'm using DSLSTATS 5.3 with my username and validation code from the email received (in DSLSTATS it says Checked OK in green).

I initially had similar problems and found norton security had blocked some of the apps required to upload the data   


Sent from my iPhone using Tapatalk
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 30, 2014, 11:48:30 PM
I had considered it being Kaspersky Internet Security I use, but disabling it made no difference.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on December 31, 2014, 08:07:21 AM
Tried setting it up tonight but I keep getting the following error...

Error code 2 while uploading MyDSLWebStats data

Not sure what I've missed, if anything.

Error code 2 is a curl.exe error code reported by DSLstats. The official description of this error is:

Code: [Select]
CURLE_FAILED_INIT (2)

Very early initialization code failed. This is likely to be an internal error or problem, or a resource problem where something fundamental couldn't get done at init time.

Did you copy all the files from the downloaded archive, including curl.exe? The reason I ask is that the error suggests that the version of curl.exe which is being used isn't compatible.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: simoncraddock on December 31, 2014, 09:02:19 AM
All files are intact and straight from the v5.3 zip file.

Edit: I deleted the installation and created a new one and it's now working.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on December 31, 2014, 10:32:48 AM
All files are intact and straight from the v5.3 zip file.

Edit: I deleted the installation and created a new one and it's now working.

Thanks for that. One of those mysteries then. :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 31, 2014, 05:43:22 PM
Anytime Roseway puts out a new version of DSLstats I uninstall/delete the old version before zipping the new version to a folder this way seems to keep all files upto date  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: snadge on January 02, 2015, 08:17:46 AM
its very difficult to register and setup

there is no validation key in my email and it kept saying the captcha was wrong? 

Quote
Hi Paul

Here are your Registration details:

Username: snadge
Memorable Phrase: hidden

You now need to visit:

http://www.mydslwebstats.co.uk/[removed]

to validate this registration.

The MyDSLWebStats Team

Donations are gratefully received via the web site - thank you!

no validation key anywhere?


----
link edited by Admin
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 02, 2015, 08:55:37 AM
its very difficult to register and setup

Welcome and sorry you've had some problems but are now logged on okay.

there is no validation key in my email and it kept saying the captcha was wrong? 

The upload validation key is sent separately by email after you successfully validate the email via the link. The log shows it was sent  and accepted by your mail server so you may need to check your spam folder?

You have also now posted your private mail validation link publicly  - can you remove it please, as it will invalidate your registration if enough people select it ....

The captcha errors were because you were entering the captcha (you get a new one every time it's entered incorrectly BTW) incorrectly according to the logs...

Do you have the Validation key now to upload? If not I'll PM it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on January 02, 2015, 10:24:57 AM
Quote
You have also now posted your private mail validation link publicly  - can you remove it please, as it will invalidate your registration if enough people select it ..

edited.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 02, 2015, 10:51:43 AM
Quote
You have also now posted your private mail validation link publicly  - can you remove it please, as it will invalidate your registration if enough people select it ..

edited.

Thanks  :) I see he is uploading now so must have found the mail....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: snadge on January 02, 2015, 11:01:51 AM
thanks

the problem here is that the reg link and reg code come from 2 different email addresses meaning both can get junked

I also entered a new captcha every time,,,, but at least im sorted now :)

so, can you use it to say get a friend to login a non-broadcom router just for basic line stats of LA,SNRM,SR ?


where is the page to view my connection on>?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 02, 2015, 03:21:45 PM
Go to the home page www.mydslwebstats.co.uk/index.htm

Click the Log On (http://www.mydslwebstats.co.uk/mdws-lg.php) button, first line of text under welcome.

Once you've logged on there are cookies stored on your PC which remember your details and you can then go directly to www.mydslwebstats.co.uk/Container.htm and shouldn't need to log in again.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 07:17:55 PM
Have just started to run Version 5.3.1 of DSLstats on the RPi thats was 40 minutes ago but MDWS is showing uptime as 0d 0h 0m though the stats are being sent to the server.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 02, 2015, 08:26:06 PM
Could you check this please:

The first item in the DSLstats event log shows where the configuration files are stored. Inside that folder is another folder called mydslwebstats. Inside this there are several files including one called NStar_live_modem_stats.log. The full pathname should be /home/pi/.dslstats/mydslwebstats/NStar_live_modem_stats.log

This is a plain text file, and you can double-click on it to view it in a text editor. It consists of a number of short items separated by single spaces. The 23rd item should be a number with three decimal places, such as 28.012, and this is the uptime in hours. Please let me know what it shows.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 08:45:58 PM
the configuration files are stored in Home/pi/dslstats32RPi-5.3.1 there is no folder called mydslwebstats just the standard files and dslstats executable.

Edit have found /home/pi.dslstats and there is a folder called mydslwebstat and see NStar_live_modem_stats.log there is so many numbers in here it's hard to find the 23rd  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 02, 2015, 09:13:24 PM
No, the configuration files are definitely where I said they were. The folder .dslstats (note the dot in the front) is a hidden folder, and you will only see it in a file manager if the enable the option View --> Show hidden files. If you look in the event log, the first (or maybe the second) line shows where the configuration files are.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 09:23:46 PM
No, the configuration files are definitely where I said they were. The folder .dslstats (note the dot in the front) is a hidden folder, and you will only see it in a file manager if the enable the option View --> Show hidden files. If you look in the event log, the first (or maybe the second) line shows where the configuration files are.

I have found the folder your interested in just trying to find 23rd item should be a number with three decimal places, such as 28.012.

could i paste this log for you to look at ?

02/01/2015 21:15 30325 6371 5.4 6.0 11.2 0.3 33292 6315 PTM 1396 115 3054087 196 13307 0 191655 0 0 2891 0  3054087 196 0 54670298 724514 0 1396 115 0 1110622101 2437317 0 59893 0 0 593 1 474 85 0 0 0 0 0 0 0 0 7.9 42.9 0 0 19.5 52.6 81.1 7.9 42.3 0 0 21.8 52.2 0   0 0   0 10.9 0.1 0 0 8.5 7.8 0 Showtime 0 0 L0 17a ON ON No Showtime 24.7 0.0 0 0 0 0 0 0 0 0 0 0 0 0 769 0 769 0 2584251782 0 5188115 0 0 0 0 76 76 3.00 0.00 3.50 9.84 8 0 54.77 26.00 138401 65 VDSL2 43 0 0 0 24.7 0.0 0 0 33292 6315 0 0 0 0 0 0
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 02, 2015, 10:54:22 PM
I'll go back to version 5.3 on the RPi and wait for a fix, the Windows 32bit 5.3.1 is showing as the correct uptime on MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 02, 2015, 10:55:06 PM
The one you've made bold is number 21 (downstream FECs per minute). Number 23 is the one two places later, and the number is quite wrong. I guess this is a bug in the RPi version of DSLstats. I'll check it out tomorrow.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: big360 on January 03, 2015, 01:39:14 AM
Set up one of my Raspberry Pi with DSLstats 5.3 and MyDSLWebStats in the hope of trying to diagnose intermittent REIN issues. Seems to be working great so far!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 03, 2015, 07:29:08 AM
Welcome big360, and thanks for letting us know.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: snadge on January 03, 2015, 11:55:41 AM
Go to the home page www.mydslwebstats.co.uk/index.htm

Click the Log On (http://www.mydslwebstats.co.uk/mdws-lg.php) button, first line of text under welcome.

Once you've logged on there are cookies stored on your PC which remember your details and you can then go directly to www.mydslwebstats.co.uk/Container.htm and shouldn't need to log in again.

thanks ronski - -tbailey2 who thought of this should be knighted! :) - great :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 05, 2015, 03:56:03 PM
thanks ronski - -tbailey2 who thought of this should be knighted! :) - great :)

Eek  ???   I'd better get my hair cut then....  Thank You!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 05, 2015, 04:24:16 PM
MyDSLWebStats  - User Guide/Help System

We now have a User Guide/Help system some many months later than I had hoped to provide it originally  :(

It's only available if you are logged on and you'll find an icon link to it to the left of the Social Media icons at the bottom of the main screen. You may need to hit F5 to reload the container to see it.

It's all web based and comes with a topic list, index (needs a bit of sorting) and Search (the text is all indexed).

There is no direct linking between the main MDWS site and Help currently but that will come.

I have no doubt that as it's V1.0.0.0 there are bound to be loads of errors/incorrect info/snafus/missing info etc etc so feel free to say and I'll try to fix it. I've borrowed a lot of general background and info  to go with the stats etc from Kitz generally (I did ask ages ago!)  to add some extra depth to it. Also lots of examples of graphs everywhere. There's an example page attached - there are about 140 individual pages in all.

Also have tried to add some info on getting going and where to find the upload progs etc.

Hope it works for you  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 13, 2015, 04:57:41 PM
V1.3.0 Update January 13 2015

This is now available as of 16:56 today.....

You may need to hit F5 to see all updates - there should be a message
telling you this if everything isn't already updated. Some of these
changes were already implemented via rolling updates since v1.2.0

1) Changes to support International Users in Time Zones other than the UK.
    Panes now display the correct local times for Non-UK users in most
    instances. Non-UK users have an asterisk against their User Names in the
    Whois online/uploading displays and the offset from UK time in Hours is shown
    at the top of a Control Box against their User Name. There are now users
    in France, Switzerland, Italy, USA and Canada although not all are currently
    uploading.
               
2) Web-based Help system implemented for Logged On users reachable via
    a link at the bottom left of main window
   
3) 'All User Listing' revised for both Pane and large window versions. Both
    versions now use the Column Headers to sort the listings

4) Mobile version implemented as a browser based app. This is quite simple
    and offers basic stats once logged on. Can be used from a main browser
    but a bit too large. Works well with Android and iPhone etc. There is a
    more extensive description/images on the Kitz forum at:
    http://forum.kitz.co.uk/index.php?topic=14737.0 (http://forum.kitz.co.uk/index.php?topic=14737.0)

5) The Current Stats Date periods now extend back up to 180 days

6) Errored seconds now include an option to display the Average and
    accumulated Total  counts over each 24 hour period. This is only
    accurate if you are using 24/7 stats and helps with diagnosing if the
    DLM is likely to intervene on your line or not. Note that the last
    reading each day is shown as 23:00 but is actually the total from
    23:00-23:59 to give a 24 hour Total in all

7) The Pane Recent Resync list for All Users (at the bottom) now shows the most
     recent resync for 30 users rather then 10

Plus an assortment of bug fixes and so on
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 13, 2015, 10:37:33 PM
Nice work, looks like you have been busy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 19, 2015, 04:25:00 PM
Nice work, looks like you have been busy.

Thanks  ;)

And a few more things as well now....

DSLAM TYPE
The Cabinet DSLAM type is now potentially available for everyone and appears in the large page (only) All User Stats as a separate last column at the end. Overseas and ADSL users don't have the entry.

This facility needs a Bits Per Tone upload file as the source to work out which cab type it is - any new user will get it added within about 3 minutes of the first hourly zip file upload as long as that includes the BPT file so if you are missing it you need to upload at least one BPT file (enable this in the GUI for the upload prog). The Cab type should then appear in the listings with 3 or 4 minutes of the on-the-hour tone file(s) upload.

When available, the DSLAM maker also appears at the top of a pane in the Summary Stats just below the SNRM title inside square brackets for each user.

ALL USER STATS
Also updated are the All User Stats pages (both large and small versions) to make them more reliable when fetching data (some people have equipment clocks up to four minutes slow which does cause problems) and also to sort on more columns.  Also the INP and Delay columns were integers but as they both had DB values to two decimal places, they now display as such and are also now sortable. Example attached.

NB
The DSLAM type is dependent on your Modem returning accurate data. At least one UK BTW user has a sequence of tones (861-870, each with 8 bits) that aren't in the UK bandplans for either type!!

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 21, 2015, 06:00:46 PM
There is a maintenance window of between 08:00 - 09:00 on a Friday but only likely to take a minute or two normally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 21, 2015, 11:52:53 PM
(some people have equipment clocks up to four minutes slow which does cause problems)

Thats kind of odd as the PC should be using Internet Time (time.nist.gov) there should be no reason for this discrepancy, unless they forgot to tick the synchronize with an Internet time Server, must check my RPI time status while i'm here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 22, 2015, 06:39:02 AM
Windows 7 is terrible, I often need to update the time on one of my media PCs. I keep meaning to install net time (http://www.timesynctool.com) but haven't got around to it. I'll have to check my server and see how accurate that is.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 22, 2015, 09:14:17 AM
Windows 7 is terrible, I often need to update the time on one of my media PCs. I keep meaning to install net time (http://www.timesynctool.com) but haven't got around to it. I'll have to check my server and see how accurate that is.

I use NetTime here on all the machines (but without a master) using uk.pool.ntp.org which keeps everything on time. Windows is always losing the ntp connection when syncing - even with a 15 min resync interval set in the Registry it was often days since it had succeeded.

Bear in mind the default resync time on Windows is 7 days or so!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on January 22, 2015, 09:24:02 AM
Only just had chance to look at the updates. Looks great. Also the Mobile Template is really useful.

Cheers

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on January 22, 2015, 10:10:34 AM
thanks for the tip, installed net time.

windows time sync is indeed terrible.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 22, 2015, 05:37:01 PM
Bear in mind the default resync time on Windows is 7 days or so!

Then it sounds like there motherboards Bios battery clock is pitiful if it's 4 minutes slow after 7 days since the last time sync....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 23, 2015, 11:20:12 AM
G.INP

Just as an experiment to see if it's useful, I've changed the Large Window version of the All User Stats displays to show, by highlighting the two values (downstream only currently), anyone who has an FEC count > 0 and with Interleaving set to 1 that might indicate G.INP is running on the line.  There is one user at the moment with FEC counts in the 1000-2000 and no Interleaving. Two others pop up occasionally [attached]. Two are on Huawei and the other ECI FWIW.

Show Active Users Only
Also, if you prefer you can now select an option to display only users who are currently active - this gives a more compact display (Large Window version only)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on January 24, 2015, 12:24:47 AM
thanks tony, as seems is no g.inp indicator in the gui tool.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 03:26:07 PM
Hi all one seems to of forgotten his security question. Whom do i go to, to sort this? If site admin for Mydslwebstats could PM me i can verify its my account.

If its better to just delete the account and then me to resign up thats not a problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2015, 05:03:28 PM
Hi all one seems to of forgotten his security question. Whom do i go to, to sort this? If site admin for Mydslwebstats could PM me i can verify its my account.

If its better to just delete the account and then me to resign up thats not a problem.

Hi

I assume you mean your 'Memorable Phrase'? Request a password reset - although I see you have done that already as a mail was sent to you at 15:22... It is sent along with the reset.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 05:09:22 PM
Ya i have but it doesn't direct me to the reset page. Hence why i am asking.

When i click the link for password reset it just takes be to the homepage and not a password reset page.


Also yes its the Memorable Phrase question i forgot (So for me it wasn't quite so Memorable Phrase for me to remember as i have tonnes of them to remember!)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2015, 05:47:11 PM
When i click the link for password reset it just takes be to the homepage and not a password reset page.

Oops! Took a while to figure this out but sending you to the wrong place  :-[

Request a reset again and all should work now....

Apologies
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 06:39:13 PM
Cracking mate it works no need to say sorry.

Now i am unsure how to get the key for DSL stats. LOL it seems so different since the last time i used it. Also i can't tell if i have logged in or not either after typing the login info


Edit: I am after validation Key.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2015, 07:03:46 PM
I've sent you a PM...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: hacktrix2006 on January 26, 2015, 08:10:16 PM
Thanks for your help, Its streaming directly to site now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2015, 05:45:29 PM
Donations
Thanks to the following users for their donations to the project during January  :clap2: :

big360
johnbullas
morphium
Msurly
NStar
pooclah

NB: it helps if you state your user name in the donation message if you want acknowledgement else it might not be possible to find you if you use a different e-mail to that you registered with.

And a note to pagodawow that your e-mail account has expired and your Resync messages are bouncing....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 01, 2015, 07:06:24 PM
I do find MDWS is helping me see the changes I do on my internal broadband side for the better or worse it's the only way with 24/7 stats being logged to judge if was fruitful or not  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on February 04, 2015, 10:41:11 AM
My DSL Web Stats is now LIVE under my name adslmax. What happen if I switched off PC. Will My DSL Web Stats continue running itself in the background on Billion 8800NL router? As I don't want my PC on at all times.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 04, 2015, 01:50:28 PM
My DSL Web Stats is now LIVE under my name adslmax. What happen if I switched off PC. Will My DSL Web Stats continue running itself in the background on Billion 8800NL router? As I don't want my PC on at all times.

the site will be available but data is being uploaded from your PC, so when your PC is off no data will get uploaded.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 04, 2015, 05:54:39 PM
My DSL Web Stats is now LIVE under my name adslmax. What happen if I switched off PC. Will My DSL Web Stats continue running itself in the background on Billion 8800NL router? As I don't want my PC on at all times.

Get a cheap Rasberry PI it's uses very little power @ 0.86 - 1.2 watts and install DSLstats this is what I have done to get 24/7 stats being logged to MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on February 04, 2015, 08:47:14 PM
^^ Will do.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 04, 2015, 10:33:27 PM
Get a cheap Rasberry PI it's uses very little power @ 0.86 - 1.2 watts and install DSLstats this is what I have done to get 24/7 stats being logged to MDWS.

I'll recommend this option too, they're cheap to run and work very well  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on February 05, 2015, 12:29:50 AM
I just ordered this: http://cpc.farnell.com/jsp/bespoke/bespoke7.jsp?bespokepage=cpc/en_CC/makerspace/raspberrypi.html&CMP=NLem2

Raspberry Pi 2 model B
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 05, 2015, 07:42:23 AM
The V2 has a different processor to the V1 (ARM7 as opposed to ARM6). I think that the present RPi version of DSLstats will still work with it when using the Raspbian OS, but I can't be certain.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 15, 2015, 05:33:04 PM
Just looking at my 24 hours graphs and when I click on "Error Secs/Hour" the pop up graph is blank (as shown below).

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 21, 2015, 08:48:32 AM
Is the site down

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 21, 2015, 10:16:34 AM
It was, but it's back now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2015, 10:32:59 AM
Is the site down

Ian

Has been, yes, sorry. It came back up just at the point you posted....

Caused by modem failure it appears, now running a new one but it's locked so I have no stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 24, 2015, 04:38:24 PM
Since realising my time was wrong on the RPi :-X, i'm now showing as yellow in the all user stats, and apparently as being a Non-uk user?

I'm now uploading in the correct time though, but the website is still showing I'm not?

user: jidavies

Log also shows uploading the correct date and time?
Code: [Select]
24/02/2015 16:39 72076 19999 6.2 15.1
Also i'm showing as "jidavies (-1Hrs)" so guessing the site doesn't think my time is now fixed, or the upload still is the wrong time ???

Any advice would be greatly appreciated, I understand this is my own mess up thats caused it, I completely didn't notice the time was wrong on the Pi!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 24, 2015, 04:56:48 PM
Since realising my time was wrong on the RPi :-X , i'm now showing as yellow in the all user stats, and apparently as being a Non-uk user?

I'm now uploading in the correct time though, but the website is still showing I'm not?

user: jidavies


Hi

Looks like it's auto corrected itself now and you show as uploading/online currently  :) , the time offset is only checked periodically after it's first set....

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 24, 2015, 05:04:28 PM
Since realising my time was wrong on the RPi :-X , i'm now showing as yellow in the all user stats, and apparently as being a Non-uk user?

I'm now uploading in the correct time though, but the website is still showing I'm not?

user: jidavies


Hi

Looks like it's auto corrected itself now and you show as uploading/online currently  :) , the time offset is only checked periodically after it's first set....

Cheers

Thanks Tony!

I donated in December, I'll put in a bigger one next month, thanks for all the hard work, love the site knowing its there in the background, was invaluable when I had a BT OR engineer here a few weeks back!

Jamie
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 24, 2015, 08:14:49 PM
Thanks Tony!

I donated in December, I'll put in a bigger one next month, thanks for all the hard work, love the site knowing its there in the background, was invaluable when I had a BT OR engineer here a few weeks back!

Jamie

Thanks for the kind offer, very quiet this month with only one donation so far....  A lot of new Registrations though.

Nice to know that OR engineers also find MDWS useful, nothing like evidence in black and white (well colour but you know what I mean ). Shame that there's no support for the HH5 et al to get some upload data into MDWS.... Even the basic SNRM/Speed would be something.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 24, 2015, 10:49:49 PM
Nice to know that OR engineers also find MDWS useful,

Not all, the one I had just said i don't understand what your showing me  :o

and i'll sort you out this month, it's just Amazon took £79.00 out of my account it called Amazom Prime look at the small print and don't get caught out !
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 25, 2015, 12:25:44 AM

Thanks for the kind offer, very quiet this month with only one donation so far....  A lot of new Registrations though.

Nice to know that OR engineers also find MDWS useful, nothing like evidence in black and white (well colour but you know what I mean ). Shame that there's no support for the HH5 et al to get some upload data into MDWS.... Even the basic SNRM/Speed would be something.

Give me a week or two and I'll help out :)

The OR engineer was very impressed, straight away he saw what I was talking about, and was able to understand there was a problem!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 25, 2015, 08:44:43 AM
Outage

Due to some unplanned DB maintenance there were no modem record uploads collected between ~08:00 and ~08:30 this morning.

You should also find that graph updates have been running much more quickly for the past 24 hours (except around 07:45 this morning...)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 25, 2015, 08:17:39 PM
Outage

Due to some unplanned DB maintenance there were no modem record uploads collected between ~08:00 and ~08:30 this morning.

You should also find that graph updates have been running much more quickly for the past 24 hours (except around 07:45 this morning...)

Thanks Tony.

Is it me or is the site slower loading recently?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 25, 2015, 08:19:22 PM
Hi Tony

I'm finding that the site is loading slowly today also, more so since around 5pm.

All the rest is great.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 26, 2015, 07:56:19 AM
Hi Tony
I'm finding that the site is loading slowly today also, more so since around 5pm.
All the rest is great.

Tony

Just had a chance to look at the logs for you - the server keeps custom logs for every access that users make with times to 1ms for debugging this sort of thing, from the time the page or graph starts initial load through to when the load has finished. I can only see one access for you at 17:22:49 when the main Container page initially loaded with two graphs up, 24Hr SNRM and ES.  Main page was 4 secs to load which is about normal and both graphs then loaded each in about 1 second which is good  (inc processing at your end).

However, I can see from other logs that you tried several more times to load the main page around then,  presumably with no response? Why I don't know, there are no indications of problems at that time.

Later on in the day maybe. My line (the server runs here) is ****** at the moment if you have a look at the SNRM. Some really bad evening noise started up a couple of days ago that  is taking the SNRM down to near 0 at times and my latency has gone from 8ms to 26 ms or so after DLM poked it's nose in. However, the data is served back to you via what is the U/S here and that isn't particularly affected (its on fast path anyway) and there isn't a lot of data to send.

I have remote access to a terminal some 100 miles away and will keep an eye on performance on that later.

The same applies to jid, nothing obvious. Having said that there are times when a page load seems to take forever and I've never found out why.

Problem is that all this takes time to work through, occasionally I feel like throwing the sever out the window  :-X , and it is after all a 'spare time' project that, at times, takes over my life.....  :'(   Fixes don't always work either as expected although yesterday morning's database change seems to have permanently boosted response time as far as delivering the data back to the user goes for the majority.

I am about to restart the server for a software upgrade  in case anyone notices a blip shortly.

Edit: 10 min outage when software 'upgrade' had to be removed  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 26, 2015, 08:31:25 AM
Tony

Thanks for the info. Loaded up fine just now, so as you say perhaps a IT blip that we never know why :-\

Best

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 26, 2015, 10:06:33 AM
Tony
Thanks for the info. Loaded up fine just now, so as you say perhaps a IT blip that we never know why :-\
Best
Tony

Okay but maybe not. I may have spotted a problem that is causing the delay as I found several of 10 secs or more in logs so I've removed the offending bits of code (just some logging that is failing to output anything - timeout?) and see what happens.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 26, 2015, 10:10:40 AM
Thanks for the update ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on February 26, 2015, 10:43:59 AM
Tony
Thanks for the info. Loaded up fine just now, so as you say perhaps a IT blip that we never know why :-\
Best
Tony

Okay but maybe not. I may have spotted a problem that is causing the delay as I found several of 10 secs or more in logs so I've removed the offending bits of code (just some logging that is failing to output anything - timeout?) and see what happens.

Seems faster today Tony :)

Didn't realise you ran the server from home, in which case the odd bit of a slow down at peak time is to be expected :)

Jamie
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: big360 on February 27, 2015, 08:42:55 AM
Hi , I've been having issues the last few days with the MDWS site becoming inaccessible from my broadband connection. It still works fine from my phone. I'm wondering if its the "Port Scan and DoS Protection" setting on my router. (Netgear DGND3700v2). Strange that its only just recently started happening
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 11:52:22 AM
At 07:55 this morning the Internet connection (but not sync to the cab) went down for best part of 30 mins -  others users in the road nearby were also affected. As a result about 25 people lost their upload connection to MDWS and have not resumed uploading so you might want to check that you are if you were  ??? I've seen my client crash in the past when there has been a long outage.

Also I am completely unable to do anything with the server here as I have lost any connection to Google, can't even search using it.  Home page on MDWS is fine as is the Big User Stats page as they have no need of Google but all other pages do  - all's I see is 'connecting to Google. and ' waiting for  Google...' and very long timeouts.

Of two remote terminals I have access to, one is functioning normally but the other has the Google problem.

Anyone else have this problem with Google, maybe DNS? I may restart the modem later if no one has but that will mean  downtime again. Shame as the server ran very well for the 24 hours previous after some tweaks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 27, 2015, 12:05:19 PM
Hi tbailey2

No issues with google

It's just a thought, which I'm sure you have tried, but have you flushed your dns cache

I'm thinking it may be pulling stale cache

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 27, 2015, 12:43:12 PM
Like the above, I have no issues with Google, but I can't contact MDWS at present. Maybe John's suggestion of a stale DNS cache is a good one.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 12:46:49 PM
MDWS down here also.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 27, 2015, 01:07:40 PM
+1 still down
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 27, 2015, 01:23:35 PM
Hi

I'm sorry, I do not use the software but if the following picture is the website down, I can see it.

I hope that helps a little but sorry if I'm wrong.

Many thanks

John(http://tapatalk.imageshack.com/v2/15/02/27/b59a01a4575d5764e9d7f3172a580d3e.jpg)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 01:30:14 PM
Thanks for replies and also at least someone can see it!! Yes that's my own (currently) grotty line you can see!

Um. I've flushed the cache on 3 terminals but no effect. Yahoo is okay. Still 'waiting for Google'. Roseway can't ping it but gets the IP from the host name okay. I can ping it from 200 miles away via rconsole okay and fully functional.

There are some people in on the web site:

big360 Corinthian craigv g3wpo GateKeeper Guest jizzerman qslam1

and these are uploading okay:

AnnM ardsar axelfoley* bart613 bigg broadstair bsdnazz Chrisszzyy craigv digginsa discom Eaglebeak Fuggi garypower GodolphinX Jasonkruys jidavies JustAnothe les-70 Liam mattb maybecrazy morphium* mrspock nb99999 NStar oliver602 pagodawow perry1964 pianist pooclah qslam1 shadow4dog splbound Starman tbailey2 TimeBandit Tyke vic0239  (39)   

But there should be around 65 of them...

Uploading doesn't need Google.

I think I'll stop modem with a 5 min pause after at 13:35. Line is bad anyway at the moment. This is a new HG612 after the other one failed some days back but has been okay up until this morning. I do have another boxed one I can unlock if that might be the problem....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 01:46:47 PM
Now I have a flooded kitchen from washing machine to sort out..  >:D

Seems to be working here now at last so hopefully elsewhere? Also restarted router.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 01:50:22 PM
back up here, good job.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on February 27, 2015, 01:57:51 PM
I am confused, tony you now hosting this at home?

Also I did wonder why google is needed for some parts of the site. your FTTC line looks a mess wow.  It makes newt's swings seem insignificant in comparison.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on February 27, 2015, 02:04:36 PM
Yes he's hosting at home.

Both mine were down from 07:55 to 13:43, both have come back up with no intervention from me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 27, 2015, 02:11:23 PM
Similar. No uploading between 0800 and 1330 approx. Wasn't able to access site either. Seems fine now. Not had any Google issues here.

Always a routing issue possibility at the ISP. Quite often if its just on one switch not enough users get affected for the ISP to say anything !

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 02:20:00 PM
Thanks for the comments to all.

I am confused, tony you now hosting this at home?

Also I did wonder why google is needed for some parts of the site. your FTTC line looks a mess wow.  It makes newt's swings seem insignificant in comparison.

Google Charts are how the graphs are produced and you have to have a live connection for their Javascript, not allowed to use local copy.

Yes, it's been hosted here since Dec 8th with no real problems. If you recollect very few people (except for some kind souls who kept the paid hosting going for a while)  were willing to donate enough for 'proper' hosting and the offer of free hosting never materialised despite a lot of reminders so I moved it here on to a spare machine I have. It will stay here now.

The line has been pretty well stable for over a year except for crosstalk halving everything until three days ago when that lot of interference appeared. I can't hear it via a receiver (if it's REIN) on any of the frequencies locally but from the rise and ebb it almost looks like a radio station. Doesn't seem to affect service back out which is U/S from here. I'll investigate further when I get a chance.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 02:46:55 PM
I have a big server I could host it on if you like. Assuming it will run on linux/nginx/mysql. I have php but if it uses some other language I might be able to accommodate that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on February 27, 2015, 03:41:35 PM
yeah I can offer also but it be apache/php/mysql.

Although I do have a windows box in a datacenter sitting idle if its windows based.

donated hosting is more effective than cash, as then you got no bill to worry about.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on February 27, 2015, 03:45:21 PM
Yes he's hosting at home.

Both mine were down from 07:55 to 13:43, both have come back up with no intervention from me.

Mine was the same, plus just 1 timeout at 14:03 since then

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 05:15:51 PM
Amongst all the goings on, it appears that the main database table has now crashed and auto repair has failed. I've manually started a repair but this may well take a long, long  time. Not accepting any uploads currently for this reason as that's where they go.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on February 27, 2015, 05:17:22 PM
Feel for TB2 seems to be having a lot of issues over the last 24hrs. Now the Database. Im sure we all appreciate the time its taking. No rush here

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 27, 2015, 05:39:05 PM
Feel for TB2 seems to be having a lot of issues over the last 24hrs. Now the Database. Im sure we all appreciate the time its taking. No rush here

Tony

Did I mention my 30" monitor failed yesterday after 5 years of faithful service? The new one arrived a few hours ago  :'(

Site back up and running. I changed my mind and restored a very recent backup...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on February 27, 2015, 05:42:57 PM
Did I mention my 30" monitor failed yesterday after 5 years of faithful service? The new one arrived a few hours ago  :'(

really now, you don't need a 30" monitor for dslstats, I run it on a 10" :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 27, 2015, 07:22:41 PM
I am confused, tony you now hosting this at home?

Also I did wonder why google is needed for some parts of the site. your FTTC line looks a mess wow.  It makes newt's swings seem insignificant in comparison.

He has some radio china international in the tones of 1700 and radio romania international on tones 1400 on the D2 band but they are not the overall cause of the low SNRM dips.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on February 28, 2015, 02:00:45 AM
Quote
If you recollect very few people (except for some kind souls who kept the paid hosting going for a while)  were willing to donate enough for 'proper' hosting

Whilst I sympathise, I think you may just have to accept that donations alone are unlikely to be able to maintain the cost of a dedicated UK server.  I do know how much they cost and you will recall that I confirmed the figures in a previous post because I know this sites requirements. Donations from dsl based sites isnt profitable - again I can confirm this.  I keep a record of each and every person that has donated for the full 12 years this site has been running (here (http://www.kitz.co.uk/sites/support.htm)). There's been many a year when Ive funded out of my own pocket and one year I even had to borrow money from a friend to keep it going and another personal friend of mine donates to my hosting costs each year rather than buying me a birthday pressie.


For one database with 65 users then you are likely to be able to get away with low level cloud based hosting to cut costs.  If push came to shove, then this forum alone would cope with cloud based hosting.  The DB is pretty large as its been running a years.  However, my problem is the main site whilst also contains some large DB's for things such as the adslchecker, my hits run into millions per week and tens of thousand of individual visitors, yet you can quite clearly see that donations never, ever cover my hosting costs.   I just have to look at the site as an unpaid hobby for which I spend many hours per week (theres a lot of b/g stuff that you guys never get to see)...  and unfortunately I cannot get away with cheap hosting.. and its also too big for me to run on my own without some help from my hosts (security and config issues) which is why I need decent UK support too. 

I'm not alone here,   BE dedicates his own time to produce hg612 modem_stats for nothing, same with Ronski for the GUI.   Eric dedicates a lot of time to maintaining dlsstats and has to also pay for his hosting, for which he too gets nothing. John doesnt make any profit from routerstats.     

You could try some other methods, I tried Amazon shop, but tbh that is a waste of time, because of the floor limit for min payment. I think Ive been using it for 8yrs and it was only 2 months ago I got my first ever payment when someone purchased some download videos.   You use google already so try google ads,  again this isnt always successful, I keep my ads as small as possible with none of the big banners which are supposed to bring more income, but a warning there.  I find that because a lot of the frequent visitors to sites such as this are tech savy so tend to use ad blockers, so perhaps you could appeal to users to white list your site? It may bring in a couple of quid per month?   Perhaps get a host to sponsor you?

I'm not trying to be pessimistic, Im just trying to state facts as they are and you're going to be very lucky if you think you can make any sort of profit from it.  Like I say, Ive been running this site for 12/13yrs and have never personally made a single penny from it, everything gets ploughed back in.  Its often a full time unpaid job, that costs me to run :D 


---
btw I want to stress that this isnt a hint at the regs to make donations for this site.   I see the forums as a community and I greatly value the input of the regs with their time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 28, 2015, 08:37:23 AM
Thanks for various PMs, private mails and posts here with comments on the hosting.

But as I said in the original post yesterday, I'm happy to have the server running here until whenever - so am not looking for alternative hosting, paid, free or otherwise as donations could never cover the cost, a fact I learned many years ago in the '90s and there are not enough users here anyway (200 registered currently) - but again thanks for several offers. DNS is NOT on this server here BTW.

Like the others involved in MDWS, I too have never looked to cover the time spent on developing this project as that would be a total impossibility anyway.

But it's great to have some ongoing donations to show appreciations and cover a few outgoings if possible thanks. It also gives one a warm feeling when they arrive and helps to counteract days like yesterday and plough on  :)
It also appears that yesterday's problem to do with Google etc was quite possibly a PlusNet fault  >:D   Again thanks to those who mailed me to mention that.

I already have paid shared hosting available and run nine web sites currently. MDWS was developed on that shared hosting but they refused use of the production version due to the continual uploads and unpredictable future traffic, plus it was shared with ~1700 other sites.

Thanks again to everyone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on February 28, 2015, 06:47:16 PM
errrm......Tony.........Is the website running very slow after the restore.

A 10 day error second plot is taking >12 seconds.

No big problem  ;)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 12:32:19 PM
errrm......Tony.........Is the website running very slow after the restore.

A 10 day error second plot is taking >12 seconds.

No big problem  ;)

Ian

Thanks, hadn't spotted that.

Um. Well it shouldn't!   Fixed and it's about 100 times faster now....  ;)

Note that the 24 hour and less ES graphs look different to the 48 hour and greater as the latter do NOT include the current day on the right. The longer periods have a dedicated summary table for speed of access and that is updated at 00:30 each day for the previous day. Also, the last two days were missing and that's fixed as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 01, 2015, 12:35:28 PM
Very fast today Tony was browsing earlier and its much quicker!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on March 01, 2015, 12:50:18 PM
  It does not matter much but I think it may be more helpful to allow the current day to appear in less than 5 day periods.  I like to look at the current day in relation to the last few days.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 12:56:43 PM
  It does not matter much but I think it may be more helpful to allow the current day to appear in less than 5 day periods.  I like to look at the current day in relation to the last few days.

It will then run very slow again....

Try running two panes one with the last day/few days and one with more?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 01, 2015, 01:02:06 PM
Thanks Tony, as you say much faster now. I had to come back and re-read your post as I was about to mention the lack of current day in my preferred 10 day plot.

As les mentions i also like to keep an eye on the live trend in real time with a manual refresh only, but if you think it slows the server too much then OK.

Thanks again
Ian

EDIT: you have replied whilst I was composing this....the server would run slow  :( I will try modifying my panes  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 01:11:32 PM
Thanks Tony, as you say much faster now. I had to come back and re-read your post as I was about to mention the lack of current day in my preferred 10 day plot.

I might be able to do something about it by adding on the current day's data to the end of the quick fetch data.... Have to wait a little while though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 01, 2015, 03:48:57 PM
Okay, all date spans are now displaying ES along with running totals for current day as well  :)

Bear in mind that horizontal compression on the graphs may lose the last hour plot or so on wider spans.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on March 01, 2015, 04:03:04 PM
  Many thanks for the quick work.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 01, 2015, 05:57:30 PM
Quote
Many thanks for the quick work.
+1
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 02, 2015, 09:36:25 PM
Back again Tony...something strange with the multi-day error second graphs...March 1 st seems to be missing (are you anti Welsh)  ;) ;)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 02, 2015, 10:33:27 PM
Back again Tony...something strange with the multi-day error second graphs...March 1 st seems to be missing (are you anti Welsh)  ;) ;)
Ian

Seems the process that generates the entries timed out and only completed about 10 users rather than 70 or so. I've rerun it and the others are there now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 02, 2015, 10:46:50 PM
well at least your DS SNRm is getting better your not getting below 1dB though 4.5dB says to me that your line has had more crosstalk an you may need to let go of some sync to balance your SNRm it's up to you  :(

If you do decide then 20:00 is the best time to resync and also remember to take 30mins modem off into consideration so modem off at 19:30 and modem on at 20:00.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 02, 2015, 11:38:43 PM
well at least your DS SNRm is getting better your not getting below 1dB though 4.5dB says to me that your line has had more crosstalk an you may need to let go of some sync to balance your SNRm it's up to you  :(

If you do decide then 20:00 is the best time to resync and also remember to take 30mins modem off into consideration so modem off at 19:30 and modem on at 20:00.

If you are referring to my line, thanks for the ideas but it's better this evening because I rerouted some wiring earlier today that I added about five days ago and that seems to be picking up the rubbish - an experiment on Saturday also gave an improvement. I still need to do some more work on that.

There was a local power outage in the village at 16:04 for a couple of minutes that raised the SNRM briefly. I'm not worried about trying to possibly 'improve' it by forcing resyncs etc at the moment, or taking the server offline for 30 mins though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 05, 2015, 08:57:46 PM
Upgrade

If all goes as planned, there will be a number of software updates tomorrow morning (Friday 6th Mar) starting just after 08:00 that will put the server offline for up to an hour so it won't be accepting any uploads or delivering web pages.

Hopefully it will be back much more quickly though  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 06, 2015, 08:44:12 AM
All should be well now, back up at 08:21  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 06, 2015, 09:47:04 AM
It's all working fine here. Well done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 06, 2015, 10:01:41 AM
It's all working fine here. Well done.

Thanks! One of the changes was to attempt to get all the database tables into some added memory to speed it all up and that seems to have almost worked, might need to allocate a bit more, certainly disk usage has dropped dramatically and I see faster user access times in the logs.

Also put on a new HG612 and flashed the 08 firmware we talked about, plus a bit of rewiring to leave the modem and lead to master socket (10 inches) away from any PSU cables. Also turned off QOS.

I see my Attainable is back up to 42 again and Sync 2.7 better but still interleaved  so will see what happens...

Also Gateway is now pcl-bng02, it was ptn-ag03.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 06, 2015, 12:03:02 PM
Load times do seem much quicker Tony, nice work!

Hopefully the unlocked hg612 will improve things for you too :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 08, 2015, 04:41:19 PM
Another G.INP line  :thumbs:

Just to say that there is now another G.INP enabled line (garypower1). Each new addition and the admins get an automatic mail once this is detected.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 08, 2015, 09:09:20 PM
Another G.INP line  :thumbs:

Just to say that there is now another G.INP enabled line (garypower1). Each new addition and the admins get an automatic mail once this is detected.

I it's strange it only happening to recently signed up members to MDWS what i would like to see is a regular member like Baldeagle1 moved to G.INP and compare the difference as he has the before and after stuff we need.

For example to see changes in errored seconds and crc's fec's the list go's on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 09, 2015, 10:19:19 AM
I it's strange it only happening to recently signed up members to MDWS what i would like to see is a regular member like Baldeagle1 moved to G.INP and compare the difference as he has the before and after stuff we need.

For example to see changes in errored seconds and crc's fec's the list go's on.

Well that's easy to solve as he has records available back to September 2014..   ;)

Trouble is he registered a new but similar username on the day G.INP was detected so has lost access to all the old records in the Current View (which needs uploads in past day or so for a user to be visible) as they don't exist under the new username.

To solve that, open a new pane and use the Range option - this lists all users who have ever uploaded anything since we went live so you'll see him next to his current username. The select a day or range to match a Current pane view for him etc etc etc...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 09, 2015, 05:52:41 PM
Its ok TB can now see the previous username as garypower and they have gone back to using that username thats good  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: garypower on March 09, 2015, 10:49:08 PM
Hi, guilty as charged sorry!

I noticed that I had stopped sending stats a few days ago - upgraded to the latest version as I had not done that for a while and the settings for the upload validation key had gone.
I poked about on the site for quite a while but could not find a way to retrieve it anywhere unless I am missing somewhere so set up another account to get some logging going.

Some more digging today and I found I had filed away the original mail from last year so back to the first account!

The increase in upload is noticeable since g.inp went on - regained me a couple of mbits of usable throughput

Gary
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on March 10, 2015, 07:42:52 AM
As you are one of the very few users on G.INP enabled connections (that we are aware of) I'd very much like to see a zipped copy of your ongoing modem_stats.log, including the periods before & after G.INP was enabled.

(PM also sent).


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 10:17:48 AM
Donations

Thanks to those who donated to MDWS over the past 6 weeks:

jizzerman
NStar
oliver602
vic0239
 :clap2:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 10:41:18 AM
MDWS Updates

A few changes to the 24Hr (00:00 - 23:59 for selected date) set of graphs.

1) The small CRC graph now shows Upstream as well
2) Errored Seconds popup works on all browsers I have here (but View Image/Save still won't work with FireFox/Waterfox)
3) For the Current Day only all eight graphs now autoupdate every 5 minutes - last update time is now shown after the date at the top for today only as you may not see it happen

A problem with the Available Dates in the dropdown lists everywhere not showing past 4th March has also been fixed (thanks to Chrysalis for noticing this)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 14, 2015, 12:36:50 PM
Tony
There is probably a bug in the FEC graph. The upstream data is not displayed. It seems to affect all users.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 01:14:47 PM
Tony
There is probably a bug in the FEC graph. The upstream data is not displayed. It seems to affect all users.

No it's not a bug. There is no data for Upstream FEC Delta supplied to the database tables by the upload progs that matches the downstream entry ....

It's possible that it might be available via another parameter but I don't know what it is if so....

Having had a look, there is a non-delta us_cb1_FEC value but if that is usable, I really need delta values to avoid having to calculate them on the server every time...

There are unused data columns that could be pressed into service if BE1 and roseway could agree to use one for us_FEC_ERRORS_delta?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 14, 2015, 01:53:45 PM
You could possibly use field 47 (us_RSCorr_delta). In general RSCorr equates with FEC, although I believe the former doesn't get zeroed on a modem resync (but that doesn't matter with delta values).

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Korben_dallas on March 14, 2015, 02:05:12 PM
Hi,

I tried to logon  but I got a message advising of incorrect memorable phrase,  I did attempt to rest my password but whils ti got an email with a link when I clicked on this the web page advised 'Password reset has failed - please go back and try again...."; '

Am really keen to have a look at the graphs and since after some issues with BT on my phone line which resulted in a loss of the phone and FTTC for a couple of days, BTOR resolved the matter on Thursday morning, which after this the speed has actually improved that and it now appears the G.INP has been activated.

I like to see if the latest change in sync speed is a result of G.INP or the fact that when BTOR resolved the lone issues they improved the quality of the connection.

Any ideas on how I can reset the password and or memorable phrase.

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on March 14, 2015, 02:05:38 PM
Indeed, field 47 is the one to use for us_RSCorr_delta values

Field 26 can be used for ds_RSCorr_delta values

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 02:26:58 PM
Hi,

I tried to logon  but I got a message advising of incorrect memorable phrase,  I did attempt to rest my password but whils ti got an email with a link when I clicked on this the web page advised 'Password reset has failed - please go back and try again...."; '

Any ideas on how I can reset the password and or memorable phrase.

Cheers

Hi

Please try again.... G.INP is activated for you but you are NOT uploading currently and haven't been since 03:32 this morning. You should have had an e-mail saying G.INP had been activated from MDWS at the time it was detected (02:21) Your D/S sync increased by ~15Mb...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 02:41:21 PM
Indeed, field 47 is the one to use for us_RSCorr_delta values

Thanks to both - we now have the plots!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Korben_dallas on March 14, 2015, 06:26:02 PM
Hi,

I tried to reset my password which was successful and I did get a new password however it seems I have an issue with the Memorable Phrase, is there any way to reset this?

Concerning the last upload, my old friend Norton decided to once again quarantine HG612_run.exe and the gui.exe despite me telling it previously to ignore it.

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 14, 2015, 06:51:46 PM

Thanks to both - we now have the plots!

Thank you.
Unfortunately there is no plot for users uploading with DSLStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2015, 06:58:13 PM
Hi,

I tried to reset my password which was successful and I did get a new password however it seems I have an issue with the Memorable Phrase, is there any way to reset this?

I just logged on as you okay using the Memorable Phrase you have set and the current password so not sure what the problem is? You should have seen the phrase when you reset the password if you couldn't remember it....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Korben_dallas on March 14, 2015, 07:40:06 PM
Hi,

Thanks again for your help,  I tried IE 11 and it worked without an issue.  It appears that using Firefox was causing the issue not sure why.

Cheers

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 15, 2015, 10:48:00 AM

Thanks to both - we now have the plots!

Thank you.
Unfortunately there is no plot for users uploading with DSLStats.
I've had a look and can't see any real problem here - there are users on DSLstats with Upload FEC's visible (try 24Hr roseway) and assuming that is your problem as you didn't say.

Can you let us know what modem you are using please as that may be the cause if it's your own stats that are not showing u/s FEC/CRCs....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 15, 2015, 06:49:18 PM
In DSLStats up/down FEC and CRC are displayed. MyDSLWebStats shows the same but without upstream FEC.
My modem is a BCM6368 with version A2pv6C030h.d22k.
There are some differences in the reported data from the modem depending on the firmware version. Maybe this causes DSLStats not to report this parameter correctly.

I attached a copy of the info --stats output if roseway wants to test if DSLStats is able to calculate the upstream FEC correctly.

Thanks for your help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 15, 2015, 07:03:34 PM
I can confirm that your stats data is in the format which DSLstats expects, so there shouldn't be a problem. But I think there may be a small bug in the latest version, which results in the RSCorr data required by MDWS not being uploaded correctly. I'll check this out and let you know.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 16, 2015, 11:18:02 PM
I've now fixed this on my test version, and MDWS displays my FECs correctly (as from about 19:30 today). I'll make the fixed version available shortly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 22, 2015, 06:48:20 PM
Tony

Is the last hour worth of error seconds/day recorded?

(I would expect the line to be vertical on the total plot)

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 22, 2015, 07:36:53 PM
Tony

Is the last hour worth of error seconds/day recorded?

(I would expect the line to be vertical on the total plot)

Ian

Yes, that's been asked before. Although it says 23:00 at the top of the plot, it's really the total for 23:00 - 23:59 after adding on the previous hourly totals. Same applies to all the other points on the hourly plot. So the one after that at the bottom is 00:00-00:59.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 22, 2015, 08:14:42 PM
Quote
So the one after that at the bottom is 00:00-00:59.

Thanks, I always thought that looked as if it was zero.

Thangs again for your quick support.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2015, 01:01:52 PM
Downtime for MyDSLWebStats

A note that the server will be down for 5-15 mins this afternoon around 15:30 for a hardware/cabling change and a few other updates. So no web pages served or uploads possible.

You don't need to do anything but DSLStats users may or may not find that the uploads have been stopped automatically by DSLstats depending on how long it's down for so might need re-enabling in the MDWS config section. 

I'll post here when it's back up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 26, 2015, 04:23:38 PM
@roseway
During the downtime DSLStats was running but the GUI freezed, only a grey surface was visible. It has not crashed or displayed an error and as soon as MDWS was back online it keeps sampling/uploading as before. It's not the first time I notice this behaviour during a downtime of MDWS.
I'm running v5.4.3 on rpi.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 26, 2015, 04:36:21 PM
Yes, that's quite right. DSLstats hangs while trying to contact MDWS. I need to add a timeout, but personal circumstances are limiting my time at present.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2015, 04:53:36 PM
Well, that didn't go as planned due to a Windows update failure. Then, the (not changed) router seems to have some sort of problem and either fails to connect at all or restarts itself every so often.

What is more of a problem though is that my U/S sync is 5347 but actual U/S speed via TBB, usually ok, is consistently a whopping ... 450k  :-X ???   

Edit: seems the newer TBB speedtester is consistently completely wrong! The Flash one gives the expected result of ~5000kbs as does FTP and also a large HTTP file upload.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 26, 2015, 11:32:40 PM
No worrys tony it's up and running that's the main thing and we have are RPI's and PC's gathering the stats to fallback on if there is a small gap  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 29, 2015, 08:46:32 AM
Trouble this morning Tony??

Not recorded from 9:42PM last night.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on March 29, 2015, 09:24:03 AM
I can't seem to access the site either myself.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on March 29, 2015, 10:31:09 AM
same here
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 12:44:43 PM
Okay it's back up after a lot of grief including 3.5 hours lost connection.

PLEASE CHECK YOUR CLOCKS ON YOUR UPLOAD DEVICE!!  :-X
THEY NEED TO BE ACCURATE (+/- 1 min) AND ON BST CURRENTLY


A fair number of  people don't have updated clocks from this morning's change and are still running GMT, not BST. Convention is to upload in LOCAL time please as the majority of users are (your stats log has the local date/time embedded in it) .  This doesn't affect the graphs as such although it will show your latest upload as an hour ago but does make several other checks malfunction.

ADDENDA
The answer to the problems here appears to be that you need to restart your DSLstats prog if you are in the list below and thus pick up the time zone change.

I've had to turn off the TimeZone detection because of this and also repair a crashed database  (not related) .

The ones I can see still on GMT at a quick check are (this may not be all) - [Edit] I've removed those that are fixed so far:

bart613
bigg
davesals39
JustAnothe [added]
les-70
longstaff
mhisani
oliver602
splbound
thepfy
toulouse
xreyuk
zk583


Everyone else is on BST as they should be. I currently can't tell if anyone above is outside the UK though.
The graphs of those above will show the latest uploads as an hour ago until corrected, after which there will be an hour's gap before the correction.

First outage was at 07:42 but had been running up until then. Back at 08:22 after database repair but then I lost my Internet connection for the best part of three and a half hours  >:D

No idea why. Everything was synched according to the status LEDs and made a few restarts but no effect. Suddenly came back with no help at 11:52. Maybe I ought to have wandered up to the cab....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2015, 01:15:14 PM
The clock on the PC & RPi says 13:14 the atomic clock says 13:14 so it's find here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lloyd on March 29, 2015, 01:19:21 PM
Clock on my server is correct. Have restarted dslstats to see if that makes a difference.
Lloyd (pianist)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 01:37:06 PM
The clock on the PC say 13:14 the atomic clock says 13:14 so it's find here.

Maybe but the date/time embedded in your modem log file is an hour slow currently.... I don't know why but will have a look later (I need a rest) and see what might be causing that at your end .... 

Um ..... A quick look say everyone in the list is using DSLstats, either the RPi or the Linux 32/64-bit versions (No Windows version and that's what I'm using and am ok)...

I am pretty sure it's not this end as everyone would be affected as you are all imported in exactly the same way.

Have a look in

C:\Users\xxxxx\AppData\Local\dslstats\ (or wherever it is - check the start of the Event Log tab for location)

and see what your current xxxxx_live_modem_stats.log says about the date/time please...

29/03/2015 13:35 34616 5527 6.0 6.1 .......
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 01:59:43 PM
Clock on my server is correct. Have restarted dslstats to see if that makes a difference.
Lloyd (pianist)

That's fixed it for you  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 29, 2015, 03:14:28 PM
Restarted DSL Stats on the Pi, seems to have sorted it Tony?

Quote
pi@dslstats ~ $ date
Sun Mar 29 15:16:58 BST 2015
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on March 29, 2015, 03:15:47 PM
Sorry about that, my PI was running on UTC.  :-[  Have now set the correct locale:

Current default time zone: 'Europe/London'
Local time is now:      Sun Mar 29 15:04:16 BST 2015.
Universal Time is now:  Sun Mar 29 14:04:16 UTC 2015.

BTW I'm seeing this message on the MDWS monitor page:

User vic0239 - your e-email server refuses our mails - please whitelist us!

Yet I have received emails in the past, the last being on 24th March?  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 03:22:16 PM
Restarted DSL Stats on the Pi, seems to have sorted it Tony?

Quote
pi@dslstats ~ $ date
Sun Mar 29 15:16:58 BST 2015

Yes,  thanks  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on March 29, 2015, 03:23:46 PM
Restarted DSL Stats on the Pi, seems to have sorted it Tony?

Quote
pi@dslstats ~ $ date
Sun Mar 29 15:16:58 BST 2015

Yes,  thanks  :D
Seems DSL Stats needs to be closed and opened again on the Pi for the update to take affect Tony

Thanks again!

Sent from my Nexus 6 using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 03:26:33 PM
Sorry about that, my PI was running on UTC.  :-[  Have now set the correct locale:

Current default time zone: 'Europe/London'
Local time is now:      Sun Mar 29 15:04:16 BST 2015.
Universal Time is now:  Sun Mar 29 14:04:16 UTC 2015.

BTW I'm seeing this message on the MDWS monitor page:

User vic0239 - your e-email server refuses our mails - please whitelist us!

Yet I have received emails in the past, the last being on 24th March?  ???

Okay now on time.  Answer seems to be to restart DSLstats.....

Re mail:

Date: Wed, 18 Mar 2015 10:21:58 +0100
Subject: MyDSLWebStats RESYNC Alert for vic0239!

SMTP error from remote server in greeting:
host: mx.bt.lon5.cpcloud.co.uk:
rgin02.bt.ext.cpcloud.co.uk Service not available - access denied

another on 22nd as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2015, 03:30:38 PM
Rebooted RPi and my MDWS account seem to be on BST yet the RPi was showing the correct time it must be one of those RPi thangs  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ip75 on March 29, 2015, 03:38:38 PM
Thanks. For anyone using a Raspberry Pi who doesn't know this, you might need to run:

$dpkg-reconfigure tzdata

and then reselect your timezone to pick up BST. Then restart DSLStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 03:41:43 PM
BTW I'm seeing this message on the MDWS monitor page:
User vic0239 - your e-email server refuses our mails - please whitelist us!

This is a new User messaging system I came up with - only the addressed user sees the message. Difficult to contact anyone if there is a problem with e-mail. One guy has been banned from uploading for several months as there's no data being sent. His e-mail doesn't exist any more and he never logs in though....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on March 29, 2015, 04:08:45 PM
SMTP error from remote server in greeting:
host: mx.bt.lon5.cpcloud.co.uk:
rgin02.bt.ext.cpcloud.co.uk Service not available - access denied

Looks like there may be an issue with BT/Yahoo mail servers. I have an alternate email address, but can't see where to change  it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2015, 10:43:30 PM
MDWS BST Clock settings (from earlier post this morning)

As best I can tell, these users still need to reload their copy of DSLstats to get the correct upload time:

JustAnothe
les-70
oliver602
thepfy
toulouse

TIA
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: splbound on March 31, 2015, 02:49:49 PM
I have just restarted my virtual server and DslStats.
Running it on a Lubuntu instance and double checked my date time timezone is correct.

I hope this has sorted it out.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Fuggi on March 31, 2015, 03:35:39 PM
Tony
       Responding to your email of multiple upload log files, Rpi version of Dslstats is the only program running.
       Nothing else has changed since restarting Pi and Dslstats on 29th March. Program stopped, will restart
       after ashort break.

Fuggi
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 31, 2015, 04:07:11 PM
I have just restarted my virtual server and DslStats.
Running it on a Lubuntu instance and double checked my date time timezone is correct.

I hope this has sorted it out.

Yup! Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 31, 2015, 04:12:40 PM
Tony
       Responding to your email of multiple upload log files, Rpi version of Dslstats is the only program running.
       Nothing else has changed since restarting Pi and Dslstats on 29th March. Program stopped, will restart
       after ashort break.

Fuggi
Nothing to worry about - you appear to have had only two today rather than 1000s as in one instance. They are automatic and won't get sent unless there are three consecutive ones , then you see the third and every minute thereafter as they occur. Reset back as soon as there is not one for a minute. Most people have one every so often for all sorts of reasons, usually a stuck process that ends in the next minute. Unusual with DSLstats though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: boost on April 01, 2015, 09:12:14 PM
Just noticed that MDWS reports a +power figure for my upstream but it appears to be a -power figure?


Reported as positive here:

Code: [Select]
DSLAM/MSAN type:        BDCM:0xa44f / v0xa44f
Modem/router firmware:  AnnexA version - A2pv6C038m.d24j
DSL mode:                VDSL2 Profile 17a
Status:                  Showtime
Uptime:                  1 day 2 hours 14 min 53 sec
Resyncs:                0 (since 01 Apr 2015 19:56:55)

Downstream Upstream
Line attenuation (dB):  5.4 0.0
Signal attenuation (dB): Not available on VDSL2
Connection speed (kbps): 79987 19999
SNR margin (dB):        18.3 23.2
Power (dBm):            13.5 13.4
Interleave depth:        1 1
INP:                    0 0
G.INP:                  Not enabled

RSCorr/RS (%):          N/A 0.0021
RSUnCorr/RS (%):        N/A 0.0000
ES/hour:                0.83 0.83


Negative here...

Code: [Select]
xdslcmd info --pbParams
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 0
Last initialization procedure status: 0
Max: Upstream rate = 36866 Kbps, Downstream rate = 122892 Kbps
Bearer: 0, Upstream rate = 19999 Kbps, Downstream rate = 79987 Kbps

Discovery Phase (Initial) Band Plan
US: (7,32) (871,1205) (1972,2782)
DS: (33,859) (1216,1961) (2793,3970)
Medley Phase (Final) Band Plan
US: (7,32) (871,1205) (1972,2782)
DS: (33,859) (1216,1961) (2793,3970)
  VDSL Port Details   Upstream   Downstream
Attainable Net Data Rate:     36866 kbps    122892 kbps
Actual Aggregate Tx Power:    -  13.4 dBm      13.5 dBm
====================================================================================
  VDSL Band Status U0 U1 U2 U3 U4 D1 D2 D3
  Line Attenuation(dB): 1.4 4.5 5.8 N/A N/A 2.6 5.7 9.2
Signal Attenuation(dB): N/A 4.1 5.0 N/A N/A 3.1 5.7 9.2
        SNR Margin(dB): N/A 23.2 23.2 N/A N/A 18.3 18.3 18.3
         TX Power(dBm): -128.0 -39.2 -13.5 N/A N/A 10.4 7.8 7.1
#

No idea which is correct!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 02, 2015, 08:10:16 AM
Just noticed that MDWS reports a +power figure for my upstream but it appears to be a -power figure?

MDWS just reports what it's sent. You need to talk to roseway (or the modem makers)....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 03, 2015, 07:27:46 AM
Server will be down shortly, not sure yet for how long....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 03, 2015, 07:52:18 AM
Just noticed that MDWS reports a +power figure for my upstream but it appears to be a -power figure?

MDWS just reports what it's sent. You need to talk to roseway (or the modem makers)....

DSLstats just reports what the modem reports. MDWS reports the total upstream and downstream powers, and these values are positive. The upstream per-band values appear to be negative dBm values, but I find it hard to believe them because they represent microscopic power levels.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 03, 2015, 08:20:47 AM
Server will be down shortly, not sure yet for how long....
Okay back up - down from 07:55 - 07:59. Running on ZyXel VMG8324-V10A now at last  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on April 03, 2015, 05:33:28 PM
DSLstats just reports what the modem reports. MDWS reports the total upstream and downstream powers, and these values are positive. The upstream per-band values appear to be negative dBm values, but I find it hard to believe them because they represent microscopic power levels.

On my Billion 8800nl modem, the "--stats" command reports 13.1dBm downstream, and -8.2dBm upstream. From "--pbParams", I get banded TXPower as 9.7, 8.0, and 6.9dBm downstream, and -22.5, -35.3, and -8.5dBm upstream - with aggregate power listed as 13.1dBm down and -8.2dBm up.

When the HG612 was plugged in, the equivalent figures were 13.0 dBm down, -7.9dBm up; and 9.6, 7.6 and 7.2dBm down with -22.1, -35.2 and -8.1dBm up - with aggregate power listed there as 13.0dBm down and -7.9dBm up.

This line is around 100m long.

On an old line (350-400m long), the HG612 would display aggregate powers as positive, but would differ in the bands: U0 and U1 would be negative, while U2 (and all Dx bands) would be positive.

On an even older line (600-650m long), the HG612 showed similar results as the medium-length line.

What I did notice is that the placement of the minus symbol differs: In the "--stats" command, it is next to the digits; In the "--pbParams" command, it is next to the digits in the individual bands, but there are spaces between the symbol and the digits for the aggregate power.

For my line, I have both DSLstats and HG612-modem-stats running, so can see that HG612-modem-stats gets the right negative value. MDWS is being fed by HG612-modem-stats rather than DSLstats, so gets it right.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 03, 2015, 06:54:24 PM
OK, I'll take another look at that.

[Later]
Yes, I'm sorry, I agree. I haven't seen negative aggregate values before, and DSLstats has been reading these as positive. This will be corrected in the next release.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 03, 2015, 10:56:20 PM
OK, I'll take another look at that.

[Later]
Yes, I'm sorry, I agree. I haven't seen negative aggregate values before, and DSLstats has been reading these as positive. This will be corrected in the next release.

Only see negatives in the US TX power on both DSLstats and HG612_modems_stats have the same value  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 03, 2015, 11:15:00 PM
Yes, but it's the aggregate data we're talking about, and these values are both positive in your examples. The error I made was in believing that these would always be positive, and only uploading positive values to MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: WWWombat on April 04, 2015, 04:34:55 PM
Here's what mine looks like with the negative aggregate values. Note the '-' is a long way from the '8.2' in one screenshot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: bigg on April 04, 2015, 04:38:42 PM
MDWS BST Clock settings (from earlier post this morning)

As best I can tell, these users still need to reload their copy of DSLstats to get the correct upload time:

bigg
JustAnothe
les-70
oliver602
thepfy
toulouse

TIA

Hi I have checked my raspbery pi and it is on BST with the correct time, rebooted and the website is still saying my time is not on BST, can somebody take a look ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 04, 2015, 05:04:27 PM
MDWS BST Clock settings (from earlier post this morning)

As best I can tell, these users still need to reload their copy of DSLstats to get the correct upload time:

Edit:

This is now automated and an affected user will see a message under each graph telling them that the clock is out and still on GMT. As soon as it is corrected, the message will go away on the next graph refresh,

TIA

Hi I have checked my raspbery pi and it is on BST with the correct time, rebooted and the website is still saying my time is not on BST, can somebody take a look ?

Gone now, it's manual coding, not automatic....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 05, 2015, 01:46:50 AM
Should the ES/CRC/FEC and so on in the header be populated? Mine always seem to be 0.0 even though on the specific graphs ES have been reported? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 05, 2015, 12:40:53 PM
Should the ES/CRC/FEC and so on in the header be populated? Mine always seem to be 0.0 even though on the specific graphs ES have been reported? Thanks
Yes, they are reported but they are instantaneous readings once per minute so if you only have a few the chances are you won't see any data...

Try looking at oliver602 if you can bear it  :o (and his DSLstats clock is still out) 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shadow4dog on April 07, 2015, 04:13:08 PM
When I logon to MyDSLWebStats I see "User shadow4dog - your upload data is invalid!"

What does this mean and how do I correct it? I'm running HG612 Modem Stats.

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 07, 2015, 04:48:52 PM
When I logon to MyDSLWebStats I see "User shadow4dog - your upload data is invalid!"

What does this mean and how do I correct it? I'm running HG612 Modem Stats.

Thanks
It appears to be fixed now  :) For a couple of days (3rd - 5thApril) your were uploading files with no data in. Usually upgrading HG612 Modem Stats or restarting it will fix the problem which is known.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: shadow4dog on April 07, 2015, 06:13:50 PM
Thanks that makes sense. My local data is missing from that time too... but if it's known then not a big problem...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 07, 2015, 07:28:03 PM
I have just registered with MyDSLWebStats but I can only get so far. It baulks on the "Check now" with "Unable to check at present". Is this my finger trouble or is the site not working at the mo'?
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on April 07, 2015, 07:33:39 PM
I have just registered with MyDSLWebStats but I can only get so far. It baulks on the "Check now" with "Unable to check at present". Is this my finger trouble or is the site not working at the mo'?
Tony

stop recording on your software, then use check now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 07, 2015, 10:13:07 PM
No doubt there us a huge list of requests but it would be great if your user was selected automatically after logging on? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 07, 2015, 11:04:03 PM
No doubt there us a huge list of requests but it would be great if your user was selected automatically after logging on? Thanks

you have plenty of panes you can use 1 for your stats 2 for all users stats 3 for another users stats  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 07, 2015, 11:04:26 PM
I've stopped recording but it still says "unable....." when I "Check now". Any more suggestions please?
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 07:41:15 AM
I've stopped recording but it still says "unable....." when I "Check now". Any more suggestions please?
Tony

Welcome  :)

That is DSLstats presumably... Have you tried unloading the program and restarting?

If that doesn't work, probably need roseway's help as it's his baby. He'll hopefully spot this post.. It sounds possibly like it can't find an internet connection to make the check?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 07:45:23 AM
No doubt there us a huge list of requests but it would be great if your user was selected automatically after logging on? Thanks

It should be selected when you first log on, seems to work here okay - if not select yourself or another user and that user will stay with you from then on for that pane until changed...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 08:07:43 AM
I've stopped recording but it still says "unable....." when I "Check now". Any more suggestions please?
Tony

If this is DSLstats, then it's possible that this is the result of a timeout. I believe you're with Plusnet, and the MyDSLWebStats site seems to be one of the sites which get affected by the gateway delay issue. Doing a gateway hop* may clear the problem. Alternatively, if you're sure that you've entered the validation code correctly, just starting recording with MDWS set up and enabled may work OK, but with something like 5 seconds initial delay before anything happens.

*To do a gateway hop, you need to drop the PPP session with the ISP and remake it several seconds later. Most routers provide a means of doing this, with a Disconnect / Connect button in the web interface. You could just resync or restart the modem, but it's not a good idea to do this frequently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 11:50:22 AM
I have upgraded DSLStats to 5.4 (I was using 5.3) and checked on the MYDSLWebstats site that I am logged in. I can see my name in the list of registered names but I'm still not uploading. I have checked the gateway I am on and checked that I've moved after a hop but still no joy. I'm almost certain this is my finger trouble which is very frustrating. Is there anything else anyone can suggest please? DSLStats is still doing its thing fine and I have stopped and restarted it to no avail.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 12:39:06 PM
I have upgraded DSLStats to 5.4 (I was using 5.3) and checked on the MYDSLWebstats site that I am logged in. I can see my name in the list of registered names but I'm still not uploading. I have checked the gateway I am on and checked that I've moved after a hop but still no joy. I'm almost certain this is my finger trouble which is very frustrating. Is there anything else anyone can suggest please? DSLStats is still doing its thing fine and I have stopped and restarted it to no avail.
Tony

Are there any relevant entries in the Event log?
And could you take a snapshot of the DSLstats MDWS configuration page and copy it here? Make sure you haven't ticked the Reveal box when you do this.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 12:39:23 PM
Have you looked in the Event Log tab of DSLstats to see if that tells you anything?  Have you get the validation checked okay message yet on the MyDSLWebStats config tab?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 02:06:53 PM
I should have checked the event log before but unfortunately the only relevant comment in there is "MyDSLWebStats validation check failed" about 8 or 9 times and my IP address. Checked OK still says "Unable....". A copy of the config page is attached (I hope!)
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 03:52:33 PM
I think you've revealed a bug: the 'Check now' button only works when the 'Upload data to MyDSLWebStats' box is ticked. If you do that, it should work. :fingers:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 04:38:22 PM
Unfortunately I've tried that and it won't let me tick it. I'm going to be so cross I'm sure when we find out what stupidity I've performed.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 05:27:41 PM
Eric is a better person to answer this but as an idea have you tried stopping DSLstats recording first, and then trying to enable it. If that doesn't work, terminate DSLstats after stopping it and restart it then try? My copy running here seems to accept changing that checkbox at any time...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 08, 2015, 08:05:31 PM
I have tried stopping the recording and after your suggestion I exited the program and restarted it. Still no joy. I am using a tg582 router (still on ADSL2+) and I wonder if someone else here has the same conditions as me. That is Plusnet customer, ADSL2+ and a tg 582. Be good to have a comparison.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 08, 2015, 08:17:17 PM


Quote from: tbailey2
It should be selected when you first log on, seems to work here okay - if not select yourself or another user and that user will stay with you from then on for that pane until changed...

Didn't have cookies enabled.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 10:56:40 PM
I have tried stopping the recording and after your suggestion I exited the program and restarted it. Still no joy. I am using a tg582 router (still on ADSL2+) and I wonder if someone else here has the same conditions as me. That is Plusnet customer, ADSL2+ and a tg 582. Be good to have a comparison.
Tony

Does that mean that you're using the TG582n as a modem/router? If so, then I owe you an apology, because the MyDSLWebStats functions only work with normal Broadcom-based modems, not with the Thomson/Technicolor models. The latter don't provide access to the range of data needed for MDWS.

I should have made this clear at the outset, but I confess that I simply didn't think of it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 11:09:46 PM
It was reading stats though if that makes any difference, you can see them at the bottom of the screen grab  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 08, 2015, 11:18:39 PM
Yes, DSLstats does work with limited functionality with the Thomson/Technicolor models, but much of the data needed by MDWS is missing.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 08, 2015, 11:25:02 PM
Yes, DSLstats does work with limited functionality with the Thomson/Technicolor models, but much of the data needed by MDWS is missing.

Okay. I thought maybe it would just upload a subset for 'challenged' modem/routers.... I did check the validation code and that is okay but nothing has ever made it up to the server.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 09, 2015, 12:46:21 AM
Thanks, everyone. It seems the problem is solved. Perhaps I should have made it clear what router I was using but since DSLStats works so well with it I didn't imagine it would not work to record my stats. This is the only reason i have registered with MyDSLWebStats. I will join the grown ups when I get proper fast broadband with a new router. Can't be long now - the exchange is upgraded but no sign of an extra cabinet by my original one.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 09, 2015, 07:03:38 AM
Once again, I'm sorry Tony. I don't like leaving you unsupported, but at present I'm having to prioritise my time spent at the PC.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tonyappuk on April 09, 2015, 12:46:59 PM
Eric
No need to apologise and absolutely no need to rush to a solution (if there is one). Sorry it took us so long to realise what the problem was.
Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 13, 2015, 03:48:12 PM
Sorry to bug you Tbailey2, but I'm just waiting for my validation key to arrive. Is there anything I need to do?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 13, 2015, 04:09:29 PM
Sorry to bug you Tbailey2, but I'm just waiting for my validation key to arrive. Is there anything I need to do?

It was sent at 15:04 and accepted by your mail server.... Please check your SPAM folder...

Edit: I've now sent you a copy....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 13, 2015, 06:37:51 PM
Thanks for that. I don't know what happened to it but I suppose it'll turn up eventually when Yahoo have had a good look at it :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 13, 2015, 09:08:29 PM
Incidentally, a quick check on the mail headers says that mydslwebstats.co.uk doesn't designate permitted senders, which I think means a lack of an SPF record which may lead Yahoo to bin it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 14, 2015, 08:03:59 AM
Aha, the original validation key email finally turned up after a 13 hour delay by Yahoo, presumably due to the lack of SPF record :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 14, 2015, 08:32:30 AM
Aha, the original validation key email finally turned up after a 13 hour delay by Yahoo, presumably due to the lack of SPF record :)

You seem to have received the original Registration mail immediately though as you validated quickly? There is no mail server on MyDSLWebStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 14, 2015, 08:42:46 AM
I received the one you resent to me after I posted above, and used that to upload from DSW32. The original automated one got delayed by 13 hours and arrived here at 4:00 am.

An SPF record is just a a TXT entry in your DNS and is supposed to cut down on Spam by allowing a site to say where it's own mail comes from. But a lot of people including me just have a default transitional entry:

The TXT records found for your domain are:
v=spf1 a mx ~all

I used this to query SPF records: http://www.kitterman.com/spf/validate.html
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 14, 2015, 09:48:45 AM
I received the one you resent to me after I posted above, and used that to upload from DSW32. The original automated one got delayed by 13 hours and arrived here at 4:00 am.

An SPF record is just a a TXT entry in your DNS and is supposed to cut down on Spam by allowing a site to say where it's own mail comes from. But a lot of people including me just have a default transitional entry:

The TXT records found for your domain are:
v=spf1 a mx ~all

I used this to query SPF records: http://www.kitterman.com/spf/validate.html (http://www.kitterman.com/spf/validate.html)

But you validated your e-mail via the link in the Registration server e-mail a few minutes after it was sent and it is that link that sends the second e-mail but not to worry. I haven't seen any problem from the other 27 Yahoo users we have, or else no one has reported it.

I have used that link as well but just had a look and it says there are no SPF or TXT records ...

Code: [Select]
SPF record lookup and validation for: mydslwebstats.co.uk
SPF records are published in DNS as TXT records.
The TXT records found for your domain are:

Checking to see if there is a valid SPF record.
No valid SPF record found of either type TXT or type SPF.

I just double checked at the Registrar. There is no TXT record although I had set one up at some point in the past but removed it in December when the server location was changed. The MX record is currently pointing at my own MyDSLWebStats mail account on another server, not the same one that the MyDSLWebStats server mail (via msmtp) is using unless that has something set... I'll check.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 14, 2015, 09:55:22 AM
Yes, it was the 2nd one that got delayed. I only mentioned the SPF record because of the odd delay - it may just be normal Yahoo :)
Anyway, it's all up and running well, so thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on April 14, 2015, 12:34:15 PM
Yahoo are pretty notorious for deferring mail as an antispam measure. It will come through eventually.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 14, 2015, 02:44:13 PM
Yahoo are pretty notorious for deferring mail as an antispam measure. It will come through eventually.

Well with some help from another forum user we've managed to get the appropriate DNS/SPF records added so that Yahoo! sees a fully validated sender and will not regard server generated mail as SPAM unless they are just being bloody awkward as you suggest  :mad:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 14, 2015, 03:48:57 PM
I suggest also to make sure is a valid DKIM, reverse dns, helo and smtp header.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on April 14, 2015, 04:15:37 PM
RE: Latency graph

My latency graph is missing in action...I have swapped from TBB to mousealike but to no avail.

I have also tried a CTRL-F5

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on April 16, 2015, 12:47:38 PM
Still got this problem on multiple devices......is everybody elses still showing OK?

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 16, 2015, 12:57:15 PM
Still got this problem on multiple devices......is everybody elses still showing OK?

Ian

They all look okay here inc yours from Firebrick.... No ideas currently I'm afraid

It helps if you quote your Username on MDWS please  ;)

NB all that it does is load the file on the link stored against your user name directly from TBB or wherever although I hope to change that soon....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on April 16, 2015, 01:59:08 PM
Looking at the img source I get

http://f8lure.mouselike.org/proxyfirebrick.asp?ID=55028?x=1429188722 (http://f8lure.mouselike.org/proxyfirebrick.asp?ID=55028?x=1429188722)

and when I paste that into a new browser window i get the error "File has expanded to fill drive."


Changed back (for the 4 th time) to the tbb graph and it is now working??? Strange.

Thanks again for your help.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 16, 2015, 03:49:57 PM
Weird. Sounds like the other end has run out of disk space or you have overrun a quota or :hmm: .....  It was okay here though at midnight or so.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 25, 2015, 07:55:30 PM
Hi tony has your line been hit by crosstalk as your DS SNRM as been dropping off over 20 days it's now down to 3.8dB  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 25, 2015, 09:15:31 PM
his snrm is bizarre , its on a downward slope as if there is something nearby gradually increasing interference, its a weird pattern for crosstalk.

by the way load my snrm graph for 30days, you see from around 5 april my upstream snrm now dips every afternoon.  It started when I moved my TV, which was moved further away from the modem not closer.  The only thing I can think off is the TV was shielding the modem from some upstream interference.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on April 25, 2015, 10:31:05 PM
by the way load my snrm graph for 30days, you see from around 5 april my upstream snrm now dips every afternoon. 

I am not confident to say thats down to your TV Chry as have noticed a few MDWS members US SNRM has fallen over the last 20 days by 0.5dB it could be down to atmospheric changes and the changes when the copper/ali cable expands as temperatures rise moving towards summer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 28, 2015, 10:08:28 AM
Hi tony has your line been hit by crosstalk as your DS SNRM as been dropping off over 20 days it's now down to 3.8dB  :-\

Sorry, been busy....

Yes, loads of crosstalk here in 14 months (~56/12 >> 32/4)

It apparently started that slow decline when I changed to the Zyxel on the 3rd April (which has been up ever since BTW). Also lost nearly 1 Mb of upstream in the process. Seems to have stabilised the drop a bit in the few days though with no changes made here.

I will change back to the old HG612/TG582n combo shortly (the router is new as the WiFi packed up on the old router, and the HG612 is also a new 3B with 08 firmware) to see what happens.. Might also try using the Zyxel as a router although it takes too long to get a new session for my liking.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kevinduke on May 01, 2015, 05:08:51 PM
Hi

I have a message on mydslwebstats saying that my emails are being bounced - please whitelist us.

Any ideas how to remove this message as mydslwebstats is whitelisted and I am receiving emails.

Thanks

Kevin
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 01, 2015, 05:57:19 PM
Hi

I have a message on mydslwebstats saying that my emails are being bounced - please whitelist us.

Any ideas how to remove this message as mydslwebstats is whitelisted and I am receiving emails.

Thanks

Kevin

Done. They were bouncing and that message is made manually. Thanks for letting us know.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 01, 2015, 06:01:57 PM
Donations

Just two to report over the past 6 weeks. They were:

AlexMUK
Starman

Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 05, 2015, 12:03:48 AM
Server Fault

There have been a number of intermittent sessions this evening and drop outs that took some hours to sort out but hopefully all is now up and running okay again as of midnight. Bed here I come ..... :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 06, 2015, 08:33:56 AM
Downtime

This is advance warning that early on Saturday morning, 9th May, the server will be down for possibly an hour or more while prepared changes are made offline to accommodate storage of G.INP data. Once restored, upload clients should reconnect without intervention but it might be worth checking you are still uploading.

There is also a web software upgrade to make Resyncs more accessible across the site plus a number of other changes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jeffers on May 07, 2015, 05:00:04 PM
Any issues with the site at the moment? Just getting a blank page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on May 07, 2015, 05:13:02 PM
Try http://mydslwebstats.co.uk/container.htm
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 07, 2015, 06:00:26 PM
Any issues with the site at the moment? Just getting a blank page.

Just had a look at the logs and hopefully fixed now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 07, 2015, 09:57:45 PM
I just got two emails from MyDSLWebStats to-day at 21:15 saying my G.INP has been disabled on my line an then another email saying G.INP has been enabled are you having issues tony ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 07, 2015, 11:22:54 PM
I just got two emails from MyDSLWebStats to-day at 21:15 saying my G.INP has been disabled on my line an then another email saying G.INP has been enabled are you having issues tony ?

I have to say though that those emails were sent to you two days ago on the 5th May..... Postman your end must have had a couple of days off  ;) Have a look in the headers and see what dates are there please.

Edit: I've checked the database entries for that time (15th at 21:15) and the row entry shows G.INP as NOT enabled - looks like a glitch, maybe the modem itself as other data is there and G.INP enabled before and after.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 09, 2015, 12:08:31 AM
Cheers Tony as that date coinsides with a auto firmware update on the HG612 it was not a manual update by me or reflashing the HG612, but the weird part is nothing changed regarding lastest firmware version only the date & time was modified in the change detection system on Ronski's GUI  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 09, 2015, 01:52:44 PM
NS. There is a problem in the detection system, I've seen it happen at work just haven't had the time to look into it. The tell tale sign is it shows as N/A, then the next entry shows the same firmware ID's as before the N/A.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 09, 2015, 07:42:45 PM
Thanks Ron that helps me relax as my mind was asking was it a update or was it not and then the dreaded thoughts of modem being compromised started to creep in.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 07:11:23 AM
MyDSLWebStats V 1.4.0 Update 17th May 2015

As well as a major update in itself, this also reflects some of the myriad of changes to MDWS that have taken place in the background since V1.3.0 was released. Please note that the Help system has NOT yet been updated as I simply haven't had the time to do it. You may need to hit F5 to get the complete updates if V1.4.0 is not already showing.

Introduction of G.INP data

G.INP works differently to non-G.INP and there's a whole new way of dealing with/avoiding errors via retransmission with much lower overhead.

Whilst this has now been somewhat upset by the decision by BT to suspend rollout, nevertheless it has taken an awful lot of time and effort by those who run the project (tbailey2, BaldEagle 1 and roseway) to sort out. At the moment, there are only two users uploading G.INP data (BaldEagle1 and roseway) and the correct versions of the upload programs for everyone else will be made available later at a date to be announced following some further trials after this upgrade.

In the meantime, you can view the 17 additional graphs that are available from the users who are uploading once you are running V1.4.0. The user names have 'G' after them in the dropdown list if this data is available. You will not see any G.INP options for users who are not uploading the data yet.

Note that if you view a G.INP specific graph for a user and then change to another user who doesn't have G.INP available, you'll see a message to that effect and need to hit Update when it will revert to the SNRM display.

Some notes:
The GINP indicator at the top left of the status bar above the graphs now reads either G.INP Active or G.INP Inactive where appropriate for that line (see this in the examples below).

G.INP Active means that it is currently implemented and running for that user and Inactive means it has been enabled at some point in the past but BT have disabled it currently.

In the data dropdown list, B0 and B1 are Bearer 0 and Bearer 1. Where both Bearers carry similar information (such as FEC/CRC) the old entries now have B0 ahead of them. G.INP specific entries have G- ahead of them.

When you start uploading data that includes the G.INP data and this is detected by MDWS, there may be a delay initially in uploading and display while some database changes are made in the background for your data. There will not be any G.INP data available prior to that time for an enabled user.

It's complicated yes - and what the new data means is a separate subject not attempted here.

Display of Resync data
You can now see Resync data for a user in several additional places. The Control Panel at left has a new dropdown list near the bottom for time-based graphs that lists all Resyncs for that user - this is the same data as is available from the Resync/LOS view. When dropped down, today's entries are in red and hovering over the entry will display (in most browsers) the same data that the Resync/LOS panel shows. This list auto updates in the background every 5 minutes.

Also, for date spans of 2 days or less, the Resyncs are now shown on the SNRM graph only. They take the form of blue spikes rising up to 3dB for each Resync. This is selectable via a check box in the Control Panel - note that this does not currently survive changes to selections other than changing to another user. And while in this mode, Zoom is not functional. The hover help by the Resync option has some more info (shown below).

Examples for the above facilities:
(http://www.mydslwebstats.co.uk/images/mdws-resync-snrm-data-2.jpg)

(http://www.mydslwebstats.co.uk/images/mdws-resync-snrm-data.jpg)

(http://www.mydslwebstats.co.uk/images/mdws-resync-ginp-data2.jpg)

Data Retention/Costs/Donations

With increasing numbers of users, the amount of data being stored has necessitated more RAM being added to the server, and with very few donations lately, means funds have come out of my own pocket.

It now looks as though even more is going to be required shortly (basically to keep all the database tables in memory and avoid disk swapping) - plus offline storage costs for critical data. In the meantime, the amount of older stored data is already being reduced somewhat.

That and other costs (such as the failure of an SSD and changing to mirrored spinning disks) means that MyDSLWebStats might be moving to requiring a donation to build a fund for upgrades etc.

The alternative is this request that we need more voluntary donations please that might cover costs overall. There have only been two donations in the past four weeks so far at less than 10% of costs incurred.

The link for donations is at the top left of the main page. It helps a lot if you mention your username in the form 'user:myusername' as a message when donating. Thanks.

Other changes:

a) Database profiled and optimised several times to take average response times (the overall time taken to deliver the data from time of the request to the user to process for the majority of queries) down to 200ms or less. The baseline query is that for 24 hour SNRM. It can be as low as 70ms but the processor is only running currently at 40% of max speed for economy.

Some queries will take longer by varying degrees depending on where the data has to be fetched from.

b) Overseas users had incorrect start times to most graphs.

c) Addition of some stats at the top of the page to show how busy the server is.

d) The All User Stats entry has been moved to the BOTTOM of the list from the top.

e) Upload data is now available for all users on a rolling 12 month maximum basis. Data prior to this should be available to you locally from your upload program if you have kept it. Users who have not uploaded anything in the past three months will have all their previously uploaded data deleted although the account will remain. This is to reduce the data retention load for data that may well never be used again.

f) The upload program and version are shown at the bottom right of each graph for each user.

g) There is an additional option Mini Stats located next to the Options link near the bottom of the main window. This displays a mini version of the stats summary for the logged in user shown above graphs but in a standalone window located at the top left of your screen by default but it can be moved.

h) And lots of other little updates I've forgotten by now but which have no significant effect on running of the program

Enjoy!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 17, 2015, 08:36:56 AM
Great work Tony, would it be worth putting your Plusnet referral link on the site, that way if anybody does sign up to Plusnet by it at least  you will get  the on going commission.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on May 17, 2015, 10:26:55 AM
Great work all. Happy to help with any further trials if you need a guinea pig. I'm on the 8800NL.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on May 17, 2015, 12:34:04 PM
g) And lots of other little updates I've forgotten by now....

And this is why changelogs exist  :P (I've been here a lot, I have the memory of a hypothetical goldfish :-X)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 01:12:28 PM
Great work Tony, would it be worth putting your Plusnet referral link on the site, that way if anybody does sign up to Plusnet by it at least  you will get  the on going commission.

Oh errr... it already is I thought since it started up.

Seems though it's only enabled on the Index/Home page   :-X

Will fix shortly. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 01:28:02 PM
Also now fixed (hopefully) is a positioning problem with the graphs and extra info in the Control Box forcing the buttons out of sight (for IE, FF and Chrome/Opera but Safari [Last Win version] won't play).

One of the G.INP graphs has been renamed to G-LEFTRS at the request of BE1 who says:

I THINK that 'L' means near side, 'EFTR' means Error Free Throughput Rate, 'S' means Seconds & the data is only non-zero whenever there has been some sort of near side 'interference'?
That's good - can we have meanings for the other 16 now please  ???

F5 will get it fully implemented.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on May 17, 2015, 02:37:04 PM
One of the G.INP graphs has been renamed to G-LEFTRS at the request of BE1 who says:

I THINK that 'L' means near side, 'EFTR' means Error Free Throughput Rate, 'S' means Seconds & the data is only non-zero whenever there has been some sort of near side 'interference'?

L for local, the converse of remote, maybe?  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on May 17, 2015, 02:48:46 PM
One of the G.INP graphs has been renamed to G-LEFTRS at the request of BE1 who says:


Just noticed; the graph title could do with changing too.


Quote
I THINK that 'L' means near side, 'EFTR' means Error Free Throughput Rate, 'S' means Seconds & the data is only non-zero whenever there has been some sort of near side 'interference'?
That's good - can we have meanings for the other 16 now please  ???



I think your naming convention describes them sufficiently, apart from maybe MinEFTR.
Presumably that's Minimum (E)rror (F)ree (T)hroughput (R)ate?

I'm not too sure about 'lookback' though.
I have assumed that is related to the size of the buffer needed to store errors that require retransmission (rtx_tx) before they can be corrected (rtx_c) or left uncorrected (rtx_uc).


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 17, 2015, 04:12:25 PM
Just noticed; the graph title could do with changing too.

Done
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on May 22, 2015, 09:13:46 AM
Tony

Has something changed; multi day seems to be not working
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 22, 2015, 10:41:34 AM
Tony

Has something changed; multi day seems to be not working
Seems okay now. The process that controls the daily update didn't fire off when it should at 00:30 but runs again at 09:30 just in case. It checks for missing days...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 23, 2015, 11:45:18 AM
Downtime

Note that the MyDSLWebStats server will be down for a while early tomorrow morning (Sunday 24th May) for some  maintenance, OS updates etc. Your uploads should resume automatically afterwards but it might be worthwhile checking your upload client just to make sure.

I'll post here again once it's running okay.

Edit: Okay back up again now as of 08:20. Thanks for waiting if you did  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 24, 2015, 10:33:06 AM
Thanks Tony, it behaved in the expected way.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 24, 2015, 11:29:11 AM
Thanks. Same here on another machine  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 28, 2015, 09:21:35 PM
Noticed a lag on MDWS i just thought is was down to new ISP and the removal of G.INP, MDWS used be very snappy just under 1 second to see stats but it can take upto 6 seconds to show stats now, have done a ping to MDWS and the average is showing up as 46ms and the BBC site as 29ms.

EDIT: Had to edit post as old Fantom posts are showing as new posts and then disappearing
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 29, 2015, 12:08:53 AM
Can't see any thing adrift from this end, delivery out to you in around 200ms and ping into server looks normal for the time of day. Base is 18ms.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 29, 2015, 11:47:40 AM
Can't see any thing adrift from this end, delivery out to you in around 200ms and ping into server looks normal for the time of day. Base is 18ms.

thanks for feedback it has to been something at end and all that has changed is different ISP and router plus g.inp removed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 29, 2015, 01:07:22 PM
If your browser tells you what it's currently loading in the status bar, see if it says 'Waiting for canv.googlecode.com...". That's the usual suspect at my end when it's slow. Unfortunately Google won't let you run it locally. DNS maybe, try something else?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 29, 2015, 10:26:20 PM
Cheers Tony have set the router to use google DNS, the Chrome status bar shows nothing apart from the rotating arrows on the top left hand corner when its awaiting information.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 31, 2015, 07:06:15 AM
DOWNTIME NOTICE - RESTART UPLOAD CLIENTS

During a server reconfiguration earlier this morning, there were a few problems and it threw off users online at the time  - you may find the site showing a 500 Server error. Hitting F5 will bring things back. Still working on the changes, some of which are fixed, but there are a couple of other things to sort out today that may cause interruptions.

It's also stopped clients uploading (possibly only HG 612 Modem Stats users?) as well so everyone needs to check their client is uploading please and restart if necessary  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 31, 2015, 07:41:49 AM
DSLstats stopped uploading as well, but recovered when MDWS came back online.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 31, 2015, 08:11:34 AM
Thanks Eric.

Mine had got stuck with Unable to login to modem/router (5.5) and had to unload and restart to get it going. However, I had pulled the Ethernet from the Zyxel o/p for a while during the sort out which won't have helped  :-X I think there are around 10-15 users not uploading currently.

Can't do much more now as other duties call...

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on May 31, 2015, 09:03:00 AM
Assuming the issue occurred at around 06:52 this morning, these appear to be the currently affected HG612 Modem Stats users:-

thermionic
ayeaye
craigv
kraven
crowroad
jizzerman
pooclah
abailey
Jasonkruys
Krazeh


I was also affected.

The symptom seems to have been that the Upload.exe program was unable to cope with some 'unusual' / unexpected messages returned from the MDWS server & ended up 'stuck'.

This in turn caused HG612_stats.exe to end up 'stuck'


ending the process in Task Manager for Upload.exe got everything running again here, but it's possible that HG612_stats.exe may also need to have its process ended.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on May 31, 2015, 04:24:17 PM
  At times, this week included I get hit by odd SES and it would be nice if they could be logged on MyDSLwebStats.

  Perhaps at low priority you could consider possibility of this -- I am assuming the SES are uploaded.

  Maybe they could be added to the ES graph in extra colours such as black downstream and blue upstream.  This should work if zero SES is not plotted and SES take priority in over writing the green and red.  I guess most would wish to see SES if they occur and most who don't get SES won't see any change.  Since SES are not that common the results should also never be too cluttered.

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on June 01, 2015, 05:39:55 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 01, 2015, 06:34:22 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian

Yes  :hmm:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 01, 2015, 06:45:01 PM
  At times, this week included I get hit by odd SES and it would be nice if they could be logged on MyDSLwebStats

Unfortunately, the data needed to plot it isn't uploaded currently in a form that can be used directly as with the other graphs. The SES data is there but would need a lot of real time calculations to get it to graph and I just don''t have the time available for some months yet to possibly have a look at it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on June 01, 2015, 09:53:31 PM
   Thanks for the response.  I do understand and am very grateful for the work that has already gone into MyDslWebStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 01, 2015, 10:24:18 PM
Hi tbailey as we have down Tot /24Hr ES graph would there be a way to see the up Tot /24Hr ES graph  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: holmbase on June 05, 2015, 02:05:06 PM
Hi. I hope no one else has reported this and I've missed it.

Since v1.4 of MDWS I seem to have gaps in my charts on an intermittent basis. I'm using DSLstats v5.5 running on Linux Mint 13.1. The gaps do not appear on the charts in DSLstats only on MDWS. My username on MDWS is hypericum. I am assuming it is something linked to v1.4 however - I upgraded from 5.4 to 5.5 of DSLstats at the same time (unknowingly) so I don't know if it is related to that rather than MDWS.

It's not a major deal and after it first happened it did settle down and become less and less frequent to the point of almost disappearing. I had to reboot my computer today and now the gaps have started again.

Anyway, I just wanted to point it out in case it's something simple to resolve.

Thanks

John

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 05, 2015, 04:00:05 PM
Are there any corresponding entries in the DSLstats event log?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on June 05, 2015, 08:19:08 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian

Yes  :hmm:
I presume you can see it is currently pointing to http://www.mydslwebstats.co.uk/Container.htm#][url]http://www.mydslwebstats.co.uk/Container.htm# (http://[url)[/url]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 05, 2015, 10:22:51 PM
Tony....Should the mini stats link point to http://www.mydslwebstats.co.uk/mdwssuu.htm (http://www.mydslwebstats.co.uk/mdwssuu.htm) ??

Ian

Yes  :hmm:
I presume you can see it is currently pointing to http://www.mydslwebstats.co.uk/Container.htm#]http://www.mydslwebstats.co.uk/Container.htm#]http://www.mydslwebstats.co.uk/Container.htm# (http://[url=http://www.mydslwebstats.co.uk/Container.htm#)

No I can't see that I have to say... it's definitely coded to the correct link and works okay here and from a remote terminal I have access to.

.... hang on

Are you referring to what happens when you hover over the link and the URL that comes up at the bottom of the browser window? If so then that's correct, you'll see what you refer to but I assume the link is actually working correctly for you though as you quoted the destination URL in the first post.

The reason it shows the link it does is because the destination URL is loaded via Javascript and you can't see that. The hash stops the calling page reloading while letting the JS execute.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: holmbase on June 06, 2015, 04:20:49 PM
Are there any corresponding entries in the DSLstats event log?
Eric

Nothing in the log window other than snapshots taken. However, I stopped, quit and restarted DSLstats and everything now seems good. Not sure why but problem solved.

Memo to self for next time.

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 09, 2015, 08:07:51 AM
Good to see I can now sort the All User data into descending G.INP so I can see all the G.INP enabled users together. Thanks ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on June 09, 2015, 04:02:42 PM
Is MDWS down?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 09, 2015, 04:36:49 PM
Not now, but it looks as though it was down for some hours this afternoon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 09, 2015, 11:09:03 PM
Not now, but it looks as though it was down for some hours this afternoon.

I've been out all day and just seen it. Looks like the modem has thrown a wobbly as the TBB monitor is showing 92% packet loss since it went down at 13:45 or so originally. It's resynched twice since then after 54 days up for some reason (LOS)  :'(

Although everything looks okay on the server, I am going to switch it off the Zyxel for 30 mins in a moment and see if that cures it so please bear with me ...

Edit:
So it's now 06:30 and no change after the modem restart. All seems to be working okay for the server in/out - Ookla shows normal 18ms latency, sync and attainable are slightly up on normal so not sure what the problem is. Recent TBB graph attached  :o , the 'normal' part is normal and the peak was a big upload Other users TBB graphs look okay

As I wasn't around when it first happened, obviously I haven't changed anything. Maybe reflash with latest 10C0 firmware when I get a chance... Or go back to HG612 if necessary.

Ideas welcomed please...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 10, 2015, 06:56:31 AM
People's experiences with Zyxel seem to vary widely. I stopped using the VMG8324-B10A because it lost ethernet connectivity after a couple of days of operation. I don't know if something like that could explain your problem yesterday. Personally I would be inclined to replace it with an HG612 and a very good router.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 10, 2015, 07:01:07 AM
Thanks Eric.

That's my preference as well. It had been up around 54 days with no problems though which is the odd thing. I'll maybe go back to the original HG612 and a new TG582n I have spare as that at least worked for over a year. Also see if the loss of 1MB upload on the change was the Zyxel or not.

There may be a Zyxel VMG8324-B10A for sale soon if anyone wants one  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on June 10, 2015, 05:15:43 PM
I am planning to sell mine alongside a spare hg612 (whilst demand is high due to g.inp issues), I decided I want an ac68 asus router, but am now discipling myself in spending so will fund it from sale of old stuff.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on June 10, 2015, 07:16:10 PM
Quote
hover over the link and the URL that comes up at the bottom of the browser window?

Yes...I'm sure the "tool tip" did point to mdwssuu.htm; but i can't seem to reproduce it now (and there was something weird when I actually clicked on it).

All seems okay now though....thanks again.
Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 11, 2015, 10:19:09 AM
SERVICE RESTORED at 09:00

Off since 07:00 to try and sort out the problem with the Zyxel but couldn't. So now back on HG612/TG582N (both new out the sealed boxes) plus various server software updates and some rewiring etc.

All is running okay, have a bit of upstream back and downstream much as it was. Ping has now returned to normal at last.
You might want to check your upload client has reconnected although the monitor here looks okay.

Thanks for bearing with me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 11, 2015, 10:21:51 AM
It looks good now. Thanks for your efforts.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on June 11, 2015, 03:10:41 PM
didnt notice any outage :) I had an outage myself anyway.  Had to use 4g this morning as soft bricked router.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 11, 2015, 10:21:01 PM
Off since 07:00 to try and sort out the problem with the Zyxel but couldn't. So now back on HG612/TG582N (both new out the sealed boxes) plus various server software updates and some rewiring etc.

My findings seem to like the new setup as MDWS is a tad faster on my end and don't bin your Zyxel as i am still searching for an all in one unit that has the xDSLcmd built in name your price  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 13, 2015, 08:36:02 AM
Someone thinks their ECI modem is working with DSLStats and MDWS  :no:

https://community.bt.com/t5/BT-Infinity-Speed-Connection/VDSL-stats-and-interleaving-depth-Possible-fast-path/m-p/1494233#M180829
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 13, 2015, 08:57:04 AM
Someone thinks their ECI modem is working with DSLStats and MDWS  :no:

https://community.bt.com/t5/BT-Infinity-Speed-Connection/VDSL-stats-and-interleaving-depth-Possible-fast-path/m-p/1494233#M180829 (https://community.bt.com/t5/BT-Infinity-Speed-Connection/VDSL-stats-and-interleaving-depth-Possible-fast-path/m-p/1494233#M180829)

He's looking at my line - notice it says Guest :D (so he's not registered or uploading [I assume] and it's an HG612 anyway) and that's whose data it is he's posted.

Seems to have assumed that plugging in his modem automatically uploads to MDWS by some miracle of modern technology... I'm working on that but haven't got my head round it yet  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 13, 2015, 10:01:22 AM
Miracles we do immediately; the impossible takes a little longer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 13, 2015, 05:22:43 PM
Miracles we do immediately; the impossible takes a little longer.

He seems to have realised that that they are not his stats but not why....

Quote
Just realised these stats may not be true. I didn't have to upload anything on that website though, just opened it and the stats appeared. After resync, it still shows 705 depth of interleaving and 8 delay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on June 14, 2015, 12:02:07 PM
Miracles we do immediately; the impossible takes a little longer.
Have you not done it yet Tony - you're slacking man  :whip:

 :lol: :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 14, 2015, 04:05:12 PM
Well I'm sorry to say that even though I do have an award sitting on the shelf here from BT for Innovation in software design, this one still escapes me I'm afraid, must be getting past it  :silly:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on June 14, 2015, 10:10:10 PM
sigh - I'm most disappointed.  Youve really let the side down.  ::)


---
On a more serious note - keep up the good work tony..  at least the possibility of the impossible was a bit of light relief for you ;D

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 17, 2015, 07:37:35 AM
He's still monitoring your stats  :-X

https://community.bt.com/t5/BT-Infinity-Speed-Connection/Interleaved-or-fastpath/m-p/1495796/highlight/true#M181206
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 07:56:19 AM
He's still monitoring your stats  :-X

https://community.bt.com/t5/BT-Infinity-Speed-Connection/Interleaved-or-fastpath/m-p/1495796/highlight/true#M181206 (https://community.bt.com/t5/BT-Infinity-Speed-Connection/Interleaved-or-fastpath/m-p/1495796/highlight/true#M181206)

So am I as he mentions!  Maybe I ought to post on there, think I have a login somewhere.

At about 19:08 last night my VDSL2 line downstream SNRM suddenly shot up from ca 6dB to 11dB+ for no apparent reason, no resync.   Upstream is about 0.5dB better. I thought at first this was a local power outage to the South as this is typical of what happens but appears not as it's still there 12 hours later and UK Power Networks have no cuts recorded.

My achievable is now at least 10Mb higher. It's almost back to where it was a year ago and closer to the max I had when first on the cab of 57Mb.  I don't think it's a disturber gone on  hols as the most I ever lost was 1.5dB in one go through a new one. I'll leave it for now to see if DLM pokes its nose in.

I guess Newt will advise a resync to get the extra d/l but won't be good news if it's temporary and then goes away.....

Ideas??

It's an ECI cab BTW....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 17, 2015, 07:58:08 AM
Vectoring has been turned on?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 09:09:15 AM
I didn't like to suggest that  :-X but it is an ECI cab and if that is the reason  :drunk:

Somehow I doubt it but you never know... I'll ask friend across the road if anything has happened to his line.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on June 17, 2015, 09:10:51 AM
I think a resync may help ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on June 17, 2015, 01:53:41 PM
I think a resync may help ;)

Same here resync will help your speeds greatly :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 04:28:15 PM
Thanks for the comments and it's still there... I'll do a resync late tonight as it takes MDWS off the air of course so inconvenience fewer people.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 17, 2015, 05:28:05 PM

I guess Newt will advise a resync to get the extra d/l but won't be good news if it's temporary and then goes away.....

Ideas??


It's your crosstalk disturber they have turned off their modem and maybe went off on hols, it never last's to long 4 days max if your lucky.

It's not worth rebooting your FTTC modem as what you gain will be taken away from you when the disturber modem comes back on again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 17, 2015, 05:38:04 PM
As I said at the start, the biggest single drop from the five disturbers I've seen in the past year is 1.5dB so I doubt they all unplugged at once, have to wait and see. It was my initial guess as well though and I did say it would be bad news if it came back to where it was and I had rebooted....

What it won't take away though is the improvement from ditching the Zyxel....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 17, 2015, 05:46:45 PM
As I said at the start, the biggest single drop from the five disturbers I've seen in the past year is 1.5dB so I doubt they all unplugged at once, have to wait and see. It was my initial guess as well though and I did say it would be bad news if it came back to where it was and I had rebooted....

I just what you to know in April we had wide spread power outage in April and my disturber took five days to come and hit me.

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 19, 2015, 09:15:51 AM
Well the SNRM went back down to 'normal' last night before I got round to resyncing so whatever it was has been switched on again as newt suggested. If it's a disturber then I can only think it has to be one that was present before I started keeping stats in May 2014 as no individual disturber has affected me by anywhere near ~6dB in one go. I think I was third on the cab at the time in February 2014 and at least one of the others is close to me.

The gradual loss of SNRM on reboot and loss of physical download/upload speed that was occurring with the Zyxel VMG8324 has now gone since ditching it and the line is stable and back up to speed again again since switching back to the HG612/TG582n combo on 11th June.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 19, 2015, 11:51:16 AM
DONATIONS

Thanks to those who donated in the six weeks since the 2nd May to support the site (some have donated multiple times) and they are listed below  :clap: :

AlexMUK
derekh
ip75
lf2k
longstaff
pooclah
valleysboy
vic0239

COSTS OF RUNNING THE SERVICE AND DONATIONS
As intimated a month ago, the physical costs of running/maintaining and upgrading the server are still not in any way reduced/countered by donations. So if the donations do not pick up quickly, the site will move to requesting a small one-off minimum donation and to restrict access to older data (back by a fixed number of days) to those users who have not donated. Basic access will otherwise remain free to Registered users. The code to achieve this is already in place but not yet implemented. 

Also, as of today, those Registered Users who have supported the site from its inception last year, either by monetary donation or through other support such as being admins, providing facilities, helping with publicity, assisting with testing and so on, will have recognition as MDWS Supporters by having their user names highlighted in green in the two lists of currently active users that appear at the bottom of the main page. This is something I've done in the past on other sites I've worked on that were supported by donations, notably Jag-lovers.  Might also have a separate list of donee usernames (only) available as there are a couple of donees who don't use the site much.

The process of recognising users who subsequently donate via PayPal is automated providing you either donate from the same e-mail you are Registered with or your registered name is uniquely identifiable or you add (in the PayPal comments/message facility) your user name in the form:

username:myusername

so it can be picked up (checked every 5 mins). Otherwise you'll have to wait until it can be processed manually.

Thanks for your support. There are currently 334 Registered Users.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on June 19, 2015, 01:53:33 PM
The process of recognising users who subsequently donate via PayPal is automated providing you either donate from the same e-mail you are Registered with or your registered name is uniquely identifiable or you add (in the PayPal comments/message facility) your user name in the form.

Is it possible to donate using alternative methods e.g. BTC?

Can you update your MDWS username and email address somehow?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 20, 2015, 07:57:47 AM
Is it possible to donate using alternative methods e.g. BTC?

Not currently, or ever likely,  I'm afraid.

PayPal is one of the few methods of payment that doesn't involve a merchant account at additional cost. Many people don't realise that anyone with a supported credit/debit card can use PayPal in exactly the same way as any online card processor, there is no need to register with them, just use the supplied link and then under Pay with Credit Card or Log In at the left, fill in the details in the usual way.

Can you update your MDWS username and email address somehow?

Not your user name I'm afraid. E-mail address you should be able to but there was a problem with the functionality and I haven't got round to fixing it yet. I'll try to get to it in between more urgent things. Or PM me any change and I'll do it for you and that applies to anyone.

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 20, 2015, 09:58:42 AM
CHANGE YOUR E-MAIL

This is now possible via the Options link near the bottom of the main page. Please check to make sure you receive the confirmation mail that will be sent to the new address else we cannot contact you.

This has proved a problem with several users who have been uploading invalid data for several months but have invalid e-mails and never logon to see console messages for them. No option but to suspend the accounts and eventually delete them.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on June 21, 2015, 02:26:24 PM
  It is not very significant and I have probably missed something, but I just wondered why the upstream FEC that occur on FTTC "fast" path don't show on MyDSLWebStats. 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 21, 2015, 03:07:46 PM
I've got an upstream interleave depth of 1, and small numbers of upstream FECs do show on my MDWS graph.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on June 21, 2015, 04:20:24 PM
  @roseway I see them on dslstats but nothing on MyDSLWebStats. I think you had zero on MyDSLWebStats prior to G.INP, I am on an ECI.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 22, 2015, 09:21:59 AM
Having been messing with Firefox for a while now I am logged out of this, however in order to login I need to remember my memorable phrase. Well as you can imagine it is not memorable enough and therefore I cannot login. Why do we need this extra level? Why is a password not good enough together with the question to try to eliminate auto logins?

So how do I recover my memorable phrase?

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 22, 2015, 09:27:36 AM
Having been messing with Firefox for a while now I am logged out of this, however in order to login I need to remember my memorable phrase. Well as you can imagine it is not memorable enough and therefore I cannot login. Why do we need this extra level? Why is a password not good enough together with the question to try to eliminate auto logins?

So how do I recover my memorable phrase?

Stuart

Resetting your password via the Log On page will also give the phrase to you...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 22, 2015, 09:35:38 AM
Fortunately the memorable phrase is in the sign up email so I have not had to change my password!

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 22, 2015, 04:04:58 PM
NEW! AUTOMATIC DLM CALCULATOR

Many of you will have seen or noticed discussions about the Kitz DLM Calculator where you put in your ES and Retrain counts and it tells you how good or lousy your line is from the DLM's perspective. The data is used by the BT DLM system to categorise your line...

This is now available via MyDSLWebStats and has a dedicated thread (http://forum.kitz.co.uk/index.php/topic,15623.msg290968.html#msg290968) for questions as well as a description of how it works

(http://www.mydslwebstats.co.uk/images/mdws-dlm-display-ex2.jpg)

Edit:
Since first posted, there is now another set of Traffic Lights! These are in the center of the group and are for MTBE UPSTREAM error seconds. The original at left now reads DOWNSTREAM. Criteria are the same for both directions.

(http://www.mydslwebstats.co.uk/images/mdws-dlm-display-ex5.jpg)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 04, 2015, 02:38:11 PM
Trouble with the recording of error seconds on my adsl connection again.

Ian

Update: 18:30  now fixed  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 04, 2015, 08:07:26 PM
Trouble with the recording of error seconds on my adsl connection again.
Update: 18:30  now fixed  ;D

There was a database table error around that time that had to be repaired so that was likely the problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: iMx on July 06, 2015, 09:23:23 AM
Good Morning,

I'm using a poor mans bonded FTTC setup (L2 VPNs over each FTTC line, bonded, to a box in the DC) - sadly it looks like the IPs from the dedicated hosting provider are blocked on your site.

The IP(s) I use are dedicated, is it possible to get an allow set up?  Happy to make a £30 donation for your time/service, but right now I can only access the site if I enable another VPN or drop the FTTC bond.

Thanks,

Ed

UPDATE: Oh, trying again this morning it seems your ACLs may have been refreshed since I tried last week - I seem to be able to access the site now?  Donation on its way as promised.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 10:09:31 AM
Good Morning,

I'm using a poor mans bonded FTTC setup (L2 VPNs over each FTTC line, bonded, to a box in the DC) - sadly it looks like the IPs from the dedicated hosting provider are blocked on your site.

The IP(s) I use are dedicated, is it possible to get an allow set up?  Happy to make a £30 donation for your time/service, but right now I can only access the site if I enable another VPN or drop the FTTC bond.

Thanks,

Ed

UPDATE: Oh, trying again this morning it seems your ACLs may have been refreshed since I tried last week - I seem to be able to access the site now?  Donation on its way as promised.
Hi and many thanks for the generous donation  ;D

Yes, I spotted it on the console monitor and removed the block...

I use Connectify Dispatch to software bond both the main VDSL2 and backup ADSL2+ lines here and works well using two NICs on my proxy server. Gives me another 9Meg download on top of the normal 33Meg (for the apps specified that can safely use it and don't need a fixed IP which the VDSL2 is)....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: iMx on July 06, 2015, 10:15:47 AM
Many thanks - I seem to have some problems with dslstats, giving the 'No data returned in the latest sample' error - left it running for 10 minutes or more.  This is using a TG589V3 in bridge mode (routing/NAT-ing setup so modems are accessible via telnet), can telnet from the Windows box hosting it just not from dslstats it seems.  Disabled firewalls etc in Windows.

Not really a Windows person, but will dig some more later and see if I can get things going - if not post in a more appropriate place.

EDIT: Just found a post that mentions about not supporting VDSL2 on this modem at the moment, will give MDWS a whirl if/when I decide to return to an HG612, although the TG589 does seem to give me a better sync rate on my lines.  Will probably just knock up a munin script for now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on July 06, 2015, 10:29:35 AM
Quote
EDIT: Just found a post that mentions about not supporting VDSL2 on this modem at the moment

The DSLstats pre-release version v5.5.4 adds VDSL2 support to the TG589vnV3, and also adds MDWS upload capability for Thomson/Technicolor modems. As with all Thomson/Technicolor modems, the support is limited by what data is available through its custom CLI.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 10:39:55 AM
Thanks Eric, you beat me to it....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 06, 2015, 10:57:44 AM
Ah, so your Avatar is Mike Hawthorn, not you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 11:27:26 AM
Ah, so your Avatar is Mike Hawthorn, not you :)

Er yes  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: iMx on July 06, 2015, 12:14:53 PM
Quote
EDIT: Just found a post that mentions about not supporting VDSL2 on this modem at the moment

The DSLstats pre-release version v5.5.4 adds VDSL2 support to the TG589vnV3, and also adds MDWS upload capability for Thomson/Technicolor modems. As with all Thomson/Technicolor modems, the support is limited by what data is available through its custom CLI.

Hi there,

Thanks for the reply, I also tried 5.5.4 and got the same problem - basic settings, default IP/username etc, technicolor box ticked.  Have knocked up a munin script for now, as I have 2 lines I want to monitor (although I appreciate this is probably not overly common).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 06, 2015, 12:43:23 PM
The DSLstats pre-release version v5.5.4 adds VDSL2 support to the TG589vnV3, and also adds MDWS upload capability for Thomson/Technicolor modems. As with all Thomson/Technicolor modems, the support is limited by what data is available through its custom CLI.

NB I'm happily running 5.5.4 and MDWS with a TG582n although as Eric says, there is very limited data available...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 06, 2015, 10:30:12 PM
Is everyone's pop ups working on resynch data?

Mine seems to have stopped (Chrome on ChromeOS and Chrome on Windows)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 07, 2015, 09:37:04 AM
Is everyone's pop ups working on resynch data?
Mine seems to have stopped (Chrome on ChromeOS and Chrome on Windows)

I've got a feeling that didn't work originally under any Chrome based Windows browsers (Chrome/Safari/Opera) hence the statement 'most browsers will display a tooltip' that shows as a tooltip in Chrome (here anyway) when you hover over the adjacent Info icon.

Had a look around and the tooltips (they are not PopUps) are okay on IE11 and latest FireFox under Win 7 and 8.1 - the code is identical for all browsers and hasn't changed since introduced...

Edit
This has in fact been reported as a bug in the latest versions of Chrome from May 22nd. It appears an earlier fix didn't. If really interested you can wade though this lot:

https://code.google.com/p/chromium/issues/detail?id=491223

Last entry on July 1st is:

Still a problem with 43.0.23157.130 m. I really hope this gets fixed soon, we have customers who rely on these tooltips for configuration of the products we sell. Anybody heard of any workarounds for this until it's fixed??

It has happened before and may have been a problem when I set it up originally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 07, 2015, 09:40:43 PM
Tony
Thanks for the info, the tooltips were working some time ago....never mind the devs may fix it sometime.
Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 10, 2015, 10:16:20 AM
SERVER DOWNTIME

The MDWS server will be down with no web access at all early on Sunday morning 12th July while some database maintenance along with a few other jobs take place. Expected to take up to an hour or more. It's been up currently for 29 days.

I'll post again once it's online.

As always, you need to check your upload client has reconnected okay afterwards. While restarting you may receive duplicate upload error mails and these can be ignored.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on July 10, 2015, 12:44:26 PM
Do you keep track of users IP addresses in MDWS?

Are there any plans to add more graphs and dlm monitor to the mobile interface?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 10, 2015, 04:59:34 PM
The IP Address is available if needed as it's returned and logged to the server with every access to the site both by upload and the GUI as happens with all web sites... 

Haven't looked at the Mobile Interface since it was written but a Traffic Light set would be a possibility. I do use it regularly myself though when out and about.

At the moment I'm trying to finish off V2.0 of the MDWS Web UI which revamps the layout completely to make more use of available space with different sized and wider graphs available plus a number of other new features and options. The current interface will still be available as an option though.

NB: you can see your current Web GUI IP Address at the top of the Options facility.

And it's a year since the first users started testing the MDWS system concept.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 10, 2015, 06:00:59 PM
Happy Birthday MDWS  :congrats:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 12, 2015, 08:46:26 AM
MDWS SERVER RUNNING AGAIN

Back up at 07:55. I think all clients have reconnected but worth checking.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2015, 09:13:20 AM
just checked wow still no g.inp for newt.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 12, 2015, 10:43:54 AM
just checked wow still no g.inp for newt.

I think he needs to visit his Cab and make offerings of some sort to appease the all powerful deity that resides in it  :cool: Pref do it when there is no one about though  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 12, 2015, 12:26:36 PM
I'll give it thump like we did on old valve tele's  ::)

Those DLM indicators are very handy it has given me a better understanding why my line never got moved onto the so called fastpath it's allways hovering between Green and Amber.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jaggies on July 12, 2015, 01:42:52 PM
I don't know if it's just my ageing eyes, or if I am misunderstanding the purpose of the traffic light icons, but they all appear to be the same colour to me...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on July 12, 2015, 01:45:23 PM
I don't know if it's just my ageing eyes, or if I am misunderstanding the purpose of the traffic light icons, but they all appear to be the same colour to me...

they are for you, which means your line is near enough to perfect.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2015, 04:42:42 PM
what threshold is used for amber on stable?

I think ideally the threshold's used should display in the tooltip or on a help page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 12, 2015, 04:47:25 PM
what threshold is used for amber on stable?

I think ideally the threshold's thresholds used should display in the tooltip or on a help page.

Look back  - I posted the figures for Newt, might be another thread though. The Mk2 interface will give more detail. That's when I get time to finish it.

Here you go:
mtbe-vdsl-speed-red <= 30
mtbe-vdsl-speed-amber > 30 <= 299
mtbe-vdsl-speed-green >= 300

mtbe-vdsl-standard-red <= 60
mtbe-vdsl-standard-amber > 60 <= 599
mtbe-vdsl-standard-green >= 600

mtbe-vdsl-stable-red <= 120
mtbe-vdsl-stable-amber > 120  <= 1199
mtbe-vdsl-stable-green >= 1200

That's time between errors in seconds over a day (86400s). To get the Errored Secs count, divide 86400 by the MTBE figure above and vice versa. Amber = no action  AFAIAA

I think that's correct. The Chablis is having an effect  :'(

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2015, 05:03:43 PM
ok thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 12, 2015, 06:25:17 PM
Amber = no action  AFAIAA

Thats correct but it also means the users line will not get a DLM retrain for example moved to a lower interleave depth your line will need full greens for this to happen.

@Chry the location of info you need is http://forum.kitz.co.uk/index.php/topic,15623.15.html (http://forum.kitz.co.uk/index.php/topic,15623.15.html)
Reply 19
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 13, 2015, 04:48:03 AM
I would assume then amber for stable is 360 and green is 180?

curious why I have amber with under 180 ES.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2015, 06:08:32 AM
I would assume then amber for stable is 360 and green is 180?

curious why I have amber with under 180 ES.

Look back three posts I put the figures there yesterday..

mtbe-vdsl-stable-red <= 120
mtbe-vdsl-stable-amber > 120  <= 1199
mtbe-vdsl-stable-green >= 1200

So Stable is then Red > 720 ES and Green < 72 ES so Amber is anything in between

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 13, 2015, 07:42:35 AM
sorry again for missing that post, thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on July 13, 2015, 07:51:27 PM
Hi Just joined Kitz. I am trying to upload my stats but keep getting this error any ideas "Unable to upload MyDSLWebStats data (file "upload14.exe" missing)"
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2015, 09:07:09 PM
Hi Just joined Kitz. I am trying to upload my stats but keep getting this error any ideas "Unable to upload MyDSLWebStats data (file "upload14.exe" missing)"

Looks like you solved this a few minutes after posting  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on July 13, 2015, 09:14:28 PM
Thanks for the reply . Yeah it is logging now does everything look ok
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2015, 09:40:19 PM
Thanks for the reply . Yeah it is logging now does everything look ok

Need to leave it to run for 24 hours to get a good idea. The line looks very, very noisy though as very high (just short of a million consistently) Forward Error Correction (FEC) counts but this is doing a good job as CRC Errors are very low.

But no interleaving applied. Is this a new line and are you capped at 40Mb download?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on July 13, 2015, 10:49:28 PM
Yeah on Infinity 1 so capped at 40. No its not a new install been in nearly two years. The only thing I have noticed is upload will not go above 6MB. Before xmas used to be between 7MB and 8MB
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 17, 2015, 12:24:50 PM
Tony,  I was just looking at erics stats after his post here (http://forum.kitz.co.uk/index.php/topic,15753.msg293142.html#msg293142).
One thing I noticed when I looked at his Err Secs on MDWS is that there wasnt a total for the up stats. 

Bearing in mind that the DLM treat the upstream and downstream count independently, we should be aware that it is possible for DLM to apply 'old fashioned' INP and interleaving based on upstream performance.    Ive had this occur on my line a couple of times based purely on the upstream E/S.   
Now that we have G.INP and Mk2 will still be using INP based Error protection based on upstream performance, it may perhaps be an idea if possible to also show an upstream E/S day count?    G.INP Mk2 should practically remove most of the Downstream E/S so its possible that some lines may still have DLM intervention based purely upon the upstream E/S count.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 17, 2015, 05:34:34 PM
The Traffic Light system has the U/S ES correct. I'll look at it when I can on the graph but problems with the house are taking my time currently...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 18, 2015, 08:22:53 AM
Kitz

Okay, US ES Total Count is now added and working hopefully  :)

US plot if it exists is black and attached is roseway's wonderful example  :-X It may start looking cluttered on busier graphs though. Colour could be changed if it causes any problem but black seems to stand out :fingers:

I don't know if you all realise but if you hover over the colour legend squares under the graphs, it will highlight the plot for the one you are hovering over to aid finding it. If you click on the square it will outline it (needs a refresh to get rid of it) but not always clearly. This won't work on the attachment though  ;)

I should add that the ES graphs in particular are only accurate if you have a full 24Hr connection, otherwise they are going to read low and may not show what is really happening.

NB FWIW (another thread but can't find it) the All Users table currently shows two users with G.INP enabled and a US INP count > 0 (40+) but they may not have been reset to zero in the first place?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 18, 2015, 11:37:27 AM
Quote
US plot if it exists is black and attached is roseway's wonderful example

That is brilliant thank you.  It occurred to me that with the advent of g.inp on downstream, more lines should now see far less (downstream) Err/Secs, so in future the upstream E/S could become a bit more important when it comes to changes to the DLM.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 18, 2015, 11:59:40 AM
By the way I'd just like to say thank you for this service. It is proving invaluable in tracking down my (still unresolved) fault :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 18, 2015, 11:28:05 PM
Have wanted to see my 24 hour US errored seconds in a graph like the DS E/S and he has done it excellent work Tony.

Now to find away to stop people ringing my phone that would stop most of the upstream errors but they are not that bad after seeing the graph  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 19, 2015, 07:25:57 AM
Port your phone number to VOIP
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 19, 2015, 06:52:06 PM
Port your phone number to VOIP

Could you make a list of what's needed for this VOIP and i'll look into it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: michty_me on July 24, 2015, 01:21:36 PM
Hi folks,

Lokking for a bit of assistance in setting this up.

I joined mydslwebstats a few weeks back but didn't have any data going to it due to using an Asus DSL modem.
I now have a Netgear D7000 and would like to set it up. I'm running DSL stats V5.5.

I've logged in to MDWS and my username has gone. I remember seeing something that said if no data is received within so many hours, Your name is removed from the list until data is received for X amount of time. How do I go about sending my data to it? I've got an upload key but not sure what to do with it. Any help would be appreciated.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 24, 2015, 03:26:54 PM
You need to be running DSLstats or HG612-modem-stats to capture the stats from your modem then that app uploads them to MDWS. You can enter the key you received into the app.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: michty_me on July 24, 2015, 05:13:38 PM
I'm currently running DSLstats V5.5. I must of missed where you get the app. Can you point me in the direction of it please. Is it mobile app only?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 24, 2015, 05:18:24 PM
I'm currently running DSLstats V5.5. I must of missed where you get the app. Can you point me in the direction of it please. Is it mobile app only?

You sound a bit lost  :(

The DSLstats version you have up and running is fine and that's what you need. You have a username and key for MDWS.

So go to the Configuration tab on the top line and find the MyDSLWebStats tab underneath it. Fill it in and hopefully it will work first time. You haven't uploaded anything in the past.

Only just spotted this as it's in the wrong thread for support - BE1 can you move it please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: michty_me on July 24, 2015, 05:21:44 PM
Ah got it now. I was looking on the mydslwebstats website.

I was very lost.

Entered everything and clicked Check and it now stats checked OK. Thank you very much.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on July 24, 2015, 06:08:43 PM
Does anyone who has donated know if just your email is exposed or if your full postal address is also included?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 24, 2015, 06:34:28 PM
Does anyone who has donated know if just your email is exposed or if your full postal address is also included?  Thanks

I never see a postal address, just the e-mail registered with PayPal. So please feel free to donate :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 28, 2015, 10:02:09 PM
Tony

It's me again.....on 24 hour graphs when I click on the titles of the graphs to see a larger graph (on dates earlier this month 23 July) i am getting graphs with no data displayed.

Also problem selecting a range (select range 21 - 22 July)

see screenies
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 28, 2015, 11:56:39 PM
Tony
It's me again.....on 24 hour graphs when I click on the titles of the graphs to see a larger graph (on dates earlier this month 23 July) i am getting graphs with no data displayed.
Also problem selecting a range (select range 21 - 22 July)

That's an unintended side effect from a database table change made a few days ago....

The 24Hr graph PopUps are now working okay but the Range will take a little longer to sort out...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 29, 2015, 08:32:53 AM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 29, 2015, 08:50:49 AM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?

I can't immediately see any problem from here... Tried several browsers on diff terminals and correctly selected date comes up and popups are also for the correct date.

When you change the date can you see the activity cursor rotating on a tab? If not you could have a JavaScript implementation problem that is stopping the change being detected. The only other problem I can remember is that Safari on a Mac (used to have one but gave up on it) doesn't work (along with a lot of other things in Safari).

Edit:
It appears you are using a Mac and Safari. I've modded this so that if it detects a Mac, it will add in a manual refresh button just after the dropdown list plus some hover notes... Let me know if it works for you please.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 29, 2015, 09:28:30 AM
If you are having problems with latency and slow responses at the moment on MDWS then there is a major wide area BT network problem currently.

See HERE (http://forum.kitz.co.uk/index.php?topic=15831.msg294807#msg294807).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 29, 2015, 08:35:29 PM
Quote
The 24Hr graph PopUps are now working okay

Thanks very much
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 04:25:58 PM
Also problem selecting a range (select range 21 - 22 July)

That's now fixed as well  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 30, 2015, 04:36:17 PM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?

I can't immediately see any problem from here... Tried several browsers on diff terminals and correctly selected date comes up and popups are also for the correct date.

When you change the date can you see the activity cursor rotating on a tab? If not you could have a JavaScript implementation problem that is stopping the change being detected. The only other problem I can remember is that Safari on a Mac (used to have one but gave up on it) doesn't work (along with a lot of other things in Safari).

Edit:
It appears you are using a Mac and Safari. I've modded this so that if it detects a Mac, it will add in a manual refresh button just after the dropdown list plus some hover notes... Let me know if it works for you please.

Maybe I'm doing this wrong.

I've got "Current" selected in Date Options. Selecting a date from "Resync Data..." and then clicking "Refresh" doesn't do anything to the graph?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 04:46:15 PM
Tony, selecting a date in the dropdown doesn't seem to move the graph to that point?

I can't immediately see any problem from here... Tried several browsers on diff terminals and correctly selected date comes up and popups are also for the correct date.

When you change the date can you see the activity cursor rotating on a tab? If not you could have a JavaScript implementation problem that is stopping the change being detected. The only other problem I can remember is that Safari on a Mac (used to have one but gave up on it) doesn't work (along with a lot of other things in Safari).

Edit:
It appears you are using a Mac and Safari. I've modded this so that if it detects a Mac, it will add in a manual refresh button just after the dropdown list plus some hover notes... Let me know if it works for you please.

Maybe I'm doing this wrong.

I've got "Current" selected in Date Options. Selecting a date from "Resync Data..." and then clicking "Refresh" doesn't do anything to the graph?

???  :-\ The Resync data list box for some graphs doesn't do anything and never has done, it's just for info.

I thought you were trying to use the 24Hr graph options list box that didn't refresh which is where I made the change?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 30, 2015, 04:48:19 PM
Why does it have an "Update" button under it then? It's a bit confusing :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 04:54:27 PM
Why does it have an "Update" button under it then? It's a bit confusing :)

That's always been there since last September and refers to the Control Box in general for the options that do need manually updating.

NB: have you tried hovering over the Info icon next to it, that does explain it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on July 30, 2015, 05:01:02 PM
Sorry I got confused - I won't trouble you again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 30, 2015, 05:06:28 PM
That's okay  ;) I've modded the hover help on the listbox to make it clearer if anyone else has the same problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 31, 2015, 08:13:04 AM
Also problem selecting a range (select range 21 - 22 July)

That's now fixed as well  :)

Cheers Tony........


One other thing....my ISP seems to be visible (either just to me or publicly) and I have enable "Hide ISP from public view"


Ian (myadsl)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 31, 2015, 10:49:40 AM
Yes, they are all visible now. Had a word with a few others and no one could see any reason at all to hide them... I can put in something to reverse what that option does currently later if it really worries you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 31, 2015, 06:50:17 PM
Tony - am I being really stupid because I cant find the options link?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on July 31, 2015, 06:52:41 PM
Tony - am I being really stupid because I cant find the options link?

Yes I'm stupid and yes I need to go to spec savers!  :doh:   

(It was greyed out and my eyes must have skipped over it about 100 times :/)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 31, 2015, 07:18:05 PM
Followed hyperlinks could maybe do with a different colour :)

See attachment

Quote
if it really worries you

Does not worry me...but if an option is there I would like it to work as expected.

Thanks again
Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 31, 2015, 08:44:13 PM
Followed hyperlinks could maybe do with a different colour :)
Does not worry me...but if an option is there I would like it to work as expected.
Ian
Link :visited colour is now Maroon and there is no ISP option any more  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 10, 2015, 02:07:48 PM
A quick question...

Is there any way to upload the stats from my HG612 via a headless linux box? The only system I have that is on 24/7 doesn't run any GUI, and is CLI only, and DSLStats will not run on that setup.


Andy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 12:23:50 AM
yeah we need a linux tool for this as I would love to move my stats monitoring to my router.

I am considering making a shell script for the task.  But would probably need help of tony and co to add all features such as stats uploading.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 12:30:53 AM
I'd also be interested in this Chrysalis.

I'd love for my OpenWRT router to do the stats monitoring.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 11, 2015, 07:32:38 AM
I'd also be interested in this Chrysalis..

I think a lightweight script/app that purely handled collection and upload but with no local graphs etc would be great. If it were bundled as a Synology package that would make me even happier - I might even have a go at doing that side of it myself if somebody else worked on the script itself.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 11, 2015, 07:47:43 AM
I don't think there's any possibility of MDWS upload capability being incorporated in custom router firmware. A simple alternative is to use DSLstats on a Raspberry Pi. This uses tiny amounts of power, so 24/7 running shouldn't be an issue.

For security reasons, the details of how to upload data to MDWS are restricted to a very small circle of people.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 08:16:53 AM
I am talking about a script roseway, linux based routers have bash awk, curl etc. as tools to collect and process stats.  Crontab a built in function of linux is the linux version of task scheduler.

The limitation would be storage, so the log would have to be cycled/archived to keep space usage down and I would probably want to work with ronski or yourself to add support into the gui apps so those apps are a frontend with the router as a backend.

So e.g. the gui would connect to the router, ask for the stats and then display them.  It could also possibly download the log from the router and generate graphs. The router would handle the automated 24/7 data collection as well as uploading the data to MDWS.

For someone like myself, adding extra devices isnt a solution, using my pc is adequate, but the preference is using the router which is entirely logical given its an always on low powered device anyway.

To give you an idea how capable linux based routers are?

My router currently does the following tasks.

1 - Selective routing on demand VPN endpoint.
2 - Downloads malware url's, tracker url's and adds the hostnames to my dns cache which is hosted by the router.
3 - I have a proxy on the router which the dns cache may forward requests to for filtering (abit like how IWF filtering works).
4 - QoS of my traffic both directions.

Linux based routers are also commonly used for purposes such as a torrent client, NAS and other types of network hub tasks.

I think you have massively under estimated the capability of a linux based router.

I can already think of personal advantages to myself.

e.g. when I watch games on nbc sports I set my clock to the eastern us time on my pc which upsets MDWS uploads, however if my router was handling those uploads, it would be a complete non issue.

I am motivated enough now I can probably have a script made to collect all the stats within an hour of work as well as log in the same format already used by bald eagle so the log would be compatible with the graph creator, the hard bit is the uploading of data and interfacing with a gui.

So the real barriers are really.

1 - Is tony ok with a script that can upload been open source? he may have reservations against that.
2 - Will yourself or ronski be ok with updating your gui's to work as a frontend (optional feature) against a linux cli lan based backend.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 11, 2015, 09:22:02 AM
So the real barriers are really.
1 - Is tony ok with a script that can upload been being open source? he may have reservations against that.

First. you may want to choose your words much more carefully when ranting on about someone.

I think you are, and I use a mild word here, being very 'rude' to roseway about his knowledge of Linux and its capabilities. I'll leave it at that.

And may have reservations?  :o :lol: :no: It's never going to happen. 100% no way if that's clear enough for you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 09:46:53 AM
am I ranting tony?  I should know if I was and I wasnt.

Roseway clearly did misunderstand given he is talking about altering a router firmware which isnt at all required on a linux based firmware.  The advantage of linux based firmware's been you have basically a portable version of linux and a package system in the form of entware.

Sadly tho you have pulled the plug on opensource, I had a feeling you wouldnt like the idea hence I mentioned it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 09:54:54 AM
Well I just did a bit of digging on the PI you reccomend.

It's a linux device in itself.  So Clearly it is possible to have a linux based tool for this, the tool used on the PI would work on a linux based router providing the necessary dependencies are installed.

Is the PI version of dslstats written in python?  Regardless of what language its written in, basically the change needed would just be to remove the GUI elements, so the configuration would be in ini files, and it would just collect process the data, then it would work fine on any linux based router.

Since  opensource wont be accepted by tony, the answer to this is down to if eric has any motivation to do this, given many more people will have linux based router's than a uncommon raspberry device tho I would like to think there is merit to this request.

Three people in this thread alone proves the demand.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 11, 2015, 10:08:34 AM
Is the PI version of dslstats written in python?  Regardless of what language its written in, basically the change needed would just be to remove the GUI elements, so the configuration would be in ini files, and it would just collect process the data, then it would work fine on any linux based router.

It also opens up the scope to run it on other simple linux based devices, as not all of us have open source routers - Many NAS devices would fit the bill for example as these are generally left on 24/7.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 10:13:32 AM
well yeah it can effectively run on any linux device, the showstopper here for linux based routers is the gui element.  As routers dont have normal gui frontends in place.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:15:11 AM
I'm very much out of my depth here, but surely when DSLStats is running on RPi it's essentially headless? I can't see why there is a showstopper.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on August 11, 2015, 10:18:25 AM
I'm very much out of my depth here, but surely when DSLStats is running on RPi it's essentially headless? I can't see why there is a showstopper.

The issue is that the existing Linux/Ras Pi version relies on there being a GUI and will not run without those capabilities. Routers/Nas devices etc do not have any GUI
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:20:14 AM
So you just have to run a VNC server on your headless box?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 10:27:07 AM
Dray does a PI have a UI or is it cli only?

I assumed it has given there is even windows 10 on it now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:30:40 AM
Dunno sorry. A poster on here gave me some instructions for running DSLStats on a RPi, which included running a VNC server so I'm guessing that handles the display for X11.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 10:37:10 AM
forget what I said, seems you maybe right on VNC I didnt know that created a virtual X environment.

I still think it wont work but I may give it a go on a spare asuswrt router I got.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 10:53:39 AM
I think you're probably right about it not working on a router, but it's maybe the simplest solution for RPi and headless servers rather than rewriting DSLStats to an MVC pattern.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 11, 2015, 11:05:23 AM
@chrysalis: I didn't misunderstand at all. My wording may not have been precise, but the answer I gave is still the only realistic answer at present.

@Dray: once DSLstats is set up on the RPi with a VNC server (or equivalent) it can be run without a monitor, keyboard or mouse connected, and all access to it being via VNC. The RPi would of course still be running in GUI mode. It uses one of the lightweight Linux desktop systems.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 11:10:39 AM
If eric says he wont do it.  Then an idea I got is masking the script to collect the stats.
I will then have it write to a logfile in the same format as bald eagle's scripts.
I will then see if ronski (or eric) can make their app's able to import these logs for uploading to MDWS.  So uploads can still happen but wouldnt be live updates.

Or another idea is to mount a windows filesystem using CIFS on the router, the script will check for its existance, and if it exists it copies the log there.  Then could have bald eagle's tool treat that as a locally generated log and upload it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 11:12:18 AM
Ok thanks for your reply eric.

So is as I expected it works on the RI because it has a local GUI installed on it.

The question is do you think its possible for you to have the time make a cutdown version of your linux tool, where none of the GUI features exist, it just runs in a cli mode to collect stats and upload them?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 11, 2015, 11:27:12 AM
Quote
The question is do you think its possible for you to have the time make a cutdown version of your linux tool, where none of the GUI features exist, it just runs in a cli mode to collect stats and upload them?

It's a possibility, but please don't press me for a timescale. I had a little health scare earlier this year, and as a result I've had to reduce the amount of time I spend in front of the PC. I will take a look at it and see what's involved.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 04:53:36 PM
I'll stick to the trusty RPi B+ with DsLstats running it's 100% stable with zero maintenance that embedding software into router sounds like hard work and extra processing for the routers CPU.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 11, 2015, 06:47:38 PM
I will then see if ronski (or eric) can make their app's able to import these logs for uploading to MDWS.  So uploads can still happen but wouldn't be live updates.

You can't bulk upload stats, if the server receives more than one set (one minutes worth) a minute then it rejects the subsequent sets, send too many and you get a warning, keep on doing so and you get a ban. Just for the record I have no idea how to upload the stats.

Personally I can't see the problem with running a Raspberry PI, they are very cheap to buy and run, really what's the problem with one more tiny box?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 07:47:29 PM
How much space would DSLstats require on a RPI?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on August 11, 2015, 07:57:54 PM
How much space would DSLstats require on a RPI?

the program itself not a lot, but depending on how long you keep the stats they can build up over time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 08:09:32 PM
See this is why I keep using my laptop as it has essentially unlimited hard drive space...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 09:16:01 PM
See this is why I keep using my laptop as it has essentially unlimited hard drive space...

You just purchase a larger SD card for the RPi just like you purchase a larger capacity HD but i think 32GB is the max you can use on the RPi not sure about that.

But you can connect a usb hard drive to it.

This is the 32GB SD card memory

Code: [Select]
pi@raspberrypi ~ $ df -h
Filesystem      Size  Used Avail Use% Mounted on
rootfs           29G  2.9G   25G  11% /
/dev/root        29G  2.9G   25G  11% /
devtmpfs        214M     0  214M   0% /dev
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 11, 2015, 09:51:02 PM
You just purchase a larger SD card for the RPi just like you purchase a larger capacity HD but i think 32GB is the max you can use on the RPi not sure about that.
Plenty of 128GB cards work http://elinux.org/RPi_SD_cards
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 10:01:43 PM
Plenty of 128GB cards work http://elinux.org/RPi_SD_cards

Thats even better Dray i just use the 32GB SD card for DSLstats and have plenty of room left after 1 year of stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 11, 2015, 11:17:17 PM
and how much do 32 gig cards cost?

its alright just saying its one more little device, but if I brought "one more" device for every computing task, the house would be filled with them :p

But anyway thanks eric, there be no rushing you, if its done its done, if its not done so be it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 11, 2015, 11:19:06 PM
It's just occured to me that I could power the Raspberry Pi off the router's USB port...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 11, 2015, 11:51:49 PM
and how much do 32 gig cards cost?

My RPi came with 8GB noobs and purchased a 32GB card for £14.99 on amazon you will need to expand the file system for it to recognize the extra memory on larger card.

Don't go for the cheap stuff make sure the ram ratings match the spec.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on August 13, 2015, 06:06:26 PM
Can somebody email me my Licence key please I have deleted the email by accident
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 23, 2015, 12:00:26 AM
SERVER RESTART

This commenced at 23:43 and completed at 23:50 this evening.

Web users will have been thrown off but uploads should reconnect okay but you may want to check.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on August 23, 2015, 05:45:03 PM
Hi Tony

Last night we had thunderstorms, and MDWS was really interesting to watch the CRC and ES build. I made me think, now you have the traffic lights (which are great), with out a massive amount of code, could an option be possible to send an email if the ES exceeded a certain figure. I was thinking if it got near 2880, and I knew about it I would power off the modem until the interference had gone. I know thunderstorms may be classed by the DLM as wide area events....but I trust your software more than the DLM

Best

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 07, 2015, 09:15:42 AM
Time for a stupid question...  :-[

Where do I enter the ISP details? I have looked in the config but for the life of me I cannot see it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 09:50:09 AM
Time for a stupid question...  :-[

Where do I enter the ISP details? I have looked in the config but for the life of me I cannot see it.

That's 'cos it's not there  ::)

It's looked up for you automatically from your IP address...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 07, 2015, 10:02:24 AM
Ah.. I see... it's not there though. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 10:12:44 AM
Ah.. I see... it's not there though. :)

 ??? What isn't where? Do you know where it should be?

See attachment
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 07, 2015, 10:16:04 AM
I guess he means his ISP isn't shown.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 10:46:31 AM
Ah.. I see... it's not there though. :)

If you had said where you were looking which wasn't where I assumed you were....  :-\

You should be able to see it now along with all the other missing ones. (He's using the full page UserStats listing with everyone on it....). This was revised recently but that detail got missed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 07, 2015, 02:18:14 PM
Sorry Tony, at that moment I was getting multiple inputs from SWMBO and phones and email's pinging, so I posted it before I had really finished composing it. I had to be out of the door rapidly too so forgive me for being a little obtuse.

However, you managed to work it out, all is now well with the world!

P.S. Would be nice to see what the hardware was for each user, but I realise that could be a bit of a nightmare.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 07, 2015, 02:22:28 PM
P.S. Would be nice to see what the hardware was for each user, but I realise that could be a bit of a nightmare.

That is coming.... If you go to the Options link then you can select your upload modem or modem/router but it isn't displayed yet as it's part of V2.0 in the future....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on September 09, 2015, 03:54:59 PM

That is coming.... If you go to the Options link then you can select your upload modem or modem/router but it isn't displayed yet as it's part of V2.0 in the future....

I see it. No Netgear D7000 in there yet. :)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 09, 2015, 04:14:31 PM

That is coming.... If you go to the Options link then you can select your upload modem or modem/router but it isn't displayed yet as it's part of V2.0 in the future....

I see it. No Netgear D7000 in there yet. :)

I assume that's what you are using? It isn't in the DSLstats compatibility list though.... And Eric has this note against the list:
Netgear models are no longer supported. They may work, but I don't have the resources to diagnose problems with them.

I have added it to the list though  - for now unless any objections are posted  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: LaurieR on September 10, 2015, 01:05:12 PM
MDWS Updates


...  View Image/Save still won't work with FireFox/Waterfox

It doesn't work with Edge (Windows 10 browser) either. It says "That’s odd... Microsoft Edge can’t find this page. Something on this page needs an app that isn’t installed." 

It works fine with Chrome.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 10, 2015, 02:49:23 PM
Nothing I can do about it I'm afraid, someone else wrote the utility and hasn't got round to updating it. I'll block it for Edge although I have no access to it here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: renluop on September 12, 2015, 01:00:52 PM
Before I embarrass my self further, which is only too easy, may I ask if, suitable for ADSL with Billion 8800NL router; recommended recording interval?

What is purpose of memorable phrase?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Stroller on September 13, 2015, 06:45:07 PM
Hi Tony,

Any chance (when you get a moment) to add the ZyXEL VMG8924-B10A to the modem dropdown list under the MDWS 'Options link', please.

Rgds,

Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on September 13, 2015, 07:15:44 PM
I think it would be nice if you could disable upstream/downstream and only show one of them if desired.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2015, 07:15:21 AM
I think it would be nice if you could disable upstream/downstream and only show one of them if desired.

I'll add it to the list but a long way down currently...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2015, 07:15:43 AM
Hi Tony,

Any chance (when you get a moment) to add the ZyXEL VMG8924-B10A to the modem dropdown list under the MDWS 'Options link', please.

Rgds,

Chris

Done  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: renluop on September 14, 2015, 11:46:01 AM
Before I embarrass my self further, which is only too easy, may I ask if, suitable for ADSL with Billion 8800NL router; recommended recording interval?

What is purpose of memorable phrase?
Just the bold part, please! :)
I had thought it was to help remember password, but with having to use a symbol such as $, I am confused how one could construct a phrase. Anyhow aren't strong passwords meant not to include easily broken text?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 14, 2015, 12:12:01 PM
What is purpose of memorable phrase?

It has a specific purpose and shouldn't be related to the password. You would only need it when logging on for the first time or when  changing your e-mail or password. I'll leave it at that  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Stroller on September 14, 2015, 07:50:19 PM
Hi Tony,

Any chance (when you get a moment) to add the ZyXEL VMG8924-B10A to the modem dropdown list under the MDWS 'Options link', please.

Rgds,

Chris

Done  :)

Many thanks, Tony. Much appreciated. :hat:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2015, 12:24:10 PM
MDWS SERVER DOWNTIME and INTERFACE UPGRADE TO V2.0

The MDWS server will be down for a period from 07:00 on Sunday 20th September (this might change) for software and hardware upgrades and for a change to V2.0 of the user interface. How long it will be unavailable for isn't known at the moment but it is likely to be for at least three or four hours. Watch this space for a notification of service resumption! Uploads should resume automatically well ahead of the Web server User Interface being available again.

SUPPORTERS/DONATIONS CHANGES
As already mentioned as a possibility several times over the past few months, the big change is that only users who have supported the site by at least a minimum Donation will have access to the majority of the new facilities summarised below for V2.0. 

Additionally only Supporters will have access to uploaded data globally beyond the most recent consecutive 5 (FIVE) days (this only affects data access, there are no deletions for uploaders past those already in effect and well documented). Summary Data is currently available for one year maximum if you have been on the system that long and upload near continuously.

These changes still allow all users wanting to have remote diagnosis of their current stats from the resident Stats pundits  - or just to browse - to use the system as normal for recent data over the last 5 days.

It's hoped that this change will eventually allow the MDWS facility to continue to be run and maintained without there being an overall system cost deficit and enable upgrades when required.

INTERFACE CHANGES
All the extras summarised below are only available to Supporters. The 'old' pre V2.0 system will still be available to everyone if preferred but many of the changes below will be unavailable and the 5 days still applies where appropriate.

GRAPH CHANGES
Graphs are now optionally wider for Supporters and available in six different heights from very small to very large (130 to 650px - the current size is 264px). The Control Box now sits above the graph rather than at the side and this makes much better use of available space and works more consistently between browsers.  The Status Bar can be hidden if wanted to maximise the vertical space available for multiple graphs. The facilities available are much as they were before with just a few additions. See attachment.

FAILED UPLOAD MONITOR
You can now monitor your data uploads  and be notified by e-mail if they stop for some reason. The period before this happens and the frequency at which you receive mail are configurable. You can also elect to receive another mail when uploads resume. This facility isn't really suitable for those who only upload  sporadically,

ENHANCED DLM GADGET
There is an enhanced DLM gadget that gives a lot more information than the current small traffic lights by using a popup window. Available for FTTC connections only. See attachment. It's only accurate for 24 hour continuous uploads and will estimate for less.

MODEM/ROUTER DISPLAY
Users can now have their modem/router displayed along with each graph to aid remote diagnosis. While we sometimes manage the impossible, this was much more difficult and so you have to manually select the correct one from a list! This is already available via the current Options menu but not yet displayed on the graphs until the upgrade.

LATENCY MONITOR
Those who have one of the Latency monitors set up can now elect to have it publicly displayed on the Status Bar at its far right as a thumbnail above a graph with the full size graph also available as a popup (see attachment).  Again, this is available as an Option currently but not displayed yet.


There still hasn't been time to update the Help system unfortunately but I'll post a more detailed guide to the changes here in a few days time and confirm the downtime.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on September 17, 2015, 12:43:40 PM
Nothing like new active development to remind me to donate. What is the preferred minimum donation?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: myusername on September 17, 2015, 12:59:10 PM
Hello,

I signed up for mydslwebstats a few days ago and have noticed in my firewall logs that the web server is trying to initiate connections on port 143 (NetBEUI)with alarming regularity. Could someone investigate and see what's going on please?

Firewall logs (sanity checked and a small sample) below.

Thanks.

Code: [Select]
33 2015 Sep 17 12:30:07 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
34 2015 Sep 17 12:30:05 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0x80 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
36 2015 Sep 17 12:29:08 Attack warn last message repeated 1 times in 1 seconds
37 2015 Sep 17 12:29:07 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
38 2015 Sep 17 12:29:05 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0x80 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
40 2015 Sep 17 12:28:36 Attack warn last message repeated 19 times in 29 seconds
41 2015 Sep 17 12:28:07 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
42 2015 Sep 17 12:28:02 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
44 2015 Sep 17 12:28:00 Attack warn last message repeated 2 times in 8 seconds
45 2015 Sep 17 12:27:52 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
46 2015 Sep 17 12:27:50 Account warn last message repeated 1 times in 0 seconds
48 2015 Sep 17 12:27:50 Attack warn Port Scan Attack: IN=pppoa1 OUT=n/a MAC= SRC=81.174.137.167 DST=  LEN=78 TOS=0x00 PREC=0xA0 TTL=124 PROTO=UDP SPT=58527 DPT=137 LEN=58 MARK=0x8000000
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on September 17, 2015, 01:07:41 PM
Isn't port 143 for IMAP ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: myusername on September 17, 2015, 01:12:49 PM
It is, No idea where my brain was when i typed 143 :D destprt is 137 which actually is NetBEUI as in the logs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on September 17, 2015, 01:13:23 PM
Nothing like new active development to remind me to donate. What is the preferred minimum donation?  Thanks

I have just donated and think the prefered minimum is £10
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2015, 04:07:38 PM
Hello,

I signed up for mydslwebstats a few days ago and have noticed in my firewall logs that the web server is trying to initiate connections on port 143 137 (NetBEUI)with alarming regularity. Could someone investigate and see what's going on please?

Firewall logs (sanity checked and a small sample) below.

Thanks.


It's a Windows based server and the reason you see it is because Windows is trying to resolve the remote host via NetBIOS (on Port 137)  name as well as with DNS. Perfectly normal and is the default setup on a card although I can see your concern, it does look a bit frequent... I'll disable it on the NIC and see what happens, hopefully nothing untoward (now done).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 17, 2015, 04:08:52 PM
Nothing like new active development to remind me to donate. What is the preferred minimum donation?  Thanks

I have just donated and think the prefered minimum is £10

Yes, there's a link at top left of page but don't let that hold you back  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 17, 2015, 05:20:20 PM
guess its time for me to stick that hg612 on ebay which I said i would send some of the proceeds to MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: myusername on September 17, 2015, 05:24:45 PM
Hello,

I signed up for mydslwebstats a few days ago and have noticed in my firewall logs that the web server is trying to initiate connections on port 143 137 (NetBEUI)with alarming regularity. Could someone investigate and see what's going on please?

Firewall logs (sanity checked and a small sample) below.

Thanks.


It's a Windows based server and the reason you see it is because Windows is trying to resolve the remote host via NetBIOS (on Port 137)  name as well as with DNS. Perfectly normal and is the default setup on a card although I can see your concern, it does look a bit frequent... I'll disable it on the NIC and see what happens, hopefully nothing untoward (now done).
Hi, thanks for taking swift action, but this is far from normal. There's a whole discussion to be had about how serious NetBIOS over the internet is, but it'll suffice to post these links explaining. Source: I'm a network security engineer for a blue chip company.

https://www.grc.com/port_137.htm
https://isc.sans.edu/forums/diary/Is+it+time+to+get+rid+of+NetBIOS/12454/
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 17, 2015, 11:29:52 PM
MDWS SERVER DOWNTIME and INTERFACE UPGRADE TO V2.0

I don't see any issue using 1.4.0 it's been very stable indeed the added enhanced DLM gadget will be very welcome for users who don't understand the DLM threshold for there line it becomes very clear when you click on it  :)

A years worth of stats is excellent it's just some stats analysts may find it to be confined i am just happy to see 7 days worth of stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on September 18, 2015, 01:19:03 PM
Any chance of you removing the reference to Plusnet on your DLM gadget or it there any option for the End user to remove it ?
Just that it isn't unique to Plusnet ,other ISP's use the DLM Speed stability option too, As if i were to be a donator i would appreciate that it be free of Branding & ads
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 18, 2015, 01:27:23 PM
Tommy, I'm sure that's there because that example was from a Plus Net connection, yours will show your ISP.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 18, 2015, 01:47:41 PM
Any chance of you removing the reference to Plusnet on your DLM gadget or it there any option for the End user to remove it ?
Just that it isn't unique to Plusnet ,other ISP's use the DLM Speed stability option too, As if i were to be a donator i would appreciate that it be free of Branding & ads


 :hmm: It's the ISP of the user you are currently looking at as Ronski says ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on September 18, 2015, 02:52:37 PM
Ok,  :blush:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 18, 2015, 04:18:19 PM
Hope it goes smoothly Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 19, 2015, 11:00:08 PM
NOTES ON ACCESSING V2.0.0 from Sunday 20th September 2015

Other things have got in the way of creating a comprehensive guide but as much of the day to day operation is the same but laid out differently, users should adjust pretty quickly. This post concentrates on the major changes.

So this is just a short guide on how to access and use V2 as it may not be immediately obvious. Please see the earlier post for more general info...

Once active with the server back up, the Version at the top the main page should read V2.0.0 (hit F5 or whatever forces a refresh if it doesn't) you should see very few immediate changes as it will effectively be running V1.4.0 (see the attachments for screen grabs of what follows). BUT on the line of links below the Social Media icons there is a new dropdown labelled Graph Size. If it says Not Available then you don't qualify as a Supporter currently and you need to for access (see earlier post). If it says this, it will operate just like V1.4 but with some limitations.

Otherwise it should read Original. Original is the display you are used to seeing with the Control Box at the left of the graphs. With the list box dropped down you'll see Vy Small - Small - Medium - Standard - Large - Extra Large as graph size options for vertical height.  Standard is a little larger than the old system (you can return to this earlier display version at any time if you want using Original.)

(http://www.wpocomms.co.uk/images/graph-size.jpg)

If you open more then one pane, all the graphs are the same size - it should in a future release be possible to mix graph sizes amongst panes. The larger the graph the less you can see at once but there is more vertical resolution. At the smaller end you can likely see a lot on screen at once but detail goes and also various labels vanish at the smallest size. The Legend for the various graph colours is now above the graphs rather than below.

So picking a graph size will refresh the whole display and the graphs now occupy the whole width of the MDWS GUI.

There still a maximum of three items in each pane - Stats Summary at the top, then the Control Box, then the graph or listing. You can turn off the Stats Summary to have more vertical space (for all panes displayed) by checking the option right of the Graph Size dropdown. Some of the info in the Stats Summary is then transferred to the Control Box including the DLM traffic light status and other info is then repeated on the graph itself. There is no obvious indication currently by colour if the line is down and the Stats Summary is hidden but that will come...

Here is a typical display with and without the Summary Stats (note the option to remove the Stats Summary has been withdrawn temporarily):
(http://www.wpocomms.co.uk/images/statuswithandwithout.jpg)

If the user has allowed it (via options), then you may also see a thumb of their Latency graph at right of the Stats Summary as in the top graph. Selecting it will display it full size. It is NOT displayed if there has been no update recently.

The Control Box is much as it was but now horizontal and the green button at right replaces the old Update button - one extra checkbox option for SNRM is Hi Res for periods of 48 hours and less - this lets the chart define the vertical limits without starting at zero and may or may not increase the vertical resolution depending on how Google feels. Here's a comparison when it does work:

(http://www.wpocomms.co.uk/images/hi-resplus-small800.jpg)
And at the bottom is the smallest graph height with hi-res enabled.

Note that the View/Save button is now hidden for browsers that do not support it (Firefox/Waterfox/Edge). There is no solution for this currently except to use a screen grabber or other utility such as Lightshot or Snipping Tool.

DLM GADGET
Here is another (there is also one in the original upgrade post) example of the popup DLM display that hopefully gives much more detail and clearly shows which traffic lights (hopefully) apply to your line. This example is for a pretty awful line!

(http://www.wpocomms.co.uk/images/3-dlm-gadg-bad-example-800.jpg)
Users cannot make any adjustments to this display as it is automated (and thanks to Kitz for helping with the layout :) ). The circular meter at right needs to be up in the yellow or preferably the green part to be accurate - it displays the percentage of minutes data available for the user from the 1440 there should be over 24 hours.  It will close automatically when it loses focus.

ZOOMING
Due to some changes with the Google charts, zooming is now only possible by drag selecting an area and not by clicking on one of the highlight circles/blobs. Try to highlight an area with the center as the point of interest. You can do this multiple times and a right click reverts to the original scale.

I've probably missed some things so please yell if you need assistance - also check the earlier post as that has additional info on some other options including displaying your modem and upload failure notifications.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 20, 2015, 10:03:45 AM
It all seems to be working properly (although I haven't checked every detail of course) so well done Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 10:13:14 AM
It all seems to be working properly (although I haven't checked every detail of course) so well done Tony.

Thanks

There's a pile of hair sitting next to me though....  :-X

The only immediate problem I see is that the graphs don't quite fit within their containers properly, too close to the bottom line but I'll find and fix.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 10:13:57 AM
I don't no if it's a glitch but saying I can only view 5 days stats because I have not donated , I did donate a few days back and my user name shows in green

Cheers
Chris

Um, it takes effect within 5 minutes of doing it. I'll have a look now...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on September 20, 2015, 10:46:27 AM
Hi Also donated username is shown in green but still saying not avaliable for new options
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 10:47:03 AM
The DLM data popup is not showing on my screen, no matter how long or where I hover my mouse. If I hover over the traffic lights I do get a small black popup with text display but that's all. What am I doing wrong?

Stuart (broadstair on mydslwebstats)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 11:01:32 AM
Looks good  :) - thanks.  Only issue here is that you seem to have tick "show status" each time you open it.  Other settings seem to be remembered.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 20, 2015, 11:13:32 AM
Great stuff Tony really great interface

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 20, 2015, 11:14:55 AM
The DLM data popup is not showing on my screen, no matter how long or where I hover my mouse. If I hover over the traffic lights I do get a small black popup with text display but that's all. What am I doing wrong?

Stuart (broadstair on mydslwebstats)

Click on the traffic lights.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 20, 2015, 11:19:01 AM
I did its great  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 11:30:26 AM
Okay, more hair has fallen out  ???

Hopefully the problem with donees not being recognised for the new interface has been sorted so if those affected can refresh the whole interface and see if it works as it should please and let know.... Really stupid bug but next to impossible to find quickly (an extraneous space appended to user names.  :-X ...)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on September 20, 2015, 11:35:42 AM
Hi

Yes new options seems to be working fine on mine now thanks a lot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 11:37:24 AM
Looks good  :) - thanks.  Only issue here is that you seem to have tick "show status" each time you open it.  Other settings seem to be remembered.

Under what conditions please? It survives an interface reload here.....

Edit: Can you check that your Cookies are set to NOT expire when you close the browser or end a session please? They need to be persistent.

And I was going to add are you using the wider graphs as it doesn't work on the original ones but you have discovered that...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on September 20, 2015, 11:56:47 AM
all seams to be working here , i can get more info about the traffic lights if i hover my cursor above but how do i get the full interface that is shown on your post about the update please

cheers
chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 11:58:14 AM
all seams to be working here , i can get more info about the traffic lights if i hover my cursor above but how do i get the full interface that is shown on your post about the update please

cheers
chris

Click on the traffic lights... Does it show a hand cursor if you hover over them? Have you got popups enabled?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 11:59:18 AM
  It is Chrome on XP! . All settings look fine and everything else is remembered OK.  No expiry is set.   The status setting is lost when ever new page or tab is opened.   I also have just noticed that if I open MDWS in one tab and enable it, then when second tab opens MDWS  then both tabs don't have the setting set. Opening the second tab resets the first tab status to off.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on September 20, 2015, 11:59:45 AM
FYI I couldn't get the info from the traffic lights on a tablet before. V2 :) now works on both Android and Apple
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 12:00:28 PM
Click on the traffic lights.

That does nothing, on my screen (Firefox in Linux) does not show the traffic lights as a link. However I see the new screen on my W7 PC and it does work. I have cleared the cache in Linux but still shows the old layout.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on September 20, 2015, 12:06:54 PM
all working, I had to change graph size from original to standard  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:07:27 PM
  It is Chrome on XP! . All settings look fine and everything else is remembered OK.  No expiry is set.   The status setting is lost when ever new page or tab is opened.   I also have just noticed that if I open MDWS in one tab and enable it, then when second tab opens MDWS  then both tabs don't have the setting set. Opening the second tab resets the first tab status to off.

I have to say if it's XP then not a lot I can do IF that is the problem......

You can't/shouldn't have two tabs open with MDWS and never have been able to successfully as they share the same settings since there is no sure-fire way of identifying tabs in use. Even worse with this version as you'll get mismatched container and graph sizes after a while if one is different to the other....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 12:12:12 PM
This is great and very fast though show status tick is not saving the setting  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:21:22 PM
This is great and very fast though show status tick is not saving the setting  :-\

See post below. It does via a persistent cookie but maybe you have two tabs open and then the second one will negate the first and you shouldn't have two tabs open anyway, it isn't supported and never has been.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 20, 2015, 12:21:58 PM
Click on the traffic lights.

That does nothing, on my screen (Firefox in Linux) does not show the traffic lights as a link. However I see the new screen on my W7 PC and it does work. I have cleared the cache in Linux but still shows the old layout.

Stuart

I'm afraid I can't explain that, Stuart. I'm using Firefox/Linux and the function works properly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:30:39 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 12:47:33 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?

Tony it worked without any alterations or new options on W7 in Firefox, but no I've not tried that in Linux but i would not have expected to change anything since W7 worked with no changes. I'll try that later on Linux as I'm using W7 right now as that PC is on 24x7 (runs my weather station and DSLStats).

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 12:57:22 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?
Tony it worked without any alterations or new options on W7 in Firefox, but no I've not tried that in Linux but i would not have expected to change anything since W7 worked with no changes. I'll try that later on Linux as I'm using W7 right now as that PC is on 24x7 (runs my weather station and DSLStats).

Stuart

Okay but what does the Graph Size option currently read on both OS?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on September 20, 2015, 02:57:55 PM
All seems ok here.   Prefer the new style layout - thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 03:51:22 PM
See post below. It does via a persistent cookie but maybe you have two tabs open and then the second one will negate the first and you shouldn't have two tabs open anyway, it isn't supported and never has been.

Just using the one tab i use 2 panes, how do you set a persistent cookie on Chrome ?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 04:32:48 PM
See post below. It does via a persistent cookie but maybe you have two tabs open and then the second one will negate the first and you shouldn't have two tabs open anyway, it isn't supported and never has been.

Just using the one tab i use 2 panes, how do you set a persistent cookie on Chrome ?

Settings > Advanced > Content Settings > and make sure for Cookies that the first radio button is set, not the others. The last checkbox is up to you but I always check that ....

However, I think the problem probably lies somewhere else ... I just ran it on Chrome here  (I normally use Waterfox as it's more stable for me) and closing/restarting it doesn't lose the Show Status setting...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 04:45:53 PM
Settings > Advanced > Content Settings > and make sure for Cookies that the first radio button is set, not the others. The last checkbox is up to you but I always check that ....

However, I think the problem probably lies somewhere else ... I just ran it on Chrome here  (I normally use Waterfox as it's more stable for me) and closing/restarting it doesn't lose the Show Status setting...

Thanks Tony have been at this all day to find a cure/fix well i did watch F1 it could well be a Vista thingy i'll check out windows 8.1 later and see how that fairs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 04:48:58 PM
Thanks Tony have been at this all day to find a cure/fix well i did watch F1 it could well be a Vista thingy i'll check out windows 8.1 later and see how that fairs.

Likewise, there's a rather large peak in my latency graph as a result via Sky Go. Shame about Lewis  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on September 20, 2015, 04:51:46 PM
  It is Chrome on XP! . All settings look fine and everything else is remembered OK.

I get the same on Chrome/XP - when going into the website I need to select the 'show status' button each time.

If I close the browser, reopen it, go to http://www.mydslwebstats.co.uk/ and press continue, the status button is showing as not selected

My settings are set as per the default - i.e. for Chrome to remember any cookies..
.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on September 20, 2015, 05:03:21 PM
Quote
I have cleared the cache in Linux but still shows the old layout.
Stuart

So is the dropdown with the Graph Sizes also not working? The link only appears on the new wider graphs... Have you selected another graph size under Linux? Or tried a different browser?
Tony it worked without any alterations or new options on W7 in Firefox, but no I've not tried that in Linux but i would not have expected to change anything since W7 worked with no changes. I'll try that later on Linux as I'm using W7 right now as that PC is on 24x7 (runs my weather station and DSLStats).

Stuart

Okay but what does the Graph Size option currently read on both OS?

On W7 it said standard and on linux it said original and I dont remember changing either or playing with either at any time. Now I've changed Linux to standard it works and if I change it back to original it disappears again.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 20, 2015, 05:06:12 PM
Thanks Tony have been at this all day to find a cure/fix well i did watch F1 it could well be a Vista thingy i'll check out windows 8.1 later and see how that fairs.

Likewise, there's a rather large peak in my latency graph as a result via Sky Go. Shame about Lewis  :-\

You noticed that to on sky go i had to reboot the router to stop the buffering, Lewis will win the championship  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 05:09:45 PM
On W7 it said standard and on linux it said original and I dont remember changing either or playing with either at any time. Now I've changed Linux to standard it works and if I change it back to original it disappears again.
Stuart

Yes that would be so. It doesn't work under Original (V1.4 code) as it isn't an option and never was so your results are as expected now....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 05:31:18 PM
  I also find the status option is not saved with Chrome on an Android tablet.  I will try windows 7 as promised later, I just have dig out my login details.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 06:28:22 PM
  Just the same with Chrome in windows 7.   I have gone to running with "original" - this seems to remove the status option and effectively set it on.  Just to repeat  - everything seems to be perfectly remembered apart from the status.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 06:41:33 PM
  Just the same with Chrome in windows 7.   I have gone to running with "original" - this seems to remove the status option and effectively set it on.  Just to repeat  - everything seems to be perfectly remembered apart from the status.

As I said earlier, there is no such option in 'Original' so it will always be on anyway as you can't turn it off... Bear in mind that Original is V1.4, not the new one.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 08:39:30 PM
Status Option

Having looked at this for some time, I think a better option would be to default it to On and not set it from where it is currently but via the Options menu as that will isolate it from being affected by other changes...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on September 20, 2015, 09:10:11 PM
 Thanks for a possible fixup  :) .  I think that would best for me and probably others with trouble saving the setting.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2015, 10:37:37 PM
Thanks for a possible fixup  :) .  I think that would best for me and probably others with trouble saving the setting.

For the moment I've fixed it on and removed the option to change it so the Status Bar is always there now. That also solves another problem I spotted and I suspect this would be most peoples choice anyway. You will need to reload the main page (F5 or whatever) or change graph size to implement it..... I'll come back to it at a later date.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 22, 2015, 08:31:48 AM
Thanks for a great upgrade Tony; I have just spotted an anomaly with the Mini stats page.

The horizontal scroll bar is always present, see screenie.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 22, 2015, 09:12:39 AM
Thanks for a great upgrade Tony; I have just spotted an anomaly with the Mini stats page.

The horizontal scroll bar is always present, see screenie.

Ian

Can't get that to happen here and nothing has changed in the code for it. It's set to have no scrollbars as well and yours is also the wrong height.

It's also set to be resizable so you should be able to make it narrower.... I know Chrome has problems with it and sometimes it shows a blank container on some terminals but no idea why. Matter of interest, which Browser (looks like Chrome) and OS please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 22, 2015, 01:13:58 PM
Quote
which Browser (

Chrome on chromeOS...Only noticed the horizontal scroll bar yesterday, it is resized to my prefered dimensions and zoom level.

Very strange  (I have tried zoom 25% full screen width and still the scroll bar is there), I don't think an upgrade to the OS has been pushed the last few days.

It's a mystery.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on September 24, 2015, 02:07:37 PM
@tbailey2

I understand that support for the MyDSLStats webpage is through this forum. I have an issue in that after making my £10 donation last night, the emal came back saying it was credited to the wrong user account. I clearly wrote username:tenbyboy2 in the message part of the paypal message section.

Can this please be rectified?

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 24, 2015, 03:12:51 PM
@tbailey2

I understand that support for the MyDSLStats webpage is through this forum. I have an issue in that after making my £10 donation last night, the emal came back saying it was credited to the wrong user account. I clearly wrote username:tenbyboy2 in the message part of the paypal message section.

Can this please be rectified?

Thanks.

The system credited an account you registered last year using the e-mail address you donated from this time and that is checked first.... The username is a backup in case the e-mail fails (but not now)!

Changed now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on September 24, 2015, 03:46:07 PM
Thanks for the quickly reply and for sorting it.

Reason I created a new account is because I forgot the password and then when I tried to reset it, it said my memorable word was incorrect - even though I know it was as I still have the original email.

Is there any chance you can delete that old account now for me please? Also, I'm sure I had that problem before and there is also a tenbyboy acount.

Many thanks. It won't happen again as I have now made a not of all the details of the new account.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 24, 2015, 04:39:28 PM
Thanks for the quickly reply and for sorting it.

Reason I created a new account is because I forgot the password and then when I tried to reset it, it said my memorable word was incorrect - even though I know it was as I still have the original email.

Is there any chance you can delete that old account now for me please? Also, I'm sure I had that problem before and there is also a tenbyboy acount.

Many thanks. It won't happen again as I have now made a not of all the details of the new account.

Okay done, do you want to lose the other one as well? There will be a user option for this soon.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on September 24, 2015, 07:46:14 PM
tony I got my hg612 up on ebay and my old asus router, when the first of them sells will send a donation.

When I checked ebay the guy who got my zyxel couldnt set it up and was asking how to do it but sadly I couldnt send the link to kitz site as ebay times out the messages :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on October 04, 2015, 05:02:55 PM
Team,

Firstly, thanks for the great work on this.

One request and some feedback for you.  I am using a Netgear D7000.  mydslwebstats is sent from a Windows 7 PC.

1) My request (if its not already there!) is to be able to look at a linear graph showing the cumulative CRC errors.
2) Observation: While listening to internet radio via a web browser, everytime the app sends data to the web, there is a short break in transmission. Is there any way round this

Cheers

David
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 05, 2015, 07:31:58 AM
Team,

Firstly, thanks for the great work on this.

Thanks

Quote
I am using a Netgear D7000.  mydslwebstats is sent from a Windows 7 PC.

1) My request (if its not already there!) is to be able to look at a linear graph showing the cumulative CRC errors.

2) Observation: While listening to internet radio via a web browser, everytime the app sends data to the web, there is a short break in transmission. Is there any way round this

1) It's not one that is currently there and I'm not sure it would have any benefit to you or anyone else? It is not a parameter that is currently monitored as such by the line management system (DLM) which looks primarily at Errored Seconds (ES) and Resyncs/LOS.

CRCs are responsible for generating ES though and it's the ES you need to keep an eye on. My observations would be that, in your case, the CRCs are very low as are the daily ES totals and nothing to worry about. You would need to see 1440 ES/Day or more for the DLM to take action, you have had a daily maximum of 52 over the last 10 days with other days being much lower.

2) You'd need to get roseway or others to comment as he looks after DSLstats that you are using for uploads. It's not something I've seen reported before - but it may have been. The upload for MDWS though is under 1k in size (except around the hour when it's a bit more). Since your router is working a bit harder at those times delivering telnet info to DSLstats then it's possible the processor can't cope at those moments? Does the interruption last for the duration of DSLStats showing Sampling?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 05, 2015, 09:43:13 AM
Concerning (2), I've had a look at the CPU load on my system during sampling, and it rises to about 14% of one CPU core for about one second in each minute. This is on a fairly powerful quad core i5 machine, so I guess on a much less powerful machine (Raspberry Pi for example) it could saturate the CPU for a second or so.

I'm not sure that I can do anything about this. During sampling there's quite a lot of processing of data, and although the relevant code could probably be optimised for minimum CPU load, I doubt that there's a great gain to be made. And there would be plenty of scope for introducing new bugs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 07:29:12 AM
Just a note that the MDWS server is being rebooted for software upgrades very shortly. Shouldn't be down for very long.

Edit:
Okay back up but will be slow for some time while 16GB of database is loaded into memory...

Also there will be a change to logins shorty. Web users will need to login every 7 days rather than be kept logged in.  This is one of a number of background security changes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 08, 2015, 10:17:59 AM
Well I've got to say that's going to be a pain, fine on my PC but I have a tab open on my phone and tablet  so I can have a quick and having to log back in every 7 days is going to get annoying. It's actually easier to login to my bank from my phone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 11:00:19 AM
Well I've got to say that's going to be a pain, fine on my PC but I have a tab open on my phone and tablet  so I can have a quick and having to log back in every 7 days is going to get annoying. It's actually easier to login to my bank from my phone.
Oh dear - and also when the browser session is lost....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 08, 2015, 01:58:23 PM
Also there will be a change to logins shorty. Web users will need to login every 7 days rather than be kept logged in.  This is one of a number of background security changes.

Suggest option for donators to control this? E.g 7d,14d, 30d, 90d, Never?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 04:10:22 PM
Tony

I'm getting "Pop up not available in original mode" when clicking traffic lights. Have re logged in as I was logged off

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 04:12:18 PM
Tony - My fault seems it went back to original mode. Changed to standard and all working. Will it loose these settings every time a logout is forced ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 04:17:00 PM
I'll have a look shortly....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 04:50:03 PM
I'll have a look shortly....

Can you remember if the physical graph size was reflected in what the selection list said or did they differ? If they were different it's buried somewhere and will take a while to find.  It may reset to Standard after a forced logout if it was wide originally and does so here.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 04:53:09 PM
I think it looked like standard but the box said original.

Hope that helps

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 05:17:42 PM
Okay. I need to debug it again, at least you know how to solve it  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 08, 2015, 05:49:59 PM
tony I feel you either need to make the login process easier or ease up on the 7 day thing as its a bit of a pain to login.

What was wrong with the long lived session?  Forcing relogin is false security.

What about a compromise of 28 days?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 05:55:36 PM
Perhaps we should be sensitive to the fact the server lives with Tony, and he should be able to take whatever measures he feels happy with. Try asking Apple of MS to alter their Logon on parameters :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on October 08, 2015, 06:56:40 PM
tony I feel you either need to make the login process easier or ease up on the 7 day thing as its a bit of a pain to login.

What was wrong with the long lived session?  Forcing relogin is false security.

What about a compromise of 28 days?

+1.......7 days is going to be a pain on my mobile...it means keeping the passphrase somewhere so i can copy and paste it.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 06:59:31 PM
I cant understand what actually is the problem with logging on again. It only needs a username and password, not the passphrase or capture stuff we had previously.

Have I missed something here as I cant in my mind see what the issue is ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 08, 2015, 07:02:46 PM
I always have to input the phrase and the city as well as the username and password
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 08, 2015, 07:05:49 PM
I have just logged in on my iPad. Only wanted username and password
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 08, 2015, 07:11:59 PM
Same here, it's user name, password, memorable phrase and the capitol city of Wales. At least that is what comes up on IE, on Firefox I can just about see the memorable phrase box, but the rest is strangely not displayed, actually they appear when I tab through them.

So on my phone/tablet I have to open my password manager and enter my master password, then search for MyDSLStats, copy the password, back to the web browser, enter my username, paste the password, flick back to password manager and copy the phrase, switch back to the browser, paste the phrase, type Cardiff and then log in. For me it's just not worth the hassle, and if I'm not going to be using it as much then I'm not going to be donating again
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 08, 2015, 08:17:22 PM
Those of you who are having to enter the additional two fields that shouldn't be necessary, might care to read the Logging on section of the MDWS Help system (link near bottom of main page) which notes:

Cookies
For MyDSLWebStats to run correctly, you must have Cookies enabled and they MUST be selected to expire when they expire, NOT when your browser is closed. Failure to set this correctly will mean it is more difficult to logon and this will occur more often - you should only need to enter your username and password after logging on the first time.

As well as your browser, there are many extensions etc that can also handle cookies and these can easily override your browser settings. Make sure that any such are set to, possibly, never expire or similar for MyDSLWebStats.

I have eight devices here plus every browser under the sun (except Edge) and everything works fine if you observe the above.

Hope that helps. Also, if you actively use the system the 7 days gets reset every so often, I forgot to mention that  :-\

Edit:
I see I have to change the Country as well now  :( Namibia will be good choice...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 08, 2015, 08:38:43 PM
Ah that explains it, I have cookies set to expire when the browser closes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 08, 2015, 10:19:39 PM
Just had the new change this evening and the browser had the username & password all set up and just clicked on login and straight into MDWS

I'll be going offline for 10 hours on MDWS due to DLM maintenance see ya all soon  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 10, 2015, 04:49:35 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 10, 2015, 06:42:22 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks

Yep it's still there just used a few minutes ago.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 10, 2015, 06:56:18 PM
I cant understand what actually is the problem with logging on again. It only needs a username and password, not the passphrase or capture stuff we had previously.

Have I missed something here as I cant in my mind see what the issue is ?

Tony

still needs the phrase.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 12, 2015, 12:23:59 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks

Yep it's still there just used a few minutes ago.
Just in case anyone else has the same issue I think you need to be using one of the supporter graphs to see this option.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 12, 2015, 12:45:53 PM
DSLAM is being detected as Huawei but it is an ECI cab. I have tried restarting modem and dslStats Pi but it is still showing as Huawei.  It has been showing as ECI but I do not know when the problem started.  Anything else I should be trying? Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 12, 2015, 01:23:32 PM
Has anyone else no longer got the high resolution graph option where instead of 0-8db is shown just 5-6 db is shown? Thanks

Yep it's still there just used a few minutes ago.
Just in case anyone else has the same issue I think you need to be using one of the supporter graphs to see this option.

Correct. It's documented in Help and elsewhere
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 12, 2015, 01:24:14 PM
DSLAM is being detected as Huawei but it is an ECI cab. I have tried restarting modem and dslStats Pi but it is still showing as Huawei.  It has been showing as ECI but I do not know when the problem started.  Anything else I should be trying? Thanks

Probably a glitch in the uploaded data. I need your username to fix it. PM if necessary please.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 12, 2015, 03:47:43 PM
DSLAM is being detected as Huawei but it is an ECI cab. I have tried restarting modem and dslStats Pi but it is still showing as Huawei.  It has been showing as ECI but I do not know when the problem started.  Anything else I should be trying? Thanks

Probably a glitch in the uploaded data. I need your username to fix it. PM if necessary please.

Thanks - done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 12:33:53 PM
Hi all, I'm new here and just looking for some info on my line.

I'm with Sky Fibre and have been since 2013.  I've been using an SR102 but picked up an HG612, flashed with the firmware and installed DSLStats to check the line.

I recently had a few issues with the SR102 sky router (they buggered up the last firmware update) which caused massive amount of re-syncs.

I think my line has stabled now, but just to make sure, can anyone please check out my DSL webstats Angel-Rex and let me know if it all looks 'OK' for my line?

If you need any other info or have any questions please let me know.  Many thanks and amazing tool!


EDIT : My ping was always 8ms to bbc.co.uk, however I have noticed in the last 3 days this has doubled to 16ms.  Can anyone see why this is based on that info?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 13, 2015, 01:20:13 PM
Looks ok but the upstream is a bit low. Are you using the SR102 with the HG612 modem or another router?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 05:04:44 PM
Looks ok but the upstream is a bit low. Are you using the SR102 with the HG612 modem or another router?

My line is approx 800 meters (to fibre cab) hence the low speed.

I am using the HG612 as modem and using the SR102 still.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 13, 2015, 07:10:02 PM
Is the upstream speed around the same as the estimate then?

So does the SR102 plug straight into the modem with no setting changes and do you have to use the LAN port marked with the green bar or does any one work?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 07:50:10 PM
Is the upstream speed around the same as the estimate then?

So does the SR102 plug straight into the modem with no setting changes and do you have to use the LAN port marked with the green bar or does any one work?

The HG612 can plug into any of the sr102 lan ports and just work.

as for the speed :

High   Low   High   Low      
FTTC Range A (Clean)   42.2   32.4 /   8.1   5.7   --   Available
FTTC Range B (Impacted)   35.7   20 /    8.1   4.3   --   Available


That is from the BT adress checker.  I was say im getting what was predicted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 13, 2015, 08:40:01 PM
Yes looks fine. Thanks for the info.
I can only think the increase in ping is either down to a change in routing or increased interleaving on your connection.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 13, 2015, 10:02:19 PM
Cheers. I'm guessing routing as all the other settings look the same as they did 16 days ago!

There are loads of the options In the stats I dont understand, wanted to make sure nothing was standing out wrong :-)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 14, 2015, 12:48:00 PM
Is MDWS down? Scrub that it loaded the page but was painfully sllllooowww over 1 minute
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2015, 12:53:59 PM
I'm going to take down the server - it crashed a couple of hours ago and keeps doing so and is running at about 5% its normal speed. Looks like an auto AV update may have started this as that's what the crash dump analysis says.

No idea how long though and it may need several reboots.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2015, 04:48:33 PM
I'm about to run a restore of a daily backup image from 06:30 this morning from a few hours before whatever happened occurred as I've been unable to fix it. This means the system will be down.

Assuming this solves the current problem, it will then be some further time before the system can be brought back up though, possibly tomorrow as there is a separate crisis in my life that has managed to coincide with this so apologies. In the meantime it's running but a page refresh is taking 8-10 secs or more instead of 200ms or less  :-X
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 14, 2015, 06:38:08 PM
Sorry to hear about your problem, Tony. I'm sure people will understand.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 14, 2015, 07:02:29 PM
Unacceptable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 14, 2015, 07:16:38 PM
The only unacceptable thing here is your pointless and irrelevant comment, Alec. If you have nothing constructive to say, then I recommend that you say nothing.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2015, 08:54:04 PM
The stats bar at the top are updating fine on MDWS it is only when the graphs are being built up for display that's when it starts to bog down.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 14, 2015, 09:26:45 PM
It is taking 20 seconds before it actually starts to load/display the page and takes around 30-35secs before any stats are visible for me,  at around 45secs page loading is complete for me,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 14, 2015, 09:59:19 PM
Unacceptable.

What an totally inappropriate comment
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2015, 11:10:26 PM
Unacceptable.

What an totally inappropriate comment

even worse he/she does not seem to a be user of MDWS anymore so why complain if your not using it  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 14, 2015, 11:24:00 PM
Wow nobody here can take a joke!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 14, 2015, 11:25:24 PM
Quote from: NewtronStar link=topic=14361.msg302460#msg302460
even worse he/she does not seem to a be user of MDWS anymore so why complain if your not using it  :-\

Stop stalking my Internet usage, it's creeping me out.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 14, 2015, 11:37:15 PM
Your 'joke' was not funny. Tony already mentioned that he's having to deal with another crisis, so your thoughtless comment got the reaction you should have expected. Drop it now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2015, 11:43:12 PM
Quote from: NewtronStar link=topic=14361.msg302460#msg302460
even worse he/she does not seem to a be user of MDWS anymore so why complain if your not using it  :-\

Stop stalking my Internet usage, it's creeping me out.

Could you expand on your statement please and how would you know if i was or was not looking at your stats ?

if information is being passed onto you from the developer of MDWS this could be a breach of confidentiality  :o
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 15, 2015, 06:31:25 AM
Wow nobody here can take a joke!

I suspected it may be a joke, but without a smiley how was any body really supposed to know for sure. It's so easy when you only have words on a screen  that something can easily be taken the wrong way, the inclusion of a smiley or even [/joke] would better convey your intent.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 15, 2015, 07:22:43 AM
I disabled my uploads to ease the stress since I am guessing its not helping having all the clients trying to connect to upload stats.

Will turn back on after its fixed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 15, 2015, 08:02:44 AM
That's a good move.

Tony is now working on fixing his server, and he'll notify us when it's up and running again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 15, 2015, 09:45:08 AM
I disabled my uploads to ease the stress since I am guessing its not helping having all the clients trying to connect to upload stats.

Will turn back on after its fixed.

I think that's an excellent suggestion. I'm doing the same, perhaps others will follow suit
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 15, 2015, 12:29:45 PM
I'll also disable mine when I'm home later :)

Hope it doesn't cause you too much hassle Tony and again, appreciate the service!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 15, 2015, 04:47:12 PM
Your 'joke' was not funny. Tony already mentioned that he's having to deal with another crisis, so your thoughtless comment got the reaction you should have expected. Drop it now.


This forum is lifeless because everything here is so serious.

I make a joke and get told to shut up, I guess this forum just doesn't understand jokes. I guess if you sit on the computer all day and never get outside you don't have much human interaction.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 15, 2015, 05:54:30 PM
Very disappointed to have to intervene after being alerted to this thread by other means.

The people you are criticising are those that give up many hours of free time to code and write things like dslstats and help members of the broadband community.

As already mentioned use of a smiley goes a long way to show that a joke was intended.  With a history of criticising  ISPs, BT, the way this forum is run, and consistent negative posts, it's no surprise that it wasn't realised it was a joke. :(

--
Now if you excuse me, but I have other things to do right now, things that have nothing to do with PCs or broadband.   I don't even have a PC or network atm.  In fact after a water leak, I have no bathroom, no kitchen ceiling, no lighting and just about every room in the process of being redecorated and under an inch of plaster dust.   

Don't push me,  on top of my own chaos I'm attempting to assist my father to come home for his final days which is his last wish so I'm having to assist and prep a room with special equipment as he has spinal cancer progressing rapidly to the point were he can't even now be moved without specialist care.  I can't even hug him now for fear of spinal neuro shock so don't say anything to me about life outside of the PC...  The mood I'm in right now after just a few hours ago being told by the docs 'not long' means I'm hardly likely to be tolerant about anything...  and I will be very blunt and you will not believe how much willpower it's taken to make this post without resorting to stronger words.  I made it clear about a week ago why I wasn't around so I'm not a happy bunny to be alerted to this thread... and why I am not in the mood to be anything other than serious.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 15, 2015, 07:47:36 PM
To everyone

For various reasons, part of which is the server failure, currently irrecoverable without a lot more more work than I can currently undertake, but primarily due to changes in my own circumstances in the past week, I regret to say that the MyDSLWebStats facility is closed down as of now although the mail server will continue running for a while yet.

If you are uploading to MDWS then you need to disable it a.s.a.p please. I'll update the web site to reflect the cessation of the project to run for for a few weeks and get a minimal index page online.

FWIW there was never any financial reward from operating it, just a deficit of four-figures overall for the hardware and running costs since inception that I can't keep covering. Recent donations have lowered the deficit quite a bit for which thanks - I'll refund  all those who did so recently and have had little benefit from doing so. Anyone else who would like their donation back then please PM me via this forum.
Hope it helped some of you with your stats analysis although I suspect it also created a few obsessed users as a result  ???

Many thanks also to Kitz for allowing use of the forum for MDWS support for the past year.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 15, 2015, 07:56:08 PM
Sorry to hear you're having problems, and I hope that whatever it is that it improves.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 15, 2015, 08:21:32 PM
Is there any way to transfer it to the public domain?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 15, 2015, 09:50:47 PM
Hope it helped some of you with your stats analysis although I suspect it also created a few obsessed users as a result  ???

Many thanks also to Kitz for allowing use of the forum for MDWS support for the past year.

Tony

Yes it has Tony it is an invaluable tool and to see and compare others stats against your own line has helped me understand VDSL2 lines much more .

There is also a downside to stats analysis it can become an obsessed hobby and that's why Openreach locked down the modem  ;)

No need for donation refunds from me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on October 15, 2015, 11:51:05 PM
Sad.

Makes me wonder whether a particular crass comment was the final straw that confirmed to Tony that he was making the right decision?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 16, 2015, 12:54:03 AM
You're not too far from the mark jelv and hence my post above. :(

I can empathise with Tony who has other things going on atm too.  It only takes a final straw to think wth do I bother doing this?

The final insult is the implication you sit on a PC all day and need to get a life, with little respect for the huge amount of hours that are put into development of something for no reward is the reason you are online.

There comes a point when you think why the hell do I put myself through this and pull the plug... and as per the implication you get on with 'real life stuff'
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on October 16, 2015, 01:23:17 AM
I found MDWS useful and interesting, and a nice complement to the dslstats running on my pc (which isn't always on). I'm sorry it's ending, but I understand the reasoning. It was good while it lasted, and thank you for the work you put into it, Tony. Sorry I never had enough free money to donate to you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 16, 2015, 03:28:49 AM
Tony sad days, dont worry about my donation, I didnt donate for perks, but felt I had to do it for your effort.

However I have a proposal, I know you want to keep it hosted in the uk so if you want I can maintain the hardware costs my end and provide the hosting whilst you just maintain the software side (will keep it in the uk) let me know, if this is ok for you, (you also keep any donations, I will do for free).

Or an alternative if you dont want to even maintain the software perhaps send over the current software to me and I will just run that with no updates.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: doughnut on October 16, 2015, 09:22:05 AM
So sorry to hear Tony.

I'm with Chrysalis here and open to help to get the project back online and maintainable for the long haul, cant do the financing because i'm currently in my own startup phase building BSS systems for telcos
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on October 16, 2015, 09:46:02 AM
Tony

My best wishes and thanks for all the efforts. Its ben an interesting project. I hope the other issues might clear themselves. I'm glad to have been involved.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Steveh on October 16, 2015, 10:00:15 AM
Tony

Thank you for your time and effort, I could not do anything like webstats.
I do not want my donation back, you deserve it.

Kind regards
Steve
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on October 16, 2015, 10:03:52 AM
I'm also with Chrysalis on this one. Great plan if it comes to fruition :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 16, 2015, 10:23:26 AM
Hiya all,

I would also like to add my name to the growing list which considers MDWS to be too valuable a resource for it to disappear. I will happily contribute both time, hardware (if required) and money to help continue this very worthwhile project.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on October 16, 2015, 10:42:48 AM
Count me in too.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 16, 2015, 10:47:28 AM
I'll support with a donation.
Only just started using the site and loved it. - NO I DON'T WANT MY DONATION BACK :-)

As a short term measure I have set up a Raspberry pi running DSLSTATS that I can VNC into from any device. The Pi is low power consumption and footprint so no need for a pc/mac being left on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tenbyboy2 on October 16, 2015, 10:49:14 AM
@kwillers

I've done the same with my Weather Station RaspberryPI as it's on permanently anyhow :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 16, 2015, 01:42:37 PM
I too would consider supporting the project further if it was a possibility.

But thanks to Tony for his hard work and commitment to this project which has been invaluable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on October 16, 2015, 01:51:27 PM
No need to return my donation either.  I certainly had my moey's worth.  And, if one of the tech-savvy team can take this on, I'll gladly contribute again.  I am missing my obsession already!

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Cloudane on October 16, 2015, 02:02:43 PM
Further proof how rubbish the comment of "it's just the internet" is when someone decides to hide behind a keyboard trolling, like it somehow means it's impossible to do any harm.

Thanks for a valuable service Tony, it will be missed.  Best wishes for whatever's going on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: bart613 on October 16, 2015, 02:57:45 PM
That's very sad to hear, Tony.  Best wishes - I hope whatever is going on will improve soon!

Also, thank you for providing the fantastic tool for the community.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: MikeZ on October 16, 2015, 04:16:20 PM
Only just seen this so have now disabled uploads. Best wishes and thanks for all you have done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on October 16, 2015, 04:32:24 PM
Thanks for the service Tony, I will miss it although as others have said, it became strangely addictive.

Hope your trials and tribulations sort themselves soon.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngelRex on October 16, 2015, 05:08:56 PM
I have webspace and unlimited throughput if required.  I was going to donate as I've only just set this up and started to use it^^

Sorry to hear about your situation, but please keep in mind should you decide to continue I'll happily donate hardware or monies :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on October 16, 2015, 06:41:40 PM
Thanks for the service Tony but sad to see it go , let's hope it can be rescued , not long since  donated but not required  back
Cheers
Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 16, 2015, 07:39:39 PM
I've released an update to HG612 Stats GUI which removes anything MyDSLWebstats related from the GUI and automatically turns off the uploads. Hopefully this will disable uploads for people who haven't seen this thread who are using HG612 Stats & the GUI program.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on October 16, 2015, 11:21:51 PM
Sorry I am late to this thread, on hols and missed the OP.
Thanks Tony for your hard work on MDWS to date, very much appreciated by many including myself.
I also hope something can be done to preserve your work and keep the service going.
I appreciate that 'life' can get in the way and priorities have to be made but ask if you can find the time to consider the options that have been offered.
The efforts you have made deserve to be 'rescued' if possible.
Thanks in advance and I hope that your circumstances improve soon.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: chris6273 on October 16, 2015, 11:35:14 PM
Very sad, this facility was extremely useful :( . Thank you for all your time and effort that you have put into this Tony.

I'd like to also put an offer on the table to keep this going if possible; I am a Network Engineer who has access to very powerful & reliable hardware within a data center which is used for hosting various communities.

Tony if you have any intention of transferring this facility to someone, I'm more than happy to take on the hosting part of it. Hardware costs would not be an issue as they are already paid for and the system is maintained by myself.

Let me know if you want any more details.

Cheers,
Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: IMgoRt on October 17, 2015, 07:50:49 AM
Very sad but hear this Tony, hopefully things will get resolved for you personally.

Good to see others offering their support to continue your excellent work for this community.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 17, 2015, 12:41:26 PM
I've heard from Tony, and he's aware of all the messages of support, for which he's extremely grateful. He's taking a little bit of time to think about possibilities and to sort out some private matters, but he is hopeful that, one way or another, the service can be resumed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 17, 2015, 12:49:15 PM
Thanks Eric that is absolutely brilliant news. I think we all hope that Tonys troubles are soon resolved.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: valleysboy on October 17, 2015, 03:19:39 PM
Having just returned from holiday, I'd like to add my message of thanks and support to Tony. This has been a great resouce, and many will have appreciated the time, effort, and money it must have taken to develop and maintain the site.

I will miss my daily fix, recognising that my ocd level has risen  ::), but its only the internet and needs to be put into perspective against all the other pressures of life.

So thanks again Tony, and I hope things sort themselvea out for you soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adslmax on October 17, 2015, 03:31:35 PM
Very sad to lose MyDSLWebStats. I am more than happy to donation and help to bring back MyDSLWebStats. I think everyones should support it and donation it if they wish to keep it.  :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 17, 2015, 03:59:48 PM
I'd be more than glad to give a donation for any coding/programming/debugging as this is my background as well as support for hardware and software. I'd also be willing to give a donation to bump start the project again, as well as a monthly fee.

Hope everything is OK with Tony personally :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: big360 on October 17, 2015, 04:41:19 PM
Thanks for all the hard work Tony.  MDWS was invaluable in diagnosing my broadband issues. Fingers crossed it can return some day.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on October 22, 2015, 02:24:29 PM
I have only just seen this as I have been away since the 11th, and was only alerted by DSLStats crashing and refusing to upload when restarted.

I too will miss it and, having read through the last few pages, I can completely understand why Tony felt he had no alternative. I also do not want my donation returned.

Tony I hope your life gets back on track soon and things work out for you.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 22, 2015, 03:20:07 PM
Early this morning the site was up for a brief period,no doubt doing some testing , and the home page now says temp home page server under repair, so things are hopefully starting to look like it will be returning when fixed
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 24, 2015, 08:38:43 PM
I see that Tony has re-enabled uploads to the site on the MDWS home page :) more to follow I'm guessing :) Thanks for his hard work ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 24, 2015, 09:04:35 PM
I still get a temporary home page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 24, 2015, 09:12:48 PM
Attached, below, is a screen-scrape.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 24, 2015, 09:54:29 PM
its working again at least in some capacity. as g.inp emails are resumed. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 24, 2015, 10:29:41 PM
I still get a temporary home page.

It's here: http://www.mydslwebstats.co.uk/Container.htm (http://www.mydslwebstats.co.uk/Container.htm)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 24, 2015, 11:12:10 PM
Hi all  :)

Thanks to all of those of you who left comments, it was these that persuaded me to have a go at getting it going again after getting rather upset and despondent at some remarks that were left initially after the server disastrously crashed.

Yes, it is (nearly) all running again and should be back on line tomorrow. It's taken a while beavering away in the background due mainly to having to fit in totally rebuilding the server from scratch and upgrading the basic software in the process and that had a number of knock-on effects. Just a couple of things still to fix, for instance the latency monitor isn't working at the moment. It hasn't been available publicly as I have been restarting it all frequently and has been down for hours at a time.

The holding page you get depends on where you come in from but wasn't intentional and I'll try to fix later.

There are about 30 people currently uploading, some never stopped!

I'll post more when it's available again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AArdvark on October 24, 2015, 11:21:42 PM
Welcome back!!

Glad you decided to not go.  ;D ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 24, 2015, 11:23:43 PM
Thanks for all your good work, Tony, and as a reward you can have an extra hour in bed tomorrow morning. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 24, 2015, 11:29:53 PM
Thanks for all your good work, Tony, and as a reward you can have an extra hour in bed tomorrow morning. :)

That reminds me the RPi / Raspbian does not see the extra hour in bed  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 24, 2015, 11:44:26 PM
Welcome back Tony ;D

Hope the donations page will be the first one to be going back up live :)

I'd be intrigued to know if you've found out what caused the major failure of the server? :no:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on October 24, 2015, 11:53:21 PM
Good news and thanks for all your hard work and giving it a go at getting it back up and running.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2015, 07:16:21 AM
That reminds me the RPi / Raspbian does not see the extra hour in bed  ;)

I'm slightly ashamed to admit that DSLstats doesn't handle it unless you close it down and restart it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 25, 2015, 07:40:05 AM
Great news Tony, thank you very much  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on October 25, 2015, 08:07:04 AM
Excellent Tony good to see you back running this ....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on October 25, 2015, 09:09:37 AM
Great news to hear MDWS is coming back!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 09:15:08 AM
That reminds me the RPi / Raspbian does not see the extra hour in bed  ;)

I'm slightly ashamed to admit that DSLstats doesn't handle it unless you close it down and restart it.


Thats funny that your embarrassed about such a minor issue :-)
But as a penalty the sun will go down an hour earlier tonight for all of us   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 09:19:06 AM
Hi all  :)

Thanks to all of those of you who left comments, it was these that persuaded me to have a go at getting it going again after getting rather upset and despondent at some remarks that were left initially after the server disastrously crashed.

Yes, it is (nearly) all running again and should be back on line tomorrow. It's taken a while beavering away in the background due mainly to having to fit in totally rebuilding the server from scratch and upgrading the basic software in the process and that had a number of knock-on effects. Just a couple of things still to fix, for instance the latency monitor isn't working at the moment. It hasn't been available publicly as I have been restarting it all frequently and has been down for hours at a time.

The holding page you get depends on where you come in from but wasn't intentional and I'll try to fix later.

There are about 30 people currently uploading, some never stopped!

I'll post more when it's available again.

Started uploading again can't wait to see the site back fully - great work Tony 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 09:33:54 AM
MyDSLWebStats IS BACK ONLINE  :yay:

Or should be...

Some Important Caveats

Based on some tests on a remote terminal from here:

Once you get a page up, I suggest you hit Ctrl+F5 (or whatever is appropriate for your OS) to pull fresh pages in.

If things look odd when you are connected, it would be a good idea to Log Out (menu link near page bottom) and then Log In again.

Otherwise post here or PM me. If it's security related please do NOT post on the forum please PM me instead  :-X

Things not working:
The large All User Stats monitor page - [now fixed]
Latency Thumbnail graphs
No Upload Warnings - too many people offline currently!

The Latency problem is third-party software related and it's a Sunday... There is a link to view your live graph directly though if it's enabled.

CLOCKS
MDWS thinks many of you have moved to Europe overnight!! Please check your clocks are not in DST any more if you have an asterisk next to your username in Current Uploaders (and are not in Europe!) . RPis need a manual reset.

Have fun! More to come no doubt.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2015, 09:40:47 AM
No problems here so far. I had to log in again, but apart from that everything came up as it should.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on October 25, 2015, 09:42:54 AM
Looking good, great to see it back, Tony. Many thanks for your sterling efforts.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 25, 2015, 09:54:21 AM
Reset the Pi and Dslstats this morning so all should be good from my end now.

Logged in no problem and its all looking good Tony! ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 10:03:32 AM
Welcome back Tony ;D

Hope the donations page will be the first one to be going back up live :)

I'd be intrigued to know if you've found out what caused the major failure of the server? :no:

Yes, that page is working well, I tested it earlier myself  :lol:

The crash was complicated but basically I had uninstalled an AV (Webroot Secure Anywhere that I've sued for some time) a few days before due to it slowing down the server and not being able to exclude anything from scanning, and then restarted the server to eliminate it totally.

BUT the b*** thing still had a process running that fired off and Blue Screened the server since all its files had vanished by then.

It was also in the process of writing to the database and a lot of things got screwed up. Then despite having some 130 backups, it proved impossible to restore them,  something I'm having a debate with the makers over as they say it shouldn't have happened... Hence the rebuild which should have solved all these problems. Certainly the restore works as it's running one at the moment.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on October 25, 2015, 10:14:59 AM
I've started logging again and the site asked me to login which I did and so far all looks good....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 10:16:56 AM
Most people will need to login in again due to the 7-day expiry having passed now - but if you use the web site then that shouldn't be necessary very often if at all.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 25, 2015, 10:49:20 AM
Yes, that page is working well, I tested it earlier myself  :lol:


Yes I just tested it too, I've just donated a starting amount to the kitty :) :drink:

The crash was complicated but basically I had uninstalled an AV (Webroot Secure Anywhere that I've sued for some time) a few days before due to it slowing down the server and not being able to exclude anything from scanning, and then restarted the server to eliminate it totally.

BUT the b*** thing still had a process running that fired off and Blue Screened the server since all its files had vanished by then.

It was also in the process of writing to the database and a lot of things got screwed up. Then despite having some 130 backups, it proved impossible to restore them,  something I'm having a debate with the makers over as they say it shouldn't have happened... Hence the rebuild which should have solved all these problems. Certainly the restore works as it's running one at the moment.

Hmm sounds like a real pain and frustration, but interesting that the uninstall failed and caused that much destruction as a result :-\ Glad its back up and running without too much hair loss ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on October 25, 2015, 12:06:26 PM
It’s only been back for a short while, but already proving it’s worth. My reported FECs were sky high:

Total time = 64 days 14 hours 41 min 56 sec
FEC:            3357822873              10399
Latest 15 minutes time = 11 min 56 sec
FEC:            7950353         0

Didn’t think this could possibly be right, so restarted my 8800NL and now back to normal.

Total time = 36 min 5 sec
FEC:            790             3

 :thumbs: :clap: :dance:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 12:22:08 PM
Despite resetting my password I still can't login   :-[
DSL Stats claims to be uploading my data though so I'm halfway there

Feeling all alone  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2015, 12:30:19 PM
Your data is showing there, so your uploads are working.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 12:33:22 PM
I know - but I'm getting invalid username when i try to log on to the website 'weird' as that the same username I have in DSLStats to upload my data

I'll wait until Tony has chance to read this and hopefully he can help me figure out whats wrong - I suspect he will embarrass me with a 'USER ERROR' issue  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 12:38:37 PM
I know - but I'm getting invalid username when i try to log on to the website 'weird' as that the same username I have in DSLStats to upload my data

I'll wait until Tony has chance to read this and hopefully he can help me figure out whats wrong - I suspect he will embarrass me with a 'USER ERROR' issue  ;D

Can you PM me your password pse and I'll trace from this end (no I don't know passwords)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 25, 2015, 12:43:45 PM
Thanks Tony
Just sent
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 25, 2015, 01:51:04 PM
Something minor I just found, clicking the Latency monitor at the top if you don't have one sent, directs to a broken linky.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on October 25, 2015, 03:46:19 PM
Tony possible to make 28 day cookie expiry a donater perk?

and welcome back :)  will resume uploading today.

--edit-- seems this time I didnt have to answer extra questions to login.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on October 25, 2015, 03:59:36 PM
 Thanks Tony,  the return is much appreciated and being put to good use.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 04:16:01 PM
I know - but I'm getting invalid username when i try to log on to the website 'weird' as that the same username I have in DSLStats to upload my data

Interestingly, this just happened to me  :-\ I think it's a case of CONFUSED_BROWSER syndrome. Changed to another browser on same terminal and logged in straight away. Probably need to flush out the browser, history cookies/restart etc etc but haven't tried yet.

If you want to try this yourself you'll need to reset your password again for the original account as I've done so several times....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: garypower on October 25, 2015, 04:36:16 PM
I've released an update to HG612 Stats GUI which removes anything MyDSLWebstats related from the GUI and automatically turns off the uploads. Hopefully this will disable uploads for people who haven't seen this thread who are using HG612 Stats & the GUI program.

I assume this needs reversing as no way to restart uploads now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 04:52:18 PM
Ronski just posted elsewhere

Until I reinstate the options,  which probably won't be until Tuesday night you have two options.

1. Roll back to a previous version of the GUI, which if you've not disabled the backup option will be in the backup folder, then don't update until I release another update.
2. Edit the ini file manually and change the option for upload to YES. Then don't run the GUI until I release an update.

Hope that helps.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: garypower on October 25, 2015, 05:01:08 PM
Ronski just posted elsewhere

Until I reinstate the options,  which probably won't be until Tuesday night you have two options.

1. Roll back to a previous version of the GUI, which if you've not disabled the backup option will be in the backup folder, then don't update until I release another update.
2. Edit the ini file manually and change the option for upload to YES. Then don't run the GUI until I release an update.

Hope that helps.


Thanks - did not think about the backup versions - all sorted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: underzone on October 25, 2015, 05:37:58 PM
I am VERY happy to see this back online! *** Donated ***
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 25, 2015, 05:59:25 PM
Why o why is SKY GO bufferibg with Sky Sports F1 are you seeing this to Tony ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 25, 2015, 11:05:09 PM
Why o why is SKY GO bufferibg with Sky Sports F1 are you seeing this to Tony ?

Complete PITA - Silverlight kept crashing out at the F1 Race Big Screen Party I was running this evening and had to reinstall it - no buffering though.

Great Race and Result - Lewis is Champion Again  :congrats: :clap: :yay: :yay: :congrats: :congrats:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 25, 2015, 11:44:15 PM
Anyone having issues logging in with Chrome on Android? It just says invalid user name? Working fine in Firefox on my desktop.  Have tried clearing all data in Chrome and it does not help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on October 26, 2015, 12:36:28 AM
Yes just watched the BBC highlights well done Lewis  good race still no showdown between the two of them maybe nexterm season. Will say  one thing bit of miss him not joining in the celebrations Paddy had to spray his champagne
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 26, 2015, 07:56:06 AM
Anyone having issues logging in with Chrome on Android? It just says invalid user name? Working fine in Firefox on my desktop.  Have tried clearing all data in Chrome and it does not help.

Working fine on my Android tablet with  Chrome.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: JamHam on October 26, 2015, 08:58:49 AM
Hi Tony,

Thanks for bringing this back. Its a great tool.

However I'm also having the same "Invalid User Name!" issue.

I've tried 3 different browsers, cleared all the history, cookies, saved info etc and reset my password plenty of times now, but still cant get in  :(

Have you any other ideas I can try?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2015, 09:16:01 AM
Hi Tony,

Thanks for bringing this back. Its a great tool.

However I'm also having the same "Invalid User Name!" issue.

I've tried 3 different browsers, cleared all the history, cookies, saved info etc and reset my password plenty of times now, but still cant get in  :(

Have you any other ideas I can try?

Thanks

Please try again now, think I've found out why it's failing for some ...

Edit: if it failed try again, missed something at 09:20
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: JamHam on October 26, 2015, 09:17:34 AM
Hi Tony,

Thanks for bringing this back. Its a great tool.

However I'm also having the same "Invalid User Name!" issue.

I've tried 3 different browsers, cleared all the history, cookies, saved info etc and reset my password plenty of times now, but still cant get in  :(

Have you any other ideas I can try?

Thanks

Please try again now, think I've found out why it's failing for some ...


Thats worked a charm,

Straight back in.

Thanks for your help, and again thanks for bringing this back.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2015, 09:48:03 AM
We'll get there eventually  ???

If you are stuck on a Guest login with nowhere else to go then hit F5/whatever to reload and you should end up at the Log In screen. From then it will hopefully work   :'(

You might also need to clear your cache in Chrome I am told.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 26, 2015, 10:43:00 AM
Anyone having issues logging in with Chrome on Android? It just says invalid user name? Working fine in Firefox on my desktop.  Have tried clearing all data in Chrome and it does not help.
Working for me now also.  Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 26, 2015, 12:49:52 PM
All working here now for me  :clap: :clap:

Thanks to Tony for some first rate support
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2015, 05:47:17 PM
CLOCKS [AGAIN!]

Just a reminder that MDWS thinks many of you have moved to Europe since the clocks went back!!

Please check your clocks are not in DST any more  - if you have an asterisk next to your username in the user lists at page bottom (and are not in Europe!) then your clock still needs sorting.

RPis need a manual reset and DSLstats needs a restart/reload.

NStar for the RPi says:
I use the command sudo dpkg-reconfigure tzdata and select Europe and London it does take a few minutes for the RPi to initiate the new settings.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 26, 2015, 06:56:35 PM


CLOCKS [AGAIN!]

Just a reminder that MDWS thinks many of you have moved to Europe since the clocks went back!!

Please check your clocks are not in DST any more  - if you have an asterisk next to your username in the user lists at page bottom (and are not in Europe!) then your clock still needs sorting.

RPis need a manual reset and DSLstats needs a restart/reload.

NStar for the RPi says:
I use the command sudo dpkg-reconfigure tzdata and select Europe and London it does take a few minutes for the RPi to initiate the new settings.

On my Rpi2 typing tzselect option 8 option 8 again showed the time was correct and both the same gmt/utc.  Could not get the "sudo dpkg... tzdata" command to work.  I needed to close and reopen dslstats to make the change apply - I may have been impatient though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 26, 2015, 09:57:13 PM
Strange I don't remember changing the clock on my RPi but its showing the right time
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 26, 2015, 10:49:07 PM
It should do if it's set up properly. But DSLstats doesn't change with it unless you close it down and restart it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on October 26, 2015, 10:55:01 PM
It should do if it's set up properly. But DSLstats doesn't change with it unless you close it down and restart it.

Yes had to restart DSLStats but the RPi was fine

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on October 26, 2015, 10:55:19 PM
MDWS is back. Yay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: doughnut on October 27, 2015, 10:10:49 AM
Yippee :)

Tony, can you mark me as a paid donator please?

I paid up just before it went down, so there is a potential those updates were lost in the DB.

No hurry though

Alan
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 27, 2015, 11:52:42 AM
Done but you'll need to hit F5 to get the facilities....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: doughnut on October 27, 2015, 02:10:56 PM
Done but you'll need to hit F5 to get the facilities....

Thank you very much Tony  :yay: :yay: :yay: :yay: :yay:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 27, 2015, 08:04:14 PM
For those of you who are using HG612 Stats, and have the GUI version which disabled MyDSL Stats functionality I have released an update to reinstate MyDSL WebStats fuctionality, note this will not automatically enable stats upload, you'll need to check to ensure it's enabled after installing the update.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 28, 2015, 04:43:45 PM
Just to say that the Upload Monitor facility is running again on MDWS if you want to be mailed if and when your data upload fails (reachable to set on or off (default) via Options) ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 28, 2015, 05:21:46 PM
Is it just me or are the stats at the top of the page wrong?

Are the stats at the top full term or just from when you login to mydslweb stats?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on October 28, 2015, 05:32:56 PM
Is it just me or are the stats at the top of the page wrong?

Are the stats at the top full term or just from when you login to mydslweb stats?

Stats at the top are your live stats, the most recent you've uploaded.

Although sometimes it take a while for them for update - so it may be 30seconds behind your uploads
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 28, 2015, 05:40:20 PM
Stange mine are wrong My CRC/FEC/ETC are showing as much lower than what i am seeing from my local stats

Even the Grafs are showing more
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 28, 2015, 06:17:31 PM
Stange mine are wrong My CRC/FEC/ETC are showing as much lower than what i am seeing from my local stats

Even the Grafs are showing more

Difficult to tell without more info on what exactly you are looking at your end when you mention graphs and stats...

Do you realise your local clock is running 11 hours ahead of the current time  :o . When you reset it, you'll not upload any new data for 11 hours BTW..  [Uploading from an Orange UK address]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 03:43:20 PM
Apologies for any hiccup/lost connection etc noticed in past few minutes - I managed to crash the Apache process (Web Server) due to an over-ambitious live database backup run :-X :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 29, 2015, 04:06:07 PM
Hello Tony,

Great to see you and your wonderful creation back again.

It looks as if my updates haven't been happening since around 15:29. Do I need to do anything or will it pick up again

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 04:11:19 PM
Reload whatever isn't working please  :'(

Edit: yup that worked, you are uploading again. RPis don't seem to recover as well as other devices.
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 29, 2015, 04:43:24 PM
Is it possible to request that the HiRes option is remembered in a future version?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 29, 2015, 06:56:18 PM
Tony -- A small request from The Cattery, please. Would it be possible for the selected "Graph Size" to persist?  :-\

On every occasion when I use your utility to view A.N.Other's statistics, the "Graph Size" has defaulted to "Standard" even though I had previously selected "Large".
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 07:23:33 PM
Is it possible to request that the HiRes option is remembered in a future version?  Thanks

Yes but it would be set globally and via the Options popup.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2015, 07:26:44 PM
Tony -- A small request from The Cattery, please. Would it be possible for the selected "Graph Size" to persist?  :-\

On every occasion when I use your utility to view A.N.Other's statistics, the "Graph Size" has defaulted to "Standard" even though I had previously selected "Large".

I think that is just a display problem and it says 'Standard' when it's actually displaying the graphs in the size you last selected.

Anyway it's fixed now and should display the correct size. If, for some reason there is no size set (loss of the cookie holding the value) it defaults to Standard.

If it persists can you describe a sequence that reproduces it please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 30, 2015, 04:33:50 AM
Thanks for the heads up Ton
i was using a old armhf device that was very slow unstable...

I am now using my centos linux server

need to the let the system read my line for some time i am getting very high numbers of ES for some reason and gent seem to find the cause maybe REIN Or Maybe RFI or heating or PIR light wish i had a VDSL test meter to Do live tests on the Line...

Are the Errors i am seeing anything to be worried about?
can you have a little look at my webstats thanks and let me know what you think :fingers:..
I just cant get my head around the errors/stats i am seeing ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 30, 2015, 08:14:34 AM
Are the Errors i am seeing anything to be worried about?
can you have a little look at my webstats thanks and let me know what you think :fingers: ..
I just cant get my head around the errors/stats i am seeing ???

Don't get paranoid over these stats now you can see them  :silly: This facility seems to cause that problem when visible errors are involved.

There are others who can comment better than I can but I wouldn't be over worried about what you are seeing. The Dynamic Line Management system (DLM) will only take drastic action on your line when you hit 2880 ES/day - and you are running at 600/day at the moment which it will not worry about - although you only have 18 hours worth of data currently - so you could hit 800 at 24 hours.

After all you are synced at 80/20 - what more do you want and have quite a bit of overhead in hand to cope with problems (how full is your cab and how long have you had FTTC, you may not be seeing crosstalk yet though?).  Get rid of all the errors and you'll still be syncing at 80/20 after all  :shrug2:

I'll happily swap with you if you are really worried - but 34/5 isn't quite the same as you have currently....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on October 30, 2015, 10:40:53 AM
Is it possible to request that the HiRes option is remembered in a future version?  Thanks

Yes but it would be set globally and via the Options popup.
Great same for "Show Total Averages" would be fantastic  
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: beardedwonder on October 30, 2015, 12:09:18 PM
Hi,

Would just like to say thanks, these stats have really helped me supply proof to my ISP that I have been experiencing problems. Am running the stats on a Rpi.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jimgb17 on October 30, 2015, 02:20:36 PM
Thanks for the reply tom
I have had fttc from 25/sep
I see the Es/day are going up slowly
i see now a am now amber amber red.
Its good to know i's nothing to worry about ;D
I was The thirst one on the cab so don't think cross talk is an issue YET :-X
i will keep an eye on the Stats Its great be able to Monitor the stats the way your service provides
Thanks for the great service i will one day understand the errors a little more :graduate:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 30, 2015, 03:44:37 PM
i see now a am now amber amber red.

Actually you are Amber Green Green - the lights read horizontally just to be awkward, the others are for different profiles  that get stricter as you go down the set  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 30, 2015, 06:13:36 PM
Anyway it's fixed now and should display the correct size. If, for some reason there is no size set (loss of the cookie holding the value) it defaults to Standard.

If it persists can you describe a sequence that reproduces it please?

Thank you Tony. I'll see how it now behaves for me.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 31, 2015, 07:33:48 AM
UPDATES

By popular demand, for V2 the check boxes that lose their settings can now be set persistently. They are:

HiRes SNRM Graphs
Totals/Averages for Errored Seconds Graphs
Show Resyncs on SNRM Graphs


The old checkboxes are still there but are now disabled, just showing the current settings which are now made via the Options menu instead.

Changes will take effect immediately and globally on the next graph refresh but the setting may not initially display correctly for the checkboxes unless you hit the green refresh button in a pane or F5 for a complete reload.

Usual caveats still apply for the results on each (see Help), especially having both Resyncs and HiRes enabled as with the former the latter will not work even if checked (unless there are no resyncs in the time period when it will work - sometimes!) or if the timeline display is not complete,

I'll see if I can move these settings to the bottom of the main window eventually rather than have them on options as this would be more convenient. Edit: I have done this now but as it involves a lot of knock-on changes, I'll leave it running here for a while to check there are no unexpected side-effects.

Enjoy  ;D

NB: Thanks for all the donations - quite inspiring  :drink:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on October 31, 2015, 05:02:22 PM
Anyway it's fixed now and should display the correct size. If, for some reason there is no size set (loss of the cookie holding the value) it defaults to Standard.

If it persists can you describe a sequence that reproduces it please?

Thank you Tony. I'll see how it now behaves for me.

It now appears to be maintaining my selected pane size. So I'll say that is a job well-done.

Thank you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 31, 2015, 05:16:46 PM
Noticed a small bug with the show averages error seconds pane today , it seems greyed out so i cant select it to get the average error rate, also the data loading in each pane is maybe a little slower than it was earlier in the week ,using latest version of ff btw
Just found the new check box in options to enable it, though i didn't have any issues with  the way it was i have got used to ticking the check box if i wanted to see the average /total error second count, the slow loading of the data  seems to be limited to the initial or full page reload
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 31, 2015, 06:57:30 PM
The wee RPi just stopped uploading to MDWS and unable to connect to modem/router on Dslstats at 16:50 the only way to get it working again was to reboot the RPi very odd but it's uploading again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 31, 2015, 11:11:54 PM
I went back 120 days on MDWS it says waiting i take it our history is unsalvageable since the server crash ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 31, 2015, 11:34:28 PM
I went back 120 days on MDWS it says waiting i take it our history is unsalvageable since the server crash ?

No, database is all still there from the daily backups - mind you you did ask me to delete your account  :D

Works fine here on SNRM at 120 days and back 360 days as well...

I would guess you just had a timeout somewhere en-route as the server came back with 250ms to get the data out on its way to you for that query.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 01, 2015, 12:09:03 AM
I went back 120 days on MDWS it says waiting i take it our history is unsalvageable since the server crash ?

No, database is all still there from the daily backups - mind you you did ask me to delete your account  :D . Looking at what?

Works fine here on SNRM at 120 days and back 360 days as well...

Your a cheeky wee monkey but i love you  :D
funny my 120 days came back on MDWS after the first post  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on November 01, 2015, 01:45:51 AM
newt you wanted account gone?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 01, 2015, 03:27:36 PM
newt you wanted account gone?

Only to see if i could survive without MDWS for a week  ;D
and just by chance the server went down for few weeks and no withdrawal symptoms  :blush:

It's just a great site and the GUI on V2.0.0 is just a dream it looks so professional.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 09:49:42 PM
SNRM not showing history above 3 days on MDWS using PC 32 bit windows with Chrome Version 46.0.2490.80 m
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 05, 2015, 09:55:43 PM
SNRM not showing history above 3 days on MDWS using PC 32 bit windows with Chrome Version 46.0.2490.80 m

As I said on the original thread (http://forum.kitz.co.uk/index.php/topic,15998.msg304144.html#msg304144), no problem here under FF and Chrome under 8.1 but it may have something to do with Vista at your end as I've never tried it on that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:17:02 PM
Have rebooted PC into Windows 8.1

I am using Windows 8.1 and IE11 and same result roseways SNRM history will not go above 2 days the MDWS window just says waiting.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 05, 2015, 10:23:10 PM
Just tried on Firefox, Chrome and IE11, could view Roseways SNRM db graphs without problems on all 3, for any number of days. (W7 Pro 64bit)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:29:56 PM
Just tried on Firefox, Chrome and IE11, could view Roseways SNRM db graphs without problems on all 3, for any number of days. (W7 Pro 64bit)

It is very odd I can see others SNRM over 3 days apart from Roseways
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:42:06 PM
Just tried on Firefox, Chrome and IE11, could view Roseways SNRM db graphs without problems on all 3, for any number of days. (W7 Pro 64bit)

It is very odd I can see others SNRM over 3 days apart from Roseways

Sorry that is incorrect I can't see anyone's SNRM above three days only 2 days worth of SNRM  ???

This must be a issue with my account on MDWS  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 05, 2015, 10:44:17 PM
It certainly works for me.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 10:53:38 PM
It certainly works for me.  :)

It sure does B*CAT I am now sure my MDWS account has a problem and it's nothing to do with vista or win8.1 or type of web browser apart from IE9 that does not work on MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 05, 2015, 10:58:46 PM
The only suggestion I have to make is to clear the cookie(s) for MDWS and the browser cache.  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:07:53 PM
The only suggestion I have to make is to clear the cookie(s) for MDWS and the browser cache.  :-\

hate doing that I'll lose all my log in details and then have re-enter them for all my favourite web sites and that's what I call a last resort.

Give Tony a few hours to look into this issue remember he did give me back my history so what ever he did this could be the place to start looking into.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:21:37 PM
Same for BaldEagle1 SNRM anything above 2 days it goes into a waiting state

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:30:22 PM
found the problem it's in the options under Check to show SNRM graph Resyncs if it's ticked then I don't see the SNRM graphs above 3 days.

give me a gold medal  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on November 05, 2015, 11:34:13 PM
Same for BaldEagle1 SNRM anything above 2 days it goes into a waiting state


Works for me, but I can only go back 5 days
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 05, 2015, 11:40:29 PM
Same for BaldEagle1 SNRM anything above 2 days it goes into a waiting state


Works for me, but I can only go back 5 days

Cheer BE1 think we have found the issue on MDWS  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 07:48:49 AM
found the problem it's in the options under Check to show SNRM graph Resyncs if it's ticked then I don't see the SNRM graphs above 3 days.
give me a gold medal  ;D

I'm outa Gold Medals at the moment but yes, you've thankfully found the problem  :D and of course that option was turned off here  :doh: ....
Now fixed for > 2 days. Cheers  :clap:

Edit: Also found some more similar ones in the 'Original' graphs for ES and Resync checkbox facilities. All fixed.
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 04:03:11 PM
THOMSON/TECHNICOLOR ROUTERS - NEED V5.6.2 (or later) of DSLstats

There are a number of new users using one of the above routers to upload to MDWS - if you do use one PLEASE make sure you are using V5.6.2 (or later) of DSLstats as there is a bug in V5.6 that causes the stats figures to be reversed for uploads and downloads with ensuing strange results.

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BritBrat on November 06, 2015, 05:50:29 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking closer it says it is 5.6.0, confused.

I am using DSLstats, should I be using something else?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 05:54:39 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking at your stats, you are not running a Thomson/Technicolor router/modem as there is data there that they do not provide.... You can display your router/modem via the Options link at the bottom of the main page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BritBrat on November 06, 2015, 05:55:40 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking at your stats, you are not running a Thomson/Technicolor router/modem as there is data there that they do not provide.... You can display your router/modem via the Options link at the bottom of the main page.

I am not and never had one.

EDIT: MyDSLWebStats.Co.Uk + DSLstats_W32 V5.6
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 06:00:13 PM
Mine says up to date and it is 5.6? and the stats looked OK.

Looking at your stats, you are not running a Thomson/Technicolor router/modem as there is data there that they do not provide.... You can display your router/modem via the Options link at the bottom of the main page.

I am not and never had one.

EDIT: MyDSLWebStats.Co.Uk + DSLstats_W32 V5.6

No but the comment about 5.6(.0) and DSLstats was addressed to Thomson/Technicolor users only...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BritBrat on November 06, 2015, 06:02:25 PM
Oh sorry. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2015, 06:55:16 PM
DOWNTIME Saturday 7th November

There will be downtime of around 30 - 40mins tomorrow morning starting sometime between 07:00 - 07:30 to change the batteries on the server UPS which expired a few days back (replacements just arrived), and also make some software/hardware changes while the opportunity is there.

Upload clients should reconnect automatically but worth checking. I'll post when it's back up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on November 06, 2015, 07:48:45 PM
Oh no! I am going to die without your site.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on November 07, 2015, 12:31:15 AM
Alec.   Stop it please..   or I will stop it for you.
I'm getting quite fed up of negativity and sarcasm of late which is coming across as troll like. 

This is twice now Ive had to respond to moderation issues, (1) when I'd gotten home late after having been at my dads bedside during his final days, and now (2) when I'm mourning his death.  There was also I believe another incident on the day he died which my mods had to deal with...

I am not amused.  >:(  In fact Im down right peed off.   
Tony does what he does for the benefit of others.   I run this site for which Im also well out of pocket this year.   I'm not paid to put up with your crap.  Take it elsewhere. 
I warned last time I would be blunt and that I dont find it in the least bit funny...  any more snipes at helpful members of the community and either I or my mods will bring the hammer down.

I requested that people play nice whilst Im not around.  Neither Eric, nor b*cat who are doing me a favour helping looking after the forums, shouldn't have to deal with it either.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 07:45:11 AM
System is back up now and all seems okay - panic while it took 10 mins to get the modem to sync though as that was down as well  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 07, 2015, 07:54:40 AM
Yes, DSLstats resumed at 7:40 here. Good job, Tony. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on November 07, 2015, 08:14:00 AM
Yes all working fine here also. Great work Tony

That moment when I issue a reboot of a server its always a 'will it won't it moment' for me
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 07, 2015, 08:08:45 PM
I hate to bring this to your attention the Resyncs and HiRes options are greyed out in SNRM and in the Errored Seconds graph the Show Totals/Averages is greyed out even if I select them in the options menu and do a F5 refresh the option show as saved.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 09:33:39 PM
Okay, they are meant to be like that unless I'm missing something.

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg303802.html#msg303802) ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 07, 2015, 10:58:31 PM
Okay, they are meant to be like that unless I'm missing something.

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg303802.html#msg303802) ...

That's ok it's just a bit of hassel to turn on/off the ES total/averages from within the options and save then hit F5 rather than click on and another click off from the GUI it was so simple you had it set like this before.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 07, 2015, 11:06:10 PM
 ???  b*cat has looked in the options (bottom of the page) and finds that he only has the means for changing his e-mail address and for changing his password.

There is nothing else present . . .  Confused.  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 11:15:17 PM
In your case, I can guess why that is (to do with no recent uploads) and I'll fix it in the morning and rearrange the order of the options a bit...

Edit: Try it again now.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 07, 2015, 11:24:22 PM
In your case, I can guess why that is (to do with no recent uploads) and I'll fix it in the morning and rearrange the order of the options a bit...

b*cat smiles inscrutably and performs one of his best Japanese-style bows.  :)

I only really use the service to view the status of others' circuits. I seem to recall that it was Chrysalis who originally prompted me to sign up (as he wanted an opinion on his circuit's well-being) and it was yourself who urged me to upload (so that Eric had someone testing the upload function of the Linux variant of his DSLstats utility).  :angel: 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 07, 2015, 11:29:07 PM
Okay, they are meant to be like that unless I'm missing something.

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg303802.html#msg303802) ...

That's ok it's just a bit of hassle to turn on/off the ES total/averages from within the options and save then hit F5 rather than click on and another click off from the GUI it was so simple you had it set like this before.

Yes, but it didn't work properly as it was...

As noted it'll be available from below the current link list at the bottom of the page shortly where there will also be some rearrangement as per the attachment... No reload, instant change but graphs need refreshing or wait until they do so automatically

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 08, 2015, 09:29:01 PM
I have noticed what maybe a small bug with the DLM error count, the upstream appears to work ok, but the DS  is hanging on to 1 error second even after several days with no ds error seconds reported ??
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 08, 2015, 10:12:13 PM
Edit: Try it again now.....

Just a quick note to confirm that all is now good. Thank you.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 08, 2015, 10:51:23 PM
I have noticed what maybe a small bug with the DLM error count, the upstream appears to work ok, but the DS  is hanging on to 1 error second even after several days with no ds error seconds reported ??

Yes, now fixed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 08, 2015, 10:51:47 PM
Edit: Try it again now.....

Just a quick note to confirm that all is now good. Thank you.  :)

Great  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 09, 2015, 08:17:09 AM
Well the 1 error second that had been lingering for days has finally gone, so everything seems to be working as intended as far as i can tell, which is nice
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2015, 07:35:08 AM
V2.0.1 MINOR UPDATE

This is now available and will need an F5 or appropriate main page refresh/reload to fully implement.

It moves the persistent checkbox options to below the options menu at the bottom of the main MDWS window making them easier to change and so they are no longer available in the Options popup. As a result, these checkbox options are no longer displayed within the graph panes themselves. There is also some rearrangement of the links to make them tidier with Help now a link.

The change is implemented instantly without any refresh but you will need to Refresh (using the button by that name) any graphs that are affected or wait for them to auto refresh to pick up the new setting. The current setting is stored against your user name so is global for all affected graphs. It may be possible to automate the graph refresh later.

There are a number of other background changes and minor bug fixes.

GOOGLE SLOW

I notice for the past few days that Google is being very slow to respond at times making it appear that MDWS is hanging/not responding - you can check using the status bar that should be at the bottom of your browser window and will say waiting for www.google.com or canv.googlecode.com or similar. It's very bad at the time of posting this and may time out eventually leaving a blank graph.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on November 15, 2015, 09:09:06 AM
Thanks for the update  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 15, 2015, 03:55:58 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2015, 04:20:38 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D

Why  :hmm:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 15, 2015, 04:47:42 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D

Why  :hmm:

I'll be using the F5 button on keyboard more as I switch on/off the ES totals
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 15, 2015, 05:16:59 PM
This F5 button on the Keyboard will be worn out well before the left mouse button but if that's the consensus I can live with it  ;D

Why  :hmm:

I'll be using the F5 button on keyboard more as I switch on/off the ES totals

You only need to hit the Refresh button on the graph in question to reload that, NOT reload the whole page!

I do have it working automatically now locally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 18, 2015, 10:34:10 AM
V2.0.2 MINOR UPDATE

This is now available and will need an F5 or appropriate main page refresh/reload to fully implement.

It removes the need to Refresh any graphs manually after changing the checkbox options at the bottom of the window.

Any affected graphs currently visible will now refresh automatically within a second or so of changing any checkbox.
 
Also, Supporters now have the option of removing the display of much of the information normally shown at the bottom of the main page if wanted. There are two additional links available near the bottom of the main page. One will Show or Hide the list of currently active Users and Uploaders, the other does the same for the general information shown at the bottom of the main window. Both will refresh the whole window when changed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 18, 2015, 06:02:10 PM
Many thanks Tony it works very well  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 20, 2015, 02:37:28 PM
Latency Graphs Working Again  :)

This fixes the last remaining thing that had failed when the server crashed.

The small thumbnails that appear to the far right of the User Status display above the Wide graphs (only) will appear automatically if available - they can be up to 48 hours old after which they won't display. The date/time they were saved is available by hovering over the thumbnail image. Selecting shows the current full size image.

The larger thumbnail for your own graph is also available again at top right of the main page if enabled. If the graph you currently see has no time under it and/or cannot be selected to show the full size graph then you need to F5 (or as appropriate) the main page once to pick up the code changes. The thumbnail image autoupdates every 5 mins or so.

The attachment shows some examples.

This facility is set up via the Options link and you will need to specifically allow others to view your graph within the User Status display.

Please note that several users have specified speed results or other irrelevant image for the Latency facility. These will be deleted shortly. Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 22, 2015, 08:52:36 AM
Is there a problem haven't  been able to login  since yesterday afternoon
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 22, 2015, 09:18:49 AM
Working ok here, although I didn't need to login.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 22, 2015, 09:35:48 AM
Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.

Could you not monitor the IP which is uploading the data and automatically disable the latency graph when you see a change?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on November 22, 2015, 10:13:17 AM
Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.

Could you not monitor the IP which is uploading the data and automatically disable the latency graph when you see a change?
Could TBB not fix their system to support dynamic IP's as there are quite a few around?
Mouselike.org supports them.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 10:48:59 AM
Is there a problem haven't  been able to login  since yesterday afternoon

You don't seem to have tried to logon since yesterday afternoon? Do you mean connect rather than logon although I can't see any reason why you shouldn't be able to.

Are you seeing any fail etc messages at all in your browser?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 22, 2015, 10:53:56 AM
I can't even get to the website just says failed to connect either from wired or a wireless device. Just tried my mobile on o2 that takes me straight in but no upload since about 12.30 yesterday.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 10:56:19 AM
Also, if you are on a dynamic IP then you need to update the link when it changes otherwise you'll get some very strange results.

Could you not monitor the IP which is uploading the data and automatically disable the latency graph when you see a change?
Could TBB not fix their system to support dynamic IP's as there are quite a few around?
Mouselike.org supports them.

Bear in mind they are uploaded to and hosted by ThinkBroadBand, not MDWS. However, since they are pinging your modem then the IP will be the same as the upload IP.

Probably not a very worthwhile thing to do as there is no monitoring of IPs changing as such - and even if there was, there's no guarantee that the user hasn't immediately uploaded a new graph location so it gets complicated to handle (I'm on a dynamic IP on one of my lines and do the change automatically after a resync).

There is a facility coming up to view User's latency graphs in one window (like the AllUserStats window) but only if you have selected public visibility for your Latency Graph via the Options link. Currently 62 users have latency graphs registered but only 20 have made them publicly available.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 10:59:40 AM
I can't even get to the website just says failed to connect either from wired or a wireless device. Just tried my mobile on o2 that takes me straight in but no upload since about 12.30 yesterday.

Can you find out your IP address please and PM it to me?

http://whatismyipaddress.com/

You accessed the web site at 10:47 just now on an Android device but didn't seem to load much.... 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 22, 2015, 11:05:45 AM
Yeah that was my mobile. Just checked  the server and that has internet connection and  software running. OK Tony will do
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 01:45:51 PM
Yeah that was my mobile. Just checked  the server and that has internet connection and  software running. OK Tony will do
Just confirmation this is now fixed...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 22, 2015, 02:56:32 PM
I did a cleanup using CCleaner yesterday and ever since doing this i have lost the stats pane in graph size standard it shows up ok if i select original and have looked for a setting to turn it back on again but cannot seem to find it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 03:35:24 PM
I did a cleanup using CCleaner yesterday and ever since doing this i have lost the stats pane in graph size standard it shows up ok if i select original and have looked for a setting to turn it back on again but cannot seem to find it.
I think you'll find using CCleaner and other Windows 'Registry Cleaners'/PC Optimisers etc is a total waste of time and energy and doesn't achieve anything other than cause problems like you have now. I have an adversity to letting a free 3rd-party program loose on my PC to delete whatever it feels shouldn't be there even if you can select from loads of options... What is considered unnecessary to CCleaner may be vital to something else (as you may have discovered)...

What exactly do you mean by 'stats pane'? The whole pane or maybe the Status part of the pane only? Screen grab would be helpful.

Edit:
I've removed a bit of code that looks for a cookie that might have been deleted by CCleaner and isn't recreated very often. See if it works now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 22, 2015, 03:57:29 PM
Probably not a very worthwhile thing to do as there is no monitoring of IPs changing as such - and even if there was, there's no guarantee that the user hasn't immediately uploaded a new graph location so it gets complicated to handle (I'm on a dynamic IP on one of my lines and do the change automatically after a resync).

If you were inclined to implement such a feature that would be easy to deal with: store the TBB URL and the IP address has changed but the TBB URL hasn't it should be removed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 04:17:36 PM
Probably not a very worthwhile thing to do as there is no monitoring of IPs changing as such - and even if there was, there's no guarantee that the user hasn't immediately uploaded a new graph location so it gets complicated to handle (I'm on a dynamic IP on one of my lines and do the change automatically after a resync).

If you were inclined to implement such a feature that would be easy to deal with: store the TBB URL and the IP address has changed but the TBB URL hasn't it should be removed.
Yes I realise that but the needed info isn't there currently as I said. I'll add it to the list.

Edit:
I've added some extra config to do this now and coded it in. Just need to test if for a few days to make sure mailing the user to remind them to change it works as intended (but only if they haven't changed it by the time the check is made every so often)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 22, 2015, 05:20:53 PM
Edit:
I've removed a bit of code that looks for a cookie that might have been deleted by CCleaner and isn't recreated very often. See if it works now.

Cheers Tony that has it working again  :)

EDIT:

I don't remember seeing two DLM Error Stats Indicators when using the standard  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 22, 2015, 05:48:48 PM
Has the other one gone now?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 22, 2015, 05:51:39 PM
Has the other one gone now?

Yes it has and many thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 22, 2015, 11:42:56 PM
Hi Tony

I have been uploading to MDWS using DSLStats on Windows and I will take a look at the web-interface every now and again to see if anything's happening. However, as I'm on a perfectly healthy VDSL2 connection on a very short-line, little is "happening" as I put it... it has become quite boring in-fact! Anyway, my unexciting stats aren't the issue

I've noticed for a week or two now that I cannot access the MDWS website in my browser, the page just times out. I ignored it at first as I know you were making some changes but then I realised that DSLStats couldn't validate or upload either. I first blamed my messy PC and tried an alternate browser, checked my AV, checked host-files, etc... but quickly realised that none of my devices on my connection could access MDWS. I figured DNS problems so I changed the DNS on my connection back to my ISP's defaults but this didn't work either - the page still times out in any browser, on any device on my connection


As I'm uploading from Ireland, is there a geo-block or is my ISP (Vodafone Ireland) blacklisted perhaps? I can browse the MDWS site without issue on other ISP's so I assume maybe it's an ISP issue?



Thanks in advance and keep up the great work! I hope to make a donation in the coming days

condi (< same as my MDWS username)



EDIT: as it happens, I'm currently accessing the site without issue... but I'm toying with Google's Data Saver plugin for Chrome which is proxying the site around my connection. Without the plugin, the issue is as described above
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 23, 2015, 08:14:19 AM
Tony this morning I was sent an email by MDWS saying I was uploading again, this happened at 00:06 today but the thing is I had not had an upload failure message or a retrain, my PC sending the uploads was rebooted about 24 hours ago and I do not see any gaps in my graphs. Not concerned but thought I'd mention it.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 23, 2015, 09:22:32 AM
As I'm uploading from Ireland, is there a geo-block or is my ISP (Vodafone Ireland) blacklisted perhaps? I can browse the MDWS site without issue on other ISP's so I assume maybe it's an ISP issue?

Can you PM me your current IP Address please (the one that's giving the problem, not proxied though)

http://whatismyipaddress.com/ (http://whatismyipaddress.com/)


Thanks

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 23, 2015, 09:31:24 AM
Tony this morning I was sent an email by MDWS saying I was uploading again, this happened at 00:06 today but the thing is I had not had an upload failure message or a retrain, my PC sending the uploads was rebooted about 24 hours ago and I do not see any gaps in my graphs. Not concerned but thought I'd mention it.

Stuart

Well the message was quite correct - you had resumed uploading after a 17mins downtime from 23:48 - 00:05....

Just had a look and you have your Notify After set to 15 mins. Due to check timings not quite coinciding etc. I'd say it was probably about to send you a downtime message but the resume one got there first  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 23, 2015, 09:45:23 AM
Does the resume email say when it went down?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 23, 2015, 09:59:14 AM
No the message just says uploading again and no upload failure message was received before or after. Looking at the timing that is a very busy time on the PC which runs DSLStats. DSLStats does not show any break in what it was doing in the event log. This PC runs my weather station and although it is an Intel I5 it probably does get busy around this time because the weather program is busy doing end of day stuff, the forecasting program is busy doing the last forecast of the day. To be honest I doubt that this PC would get busy enough to cause a break in transmission of this length. As I say there is zero indication that anything failed on the PC itself.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 23, 2015, 10:12:15 AM
Can you PM me your current IP Address please (the one that's giving the problem, not proxied though)

http://whatismyipaddress.com/ (http://whatismyipaddress.com/)


Thanks

Hi Tony,

I've sent off my current dynamic IP as requested but surely enough, just as I sent it... all's working again!!

DSLStats is uploading (it told me I had an invalid key) and the MDWS website is opening again


Many thanks :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 23, 2015, 10:17:39 AM
Okay  :)

I can't find anything that would affect that range but just in case I've allowed it anyway (but after you sent your mail!)...

NB: You have an interesting U/L sync at 20480.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 23, 2015, 10:21:52 AM
Quote
DSLStats does not show any break in what it was doing in the event log.

When MDWS uploads fail, DSLstats may not detect the failure. Hence the absence of any event log entries. This is down to the fact that it uses an external program (curl) to perform the uploads, and the timeout mechanism doesn't always work if curl hangs. For the same reason the local DSLstats graphs will display a straight line during the down period.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 23, 2015, 10:33:22 AM
I have various alerts set to display in the event log so I might expect something if these monitored values change significantly. I can also see graph entries during the so called failing period for things like snrm and crcs. It is possible that the curl program is timing out for some reason which would cause a problem but I guess that does not log anywhere at least not in Windows 7 which is what this PC runs. (Sadly at present I cannot find a Linux weather program which does all I need  :( ). So as I say I can see no obvious cause unless it was curl which I cant check.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 23, 2015, 10:34:55 AM
Okay  :)

I can't find anything that would affect that range but just in case I've allowed it anyway (but after you sent your mail!)...

NB: You have an interesting U/L sync at 20480.....

Thanks Tony

It's certainly bizarre but it's all up and working here at the moment so I'll keep an eye on it for the next few days

Re. my upload sync - I'm on VDSL2 at about 200 meters from the exchange. The current attainable noted on my modem is 25 Mbps and the engineer got over 35 Mbps on his hand-held. 20 Mbps is the max upload speed available on eircom's, now open eir's VDSL2 network. The max download speed available is 100 Mbps when vectoring is used or 70 Mbps when non-vectored. Vectoring is limited to cabinet installs for now but I believe they are trialling exchange based vectoring in some areas at present. I'm non-vectored as I'm exchange based but my attainable downstream is currently showing 120 Mbps so I'm certainly looking forward to any developments around exchange-based vectoring
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 23, 2015, 03:25:31 PM
When I am here, this is a question concerning both MDWS and DSLStats

Would it be possible to support uploading back-data to MDWS... as in data that wasn't uploaded due to a missed or failed upload or data collected over a short period but not uploaded. What spurred the thought was a case I've seen on a poor connection where the link is on it's way to dropping, where the data channel falls but the DSL link stays active for a short time afterwards before collapsing also. As the data channel has failed, the last few moments of particularly interesting data from the DSL link are lost as they failed to upload. My thinking is that if DSLStats could temporarily cache those last few moments of data locally when an upload fails and then upload it to MDWS once the connection allows

I see DSLStats is storing some MDWS data in local ZIP and .log files so my innocent thinking is that it could build the cache here and then upload the lot on the next upload. However, I also recall reading about the importance of accurate clock times when using MDWS so perhaps uploading old data is a complete non-runner? I know it's a big ask either way so it's more just curiosity as to if it can be done
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 23, 2015, 04:42:32 PM
Unfortunately I think it's a non-runner for the reason you stated - the timing of uploads. Of course, in principle these things could be dealt with but it would require redesign at both ends, and at the moment I'm struggling to find the time to do the jobs which are already on the todo list.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 24, 2015, 01:26:30 PM
I've moved the very interesting but off-topic discussion of OpenEIR to http://forum.kitz.co.uk/index.php/topic,16506.0.html
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: condi on November 24, 2015, 01:50:37 PM
I've moved the very interesting but off-topic discussion of OpenEIR to http://forum.kitz.co.uk/index.php/topic,16506.0.html

Apologies roseway and thanks for moving it

Back to MDWS :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mavelot on November 24, 2015, 03:09:58 PM
Hello, I am a new member from Italy.
I would point out that I think there is a bug in the status bar.
As you can see from the attached image, the attenuation value upload (highlighted in yellow) is incorrectly printed in the box of the ES.
I encountered the same problem also looking at the statistics of other users.
I hope I was helpful
Thank you

(http://s24.postimg.org/yf9edss41/Cattura.jpg) (http://postimg.org/image/yf9edss41/)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 24, 2015, 03:46:07 PM
Hello, I am a new member from Italy.
I would point out that I think there is a bug in the status bar.
As you can see from the attached image, the attenuation value upload (highlighted in yellow) is incorrectly printed in the box of the ES.
I encountered the same problem also looking at the statistics of other users.
I hope I was helpful


Hi and Welcome!

You are quite correct and the U/S ES and Attenuation columns have been reversed for about a year! I've corrected it now so thanks for pointing it out.

NB: not all modems report an U/S value.

I'll also welcome our New Zealand user while I'm at it.... I had to check on where the +13 hours time offset was coming from  ???

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mavelot on November 24, 2015, 05:55:14 PM
Hi and Welcome!

You are quite correct and the U/S ES and Attenuation columns have been reversed for about a year! I've corrected it now so thanks for pointing it out.

NB: not all modems report an U/S value.

I'll also welcome our New Zealand user while I'm at it.... I had to check on where the +13 hours time offset was coming from  ???

thanks for the quick support tony!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 12:47:31 PM
V2.0.3 MINOR UPDATE

This is now available and will need an F5 or appropriate main page refresh/reload to fully implement if you don't see the extra menu entry.

1) This adds the original fail date/time to Upload Resumed emails

2) When a Latency Graph on a Dynamic IP has a change of IP address, this now invalidates the entry if you have one (for TBB graphs only) and you'll need to get and enter a new graph reference from TBB. You can elect to be mailed as a reminder if this happens via a new setting in the Options menu

3) A new facility is now available to Supporters with an extra entry in the menu links at the lower part of the screen of Latency.

This allows a view of anyone's Latency graph who has allowed their graph to be visible publicly (via an existing checkbox in Options).

This opens in a new window and has the options of viewing Small or Large thumbnails with various refresh frequencies. The graphs are stored on the server and updated every 5 mins. The attachments shows what it looks like for the two sizes. Selecting a thumbnail shows the original graph in a PopUp as usual.

There are some 60+ users with Latency graphs available but only 20 have allowed them them to be public currently.

Downtime Advance Notice
UK Power Networks are going to leave this location powerless next week (Monday I think) for "approx six hours" - although last time they did this it lasted a lot longer..... As the UPS only lasts about an 90mins the system will be taken down before they intend to start.

More details this weekend if they don't cancel as has happened before.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 25, 2015, 01:25:35 PM
Excellent work Tony!

It's just taken me three attempts to find the correct TBB URL to enter. I wonder if others had issues trying to set theirs so perhaps some guidance notes might be in order (it's a URL ending png not html).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 02:00:17 PM
Excellent work Tony!

It's just taken me three attempts to find the correct TBB URL to enter. I wonder if others had issues trying to set theirs so perhaps some guidance notes might be in order (it's a URL ending png not html).

Didn't MDWS tell you the html link was invalid?

Edit:
No it didn't but it will now and I've added a note under the URL field...

From Help:
Latency Monitor
This sets up the Latency Graph (Ping) facility and allows you to specify the graph location for supported graph types. Please make sure that you only use the graph link provided and that it is not an embedded link (it should end in .png or whatever format the image is in). When you select Save Settings you should see the thumbnail graph - if not then check your typing/source.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 25, 2015, 03:38:24 PM
Great work Tony, would be possible to show the user's ISP, and perhaps filter by ISP as well?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 25, 2015, 03:41:12 PM
Quote
would be possible to show the user's ISP

It does show the user's ISP, but the user has to enable it first (it's in the options, under the graphs). You can see mine, for example.

[Edit] Sorry, I'm talking rubbish, which isn't unusual. I was thinking of the modem type when I posted that. :paperbag:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 04:03:10 PM
Quote
would be possible to show the user's ISP

It does show the user's ISP, but the user has to enable it first (it's in the options, under the graphs). You can see mine, for example.

 :hmm: Er, there is no restriction or option on displaying the user's ISP - it's always shown above the live graphs at far right of the graph panel itself. I think there might have been when we first started MDWS though...

@Ronski
Do you mean on the Latency graphs themselves, say above or below the thumbnail? Or just the large version as it would then fit alongside the User Name
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 25, 2015, 04:23:59 PM
I've corrected my nonsense.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 04:26:14 PM
I've corrected my nonsense.

 from one  :oldman: to another  :oldman:

 ;)

I've also started saving a dated graph every day around midnight so there can be a historical option sometime...
 
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 25, 2015, 05:41:16 PM
The Latency facility now shows ISPs and later there will be a filter to select them out...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 25, 2015, 06:46:00 PM
That's it, and the filter will allow us to see just graphs for that ISP. Useful for seeing if something is affecting all users on a given ISP.  :thumbs:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on November 25, 2015, 09:28:09 PM
I'll keep my ICMP ping turned off thankyou very much  :)

"Why is my graph completely red (showing 100% packet loss)?

This may be due to firewall settings or because your IP address has changed. If you have a firewall, ensure that it allows ICMP ping. You will also see 100% packet loss if the address we are monitoring is disconnected from the Internet. You can find out how to configure your router or firewall "
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 26, 2015, 05:16:25 AM
And your point is? Or are you hinting at the security implications?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 08:11:28 AM
Tony I am wondering if it might be an idea to alter the frequency of emails when uploads fail. Mine started last night after I had gone to bed and this morning I had 20+ emails about it. Perhaps you could adapt the frequency of emails according to how long uploads have failed for, so for the first hour you send 6, after that only sending maybe one per half hour for a couple of hours and the hourly if still has not restarted. If this happened while I was on holiday it could be days before I saw it and would flood my inbox on the server with emails.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 08:36:32 AM
Tony I am wondering if it might be an idea to alter the frequency of emails when uploads fail. Mine started last night after I had gone to bed and this morning I had 20+ emails about it. Perhaps you could adapt the frequency of emails according to how long uploads have failed for, so for the first hour you send 6, after that only sending maybe one per half hour for a couple of hours and the hourly if still has not restarted. If this happened while I was on holiday it could be days before I saw it and would flood my inbox on the server with emails.

Stuart

It's a lot easier if you set a longer repeat interval in the first place please to avoid this happening.... After all you get a resume message if it comes back before the next fail message was due. I may default it to an hour anyway to avoid this problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 09:06:57 AM
It's a lot easier if you set a longer repeat interval in the first place please to avoid this happening.... After all you get a resume message if it comes back before the next fail message was due. I may default it to an hour anyway to avoid this problem.

To be honest I forgot it was an option  :( I will indeed do that.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 26, 2015, 09:14:34 AM
Tony, Would it be possible to have a 0 mins or Off option for the repeat which turns the repeat emails off?

I don't have the warnings enabled as the PC running HG612 modem stats is turned off over night and I don't want half a dozen or more emails telling me what I already know. I would like to be alerted if it fails during the day. A single email when it fails would be fine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 10:25:22 AM
Further changes to V2.0.3

1) There are now additional Configuration intervals for the repeat Upload Fail messages through to 24 hours to avoid too many messages if preferred. The repeats can also be turned Off completely if you want. You'll still get the initial message if the facility is enabled. If repeats are set to Off, you'll need to check the Notify after Uploads resume box if you want to know when the line comes back up.

2) All User Latency View - this now allows you to select the ISP so the graphs can be viewed for just one ISP (needs an F5 or whatever if already running to see the added list).

Note: The ISP list is only updated when the whole page refreshes (F5 or change Interval or Graph Size) and reflects all ISPs for all latency graphs in the system. Since not all users will allow a view of their latency graph, there may be no currently visible graphs for some ISPs...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 10:34:39 AM
Just wondering about the fail emails some more. I had to turn the power off yesterday to do some work here which means ofcourse that there will be no uploads even though my laptop running DSLStats will still operate for an hour or so on battery but the router is off. Now currently this will trigger a fail email after my initial period (currently 15 mins). Is there any way DSLStats could tell MDWS that uploading has stopped deliberately? That way I could stop DSLStats trying to record for the duration of the outage, something I dont bother with right now. Just a thought.....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on November 26, 2015, 10:35:45 AM
!!!***!!! Tony - that was quick!

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 10:43:27 AM
Just wondering about the fail emails some more. I had to turn the power off yesterday to do some work here which means ofcourse that there will be no uploads even though my laptop running DSLStats will still operate for an hour or so on battery but the router is off. Now currently this will trigger a fail email after my initial period (currently 15 mins). Is there any way DSLStats could tell MDWS that uploading has stopped deliberately? That way I could stop DSLStats trying to record for the duration of the outage, something I dont bother with right now. Just a thought.....

Stuart

Even if it was possible, which is unlikely, Eric has little time available to do anything currently. You'll just have to manage it yourself with the current options. Possibly just turning off the monitoring completely is the best idea if you can't cope with it as it is.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 26, 2015, 12:48:02 PM
Thats fine Tony I'll turn it off when I go away. I'll just leave those thoughts as an idea which might happen in the future if it is decided it's worth it.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gazaai on November 26, 2015, 03:28:54 PM
Hi Ive just started using myDSLwebstats and its great. I am running a Billion 8800nl with DSLStats on raspberry pi. Although I have noticed two things:

-I don't seem to have any G.INP stats on the site
-And why does my sync rate highlight in yellow even tho its only 4kbs from the attainable. A little too sensitive if you ask me

My username on myDSL is: GaZaai
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 26, 2015, 03:59:55 PM
Hi Ive just started using myDSLwebstats and its great. I am running a Billion 8800nl with DSLStats on raspberry pi. Although I have noticed two things:

-I don't seem to have any G.INP stats on the site
-And why does my sync rate highlight in yellow even tho its only 4kbs from the attainable. A little too sensitive if you ask me

My username on myDSL is: GaZaai

Your G.INP stats will be there now but only starting from now as the process that handles these had been hung up for some days....

The yellow background is only an alert..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gazaai on November 26, 2015, 05:42:02 PM
OK cheers, and yeah I know.. I'm just a bit OCD and don't like seeing the alert for something so little, if you know what I mean haha
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2015, 07:40:50 AM
OK cheers, and yeah I know.. I'm just a bit OCD and don't like seeing the alert for something so little, if you know what I mean haha
There is now an arbitrary 5% tolerance on U/S and D/S before it puts the warning on so see how that goes :) This will also remove the warning on some (but not all) G.INP lines where the Attainable is often a lot higher than the current Sync rate.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 27, 2015, 08:05:52 AM
I don't know how modems calculate the attainable figures, but in my case (with G.INP enabled) the attainable downstream is about 18 Mbps less than the actual speed. So I'm sure it's right to ignore the attainable speed when G.INP is enabled.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2015, 08:13:18 AM
I don't know how modems calculate the attainable figures, but in my case (with G.INP enabled) the attainable downstream is about 18 Mbps less than the actual speed. So I'm sure it's right to ignore the attainable speed when G.INP is enabled.
Yes, it's set to warn when the Sync is greater than the Attainable - which is the same as you are finding! I'll see if I can turn it off completely for G.INP enabled lines..

Edit: Done
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 27, 2015, 08:17:10 AM
I seem to be having problems viewing 24 hr graphs*, both of my accounts only show up to 24 November, Roseways is the same, Pauleagles only goes up to 25 November. Others are fine. As far as I'm aware both my accounts have been uploading, as I've had no emails.

*Actually I there are no dates past the 24 November in other graphs as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2015, 08:27:34 AM
Ah you mean the 24 hour multi graphs not the single 24 hour graphs.... I can see that and will have a look when I get back later.

Edit: now fixed.

Would it make more sense to have these graphs as rolling 24 hours to current time? And there really isn't enough vertical space to view them as wide graphs in the smaller heights currently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on November 27, 2015, 10:10:13 AM
All fixed thanks,  yes it would make sense to have the current days graphs showing the last 24 hour period up to the current time.

I'll sort you out another donation soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gazaai on November 28, 2015, 01:32:01 AM
Thanks for the quick edits, works excellent now :)

Edit: Just noticed that my DSLAM doesn't seem to have a value? I have a billion 8800nl and I have an Huawei cabinet, do you think its not uploading the information of my DSLAM?. Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 29, 2015, 11:38:18 AM
DOWNTIME MONDAY 30TH NOVEMBER 2015 from 10:00 or so

The MDWS server will be down from around 10:00 - 15:00 (or later) as UK Power Networks are pulling the power from our substation to finish renewing some overhead supply wiring. Maybe they'll remember not to disconnect the street lights permanently this time  ???
 
Edit: this never happened and no explanation as usual. Hopefully they'll tell us when they try again. Maybe.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 29, 2015, 11:52:14 AM
Thanks for the warning Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mikecrawford71 on December 01, 2015, 12:40:45 PM
Please can you advise if the Netgear D6400 can be added to the list for Upload Modems?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2015, 12:43:55 PM
Please can you advise if the Netgear D6400 can be added to the list for Upload Modems?

If it works okay, yes....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: mikecrawford71 on December 01, 2015, 12:58:48 PM
If it works okay, yes....

Hi Tony, I'm currently using DSLstats_W32 V5.6 to query the info from the modem (I've set the modem in DSLstats to a Netgear DGND3700 and that setting seems to get everything it needs from it).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2015, 01:10:30 PM
Okay done. Wasn't sure if you were asking if it would work, hence the question...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 02, 2015, 05:13:00 PM
Registration Failures

Anyone trying to Register since the 27th November will have failed with the page just reloading on submission but with no reason why being offered.

The page has, as required by current EU Law, a system that gets you to consent to the use of Cookies before continuing and it uses some Javascript code from another site to do this. Unfortunately, the host decided to move the code to another location as it was so popular they couldn't afford to host it for free (I know the feeling) - but without any visible error being generated which wasn't very helpful at all  :rant:

The facility is currently disabled until I can find a reliable solution which is to host it locally.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on December 03, 2015, 03:48:12 PM
why didnt you host the javascript locally? using a 3rd party you have no control over for code is a big security risk no? not to mention bad for performance with an extra dns lookup.

Or is there something I am missing. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 03, 2015, 03:55:32 PM
why didnt you host the javascript locally? using a 3rd party you have no control over for code is a big security risk no? not to mention bad for performance with an extra dns lookup.

Or is there something I am missing. :)

It is hosted locally now but couldn't be originally.  Haven't implemented it live yet though.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: deanwade on December 04, 2015, 10:15:23 AM
Good morning Tony,

In the notification email that can be configured, would it be possible to include or add an option for the public IP address after a resync/restart please?

I think this would be a useful feature for when one is away from home and ones DDNS service fails preventing remote access (as has just happened to me!).

If this is considered a security vulnerability then perhaps the public IP address could be displayed in the users account information.

I am using DSLstats_RPi V5.6 currently but hope to run the Linux DSLstats version on my Synology RS812+ NAS. ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 04, 2015, 10:36:46 AM
I think this would be a useful feature for when one is away from home and ones DDNS service fails preventing remote access (as has just happened to me!).
Just sign up to an additional DDNS service.

I certainly don't want my IP address bandied about in emails.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: deanwade on December 04, 2015, 10:56:03 AM
Whatever you would be comfortable with then.

A second DDNS service would suffer with potential common mode failures in the client machine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 04, 2015, 10:58:07 AM
I use the DDNS capability provided by my router which is more reliable than a client machine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 04, 2015, 11:56:11 AM
Good morning Tony,
If this is considered a security vulnerability then perhaps the public IP address could be displayed in the users account information.
It is already displayed at the top of the Options popup - or at least the address you are using for the web site is. Conceivably, it may not be the address you are uploading from though if you have multiple lines or aren't at home/work.

Edit: I've modified to show both the current IP Address being used by the browser and also the last upload's IP Address.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: deanwade on December 04, 2015, 10:34:28 PM
Tony,

That's great... many thanks!  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 04, 2015, 10:56:18 PM
Brilliant  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 05, 2015, 11:44:52 AM
Further changes to V2.0.3 now available

These only apply to the wide (Supporter available) graphs.
NB although not mandatory, if you have the 24 Hour Graphs facility already running, you might want to reload any such panes using the green Refresh button if anything looks strange.

24 Hour Graphs


1) The current day's graphs are now displayed for a rolling 24 hours (rather than from midnight to the current time) updating every 5 mins. If the equipment is running at around midnight then the stats will carry on rolling into the next day

2) The SNRM graph now supports the HiRes option (it was previously always HiRes). PopUps similarly.

Note that the green Refresh button now always pulls back a Rolling 24 hour graph for the current day as does changing the selected user. All other graphs are static and do not refresh once displayed.

BTW, if during the data collection for the eight small graphs, anything times out for whatever reason, the graphs do not display. The green Refresh button will hopefully pull them back.


All User Latency Monitor

This now has an archive ability which allows you to look back at individual latency graphs for up to 8 days back beyond the current one. The archive images are displayed as very small thumbnails in a row under the main thumbnail and selecting one displays a PopUp as normal (see attached images to help explain the description!).

For Small main thumbnails there are FOUR archive images and for Large there are EIGHT (currently), and they are displayed in descending date order starting with the previous day. If any graph is unavailable, it will show a red cross on it.

NOTE that it can take a long time (maybe 30 seconds) to bring up the initial display after making a selection change depending on how many users/images you are displaying. After that auto refresh takes over and the refreshes are much quicker as they use Ajax (a specialist Javascript library) to cache the revised display while loading.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on December 08, 2015, 10:27:11 AM
I should probably know the answer to this, but I'm not sure. On my stats (user=toulouse), the upstream sync rate is showing as 5999 highlighted in yellow. The max attainable is 5895. Could someone please explain the significance, if any, of this situation.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 08, 2015, 10:30:58 AM
It just means that the sync speed exceeds the max attainable. The max attainable is a calculated figure based largely on the SNR and indicates that if you were to resync now, your sync speed would fall to around the max attainable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on December 08, 2015, 10:39:29 AM
Hey, thanks Dray. So it's nothing to be too concerned about.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 08, 2015, 02:48:55 PM
I should probably know the answer to this, but I'm not sure. On my stats (user=toulouse), the upstream sync rate is showing as 5999 highlighted in yellow. The max attainable is 5895. Could someone please explain the significance, if any, of this situation.
toulouse


If you hover over the upper part of that section it explains what it means....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 08, 2015, 02:50:02 PM
DOWNTIME

Briefly at 15:00 while I down the server and change UPS battery that has expired with the replacement just arrived...


Back up but seem to have a problem with a Cisco switch that doesn't start up again properly when power has been off (it starts up but little or no data flow on some ports). Has happened before but forgot....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: aesmith on December 08, 2015, 07:39:30 PM
How do you have the switch ports configured?   Default spanning tree can be slow to go to forwarding state,  use "portfast" if you can be sure of no loops.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 09, 2015, 03:03:35 AM
Seeing slow loading of the graphs again although it seems to be randomly loading slowly and sometimes the whole thing is slow to resolve , also sometimes one of the panes fails to load giving the connection was reset message from firefox
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 07:53:08 AM
How do you have the switch ports configured?   Default spanning tree can be slow to go to forwarding state,  use "portfast" if you can be sure of no loops.
Thanks. From memory it's as it came (about two years old) straight out of the box since visually it was doing what was required for the ports. The server is on port 8 and I could see zero LED activity yesterday until powered on/off whereas other ports were actively passing data. I'll dig out the instructions when I get some time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 08:14:14 AM
Seeing slow loading of the graphs again although it seems to be randomly loading slowly and sometimes the whole thing is slow to resolve , also sometimes one of the panes fails to load giving the connection was reset message from firefox
I can't see anything untoward in the logs from that time period - data to you was delivered in 280ms at worst and from then on it's mostly up to your end and the routing involved.

Likely cause is possibly Google, there were long periods yesterday morning where the browsers here were waiting ages for the various Google servers involved in delivering the graph data to respond. Google's Terms of Service do not allow the needed code libraries to be downloaded and saved locally unfortunately. Personally I find Chrome works a lot better with MDWS than Firefox....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 09, 2015, 07:20:24 PM
Have noticed on the SRNM graph there are small gaps of 10mins without any upload it seem to have started yesterday at 15:00, what I have done is to reboot RPi and router to see if it fixes this issue but no.

Is there anything else I should try like change the DNS server the router is set to use Google DNS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 07:57:33 PM
That looks to be more generic than just you but not everyone is affected at the same time. It roughly coincides with the last server restart. I've restarted the server database and web server at 19:53. If that doesn't help I'll do a total machine restart later.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 09, 2015, 09:20:17 PM
I am having a look at SNRM at 20:29 on both MDWS and on the RPi there is still some missing bits on both, now even this is showing up on the DSLstats V5.6 graph on the RPi that would suggest it's the uploading program  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jid on December 09, 2015, 09:58:40 PM
Have noticed on the SRNM graph there are small gaps of 10mins without any upload it seem to have started yesterday at 15:00, what I have done is to reboot RPi and router to see if it fixes this issue but no.

Is there anything else I should try like change the DNS server the router is set to use Google DNS

I'm seeing this too for around the same time frame?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 09, 2015, 10:16:22 PM
Have noticed on the SRNM graph there are small gaps of 10mins without any upload it seem to have started yesterday at 15:00, what I have done is to reboot RPi and router to see if it fixes this issue but no.
I'm seeing this too for around the same time frame?
Don't forget that the server was intentionally down yesterday from 15:00 on and off for 40 mins while the UPS was sorted and some other changes made. The current problem is different but does seem to be primarily affecting DSLstats users as Newt observed. My own uploads are also made using DSLstats and that is running on the server and thus directly into the database. That is fine and makes me think this is not a server problem. I'll eliminate cables and switch in an hour or so.


NB I use OpenDNS here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 10, 2015, 06:14:39 PM
If i select  the option that displays both up and down stream snr's  i see a lot of small gaps in the snr traces, this displays on less than 24hrs  or up to the 2 days mark,

But if i select to view up or downstream only snr's there are no gaps displayed So it would appear to be a cosmetic issue and not a data upload issue IMO
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 10, 2015, 07:31:31 PM
If i select  the option that displays both up and down stream snr's  i see a lot of small gaps in the snr traces, this displays on less than 24hrs  or up to the 2 days mark,
But if i select to view up or downstream only snr's there are no gaps displayed So it would appear to be a cosmetic issue and not a data upload issue IMO


Afraid not.... The SNRM display up to 2 days is the only graph that displays missing uploads using a load of inserted nulls to override the default chart behaviour... And that is to just join up any missing points with a straight line as DSLstats normally does. If you look at the downstream SNR carefully at the same point where there is a gap on SNRM you'll see the cursor jump over the missing data..


Most of the day has been spent trying to trace this with not a lot of luck as there is no consistency to it or anything much in common between those affected. The server was eventually restarted at 16:33, the switch appears to be configured and working as it should. But I can't spend a lot more time on it though at the moment due to other commitments and generally it's still working as intended.


NB Dray and ray-dorset look like you need to restart DSLstats  as you have both been uploading empty files since 03:00 or so. (two of the four tone related files uploaded hourly)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 10, 2015, 08:09:55 PM
Probably another windows update direct hit. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 10, 2015, 10:54:55 PM
If it is a result of a Windows Update you can remove thoses updates and test it will require a reboot, just had look at update tuesday on vista and have 12 updates most seem explanatory but the other updates i'll have to digg deep.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 10, 2015, 11:03:01 PM
I just unzipped the ini file from the backup
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 11, 2015, 05:40:58 PM
mmm, seems to be working without any gap's since around 2am for me,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 11, 2015, 08:42:10 PM
mmm, seems to be working without any gaps since around 2am for me,


The same applies to the great majority of others as well - but I was asleep at the time. ::)


I suspect it was something external to the server, what I have no idea.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 11, 2015, 08:44:26 PM
No SNRM gaps for two hours since RPi & DSLstats was turned off/on at 17:59  :fingers:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on December 12, 2015, 09:09:45 AM
Wish I had checked this thread first... I've beeen searching for a problem with my firewall, switches or server for days trying to find the cause of the missing data.  :-[
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 12, 2015, 10:36:30 AM
Apologies. What I will try and do is set up some form of summary Notice Board on the main page (at the top) that can be read/hidden as needed to alert to problems/resolutions/changes like this and link to a post in this thread.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: marjohn56 on December 12, 2015, 10:55:56 AM
No need to apologise Tony, however that's a good idea.

Having had problems with my line and various internal network issues, now all resolved I hope, I've been watching the 24 hour profile monitor to see if it every goes to 24.00 :)

At present it's at 23.83.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 21, 2015, 08:34:10 AM
DOWNTIME


The MDWS server was down from about 07:45 to 08:10 this morning - around 10 users have not reconnected for upload so you might want to check your client is running and restart if necessary if you don't have a failed upload alert mail set up.


Merry Christmas and a great New Year and 2016 to everyone, especially those who have supported the project to date  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andy265 on December 26, 2015, 11:32:18 PM
It's more cosmetic than anything as they are the same company now, but my current IP (79.67.98.xx) is showing up as Tiscali on MDWS but I'm on TalkTalk. I think it's more their fault for reusing a block of IPs and not updating the whois details.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 26, 2015, 11:43:30 PM
It's more cosmetic than anything as they are the same company now, but my current IP (79.67.98.xx) is showing up as Tiscali on MDWS but I'm on TalkTalk. I think it's more their fault for reusing a block of IPs and not updating the whois details.
Well the IP lookup comes back with both - the main entry used for getting the ISP is for Tiscali but the abuse@ contact mail is for TalkTalk....!! I'll change it for you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 27, 2015, 07:44:11 AM

DATA DELETION

From Jan 7th 2016, additional uploaded data deletion is going to take place on top of that already in place to keep on top of growing storage requirements.

Currently, anyone who has uploaded in the past but hasn't uploaded any data in the past 3 months has all their previously uploaded data deleted but with account details and settings left in place.

From 7th January, anyone who uploads and is not a Supporter will only have 5 days of rolling data retained on the live database system, regardless of how much there is stored.

Similarly, anyone who uploads and isn't a Supporter and hasn't visited the web site in the past 3 months will only have 5 days of rolling data retained, regardless of how much there is stored, on the assumption that the older data is of no interest. There are a fair number of users who appear to have just forgotten they are uploading and have lost interest/never visit the main web site to look at their data, a number going back over 10 months and many more over 3 months....

There is a notice on the main MDWS page for those affected. If you are affected and want to keep your data, then you need to become a Supporter by Jan 7th 2016 if older data is to be retained.

Thanks go to those who have Supported the site to date. The continuous subscriptions from some are much appreciated and it all goes towards the running costs and reducing the operating deficit.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on December 27, 2015, 06:26:44 PM
Can you confirm that there is no impact for supporters?  Supporters will not have any data removed even if they don't login?

Could you consider adding the ability to have a special url to login? Could you generate a 32/64 char string and use that to allow users to login without any passwords / secrets / questions?

You could add this for supporters only?

Thanks for providing the service.  Knowing I have stats going back is essential if anything goes wrong with my line again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 27, 2015, 07:02:25 PM
The "hasn't uploaded for 3 months" applies to everyone, Supporters or otherwise. That's been in operation for some time. Often deletes a couple of users' data a day.

Neither of the other deletions apply to Supporters - I've modified one to make that clear.

There will also now be a 10 day advance warning e-mail sent to affected users so giving time to take any action they may want to. There are users with invalid e-mails so it's a good idea to keep these up to date as otherwise no contact is possible.

There aren't any plans for the other suggestions at the moment since very few people need to login frequently these days - you certainly shouldn't need more than a username and password  - and not even need to login again for at least a month, if at all, if you use the site at least once a week. Adding other means of logging on purely as a convenience just duplicates what's already there.

Edit: Honorary Donees
Also need to say that there always have been a number of users who have not necessarily donated (although many have) but have assisted in some valuable way with the creation and/or upkeep of the site since its inception in July 2014. These are, of course, exempt as well and currently regarded as honorary Donees. Shortly, these will be distinguished in the various color coded lists at the bottom of the main page with an additional Exclamation Mark (!) after their username as well as being shown in green text.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on December 27, 2015, 08:40:32 PM
There is no excuse any more for not uploading stats 24/7 if you are serious about your line stats a simple Raspberry Pi will do the job with a negligible impact on electric bills the RPi will use 0.02p per day * 7 days = 0.14p * 4 weeks = 0.56p * 12 months = £6.72

PS it's time for a donation from me this friday  ;)
here is a nice an easy watts Calculator
http://www.rapidtables.com/calc/electric/electricity-calculator.htm (http://www.rapidtables.com/calc/electric/electricity-calculator.htm)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on December 27, 2015, 10:33:45 PM
How much would it cost to put a Pi together to do it?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andy265 on December 27, 2015, 10:39:13 PM
Just looking at Amazon, the raspberry pi is £26, so with a case, psu and sd card, probably around £40.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on December 28, 2015, 09:35:49 AM
I bought this starter kit from Amazon, has everything you need to get up-and-running including a Wi-Fi adapter. http://www.amazon.co.uk/dp/B00T53135O/ref=pe_385721_37986871_TE_item (http://www.amazon.co.uk/dp/B00T53135O/ref=pe_385721_37986871_TE_item). It's been running quite happily since February.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andy265 on January 04, 2016, 10:16:53 PM
It's more cosmetic than anything as they are the same company now, but my current IP (79.67.98.xx) is showing up as Tiscali on MDWS but I'm on TalkTalk. I think it's more their fault for reusing a block of IPs and not updating the whois details.
Well the IP lookup comes back with both - the main entry used for getting the ISP is for Tiscali but the abuse@ contact mail is for TalkTalk....!! I'll change it for you.

I've got a new IP that's done the same thing - 79.67.112.xxx - guess they've reused the whole of that former Tiscali block for TalkTalk.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on January 19, 2016, 12:18:35 PM
Some education please.

MyDSLstats ID - pdes

1) A few days ago, my U/L SNR suddenly went from 6.1db to 15.3db.  The U/L speed dropped by 50% (an awful lot when the max is 1Mb!!).  Today, I was notified of a re-sync with this message:

Reason: 1 Remote Defect Indicator/DLM. 

What does this actually mean?  Is there a line fault?  Has the DLM kicked in (or out)?

2) I have attached a bits per tone snapshot. Does this look normal?

Thanks

David
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 19, 2016, 07:21:25 PM
The 1 Remote Defect Indicator/DLM seem to happen when there has been a large change in SNRM be it on the upstream or downstream in the last 24 hours.

So its just a guess the DLM is trying to normalize the SNRM back to what is was before the change :-\ 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 19, 2016, 08:24:43 PM
Database Unavailable... at 20:23 on MDWS  :o
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on January 19, 2016, 08:26:42 PM
Database Unavailable.. Is MDWS fighting some gremlins tonight Tony? edit, now it's back up again??
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 23, 2016, 11:28:38 AM
Database Unavailable.. Is MDWS fighting some gremlins tonight Tony? edit, now it's back up again??

Sorry missed these two posts....  Yes, there was a problem with TCP socket allocations and the server ran out of them  :(

Fixed quickly and being monitored but haven't seen any problem since.

I haven't been around a lot as we had to say goodbye to our faithful doggie companion (Charlie, an Old English Sheepdog) of over 12 years on the 4th Jan and haven't felt like doing much since. He had lost all his hind leg muscles over the past year and could no longer get up without collapsing so it was the kind thing to do. He was surrounded by friends at the end - but aged 14 1/2 (he was a rescue) so had a good innings. I've attached a piccy from 2007 of him.


Anyway, there is a new facility going on shortly that I started on New Years Day but only just finished....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 23, 2016, 08:40:59 PM
Having pets who's live span is shorter than our own is always going to end up with the owner grieving it is not fair and you think yourself I'm not going to go though that again no more pets any-more, but six months or a year later we do it all again with a new kitten or puppy and fall in love all over again.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 24, 2016, 08:13:44 AM
NEW FACILITY - UPLOAD PERCENTAGE

This doesn't need any restarts so is on as an addition to V2.0.3

I did this for myself originally but thought others might find it useful. For the wide graphs only, there is now a small information box next to the traffic lights in the Status display above each graph that shows a colour-coded percentage of uploads made for any user in the past rolling 24 hours (i.e. 1440 will show 100%). See attachment for some examples.

Obviously it's ideal to have 100% uploads all the time for best accuracy where counts matter (particularly ES for the DLM display). Since it's almost inevitable that a few will possibly be missed during a 24 hour period for a multitude of reasons, there is an allowance of 5 missed uploads and will still show 100% on or below that (to avoid a plague of 'where did my upload at 16:43 go to - is there a fault?' posts. I do restart the web server quite frequently for various updates and an upload might be missed due to this for a start.

The boxes are defaulted to being shown all the time. If you do NOT want to see these boxes, you can turn them off via the Options menu. They'll disappear automatically within a minute. And turn them back on in the same way.

SSL (Encrypted Connection)
The server now has a GeoTrust/RapidSSL SSL Certificate on sensitive pages so you can be sure you are connected to the correct server when logging on and the traffic is encrypted. It's sole purpose is currently for server identification and sensitive data encryption only.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on January 24, 2016, 09:35:52 AM
Nice touch. Any other nice touches or updates in the pipeline. Keep up the good work much appreciated Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 24, 2016, 09:49:04 AM
Nice one, Tony. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on January 24, 2016, 04:28:23 PM
Sorry to hear about Charlie  :'(
Pets are part of the family so I can fully sympathise.

__

Thank you for the MDWS update.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 24, 2016, 04:47:18 PM
Amazing to see so many MDWS members who are able to make use of the Infinity 2 service 40+ Mbps all the way upto 80 Mbps and even more members on 70 Mbps than last year Oprenreach must be doing something right.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on January 24, 2016, 07:59:58 PM
just Haewei cabs not ECI cabs. Us ECI cab users are still hopping for G.inp
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 24, 2016, 08:37:08 PM
just Haewei cabs not ECI cabs. Us ECI cab users are still hopping for G.inp
Yes, as an ECI user I'm hopping - mad  >:D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on January 25, 2016, 03:32:11 PM
Hi

I hope you don't mind, but I read you have a geotrust SSL

I'm sure you know already, but just in case you did not, you can get a free SSL from startssl (startssl.com) and renew free.

There is also lets encrypt, who offer free SSL

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 25, 2016, 04:02:55 PM
Hi

I hope you don't mind, but I read you have a geotrust SSL

I'm sure you know already, but just in case you did not, you can get a free SSL from startssl (startssl.com) and renew free.

There is also lets encrypt, who offer free SSL

Many thanks

John

Thanks. Yes, I wasted  several days talking to a StartSSL free support person (who was worse than Plusnet's support in understanding what was wrong) trying to get it working properly (it ran sort of okay but the certificate chain was broken and FireFox didn't like it) and gave up in the end....

I believe Lets Encrypt doesn't run under Windows though.

The RapidSSL one worked first time and has some other advantages - they even phoned me from the States this morning to check it was working okay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on January 25, 2016, 04:16:59 PM
Hi

Many thanks, and sorry I didn't realise lets encrypt could not be used in Windows

Have you looked at positivessl, if it helps we can give you a positive SSL but you would need to register on our portal so you have full control over it

I know positivessl works very well in Linux and Windows

If you would like to take me up on my offer, please PM me and I'll give you the details

I hope you don't mind the offer, and please disregard if you would prefer not too

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on January 26, 2016, 04:07:22 PM
tony come renewal time if you to save money pm me, I will help you on startssl, I deployed it to a website a month ago and its fine in all browsers I tested it in including firefox.  I plan to migrate more to startssl when they expire also since paying for automated cert's is a con.

The internet is moving to free cert's since as a whole there is a push to a https only web which is only viable if signed certs are free.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 26, 2016, 04:17:18 PM
Thanks but already covered.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 08:29:49 AM
VERSION 2.0.4 UPDATE

There has been an update affecting background code that means you need you to reload the main page (F5 or whatever) to pick some of it up (affects the updating of the graphs when the checkbox options are changed). You should see a warning to do this if your running version needs upgrading.

Also, missing up until now,  MDWS can now show Severely Errored Seconds (SES) in graphical format. Further post to follow explaining this.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 09:48:40 AM
SEVERELY ERRORED SECONDS AVAILABLE!

This data hasn't been available until now since the data isn't uploaded in the usual format. It's now calculated and stored on MDWS locally though and has been available for a few days. Examples attached.

Available only in Wide graph format and limited to the Current Date/Time range. It function pretty much the same way as Errored Seconds, with data being updated every hours at 3 minutes past the hour. Data is available back about two months currently. The entry appears immediately after Errored Seconds in the dropdown list as Severely ES.

The Status bar (which shows the current minute's instantaneous figures) above the graphs also shows SES adjacent to ES. To help spot any, the SES section takes on a coloured background when any are detected - yellow for any at all and reddish when 10 or greater. Rather than the instantaneous count, SES displays the total for the past 5 minutes instead to maintain visibility.

The SES count also appears on the dedicated All User Stats page, again totaled over for 5 minutes. It can't be ordered by that column though as the data isn't in the same format but ordering by Errored Seconds will usually also show SES at the top.

I believe I'm correct in saying that ONE Errored Second results from at least ONE code violation (CRC for example) within any second OR at least one Loss of Service event occurred  - and that ONE Severely Errored Second has at least TEN code violations in any second. So lots of ES does not necessarily mean a corresponding increase in SES. And that the DLM system possibly takes more immediate notice of continuing high SES counts.

Also, thanks to all those who donated in the past month to help keep the system running  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on February 01, 2016, 10:17:12 AM
I got the upgrade banned and F5'd.  The graphs reloaded but I am still on 2.0.4 without the Serious ES.

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 10:47:49 AM
Try hitting the Green reload button and check the list again - bear in mind it's not in alphabetical order and is listed after Errored Seconds in the dropdown. I can see others using it. 2.0.4 is the latest version.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on February 01, 2016, 12:30:43 PM
Nope, not in my drop down! :no:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 12:54:07 PM
Quote
Parse error: syntax error, unexpected 'endif' (T_ENDIF) in <Path removed> on line 650

Doesn't look good :(


Admin edit: path info removed for confidentiality reasons Thanks ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on February 01, 2016, 12:58:06 PM
Yes, I'm seeing that error as well.

Any ideas anyone ?

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:04:17 PM
Fixed, dropped  a cup (empty) on the KB....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:23:54 PM
Nope, not in my drop down! :no:

Well I can see 12 others with the entry okay..

Can you just refresh any wide graphs please that you have open (using the Green button) and should be able to see what's happening from this end...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 01:28:16 PM
I thought SES was Severely Errored Second.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:37:54 PM
I thought SES was Severely Errored Second.
I guess so when there's only one...

Kitz defines them as plural as are Errored Second(s)...

I also note:

Ten consecutive SES's will trigger a UAS event, and will remove the path from use. The path will become usable again after 10 consecutive seconds with no SES.

A count of UAS events can be triggered by a LOS event and will continue to accrue for each second that the system is up and the path is unavailable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 01:46:50 PM
I thought SES was Severely Errored Second.
I guess so when there's only one...

Kitz defines them as plural as are Errored Second(s)...

I also note:

Ten consecutive SES's
Apologies. What I mean is you have them as Seriously, but I think they're Severely.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 01:54:39 PM
I thought SES was Severely Errored Second.

Oh er  :-[  I need to make some amendments a bit later it seems.... Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 01, 2016, 02:07:41 PM
No worries mate :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on February 01, 2016, 02:36:50 PM
Nope, not in my drop down! :no:

Are you looking at the wide graphs as shown in the attachment to reply #1134??

Quote from: Reply #1134
(http://forum.kitz.co.uk/index.php?action=dlattach;topic=14361.0;attach=18825;image)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 01, 2016, 03:27:53 PM
No, he appears to be looking at the original ones according to the debug info....

Edit:
Also as of 3rd Feb, he is still running V2.0.3 or some of it. Needs a Ctrl+F5 or similar.....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 10:57:50 AM
Help! Where is the download file for this? Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 02, 2016, 11:11:53 AM
Hi

You register an account with the website, but there is no download

You download dslstats or similar program and use the credentials for the website, which uploads the information

If you search the forum for ddlstats you'll find a lot of information on what to do

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 11:14:31 AM
Thanks. The line stats are now online! MDWS ID: Grimers.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 01:15:23 PM
Hi, I've messed the data up a little bit on the DSL web stats. I have a number of resyncs that aren't true (turning the router off and on) is it possible to delete the resyncs and data?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 02, 2016, 04:15:02 PM
There is nothing wrong with your data, except that you haven't uploaded very much for some reason - your last upload was at 13:09....

The resync events shown are correct, one gets generated each time you turn off/on your modem/router. They are shown as Reason 0 Loss of Service (LOS) events. That means the modem has to renegotiate the connection or resync it and resets the line Uptime it keeps a record of to zero. You can see this via the Uptime graph and it is that is used to work out the time of the resync.

The second one shown did change the Upstream speed, but there isn't always a change in sync speeds. The resync events won't show on your graphs as you don't have enough uploaded data yet (hover over the little blue icon by the checkbox for showing these and it will explain).

There are no ways of deleting data, it's all useful.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 04:26:29 PM
There is nothing wrong with your data, except that you haven't uploaded very much for some reason - your last upload was at 13:09....

The resync events shown are correct, one gets generated each time you turn off/on your modem/router. They are shown as Reason 0 Loss of Service (LOS) events. That means the modem has to renegotiate the connection or resync it and resets the line Uptime it keeps a record of to zero. You can see this via the Uptime graph and it is that is used to work out the time of the resync.

The second one shown did change the Upstream speed, but there isn't always a change in sync speeds. The resync events won't show on your graphs as you don't have enough uploaded data yet (hover over the little blue icon by the checkbox for showing these and it will explain).

There are no ways of deleting data, it's all useful.

Ok, thanks Tony.

So, do the resyncs logged only count when the program is running and are these stored infinitely?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 02, 2016, 04:37:31 PM
Ok, thanks Tony.
So, do the resyncs logged only count when the program is running and are these stored infinitely?
No, they are held for up to a year. They'll be recorded even if the program is not running but only when the downtime is an hour
or less (from memory). If the downtime is longer some or all that occurred during that time may be lost.

I see you are running again now...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 02, 2016, 04:45:22 PM
Ok, thanks Tony.
So, do the resyncs logged only count when the program is running and are these stored infinitely?
No, they are held for up to a year. They'll be recorded even if the program is not running but only when the downtime is an hour
or less (from memory). If the downtime is longer some or all that occurred during that time may be lost.

I see you are running again now...

That's interesting, because I must've turned the router off and on several times today and it's only recorded two.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 02, 2016, 04:54:47 PM
Ok, thanks Tony.
So, do the resyncs logged only count when the program is running and are these stored infinitely?
No, they are held for up to a year. They'll be recorded even if the program is not running but only when the downtime is an hour
or less (from memory). If the downtime is longer some or all that occurred during that time may be lost.

I see you are running again now...

That's interesting, because I must've turned the router off and on several times today and it's only recorded two.
They were the only ones in the timeframes you have been uploading, but may have missed something in the downtime gap (about 4 hours in all) although it doesn't look like it from the stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 06, 2016, 11:17:39 AM
All User Stats changes

This applies to the full page version, not the one embedded in the graph container, the latter will be retired soon. 

It is now possible to sort by more columns with Upload Prog, ISP and DSLAM added as well as Power which was added a few days ago.

Additionally, if an Upload Prog entry has an asterisk after it then if you hover over it you'll (hopefully in most browsers) see the Modem type being used if the owner has configured it.

It's also possible to separate out ADSL users when ordering by DSLAM as they don't have DSLAM entries. However, there are a few VDSL2 users who haven't uploaded any Bits/Tone data so they also have no DSLAM shown.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on February 06, 2016, 12:29:20 PM
Thanks tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 13, 2016, 08:53:14 AM
TONE RELATED GRAPHS

I only noticed a few days ago that three of the tone related graphs (Hlog, QLN and SNR/Tone) were not functioning as they should be.... They are supposed to give you details of the exact frequency for any point if you hover over them but that was only happening on the rightmost plot. It's now fixed on all of them and should help determining the exact frequency of any problem such as interference...

(http://www.mydslwebstats.co.uk/images/qln-hover.jpg)

These graphs can also be drag-zoomed - despite what it currently says on the graph! - if you want to get in closer:

(http://www.mydslwebstats.co.uk/images/qln-hover-expand.jpg)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 13, 2016, 09:49:06 AM
G.INP
A note that the G.INP detection and notification system has been malfunctioning for the past 10 days  :-X  I didn't notice as I don't have G.INP (ECI cab)  :'(

It's now working again but is having to catch up over the next few hours so those affected may see additional or duplicated e-mails concerning G.INP. It's also possible that for a few people, any stored data for G.INP over the past 10 days may have been deleted and is starting over again (this causes a series of duplicated mails).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 15, 2016, 11:25:43 AM
Hi tony

I hope you don't mind, but there's 2 things as follows

Firstly - your website is dropping out of secure once logged in. I don't know if this intentional but I would think not

Secondly - I like your new layout, just took me a while to work out where to change graphs, but this is my age I think, getting too old

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 15, 2016, 01:14:58 PM
Hi tony

I hope you don't mind, but there's 2 things as follows

Firstly - your website is dropping out of secure once logged in. I don't know if this intentional but I would think not

Secondly - I like your new layout, just took me a while to work out where to change graphs, but this is my age I think, getting too old

Many thanks

John

The drop back to http: is currently intentional  - the link, if you have one, to the latency graph is not secure and partly invalidates the page security.... TBB don't have a secure version. I have a solution to keep the certificate validity, just need to transfer it from the development system to live once I fix a small problem...

Thanks for the observations, I'm probably even older  :oldman:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 15, 2016, 05:18:01 PM
I've just been looking at the stats for MDWS ID: Gary M. It shows that he has a Downstream SNR Margin of 3.6 dB. As far as I know, the target SNR Margin for FTTC is 6 dB, so how is he reporting a Downstream SNR Margin of 3.6 dB?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on February 15, 2016, 05:23:21 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 15, 2016, 05:26:47 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.

Wow, it must be a good modem then to hold at such a low SNR Margin for so long.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on February 15, 2016, 07:53:50 PM
Hi tony

Many thanks, much appreciated

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on February 15, 2016, 08:12:57 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.

Wow, it must be a good modem then to hold at such a low SNR Margin for so long.

Not necessarily,  theres a lot of lines which will hold 3db, it all depends on the amount of fluctuation.   He's only fluctuating 0.5 dB between 3.6 and 3.1 if it spikes.   Over a year ago aardvark used to keep his line up for months, he'd get a new crosstalker, his SNRm would go down a bit, then another crosstalker etc.   iirc this went on for many months until he got to about 2dB.  Then DLM forced a resync.

The technology behind adsl and vdsl is the same.  Im sure Ive show you one of my old mrtg graphs showing holding 3dB for many months without a resync... it would do the same at 2dB.   In fact just for laughs I took it down to 1.5db and here you can see it held for 5 weeks before I took it back up to 3.   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 16, 2016, 12:12:53 PM
The target margin is only a target at sync time. It may have synced at 6 but noise has increased since then.

Wow, it must be a good modem then to hold at such a low SNR Margin for so long.

Not necessarily,  theres a lot of lines which will hold 3db, it all depends on the amount of fluctuation.   He's only fluctuating 0.5 dB between 3.6 and 3.1 if it spikes.   Over a year ago aardvark used to keep his line up for months, he'd get a new crosstalker, his SNRm would go down a bit, then another crosstalker etc.   iirc this went on for many months until he got to about 2dB.  Then DLM forced a resync.

The technology behind adsl and vdsl is the same.  Im sure Ive show you one of my old mrtg graphs showing holding 3dB for many months without a resync... it would do the same at 2dB.   In fact just for laughs I took it down to 1.5db and here you can see it held for 5 weeks before I took it back up to 3.

That's interesting. I haven't seen that graph before. On my line, the Upstream SNR Margin can drop below 5 dB for quite a long time and the line doesn't resync.

I was going to say, for some reason I have a lot of missed uploads to MDWS even though it was been running constantly all night. Any ideas?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: S.Stephenson on February 16, 2016, 02:46:19 PM
It may be going into hibernation William, if it is change the power management settings.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 16, 2016, 03:11:00 PM
Some people using DSLstats do miss uploads every so often but why is a mystery in most cases.

One reason though as suggested can be Sleep or Hibernation as it happened to me on an ADSL line on a machine that slept overnight but unloading and reloading DSLstats afterwards stopped it happening (until next time). I am not aware of any problems with the overall system that cause it, the occasional upload just does not arrive at the server for some people. I don't believe the DSLstats logs show anything in these cases though.

I don't see any missing data when uploading directly to the server or on another line I monitor have that is remotely connected 24 hours a day, both using DSLstats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 16, 2016, 03:18:29 PM
Some people using DSLstats do miss uploads every so often but why is a mystery in most cases.

One reason though as suggested can be Sleep or Hibernation as it happened to me on an ADSL line on a machine that slept overnight but unloading and reloading DSLstats afterwards stopped it happening (until next time). I am not aware of any problems with the overall system that cause it, the occasional upload just does not arrive at the server for some people. I don't believe the DSLstats logs show anything in these cases though.

I don't see any missing data when uploading directly to the server or on another line I monitor have that is remotely connected 24 hours a day, both using DSLstats.

Yes, my PC never hibernates, it's always on as hibernation caused a problem on another program I have used.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 17, 2016, 04:30:29 PM
I have another question. I had 3 CRC's at 13:16 but this didn't count as 3 ES. Any ideas?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 17, 2016, 04:38:37 PM
Quite possibly because those three CRCs all occurred within one second. An errored second (ES) is a second in which one or more uncorrected errors occurred.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 17, 2016, 04:47:14 PM
Quite possibly because those three CRCs all occurred within one second. An errored second (ES) is a second in which one or more uncorrected errors occurred.

Ah, but it shows 0 ES on the ES graph not even 1.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 17, 2016, 06:05:36 PM
Ah but it does show 1....

As explained on the graph when the running totals are displayed (and in a post somewhere), the figure for 13:00 is actually the ES for the period 13:00- 13:59 and that shows the one single ES. The far right plot is always inaccurate until the next hour starts or the day ends. Usually it's of no consequence in practice as we are only worried about ES counts in the high 100s or even 1000s for the DLM to react at the end of the day.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 21, 2016, 08:41:34 PM
May I ask but does the ES graph use data from accumulated real time data or from history e.g. is my ES wrong for today due to data problems?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 09:32:01 PM
May I ask but does the ES graph use data from accumulated real time data or from history e.g. is my ES wrong for today due to data problems?

I think it does the way TB has set this up if you have 1 errored second at the time you switch off your modem say for 8 hours it will equal 1 errored second for each hour = 8 ES during the modem off period in that case it's not real-time data as the modem has been off.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 09:45:03 PM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 10:02:56 PM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.

That is not the way are graphs see it for example ES it increases DS/US keeps increasing when we stop logging into MDWS

example below

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 10:41:34 PM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.


That is not the way are graphs see it for example ES it increases DS/US keeps increasing when we stop logging into MDWS
Nope, that is not what is happening. You appear to be misreading the way graphs are constructed.

If you have two points to plot, a Google Line Chart just connects a straight line between them so if the gap is umpteen hours and the second point has some error seconds, there will be a slowly rising line between the two which is what I believe you are seeing and the system has been like that since day one.

Try running your cursor along the line of an ES plot with missing data such as William's. You'll only see plot points where there is data, not in between on the hourly divisions as there would be if you were correct. The value plotted are taken straight out of a database table and if no data was uploaded, there is no data to retrieve from that table.
 
The only place this does not happen is with the SNRM graphs for the shorter time periods where I spent a LOT of time rewriting the Google code to remove the joining up during periods of no uploads so it was clear when there were no uploads (which is why you can often see gaps!)  It has been explained before I believe.

It's clearer if the chart is drawn as a Column chart rather than a Line chart as the gaps are then obvious - but Google is a bit weird with the width of the bars and they are often very thin which is why they are currently shown as Line charts. See attached examples.

BTW this is off my local dev system and this has flags for each user's Country. I am considering putting this live with options to hide them or not show your own etc etc.

We have quite a few overseas users - notably one currently in the Cayman Islands (steubing @ -5 hours) who seems to have an example of a totally unmanaged FTTC line with enormous error counts but no form of divine or man made intervention....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 11:18:04 PM
If you have two points to plot, a Google Line Chart just connects a straight line between them so if the gap is umpteen hours and the second point has some error seconds, there will be a slowly rising line between the two which is what I believe you are seeing and the system has been like that since day one.

Sorry to be the one to tell you the google line chart saves the last point of reference then accumulates this point each hour and so on after the user has logged off.

If you had 2 DS errored seconds and switched off for 24 hours the google graphs would show 48 errored DS seconds

you had it right before where it was just showing a straight line when the user was offline just seems the google prediction thingy is weired which we don't need as most users are on 24/7
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 11:32:44 PM
Well if that's what you want to believe then fine.  I suggest though that whatever you are on you stop taking it  ???

Edit:
To demonstrate that on the attached graph, on your theory the earlier ES count of 16 at 08:00 would have risen, by the time the next available plot at 17:00 was reached  9 hours later, by 144! It's actually gone up by 2 as that was the count for that partial hour and has been added on...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 21, 2016, 11:42:19 PM
I suggest though that whatever you are on you stop taking it  ???

Cipralex 10mg would need to consult with DR before I cease the treatment   ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 21, 2016, 11:59:25 PM
Um... I think maybe you don't realise that the black line is a CUMULATIVE total, not hour by hour. The latter is the green line at the bottom with the same join between the available hours and zero at times..  :-\  Of course, if the second highlighted point had no errors, it would be a straight line joining them as expected ....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 22, 2016, 12:16:10 AM
Lets say I cease uploading to MDWS now at 00:15 hours for 24 hours will my DS errored seconds show zero during that time period ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on February 22, 2016, 07:43:45 AM
No that isn't the way it works. The one errored second stays as just that, nothing else is recorded until the line is up again and the hour that that is in will only be partially accurate due to missing data. There is no 'guesstimate' of missing data anywhere in the system.

Ah, I see! Thanks for explaining.

[Edited by roseway to remove inappropriate comment]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 22, 2016, 08:27:14 AM
Lets say I cease uploading to MDWS now at 00:15 hours for 24 hours will my DS errored seconds show zero during that time period ?
You appear to have done just that. Here follows a longer explanation while I partake of the third cup of tea of the morning.. ;)

Correct, as long as the period between 00:00 and 00:59 has no ES (which it doesn't, it's 0) then there will be nothing plotted between there and the next plot on that day or the next day. There can't be as MDWS will not have defined any data above zero for that period  since the database table entries will all say 0 - it will though have defined zero for each hour where there was no data to preserve the timeline on the graph plot.

Have a look at your own attached line for the past 24 hours. The cumulative US (BLACK - GREEN on the none-cumulative version) plots starting from the left which is at 00:24 through to 06:00 are all zero (as are DS)  since there were no ES, then at 07:00 there is one ES from where it starts accumulating. On the ordinary graph there are peaks and troughs.
I'm not sure where you get the idea that Google Charts are in any way intelligent from  ::) . They just make it somewhat easier for a programmer to draw complex live graphs with automated hover info etc.

Each data point for any graph has to be constructed in code by MDWS on the server so that it can be sent to and then drawn by your terminal using Javascript by the way - there is nothing automatic at the Google end about this data generating part. So a full day's data from SNRM for 24 hours has 1440 (actually less but we won't go into that here) sets of data that look like this extract, you can see the two SNRM figures at the right in this instance (NB Google months have January as zero before someone says the date is wrong):

Code: [Select]
[new Date(2016,1,20,Number('07'),Number('51'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('52'),00), 4.9, 18.0,],
[new Date(2016,1,20,Number('07'),Number('53'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('07'),Number('54'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('07'),Number('55'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('07'),Number('56'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('57'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('58'),00), 5.4, 18.0,],
[new Date(2016,1,20,Number('07'),Number('59'),00), 4.6, 18.0,],
[new Date(2016,1,20,Number('08'),Number('00'),00), 4.7, 18.0,],
[new Date(2016,1,20,Number('08'),Number('01'),00), 5.3, 18.0,],
[new Date(2016,1,20,Number('08'),Number('02'),00), 4.9, 18.0,],
[new Date(2016,1,20,Number('08'),Number('03'),00), 5.1, 18.0,],
[new Date(2016,1,20,Number('08'),Number('04'),00), 4.4, 18.0,],
[new Date(2016,1,20,Number('08'),Number('05'),00), 5.4, 18.0,],

Some graphs have more data for additional popup info, or for more data points than the two above:
Code: [Select]
new Date(2016,1,21,Number('09'),00,00), 0, 15, 1, 0.1, 24],


Hope that helps - though I believe Cipralex makes it difficult to think clearly at times....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 23, 2016, 10:51:18 PM
Hope that helps - though I believe Cipralex makes it difficult to think clearly at times....

That is a great explanation into the workings on MDWS yeah I took it offline for 1 day then thought give it another 24 hours as there is nothing interesting happening on this line and also gave the RPI a new case.

The only side effects of Cipralex we have noticed is my heart has become tachycardia so will need a ECG but they are sure it's the down to the meds
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on February 25, 2016, 03:06:17 PM
What is the XTR tab about, and what are the stats within that, as i can't fathom out what they mean
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 25, 2016, 03:26:19 PM
What is the XTR tab about, and what are the stats within that, as i can't fathom out what they mean
See here for now, caught up with house repairs currently:

http://forum.kitz.co.uk/index.php/topic,17106.msg314386.html#msg314386 (http://forum.kitz.co.uk/index.php/topic,17106.msg314386.html#msg314386)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 28, 2016, 08:51:52 PM
Hi Tony

I am not sure if this is a hg612stats issue or mydsl but I am having issues with my hlog not being displayed on the website. The Hlog graph is present on the software when viewed locally so could you offer some advice please.
Many thanks
mydsl user "skytester"
modem type 8800nl
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 07:59:29 AM
@skynewb

If you look back at your historic Hlog entries, you'll see that they were fine up until 12:00 yesterday (they upload once every hour, as do all the Tone related files - see the Help system and previous posts here for more). Then your line was down for some time and when the next upload occurred at 16:00 they stopped displaying properly.

I've been through your data as best I can here and there appears to be a problem with your Hlog upload files now (the other are okay) - they apparently have some corrupted or extra data in (although I can't visually see exactly what) and they are not decoding properly and then stop the chart actually displaying due to a Javascript error.

Since nothing has changed at this end with the code for that, I suspect that something has at your end. Try unloading the stats program and starting it up again and see what happens at the next hour upload. If still a problem, then power down the modem for 30 mins and restart and see if it's okay then. Past that, I don't have any ideas currently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 09:43:01 AM
Ok thanks Tony. I will reinstall and try again. The modem was rebooted yesterday so it might be something else. The pc was restarted too. I will try a couple of things tonight and see if any joy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 29, 2016, 06:30:22 PM
Hi Tony I don't seem to be getting 100% uptime due to 4 of 5 gaps per day thought it was upload software versions but still the same , taken RPi offline for maintenance plenty of on-board ram only 30% used and done some stuff to memory card and also gave the router a new PPPoE connection.

I am starting to think this issue is on my side how does it look from your end ?

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 06:33:17 PM
@skynewb

If you look back at your historic Hlog entries, you'll see that they were fine up until 12:00 yesterday (they upload once every hour, as do all the Tone related files - see the Help system and previous posts here for more). Then your line was down for some time and when the next upload occurred at 16:00 they stopped displaying properly.

I've been through your data as best I can here and there appears to be a problem with your Hlog upload files now (the other are okay) - they apparently have some corrupted or extra data in (although I can't visually see exactly what) and they are not decoding properly and then stop the chart actually displaying due to a Javascript error.

Since nothing has changed at this end with the code for that, I suspect that something has at your end. Try unloading the stats program and starting it up again and see what happens at the next hour upload. If still a problem, then power down the modem for 30 mins and restart and see if it's okay then. Past that, I don't have any ideas currently.

Hi Tony - so I tried rebooting, re-install but still no hlog. However I have created a new user called skyECI. I let the update run by itself and everything uploaded bar hlog.

If I choose Hlog from mydsl  drop down box the graph box reports
"Waiting for Google response..."

Any ideas why this happening?

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 06:53:52 PM
Ok thanks Tony. I will reinstall and try again. The modem was rebooted yesterday so it might be something else. The pc was restarted too. I will try a couple of things tonight and see if any joy.
I see it was still the same on your new username  :(

Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 07:09:22 PM
Ok thanks Tony. I will reinstall and try again. The modem was rebooted yesterday so it might be something else. The pc was restarted too. I will try a couple of things tonight and see if any joy.
I see it was still the same on your new username  :(

Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.

Thanks very much looks to be working - any chance of transferring my donation status to my new ID (skyECI) please as I won't be going back to old  profile.   ;)

thanks

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Bald_Eagle1 on February 29, 2016, 07:13:08 PM
Hi Tony,


Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.


I may have missed something so could you please confirm what the issue is/was regarding the offending tone (15) of skynewb's Hlog data?

It does seem odd that correct/valid data was being consistently uploaded previously & now it consistently isn't.

If it's anything to do with the HG612 Modem Stats program, I'd rather fix it than simply mask a potential error.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 07:16:31 PM
Hi Tony I don't seem to be getting 100% uptime due to 4 of 5 gaps per day thought it was upload software versions but still the same , taken RPi offline for maintenance plenty of on-board ram only 30% used and done some stuff to memory card and also gave the router a new PPPoE connection.

I am starting to think this issue is on my side how does it look from your end ?

I can't add anything to this above what I've said in the past. A few lost minutes are not abnormal and that happens to quite a few people but certainly not everyone. The 100% uptime allows for 5 lost minutes. There are some people who it happens to all the time (but you are okay some days). I don't see any errors that say an upload failed (there are loads of error traps) and when I've put a monitor on a user, that always says that they do not arrive at the server in the first place.

The only thing I can point out is that if the server has a problem (other than an Apache restart which usually just results in queuing for a few secs, or actual full restarts etc) I don't see errors on my upload directly to the server on the server itself (i.e. not via the internet or router/switch). But I have an ADSL2+ line as well from another provider uploading in the same way as everyone else and that hardly ever shows any lost minutes. Both use DSLstats, currently 5.7.1. Both on Windows 24/7 machines, Win 7 and Win 8.1 FWIW. Not so good though if I hibernate the Win 7 machine then DSLstats gets very erratic after wake up. Stopping and restarting stats cures it a bit Eric is aware of this as noted on another current thread.

It might be interesting to find people with missing minutes and see what stats prog they are using if you have an idle few minutes (use 12 hour as it's more obvious and that has all the minutes plotted). I can't remember if it happens with both HG612 Stats and DSLstats.

I'm pretty confident that it is is occurring due to something en-route though. I watched carefully the other evening when the server had a record number of uploaders and users and couldn't see anything of note. The server is never heavily loaded either currently.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 29, 2016, 07:30:45 PM
Thanks very much looks to be working - any chance of transferring my donation status to my new ID (skyECI) please as I won't be going back to old  profile.   ;) 
Done  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 29, 2016, 07:32:24 PM
Hi Tony,


Haven't got time to trace it all through so I've masked the problem by setting the value of the offending tone (15) to that of the previous one for now and all looks well.... That shouldn't have an practical effect on the data hopefully.


I may have missed something so could you please confirm what the issue is/was regarding the offending tone (15) of skynewb's Hlog data?

It does seem odd that correct/valid data was being consistently uploaded previously & now it consistently isn't.

If it's anything to do with the HG612 Modem Stats program, I'd rather fix it than simply mask a potential error.

Just to add it just seemed to stop working when I  rebooted the modem (8800nl) yesterday, well took if off line for couple of hours - I made no other changes to the software or my setup..

Thanks Tony for sorting my status..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on February 29, 2016, 08:25:07 PM

I'm pretty confident that it is occurring due to something en-route though. I watched carefully the other evening when the server had a record number of uploaders and users and couldn't see anything of note. The server is never heavily loaded either currently.

That is also my conclusion after ruling out software and hardware the next step will be to change DNS server from google back to the ISP's default

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 04, 2016, 10:47:12 AM
Tony

Just spotted something odd, On the 24 hour graphs...Click on the SNR margin.....The legend reads "dB up - MyDSLWebStats.Co.Uk"

and when you hover over the line, the legend again has the extra (unwanted) text.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 04, 2016, 11:07:42 AM
Ok thanks. Fixed and was only happening on the original narrow graphs  :)

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 05, 2016, 11:05:43 AM
Tony

Can you add TP-Link W9970 to the list of modem/routers please.

Thanks in advance
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 06, 2016, 07:25:03 AM
Can you add TP-Link W9970 to the list of modem/routers please.
This was added about two minutes after you asked but had to go out for rest of the day....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on March 07, 2016, 06:32:06 PM
Would be great if you could add a slightly different colour to make eci ginp users noticeable and a link to the full page all users stats on the graph page would also be great :) thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 07, 2016, 11:17:09 PM
How about making the User Name on the All User Stats page link to that user's other stats page
i.e. link HG612-MultUsersLivei.htm to Container.htm
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 08, 2016, 08:20:53 AM
Would be great if you could add a slightly different colour to make eci ginp users noticeable and a link to the full page all users stats on the graph page would also be great :) thanks

ECI now has a light yellow background. The graph-sized User Stats window (which already has a link to the full page version) is being withdrawn soon and the entry will open the separate tab/window by default.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 08, 2016, 08:23:36 AM
How about making the User Name on the All User Stats page link to that user's other stats page
i.e. link HG612-MultUsersLivei.htm to Container.htm
That isn't currently feasible but I'll add it to the list of possible features yet to come.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 08, 2016, 07:51:21 PM
Hi Tony

One week ago G.INP and vectoring was enabled on my line. Therefore I realized there is no information about the vectoring state available on MDWS.
Wouldn't it be interesting to see which lines already got vectoring enabled?
I don't know the situation in UK. Are there already a lot of vectoring enabled lines available or will it be deployed in the future?

DSLstats and HGWin would need a little update to provide this information.

What do you think about it?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 08, 2016, 08:03:42 PM
Where is the vectoring data presented?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 08, 2016, 08:15:04 PM
You can use the following command:

xdslctl info --vectoring

Quote
xdslctl: ADSL driver and PHY status
Status: Showtime
Last Retrain Reason:    1
Last initialization procedure status:   0
Max:    Upstream rate = 37534 Kbps, Downstream rate = 93184 Kbps
Bearer: 0, Upstream rate = 11007 Kbps, Downstream rate = 55039 Kbps
Bearer: 1, Upstream rate = 0 Kbps, Downstream rate = 0 Kbps
Vectoring state: 1
VCE MAC Address: 0:10:fc:20:0:0
Total error samples Ethernet pkts sent: 131290
Total error samples Ethernet pkts discarded: 0
Total error samples statuses sent: 65645
Total error samples statuses discarded: 0

I don't know all state codes but on my line I saw this:

Vectoring state: 1 vectoring enabled
Vectoring state: 5 without vectoring (Without vectoring "VCE MAC" and "Total error samples" are all zero.)

Maybe codes 2,3 or 4 indicate vectoring friendly mode.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 08, 2016, 08:34:52 PM
There are some vectoring states defined in the AdslMibDef.h file that can be found in the source code released for various Broadcom modem/routers. This is from the TP-Link VR900v1 code:
Code: [Select]
#define VECT_WAIT_FOR_CONFIG  0
#define VECT_FULL             1
#define VECT_WAIT_FOR_TRIGGER 2
#define VECT_RUNNING          3
#define VECT_DISABLED         4
#define VECT_UNCONFIGURED     5

Looking at the strings in the xdslctl binary, it might also give "Vectoring is disabled" or give a "VCE IP Address".
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 08, 2016, 08:56:12 PM
For "xdslcmd info --vectoring" I get

Vectoring state: 5
VCE MAC Address: 0:0:0:0:0:0
Total error samples Ethernet pkts sent: 0
Total error samples Ethernet pkts discarded: 0
Total error samples statuses sent: 0
Total error samples statuses discarded: 0
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on March 08, 2016, 09:08:03 PM
This means vectoring isn't enabled on this line.
I think because the command is available the firmware supports vectoring. You only have to wait until it gets enabled.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on March 11, 2016, 07:40:47 PM
Is it possible for MDWS to display/monitor the chipset version used by each DSLAM?

It would be interesting to see how/when they change during the rollout of a new version.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on March 11, 2016, 09:13:05 PM
Hi, I donated to MDWS but now I've created a new ID, I can't seem to access the additional features. Do I need to donate again?

I've noticed a bug with MDWS. For some reason, when I select the Errored Seconds graph, the scale is in years not hours!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 13, 2016, 08:25:39 PM
Hi, I donated to MDWS but now I've created a new ID, I can't seem to access the additional features. Do I need to donate again?

If you want the additional features it would be normal to do that, yes, but only when you have several lines and require two log ons.

But you only have one line I believe and yet you are on your third Registration since you joined. One Registration seems enough for 99% of users.

Anyway I've transferred your donation to the latest registration now on the assumption you don't want use of the old one.

Quote
I've noticed a bug with MDWS. For some reason, when I select the Errored Seconds graph, the scale is in years not hours!

Can't see anything wrong here. But beyond 4 days the x-axis reads, for example, Mar 11 2016, at the start of each day as there isn't room for more. Longer periods have larger intervals.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 14, 2016, 11:25:10 PM
On the All User Stats page, the View Active Only dropdown appears to have been disabled.
Or is it just me?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 14, 2016, 11:29:28 PM
Yes, it's been disabled as it was causing problems....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 15, 2016, 12:12:02 AM
Thanks ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: LaurieR on March 21, 2016, 04:34:34 PM
I'm getting "Fatal error: Function name must be a string in . . . on line 8" for most data options.

[Moderator edited to remove the quoted path, as requested.]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 21, 2016, 05:20:58 PM
Fixed - thanks...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on March 24, 2016, 08:56:50 PM
General question, if we would like to see some kind of mdws support for hacked eci modems what would need to happen? Is there anything us users could do to help? As ginp is rolling out to eci cabs and giving better sync speeds using an eci modem some mdws support is wished :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on March 24, 2016, 09:03:55 PM
General question, if we would like to see some kind of mdws support for hacked eci modems what would need to happen? Is there anything us users could do to help? As ginp is rolling out to eci cabs and giving better sync speeds using an eci modem some mdws support is wished :)

I have my hacked eci running munin for some output graphs - example attached. Jsamuel got this going - it runs on  oracle virutal box within my win10 - little data as I literally only got it going tonight after connecting the modem up
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 24, 2016, 09:07:22 PM
General question, if we would like to see some kind of mdws support for hacked eci modems what would need to happen? Is there anything us users could do to help? As ginp is rolling out to eci cabs and giving better sync speeds using an eci modem some mdws support is wished :)
You'd need to ask in the respective threads for HG612 Modem Stats (http://forum.kitz.co.uk/index.php/topic,15483.0.html) and DSL Stats (http://forum.kitz.co.uk/index.php/topic,17106.0.html) really, as it's those two programs which harvest the stats and upload them to MDWS.

In theory if you can telnet into the ECI modem then it should be possible, but I suppose it depends on how much work it'll take and the time available to the authors.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2016, 08:07:52 AM
SERVER DOWNTIME

There is a problem with the server that started about 07:52 and I've had to kill the web server process. The main database table seems to have a problem so will need to rebuild it.

While I'm at it, I also need to carry out a number of updates to the server so expect it will be down for an hour or two but this is well overdue anyway.

And BACK UP AGAIN

Okay, all looks okay from this end. Quite a few people haven't reconnected for uploads though so you might want to check if you don't have failed alerts email enabled...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on March 27, 2016, 04:05:33 AM
Looks like something has happened as all users are reported as being down by MDWS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 27, 2016, 07:13:49 AM
Data is still being uploaded and showing in the graphs, but is reported as being down since the present time. This is presumably related to the time change, and I know that DSLstats doesn't handle the time change properly, and is probably an hour out until it's stopped and restarted. But as you say, this seems to apply to everybody.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 27, 2016, 08:57:34 AM
Having seen these comments this morning I restarted DSLStats and then got the upload OK message from MDWS.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on March 27, 2016, 09:24:04 AM
Had an GMT error msg on MDSLS - restarted DSLSRpi and forced a manual fresh of the website - error disappeared :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 27, 2016, 09:26:05 AM
Okay I admit guilt - there is a clock change calendar and it was a day out (tomorrow)  :-[

Okay now BUT there are some 45 users with the clock an hour slow (mostly DSLstats) so you need to stop and restart that assuming the equipment clock is set okay. The list of uploading users at the bottom of the main window will show a double red asterisk against a user name if the clock is one hour slow (which is an invalid time zone) username**
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 28, 2016, 07:59:41 AM
POWER OUTAGE 01:40 - 07:15

Had to disappear out on on a crisis yesterday and got back to find the power had gone down at 01:40 this morning after the UPS gave out when our sub-station tripped. Back up now okay at 07:15 but winds still have potential for it to happen again before this afternoon. Trees down all over the place here.

Most people have reconnected but there are still loads of people with bad clock times who are still on GMT. Mostly DSLstats where you will need to close down the program and restart to fix (known bug).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on March 28, 2016, 08:37:02 AM
Given the winds today around the country I can't say I'm surprised :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on March 28, 2016, 07:09:50 PM
Hi,

I don't seem able to change my password for logging on. Once I have used the reset email details and enter a new password I always get the error message invalid memorable phrase? - I know its the right one as the reminder page tells me what I used originally..

Any help appreciated as I keep on having to use a temporary password..
thanks

   Invalid Memorable Phrase
Password Change   Enter your Memorable Phrase   

Enter your new Password   

Repeat your new Password   

 Change Password   min 8 max 18 chars
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 28, 2016, 08:17:31 PM
I don't seem able to change my password for logging on. Once I have used the reset email details and enter a new password I always get the error message invalid memorable phrase? - I know its the right one as the reminder page tells me what I used originally..
This is/was a problem that was fixed earlier this month but your registrations precede the fix. The Memorable Phrase is now enforced as unique amongst all users but wasn't when you registered. You have two registrations so it's coming up with the wrong user when it tries to ID you....

I've changed your current skyECI one and will PM you...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 28, 2016, 11:03:39 PM
and I know that DSLstats doesn't handle the time change properly, and is probably an hour out until it's stopped and restarted. But as you say, this seems to apply to everybody.

Even my RPi clock was off by 1 hour so don't just put this down to your software the RPi is supposed to update it's clock via on line ethernet but it does not during time changes.

The only way is to use the command sudo dpkg-reconfigure tzdata think I posted this the last time the clocks changed and select Europe and London this will correct the time shown on the RPI
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 29, 2016, 06:11:20 PM
Apologies if this has been suggested before, but wouldn't it be better to store all the times in UTC (which doesn't change for summer time), and display them to the user in their local time zone?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2016, 07:10:46 PM
Apologies if this has been suggested before, but wouldn't it be better to store all the times in UTC (which doesn't change for summer time), and display them to the user in their local time zone?

It can be very confusing with software as the UK uses DST daylight saving time from March to October or even called BST British Summer time.

even selecting UTC/GMT when using calculators and converters for the UK will lead to incorrect results during the summer months when DST is in use.

I have seen rumours that GMT might be abandoned.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 29, 2016, 07:58:33 PM
Apologies if this has been suggested before, but wouldn't it be better to store all the times in UTC (which doesn't change for summer time), and display them to the user in their local time zone?
An idea but would take a totally inordinate amount of time and effort to implement and it wouldn't fix a problem caused twice a year by a bug in 3rd party software/hardware (that of the RPi). It works as it stands except for the RPi being unable to return the correct time after a GMT/BST change without manual intervention....
It would be far easier to ban the Rpi from MDWS if it's a problem for anyone  >:D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 29, 2016, 08:22:34 PM
I changed my own stats scripts to record everything in UTC to avoid problems with the time jumping forward or back.

Also I just switched on my Pi 2, it had the correct time and timezone (BST). But then I installed Fedora on it rather than Raspbian.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2016, 09:04:17 PM
Also I just switched on my Pi 2, it had the correct time and timezone (BST).

You have just given the answer the RPi will change the time to +1 hour when it has been rebooted or switched on from a cold boot, it's when the RPi has been up and running during the clock change it will not adjust the time automatically.

It would help if the RPi had a chronometer built in then software and hardware could interrogate each other and come up with the right time
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on March 29, 2016, 09:17:29 PM
I can't really see why the RPi wouldn't - it's keeping the clock running in software, and it knows the date and time and timezone. But I'll check in about 6 months.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 29, 2016, 10:56:47 PM
It's presumably a bug in the NTP software (or more likely, its configuration) in the RPi. Raspbian is based on Debian Stable, which is what I use on my main desktop PC (this one) and which runs 24/7. The clock changes at the correct time without manual intervention.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 29, 2016, 11:14:27 PM
I'll try this command on October the 30th -> sudo service ntp restart or sudo service ntpd restart

https://support.rackspace.com/how-to/using-ntp-to-sync-time/ (https://support.rackspace.com/how-to/using-ntp-to-sync-time/)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on March 30, 2016, 12:21:40 AM
Couple of queries/requests please (Trying to update the days eci g.inps)

1)Would it be possible to include a direct link to the Multi-user view.

Presently the way I get to it is > Select User Stats > It opens in the iframe > Click the full page version <here>
Then I want to get rid of that window to go back to the previous stats I was looking at so I click the red X, which takes me to tbailey SNR stats, so then I have to reselect user again and the type of graph I wanted to see.

It seems a bit long winded or am I missing something.   Could you put a link to multi-user from say the top under the TBB monitor image.


2)Tonight Im wanting to check a few people stats who have since gone offline, but I need to check say their cab type.   The main window doesnt show it me (eg James11223), so I go to the multi-view - but I find that I can only select stats for currently active -  Im sure I used to be able to view info if someone was offline too.   
The only option I have from the 'View Active Only' drop down box is YES.


TIA

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 30, 2016, 08:20:06 AM
1)Would it be possible to include a direct link to the Multi-user view.

2)Tonight Im wanting to check a few people stats who have since gone offline, but I need to check say their cab type.   The main window doesnt show it me (eg James11223), so I go to the multi-view - but I find that I can only select stats for currently active -  Im sure I used to be able to view info if someone was offline too.   
The only option I have from the 'View Active Only' drop down box is YES.
TIA

1) I'll do something in a while - but as I've said before the small All User Stats is being retired to just use the full page one and the dropdown will then take you directly to it.

But James 11223 isn't showing a cab for some reason in the stats although he has one defined. It's an Huawei

2) Use the Range graph view rather then Current as the dropdown then shows all users who have uploaded in past 3 months whether currently uploading or not. it's been asked before but Inactive was removed as it was using too many resources. I've hopefully fixed it so will check and put it back if okay.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on March 30, 2016, 04:58:06 PM
Couple of queries/requests please (Trying to update the days eci g.inps)

1)Would it be possible to include a direct link to the Multi-user view.

You could bookmark the link.


[Admin note - url removed]
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on March 31, 2016, 12:33:00 AM
Thanks Tony :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 04, 2016, 07:54:50 AM
DOWNTIME

The MDWS server will be down for around 30 mins shortly for some maintenance...

EDIT: Back up at 08:31....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 04, 2016, 03:05:06 PM
Is it possible to suggest two new features to help detect when new functions may be enabled by BT?

1. Vectoring On/Off
2. 3db Target

Perhaps a new column and/or colouring?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on April 04, 2016, 03:40:11 PM
You can sort the snr column on the all users chart, then just pick out the ones that are on fttc.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on April 07, 2016, 12:29:09 PM
Tony does MDWS store the actual F/W for a users CAB and if so can it be currently displayed anyway on the website please?

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 07, 2016, 12:35:57 PM
Tony does MDWS store the actual F/W for a users CAB and if so can it be currently displayed anyway on the website please?
Stuart
No it's not uploaded by either of the stats gatherers...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 10, 2016, 06:39:38 AM
Hi Tony

Would it be possible to add a column on the all user stats for modem type being used provided the modem type has been set. I know you can see it if its been specified on the individual users page but it would be handy to see a list on the all users stats page alongside the cabinet data type

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 10, 2016, 07:16:33 AM
If you hover over the "Upload Prog" entries with an asterix the modem is displayed in a tooltip
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 10, 2016, 07:20:49 AM
Ah great. Thanks for that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 05:27:58 PM
I see only blank page when I open https://mydslwebstats.co.uk . Why?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 10, 2016, 05:36:22 PM
According to Firefox, the website doesn't match the certificate
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on April 10, 2016, 06:32:49 PM
I see only blank page when I open https://mydslwebstats.co.uk . Why?

Please try using the https://www.mydslwebstats.co.uk/ address. You should see the welcome screen, an example is attached below --
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 06:48:27 PM
I still see blank page.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 10, 2016, 06:58:36 PM
Try Control + F5
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 07:04:10 PM
Unfortunately it does not help.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 10, 2016, 07:28:27 PM
Unfortunately it does not help.
Can you PM me your IP address please?

https://www.whatismyip.com/ (https://www.whatismyip.com/)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 07:59:17 PM
I've sent my current IP but I have dynamic IP.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 08:46:30 PM
OK, it works. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 08:53:42 PM
Unfortunately when I've tried to register I've got
"Sorry, the database update failed. Please press BACK and try again. The problem has been reported..."
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 10, 2016, 08:58:15 PM
Unfortunately when I've tried to register I've got
"Sorry, the database update failed. Please press BACK and try again. The problem has been reported..."
See the direct mail I sent you to fix that....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: konrado5 on April 10, 2016, 09:54:22 PM
It works, but DSLStats didn't sent my Hlog. Curious.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 10, 2016, 10:07:22 PM
It works, but DSLStats didn't sent my Hlog. Curious.
It's not curious, the tone related files upload around the hour so will be there now if you have them set to upload...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 11, 2016, 06:07:10 PM
Tony does MDWS store the actual F/W for a users CAB and if so can it be currently displayed anyway on the website please?
Stuart
No it's not uploaded by either of the stats gatherers...

ok so first bald eagle and eric need to add to their tools to collect the info.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on April 14, 2016, 04:13:00 PM
20min power cut last night affecting everyone at my exchange. Line resync'ed at maximum sync although my downstream SNR is hanging on at ~1.5dB. Interested to see how long it remains :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 18, 2016, 11:39:58 PM
Request, would it be useful to have the attainable rate highlighted if it is faster than the actual sync rate by a suitable margin and less than 80000?

 The kind of reverse of the highlight on the actual sync is greater than attainable?

My line seems to have a big difference even though it syncs at 6db whatever I do it doesnt sync at the attainable value after forcing a resync.

 Is this caused by Ginp or banding?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: cefacat1 on April 23, 2016, 07:41:47 AM
Hi Guys,

I'm a relatively new member from Australia and was wondering why the MDWS website does not appear to be accessible from here?

I've tried various browsers, PCs and even ISPs over the past couple of weeks and the url simply times out after sitting at a blank page for a while.

I finally managed to get the site up by using a VPN connecting to a UK server, then the site came up fine. I've now registered and would be happy to donate, however I'm not sure if you accept members from Australia?

Fantastic site and resource by the way guys!

Cheers,
Mike
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 23, 2016, 07:56:20 AM
Hi Guys,
I'm a relatively new member from Australia and was wondering why the MDWS website does not appear to be accessible from here?
Hi

Can you PM me your IP address please?

http://whatismyipaddress.com/ (http://whatismyipaddress.com/)

Edit: I've PMd you again. Doesn't appear to be an IP block and Australia is not banned in any way. I'll use my own VPN to see if I can find the reason.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 23, 2016, 09:09:21 AM
Tony is it possible to see historical line configuration data on MDWS? Ronski posted in William's thread saying several parameters changed on his line but I cannot see how came to that comment because all the parameters visible with historical data show no change, the parameters under the XTRA hover have no historical data.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 23, 2016, 09:51:36 AM
Tony is it possible to see historical line configuration data on MDWS?
Only for the graphed items, the stuff at the top is transient. If you have a specific date/time I could extract the XTRA data from the DB though (as a one off as long as he was uploading at the time). I see Williams line is about to go up in flames if it hasn't already
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on April 23, 2016, 09:20:57 PM
Tony is it possible to see historical line configuration data on MDWS? Ronski posted in William's thread saying several parameters changed on his line but I cannot see how came to that comment because all the parameters visible with historical data show no change, the parameters under the XTRA hover have no historical data.

Actually I posted saying there had been several resync's and that the speed had changed, that was all.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: S.Stephenson on April 24, 2016, 02:16:39 AM
Is it possible to run 2 instances of DSL Stats on a RPI and collect data from 2 different modems say 192.168.0.2 and 192.168.0.5

Only problem I can see would be the temp files maybe?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 24, 2016, 07:29:18 AM
No, I'm sorry, that's not possible at present. It's not temp files (DSLstats doesn't use them), it's the main configuration files which would get mixed up. Untangling that would be a substantial undertaking.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on April 24, 2016, 08:12:00 AM
Sounds like the simple answer is another RPi, although I run 2 copies on Windows as I've mentioned before but it does cause a problem with IP addresses.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: S.Stephenson on April 24, 2016, 12:32:24 PM
Sounds like the simple answer is another RPi, although I run 2 copies on Windows as I've mentioned before but it does cause a problem with IP addresses.

I have an always online Windows 10 server, so I guess when I get round to it I will run the 2nd on off it.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on April 24, 2016, 07:23:28 PM
Just to let you know, a lot of uploads are being missed at the moment, most likely MDWS side.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 24, 2016, 08:14:40 PM
Are you sure? - I see yours is missing stats but mine isnt at the mo..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on April 24, 2016, 08:56:16 PM
It could be due to how unstable my line is but unlikely.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 25, 2016, 09:15:02 AM
Just to let you know, a lot of uploads are being missed at the moment, most likely MDWS side.
I cannot see any sign of problems over past 24 hours here in the logs or with anyone else except for those few that suffer the same problem for whatever reason. The uploads you are (still) missing just aren't making it to the server.

I suggest you stop DSLstats (unload it, don't just stop sampling), then restart and see if it is okay. It can also happen with DSLstats after a machine has slept/hibernated as I found out here once. Past that I have no idea.

There is a reference upload you can look at (Centurian) that runs from here 24/7 - it has no connection to MDWS and is with a different ISP on ADSL2+ so it's just like any other uploader. If there are server or network problems that account will show it (the U/S SNRM is terrible on it but it works and I just don't worry about it). The only time is will miss is when I update the machine software or otherwise stop it running. It's on 5.8 also.

I only use it as a backup and to software bond with the FTTC line to get another 9+mbps or so d/l and 1mbps u/l, it'll be upgraded to another FTTC line soon.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on April 25, 2016, 09:29:02 AM
Tony,

I've already restarted my PC several times after I reported the problem and the problem still lies...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 25, 2016, 12:11:21 PM
Mine has been perfect for the last few days and still running 100% normal with hg612 stats
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 01, 2016, 07:12:19 AM
DLM Gadget - Current Day Cumulative Totals Available
This facility (available from the wider graphs by selecting the traffic lights for FTTC connections) has by default always shown the line status for a rolling 24 hour period. Since the DLM actually monitors the stats over a 24 hour period starting at 00:00, it can give misleading results when a line with lots of errors becomes less error prone and the error rate drops.

Version 2, available now, lets you select the current way of displaying a rolling 24 hours for a user or, if you prefer, the actual day's cumulative figures resetting at 00:00 each day and counting up as the day progresses. Whichever way you choose, accuracy is only ever obtained for the current day with a full 24 hours worth of data.

Note that the cumulative view is slower to load than the rolling one.

Since you may well not be around when it reaches 23:59. you can also now select the previous day's total - or any day in the past 10 days if the data is available of course - the dropdown list will only show days that have uploads. If there is insufficient data, the status will be all Red with zero values. The current setting is retained until changed. The screenshots below show some examples with the leftmost showing a view from this morning as it has been, then at center the new 'Cumulative' view as (hopefully) the DLM sees it at about the same time as the left one. At right is a view of the dropdown selection  list.

The small traffic lights in the Status Panel still currently show a rolling 24 hour period as a line overview.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on May 01, 2016, 07:30:04 AM
Nice addition Tony keep up the good work0
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: valleysboy on May 01, 2016, 11:45:39 AM
Very nice Tony, ta very much  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Alex Atkin UK on May 02, 2016, 12:36:05 AM
Trying to donate via the website but every time I login to PayPal I get a failure due to technical difficulties.  :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 02, 2016, 11:50:12 AM
Alex
I tried a few hours ago using another account and it worked fine. Have you tried again since the original attempt? At what point does it hit Technical Difficulties?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on May 02, 2016, 04:31:43 PM
What does the * mean in the upload column?  Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 02, 2016, 04:57:39 PM
What upload column are you referring to?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on May 02, 2016, 05:00:52 PM
I think you mean in the user stats page. If thats the case you can hover over the box and the modem type is displayed that is being used to upload
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 02, 2016, 05:22:14 PM
Yes, sounds like it. If he'd have said Upload Prog then it would have been obvious, plus it tells you what it means if you hover over the title...

If he means the Uploader list then it indicates a non-UK user (different time zone). ** means they are probably in Greenland  :'( . Or the clock is still on GMT.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on May 04, 2016, 04:48:32 PM
Hi,

update: Tony just emailed me to say yes some strange things are happening so is investigating -Thanks Tony

Just thought I would mention I notice a few users from today have missing minutes. From looking at the logs mine points to a curl error 28. Anyone else had a look at the error file?

The 4 other users I looked at all had between 96-98% upload with missing minutes for today. Perhaps there is a problem somewhere- I have been on 100% for some time but some gaps today.

many thanks

sample
04/05/2016 15:48:00.97 - ONGOING-ISRUNNING-154800-940.TXT - Start of [HG612_stats.exe] - **** Version 5.2.0.7 10/03/2016 ****
04/05/2016 15:48:04.66 - ONGOING-ISRUNNING-154800-940.TXT - Normal End of [HG612_stats.exe]
04/05/2016 15:48:04.74 - ONGOING-ISRUNNING-154800-940.TXT - ************** G.INP is *NOT* active **************
04/05/2016 15:48:25.26 - ONGOING-ISRUNNING-154800-940.TXT - curl ERROR (28) - Operation timeout. The specified time-out period of 20 seconds was reached according to the conditions.
 
04/05/2016 15:48:25.32 - ONGOING-ISRUNNING-154800-940.TXT - End of [HG612_stats.exe] AFTER WebStats stuff
04/05/2016 15:48:25.35 - ONGOING-ISRUNNING-154800-940.TXT - **************** Total execution time = approximately 24.4 second
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 04, 2016, 04:53:43 PM
Yes, thanks for the PM. I'm just closing down and restarting the server, it seems to have been unhappy since G.INP was disabled this morning but probably a coincidence...

BACK up at 17:06
I can't see anything in the Apache error logs that's any help unfortunately, nothing out of the ordinary.

Curl 28 is timeout as noted in that log.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on May 04, 2016, 05:25:48 PM
Thanks Tony, will keep an eye and see what happens.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: colintd on May 05, 2016, 02:35:53 PM
I wonder whether anyone can shed some light on something I'm seeing?

I'm currently on FTTC in a village setting, getting fairly near perfect performance - 79,999 DS, and between 18,500 & 20,000 US.

However, I've noticed that when I look at bit loading in MyWebDSLstats, the maximum reported tone is 255, and none of the higher bands are visible.  I've also noticed that the protocol is just reported as VDSL with no band plan.

Do anyone know why this is?  Is it a bug in the modem / stats collection? 

I'm currently using DSLstats_RPi V5.6.2  with a Thom/Tech TG589vn v3 modem, and the username in MyDSLWebStats is "AvonHouse". 

Any thoughts welcome.

Colin.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 05, 2016, 03:55:17 PM
The problem is the TG589vn (and other Technicolor models). They provide only limited data via their custom CLI. In particular, the pbParams data isn't available, and it's this which contains the band plan and other VDSL2-specific information. Unfortunately I know of no way round this (apart from using a different modem of course).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: colintd on May 05, 2016, 04:45:27 PM
Thanks for the quick reply.   I wondered whether this might be the case.

At present no desire to move modem because I'm very happy with general performance, but I might see if I can borrow one to try out.

Colin.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on May 09, 2016, 10:22:13 PM
Tony -- Please see the two attached images.

I have been monitoring daveesh1's circuit (because of the six resynchronisation events recorded today and the concomitant crazy SNRM plot (http://forum.kitz.co.uk/index.php/topic,17741.0.html)) and it seems as if there is failing in the code for the pop-up window.

The main graphical frames show the "traffic lights" as "amber, amber, green", "amber, amber, amber" and "amber, amber, red" when read as three rows, top to bottom.

The pop-up window shows the "traffic lights" as "amber, amber, green", "amber, amber, green" and "amber, amber, green" when read as three rows, top to bottom. A significant difference!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 09, 2016, 10:37:23 PM
Thanks. Looks like it's missed the retrain count on the popup, I'll have a look tomorrow.

EDIT @ 08:23: Now fixed
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on May 09, 2016, 10:46:01 PM
Thanks Burakkucat was going to mention that but you beat me to it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on May 12, 2016, 09:23:57 PM
@tbailey2 again today same issue as Monday but this time Cumulative not showing any retrains even though front page is showing
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 12, 2016, 10:31:13 PM
@tbailey2 again today same issue as Monday but this time Cumulative not showing any retrains even though front page is showing
Try it now, left out a negative sign  :-X  Have you got something living in your cab that wakes up occasionally and goes on a rampage?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on May 13, 2016, 07:43:51 AM
Thanks Tony that looks better. You never know there could be.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on May 21, 2016, 11:47:38 AM
A couple of suggestions is there a possible method of highlighting if a line may be 1) banded 2) vectoring on the All Users stats table page?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 21, 2016, 01:27:31 PM
I've recently noticed an issue where the stats bar increases in height, this with graph size large on Firefox. I think it's down to the username in the "Line Status for" box wrapping round to another line.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on May 21, 2016, 05:44:12 PM
I have attempted to create a second registration on MDWS for my second line, but keep getting "You already have an existing registration on MDWS!”. I think I am using unique details, but no luck. I see others with a second registration so wonder what my issue might be?  Any advice welcome. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 21, 2016, 05:47:20 PM
I used a different email for each registration, I'm sure that's all you need to do.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 05:56:19 PM
I have attempted to create a second registration on MDWS for my second line, but keep getting "You already have an existing registration on MDWS!”. I think I am using unique details, but no luck. I see others with a second registration so wonder what my issue might be?  Any advice welcome. Thanks.

I've PMd you...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: vic0239 on May 21, 2016, 05:59:18 PM
Thanks Tony.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 06:01:16 PM
I've recently noticed an issue where the stats bar increases in height, this with graph size large on Firefox. I think it's down to the username in the "Line Status for" box wrapping round to another line.
I can't reproduce this anywhere under any version of Firefox or Waterfox I have here under Win 10, it never wraps. The graph height is not related but it will obviously displace a graph vertically. It might possibly do this on a low res smartphone display although it's fine on Galaxy S5. I have made a slight change to the code that might stop it but no way to test it here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 06:04:18 PM
A couple of suggestions is there a possible method of highlighting if a line may be 1) banded 2) vectoring on the All Users stats table page?
I am not aware of a method of detecting banding that won't generate more queries than it answers. Perhaps Kitz might have some ideas.

Vectoring is not possible as there is no uploaded data available. And for that to be available there would have to many more live examples to generate whatever data there is reliably.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 21, 2016, 06:23:32 PM
I can't reproduce this anywhere under any version of Firefox or Waterfox I have here under Win 10, it never wraps. The graph height is not related but it will obviously displace a graph vertically. It might possibly do this on a low res smartphone display although it's fine on Galaxy S5. I have made a slight change to the code that might stop it but no way to test it here.

It has changed as there is now no space between "Line status for" and the username. After a little bit of fiddling I think it's related to the zoom level (CTRL +), after increasing the zoom a few times the minutes in the uptime drops down a line. No shortage of pixels here, in fact the opposite hence zooming in a bit - running at 2560 x 1440.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 06:47:57 PM
Well I'm on 2560 x 1600 but it never does it... OTOH I never zoom.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 21, 2016, 06:54:08 PM
Does it do it if you do zoom?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on May 21, 2016, 06:57:07 PM
I am not aware of a method of detecting banding that won't generate more queries than it answers. Perhaps Kitz might have some ideas.

It could be a tricky one to do because banding isnt always at exactly x999 or x000 for example you may see a x987 or x993.  You'd also need to look at other factors such as if there is surplus SNRm ..  and ensure that any surplus isnt just a normal day to day fluctuation.  Cant rely on max attainable either if the line is interleaved.
Sometimes it takes an advanced eye to spot if a line is suspected of being banded :(  Probably the easiest way to pick it up is if the line always syncs at the same rate even if there is more SNRm.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 07:15:26 PM
Does it do it if you do zoom?
Nope not even at 500%, not in FF or Iron
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 21, 2016, 07:28:21 PM
I can see it. I have 115% zoom permanently set, and it appears as below. As you can see, I can't even get to the options bar to change to a different user etc.

If I revert to 100% zoom, it appears normal.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 07:37:00 PM
What browser is that? The cause there are the traffic lights.

Edit:
I am going to put it back to where it was this morning before it was reported as I'm working blind not being able to see the problem and generating new errors in the process. Nothing had changed in some days (9th May) there prior to then. Done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 21, 2016, 09:16:38 PM
I don't think it's a recent thing, can't remember when I first noticed it, must of been a couple of weeks ago at least.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 21, 2016, 10:58:55 PM
What browser is that? The cause there are the traffic lights.

It's Pale Moon 26.1.1 (in effect, Firefox 26.1.1). I hear what you say about the traffic lights, but if I changed to a shorter user name (such as my own) it displayed correctly.

Anyway, I now see the same effect as Ron, and it doesn't seem to have any disadvantageous result.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 21, 2016, 11:16:36 PM
That's weird as even at 500% I have no problem in Firefox 46.0.1 as attached - I even removed some data and a word from the status bar about an hour ago which should have solved any problem. I'd guess it's maybe a font problem of some sort...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 21, 2016, 11:18:34 PM
With all this extra info on MDWS users stats I have had to increase monitor resolution from 1024 x 768 to 1920 X 1080 and purchase a magnify glass, come on guys there is only so much a human eye can see if your at the 40+ age with farsighted issues  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on May 22, 2016, 09:46:19 AM
Changing it to 'Status for' username seems to have fixed it thanks.

With all this extra info on MDWS users stats I have had to increase monitor resolution from 1024 x 768 to 1920 X 1080 and purchase a magnify glass, come on guys there is only so much a human eye can see if your at the 40+ age with farsighted issues  ;)

I'm not far off 50 and now have glasses for close up work, but there's no way I'd go back to a 1920 x 1080 resolution, let alone a 1024 x 768, but my monitor is 27" so that helps.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 22, 2016, 09:49:55 AM
Thanks

As well as that I've defined a font-family (Arial) in CSS for the table as it was missing  - I noticed here that the characters all compressed slightly afterwards so was hoping that might help  ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 22, 2016, 09:53:04 AM
Well my monitor is 30" - and aged 71 and with varifocal glasses since I was 45 it works well. I never have to magnify in any way though, probably 'yet'.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 22, 2016, 10:28:57 AM
I confirm that the display is now good at the 115% zooming which I use.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 22, 2016, 11:18:26 AM
Thanks Eric  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 22, 2016, 10:51:45 PM
For @pdes
Your upload equipment clock thinks it's the 1st January 2012 00:58 at the moment :-X


This would account for the really strange data on your graphs!! It appears to have flipped back to end of 2011 around 21-05-2016 09:56:00...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on May 23, 2016, 09:17:13 AM
Tony, Rather than have it display strange data, wouldn't it be better to reject data being uploaded where the date/time is way out? I'd suggest more than an hour to avoid daylight saving time problems if that is a likely issue.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on May 23, 2016, 09:25:14 AM
Tony, Rather than have it display strange data, wouldn't it be better to reject data being uploaded where the date/time is way out? I'd suggest more than an hour to avoid daylight saving time problems if that is a likely issue.

Nice idea but there is also an issue of timezones if some users are not UK based, so it might not be as easy as that.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 23, 2016, 10:26:25 AM
Possible but we have users in California, Australia and New Zealand for example. It also means a lot of coding to detect and notify users etc etc. There is always a message on the User terminal though if the clock is out. It's a very unusual occurrence to have the clock this far out by umpteen years!

But not of help if they don't log in. I have mailed him. That doesn't work when someone hasn't updated their email and it bounces. There is one user who had been uploading for 14 months  but I've binned all uploads for the past 12 months as the uploads are invalid but his e-mail bounces...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on May 23, 2016, 10:30:51 AM
For @pdes
Your upload equipment clock thinks it's the 1st January 2012 00:58 at the moment :-X


This would account for the really strange data on your graphs!! It appears to have flipped back to end of 2011 around 21-05-2016 09:56:00...

Fixed, thanks.  I was wondering what was wrong!  I have a monitoring PC that seems to just lose it's time and date stamp after power cuts!

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 23, 2016, 10:53:10 AM
Okay, all looks well now. You maybe need a new motherboard battery/button cell?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on May 24, 2016, 10:58:23 PM
Does indeed sound like he needs a new CMOS battery.  They can be picked up pretty cheap for about a quid.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: frogfoot on May 26, 2016, 10:30:46 AM
Hi, just a quick post to say DSLStats with upload is working fine on my new Billion 8900 AX2400,  so that one can be added to the list of supported modems.  (I'm using the included Billion 8800 profile)
Tom
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 26, 2016, 11:06:35 AM
Thank you for that information, I'll add it to the list.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 26, 2016, 04:14:47 PM
Likewise on MDWS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on May 27, 2016, 12:55:23 AM
Does indeed sound like he needs a new CMOS battery.  They can be picked up pretty cheap for about a quid.

They all called CR2032 Battery cells 3Volts you can get 4 of them along with two CR2025 and two CR2016 all for £1 in the pound shop  :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 01, 2016, 05:29:34 PM
I've been using the SNRM/Band graph a lot recently because of the issues on my line. I was wondering if it might be possible to place a re-sync indicator on these graphs as well as the SNRM one? Certainly would be useful I think.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 02, 2016, 07:58:47 AM
It may be possible but can't do anything at the moment. You do have a list of resyncs just above the graph for reference.

Over today and maybe tomorrow, the Apache process and possibly the entire server will be restarted a number of times for config changes. The former probably will pass unnoticed, the latter could mean up to 10 minutes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on June 02, 2016, 02:12:04 PM
Over today and maybe tomorrow, the Apache process and possibly the entire server will be restarted a number of times for config changes. The former probably will pass unnoticed, the latter could mean up to 10 minutes.

I guess this might explain why I unexpectedly received 5 'not uploading' emails today. ;)

I stopped uploading the other day to try a new modem which is not compatible with DSLStats etc.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 02, 2016, 02:45:45 PM
No it doesn't work that way, you need several missing uploads several minutes apart to initiate the messages.

The reason you are seeing them is because .... you haven't uploaded since yesterday at 12:34...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on June 02, 2016, 02:55:45 PM
Lol - it's not important but I wouldn't have expected to receive any today  since I have


UPLOAD FAIL
E-mail Notify after 10 minutes 
If active, repeat every Off

In the options..   ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 02, 2016, 03:49:18 PM
Yes, very odd. Can't immediately see what might be wrong and seems to have stopped for the moment. Off is actually set to every two days though in case the user forgets but it's been sending at irregular intervals. I'll add it to the list. Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on June 02, 2016, 09:18:25 PM
Not sure if you are making any changes or not, but the page loading times are  all of a sudden like treacle

I get a message Sorry, but the server is busy and cannot handle your request at the moment. Please try again shortly ? so i try again and it doesn't even load , not moaning about it, just giving you the heads up , in case you didn't already know about it
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 03, 2016, 07:44:13 AM
Yes, thanks, very aware  :o 
That error gets mailed to me every time it happens... I have been trying to fix a memory leak that makes the server grind to a halt periodically.

EDIT 5th June:
Still working on this today so you may see more errors. One side effect of restarting the Apache server is that the no upload warnings get sent again even if they are turned off (that's why this has been happening). I need to find a cure for that as well...

EDIT 8th June:
Looks like the cure was to allocate more Apache workers and fastcgi processes, getting the balance right was the awkward part - the memory loss was due to expired processes not being killed off properly when requested. Haven't seen any errors for two days now. Also, the unwanted upload warning errors seem to have mostly gone away after some code changes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on June 10, 2016, 05:02:46 PM
I'm trying to make a donation via PayPal, but I don't have a PayPal account at the moment. when making a card payment as a guest, where do I enter username:myusername ? and does the email I enter in PayPal need to match the email I'm registered with on mydslstats?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 10, 2016, 05:17:11 PM
Hi

The e-mail doesn't need to match as long as somewhere (there should be comment/note section) you can put your username (the username:myusername is for automated processing).

Or just do it and then say here that you have please along with your user name.

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on June 10, 2016, 08:37:37 PM
blah! my PayPal account is suspended as of last week. tried paying as guest with card option but it's linking it to a limited account.
No other way to donate? Google wallet, bank transfer, paym, Ukash? I'll get a friend to use his account if not, but surely something to consider. Many don't like the evil entity that is PayPal.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 11, 2016, 05:03:34 PM
If it helps, I've added a Google Wallet address for donations but as I've no idea what an incoming payment looks like via e-mail until someone sends one.  There are some additional notes on the donations page. Note that anything using this address that is not a donation will end up in the trash bin.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: loonylion on June 11, 2016, 06:41:45 PM
Not sure about the evil entity bit. I've used them since 2003 or so for everything online with no problems and always found them very helpful when things infrequently go wrong.

I had a successful business shut down by them after we refused to comply with their illegal demands for access to our customer database and servers. (not illegal under US law but illegal in virtually every other country including the one we were registered in)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on June 12, 2016, 03:47:56 PM
If it helps, I've added a Google Wallet address for donations but as I've no idea what an incoming payment looks like via e-mail until someone sends one, then this is experimental until I can work out how to auto-process it into the system.  There are some additional notes on the donations page. Note that anything using this address that is not a donation will end up in the trash bin.

Not sure about the evil entity bit. I've used them since 2003 or so for everything online with no problems and always found them very helpful when things infrequently go wrong.
very much appreciated!!
donated via google wallet, hopefully you get it okay. not sure if you'll be able to automate it as it says "The recipient will need to claim the money once it's received."
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 12, 2016, 04:12:38 PM
Okay, done thanks. It's now automated (hopefully)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on June 23, 2016, 07:19:44 AM
anyone who might be watching my line, I shut down the tool for a while as I was moving it to my laptop, this is done now so its up again but now running on my laptop.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 26, 2016, 10:52:12 AM
Hello,

How do I order the users list by uptime?

Thanks!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on June 26, 2016, 10:57:01 AM
You can't, only the clickable columns (in blue) can be sorted.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 26, 2016, 11:39:55 AM
Ahh, thanks. How do I sort those then? Can't see anywhere where it says "sort" or something similar?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on June 26, 2016, 12:59:13 PM
Click the heading,  to sort ascending or descending there's text above to click.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 26, 2016, 01:12:10 PM
Err, nope. That doesn't work? I presume you mean the headings above the drop down menus?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on June 26, 2016, 01:17:12 PM
The headings of the columns.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 26, 2016, 02:03:48 PM
Clicking the headings shown here doesn't do anything...

(https://i.gyazo.com/95d885cdc6328560794b5864f7540794.png)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on June 26, 2016, 02:42:54 PM
If you want to look at all users I would click on the 3rd column then select user stats, then click on the  click here at the top and it will give you all the current users...you cant sort by uptime but you will see all the active ones along with how long they have been up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 26, 2016, 02:44:42 PM
Ahh, that's how it works. Thank you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on June 26, 2016, 03:01:57 PM
No probs  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 30, 2016, 02:14:54 PM
30/06/16 13:46
Seems the server may have a motherboard comms problem. Working on it but have to go out shortly so may be slow to fix (if fixable).....

14:29
Back up but seems the USB comms has failed on the motherboard. More anon. Sorry if everyone gets No Upload messages etc but had no time to stop them...


Now solved. The problem was that the mouse and KB were non functional but USB discs were okay. So uninstalled all USB related drivers and then reinstalled and all is now well! I habitually RConsole in so hadn't noticed the lack of functionality. This means I can now add some memory at the weekend as with no machine KB functionality, I couldn't hit F1 when it tells me at BIOS startup that the amount of memory had changed...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 30, 2016, 02:46:29 PM
Thanks for your continued support, Tony. I'm uploading back now, the want for monitoring has come back.

Hopefully, the line looks very good now. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 30, 2016, 03:31:38 PM
William

The new e-mail you just changed to is disabled as message confirming it to you bounced:

      Recipient: [SMTP:********@google.com]
        Reason: Remote SMTP Server Returned: 550 5.2.1 The email account that you tried to reach is disabled. wm1si4236676wjc.277 - gsmtp
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: William Grimsley on June 30, 2016, 03:48:35 PM
Ah, whoops, sorry can't remember why I changed it now, I'll change it back now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 08, 2016, 07:44:22 AM
SERVER MAINTENANCE

Please note that the MDWS server will be down early tomorrow morning (Saturday 9th July) for a fair amount of software and hardware changes. Duration unknown but likely an hour, maybe more. Thanks.

COMPLETED

Down at 07:30
Successful Restart at 08:15
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 09, 2016, 01:46:50 PM
Good work MDWS loads & refreshes much quicker  :thumbs: 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on July 11, 2016, 01:13:31 PM
Does today's shock announcement mean the MDWS security question has changed Tony?  :) :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 11, 2016, 01:19:33 PM
Not yet but I'll likely change it to something more long lasting like who is the President of Russia or Wimbledon Mens Champion....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on July 11, 2016, 01:28:28 PM
 :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 12, 2016, 12:08:28 AM
Notice the dips on a daily basis on my US snrm?

No intention of reporting it as a fault because (a) its not service affecting and (b) I have a pretty good idea what the cause is.

My neighbours upstairs seem to be running some kind of machine overnight, as I can hear the faint noise in the room below.  Seems to match the time the US snrm gets droopy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on July 12, 2016, 08:14:08 AM
Not yet but I'll likely change it to something more long lasting like who is the President of Russia or Wimbledon Mens Champion....

 :) :) Caught me out this morning.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on July 12, 2016, 11:29:45 AM
Hi

I feel foolish as I do not know the answers to those 2 questions - I don't follow Russian politics or tennis. I used to know the answers in the eighties though

I might suggest you maybe consider Google box to confirm human (sorry, the name has slipped my mind)

Just a thought

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 12, 2016, 11:37:37 AM
You could use google to find the answers.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on July 12, 2016, 12:15:20 PM
Hi dray

Haha should have expected that answer (never thought of googling answer)

A mute point though, if the verification answer never changes, then it is open to abuse, and Google verification is simple to implement but there are other verification code you could use

It's only my thought though

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 12, 2016, 12:21:43 PM
How is that a moot point as the answer has changed?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on July 12, 2016, 01:10:24 PM
Hi dray

Yes, it may have changed now, but it will not change tommorow, next week, next month, not until the prime minister changes again

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 12, 2016, 01:14:48 PM
So what? You were complaining you didn't know the answer. Are you saying the problem is you now know the answer?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on July 12, 2016, 01:22:26 PM
Hi dray

I am not complaining 

I was merely stating I did not know the answers...!

I made a suggestion not a request or demand, so I am a little surprised by your post

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 12, 2016, 01:28:03 PM
Sorry, you've lost me
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on July 20, 2016, 09:40:26 AM
Looks like MDWS has gone down..... I can't get website or ping it.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 20, 2016, 09:57:52 AM
It's there. BT is having an issue apparently - something to do with the thunder and lightning.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on July 20, 2016, 10:02:29 AM
All ok here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 20, 2016, 10:04:05 AM
There appears to be a wider network issue somewhere as suggested. Over the past two hours, some 50 odd people have stopped uploading and I can't see why - others are fine but the uploaders total is still falling slowly. Plusnet/BTW seems to be a majority.

TBB site is not accessible from here so latency graphs are failing. I had two RDI failures yesterday which is very unusual (Plusnet) and a lot of packet loss that I hardly ever see. Also Plusnet do have an alert active from yesterday that I found when I spotted my resyncs.

Edit:
I now have an ebay DNS failure....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on July 20, 2016, 11:23:29 AM
Well I've been out for a while but I can now ping it OK.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 20, 2016, 11:39:14 AM
Yes, all been fixed (router failure following UPS failure in London) and uploaders almost back to usual  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 21, 2016, 01:55:06 AM
tony was a BT router outage which affected plusnet also, that's why.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: highpriest on July 21, 2016, 06:59:45 PM
Is anybody else getting this problem accessing the website through a proxy server? Seems to be going into some kind of redirect loop. Works fine if you go direct.

Screenshot attached.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 22, 2016, 06:38:48 PM
The page is invoked in response to a 403 Access Denied from the server and redirects to a user validation page. So the proxy server you tried for whatever reason has its IP banned.

I just tested this on a banned IP via a VPN and works fine under Chrome with no errors so no real idea why you saw that response. Can you say what the IP was please? Avoiding proxy servers is probably the best way round it if there is a problem. I've not seen this ever happen before. Are you registered with MDWS?

Edit 25/07/16:
This has been resolved....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: highpriest on July 23, 2016, 01:52:39 AM
The page is invoked in response to a 403 Access Denied from the server and redirects to a user validation page. So the proxy server you tried for whatever reason has its IP banned.

Very odd. It's the proxy cluster at work.

Quote
I just tested this on a banned IP via a VPN and works fine under Chrome with no errors so no real idea why you saw that response. Can you say what the IP was please? Avoiding proxy servers is probably the best way round it if there is a problem. I've not seen this ever happen before. Are you registered with MDWS?

I am, with the same username, but I'm not uploading any data at the moment. Will send you the IP addresses in a PM. Unfortunately at work, I can't avoid the proxy servers. At least not unless I tether a laptop to my phone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on July 23, 2016, 12:43:23 PM
I think I have come across a v. small bug re: the Latency Monitor.

In the Options section I populated the Latency Monitor section with graph information some time ago but set the 'Monitor' box to 'Off' as I was going to be using an MDWS incompatible modem for a bit.

Now I have swapped modems again - I note that MDWS seems to ignore the 'Off' instruction and continues to update the graph..



Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 23, 2016, 12:57:21 PM
Seems okay here - if I turn mine off it goes away and gets replaced by a dummy image saying you need to set it up... (You would need to hit F5 after changing the option to get it to take effect although it will disappear next to a your user stats pane if you have one open [on wide graphs only]).

Try turning it off and on and off  if that doesn't work.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on July 23, 2016, 01:04:25 PM
Turning it off/on changes the larger graphic on the top right hand side but not the smaller graph next to the uptime on the status bar which always seems to appear/update
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 23, 2016, 01:08:28 PM
Um. I'll have a look later after F1 Monsoon Qualifying and dealing with builders banging away here.  Removing the link should kill it all.

Edit:
This should be okay now...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on July 23, 2016, 01:11:49 PM
Thanks - take your time - its not important.. and enjoy the racing!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 23, 2016, 05:01:22 PM
Tony I am looking into my uptime and see a gap of two minutes coming up to each hour, could you have a wee look when you get time before I start stripping down the RPi OS

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 23, 2016, 05:13:49 PM
I don't see any server problems currently.

Had a good look at this some time back with Eric... Check the DSLstats log for errors - unable to connect/log in to modem or connect timeouts.  That's the only reason I'm aware of although the Billion seems far more prone than others...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 23, 2016, 05:36:48 PM
The only event logs on the DSLstats v5.8.2 are from the 21 Jul 2016

21 Jul 2016 12:14:42 Unable to save Bits.Log for MyDSLWebStats
21 Jul 2016 12:14:42 Unable to save Bits.files.zip for MyDSLWebStats
21 Jul 2016 12:14:43 Unable to save SNR.Log for MyDSLWebStats
21 Jul 2016 12:14:43 Unable to save SNR_file.zip for MyDSLWebStats
21 Jul 2016 12:14:43 Unable to save modem_stats.Log for MyDSLWebStats
21 Jul 2016 12:14:43 Unknown error while uploading MyDSLStats data

Checking the RPi monitor coming up to each 56 minute it shows as sampling each minute all the way upto the hour but on MDWS there are 2 minute gaps not recorded
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 23, 2016, 05:57:43 PM
I've put a monitor on your line to see if the missing uploads are ever getting here...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 23, 2016, 06:07:11 PM
Thank you Tony I'm also monitoring RPi DSLstats screen each minute which is doing my head in.
Very interesting wet to dry qualifying one of the best so far  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on July 23, 2016, 06:20:51 PM
Don't think they would have waited for the drizzle to stop in Tony's avatar's day though.  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 23, 2016, 07:17:37 PM
Yes, they were real men driving real cars with little aid from anything else. Not wimps like today's drivers...

@NStar

You are only missing one upload at 57mins to the hour. It started a couple of days ago,

But.... have you noticed that you are not uploading any bits zip files (I assume not intentionally). They upload at 57mins to the hour for you. If you look, you'll see that last Bits/Tone file uploaded was on 21st July at 11:58. Same for the others. That happens to coincide with your log entry you showed where the zip uploads failed just after that. I will observe that we used to upload every 15 mins but that changed a long time ago to every hour.

Looks like something has gone adrift there in DSLstats and it isn't reporting it. Maybe you need to clear some files or whatever, possibly Eric could advise if he spots this..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 23, 2016, 08:09:23 PM
Ok Tony that is very helpful it gives some idea on how to proceed i'll switch over to PC uploading and start tinkering with the RPi.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on July 23, 2016, 10:20:46 PM
This 1 min gap has gone with RPi uninstalled DSLstats or moved to wastebasket then click show hidden folders moved .DSLstats folder to wastebasket and installed DSLstats again and set it up again.

And thinking back I took the DSLstats offline to MDWS and changed the sample rate to 15 seconds while doing some stuff to see if it effected stats and must have borked the .INI file  :blush:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 26, 2016, 09:47:32 AM
Missing Uploads

Please also see this post:

http://forum.kitz.co.uk/index.php/topic,18141.msg328731.html#msg328731 (http://forum.kitz.co.uk/index.php/topic,18141.msg328731.html#msg328731)

There is a suggested fix at the user's end for some of the intermittent missing uploads...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on July 26, 2016, 06:19:17 PM
How often does MDWS check what modem is in use? I switched both modem and stats program a couple hours ago and it instantly noted the change of stats program, but still shows me as using the older modem. It's not a huge deal, I'm not even sure what info it uses to identify the modem. I know it's not anything I select in DslStats as I'm using the Zyxel VMG8924 and that isn't even an option, though MDWS reports a number of users using it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on July 26, 2016, 06:40:57 PM
You need to manually select the modem type in the options page on mydslwebstats when you are logged in. At the bottom of the page "options"  then choose modem model and other alerts.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on July 26, 2016, 06:57:59 PM
lol! thank you! can't even remember setting that in the past. I know Tony uses a bit of trickery to work out the DSLAM type, thought it was similar for the modem.  :doh:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on July 26, 2016, 06:59:48 PM
Lol. Dont forget your upload alerts on the same page. I am interested to see if you get any missing minutes. My 8924 kept on skipping minutes for some reason. My 8324 does not miss a beat. :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 01, 2016, 06:40:54 PM
Thanks to MDWS I have the time my laptop locked up.

Earlier today the screen wouldnt wake up, so laptop was basically unresponsive, had to power cycle it.  I can see from MDWS it stopped working around 4am this morning.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on August 03, 2016, 07:50:13 PM
Tony

Have you changed the refresh option on Errored Seconds. I can only find 15 or 30 Mins, (I used to have 5 mins )

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 03, 2016, 08:17:26 PM
Yes. It only updates once an hour so others were a bit unnecessary and reduces loading a bit. You can always manually reload it at about 5 mins past the hour if you want.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: krypton on August 03, 2016, 08:19:04 PM
It's still there:

(https://abload.de/thumb/escwugi.png) (https://abload.de/img/escwugi.png)

But not every time. Sometimes another interface is displayed. But I don't know how to switch between them:

(https://abload.de/thumb/es2z5uid.png) (https://abload.de/img/es2z5uid.png)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 07, 2016, 05:19:15 PM
Noticed on the full user stats the Zyxel modem/routers are highlighted with a green background and other non Zyxel modems/routers are not, is there something wrong with the Zyxel that needs it to highlighted  :-\
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 07, 2016, 05:27:56 PM
Hover your mouse over the green and it says the modem is MCT approved.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 07, 2016, 05:52:16 PM
Hover your mouse over the green and it says the modem is MCT approved.

Is that what it is  ;D are the HG612 not MCT approved as openreach gave them out during fttc installs
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 07, 2016, 06:18:19 PM
The Show Resyncs on SNRM Graphs seems to be offline
Edit my mistake was looking at data over 60 days the resyncs don't show up in that time frame  :-[
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: xreyuk on August 08, 2016, 12:22:46 PM
Couldn't find any contact information on the website. I've forgotten my memorable passphrase and wondered could an admin help me out?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 08, 2016, 12:59:13 PM
It's in your original welcome email... If you can't find that I'll PM you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 13, 2016, 09:03:09 AM

Is that what it is  are the HG612 not MCT approved as openreach gave them out during fttc installs
I just checked this with Kitz and they both are. She says:
Quote
In fact various ISP supplied modems are MCT approved, but they don't actually make the public MCT list.  This is because the ISPs have submitted their branded modems themselves; for example Sky, BT, TT and presumably the EE Livebox although I'm not certain for the latter.
But of course they have to be able to upload to MDWS as well so many approved modems won't show unless either HG612 Stats or DSLstats works with them (obviously  ??? )

I've updated the listings concerned.

There are still quite a few people who haven't added their modem via the MDWS Options menu. Only takes a few seconds  ;)

Edit:
I also note on the Billion Forum (http://www.billion.uk.com/forum/viewtopic.php?t=9006) this statement (15 July 2016) from a user who appears to be a company rep:

Quote
The original 8800NL has not passed BT's MCT for SIN 498 and there are no plans to put this through.

They try to point out that you can use what you like and BT can't stop you. Which is true but you might have problems getting support I guess. Which begs the question, can BT tell remotely what Modem you are using? Since they can update the firmware on their own modems/routers, I guess they can.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on August 13, 2016, 12:57:01 PM
The MCT list occasionally escapes into the wild - for instance: www.fcs.org.uk/image_upload/files/BTW%20List%20of%20Approved%20Modem%20CPE%20v7.pdf - though as you/Kitz say it doesn't list ISP own brand models or ones supplied by Openreach themselves.

I note the posts on Billion's forum which I see are 4 years old and have to say are somewhat misleading re: the current position.

 Openreach can identify non MCT kit and one may find it breaks following changes in their network. Draytek sum up my understanding at www.draytek.co.uk/information/our-technology/bt-sin-498

they reserve the right to terminate your service if not using approved kit though how likely this is unless you are interfering with other customers lines I can't say..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 13, 2016, 01:58:56 PM

 ???

As already stated, that post I quoted was made on

Mon Jul 11, 2016 10:23 am

Are you looking at the users' Joined dates?


Yes I have that list.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on August 13, 2016, 02:55:08 PM
As already stated, that post I quoted was made on

Mon Jul 11, 2016 10:23 am

Are you looking at the users' Joined dates?

Yes, sorry I was - it's what I get for being half asleep!   :blush:

Just glad I don't have a Billion if that is their view though
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on August 13, 2016, 04:55:26 PM
I'm not sure if you're aware but I did an MCT page several months ago, but never got around to publicly announcing it.

BT Openreach Modem Conformance Test (MCT) (http://www.kitz.co.uk/routers/MCT.htm)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 13, 2016, 07:07:46 PM
So using a Billion 8800nl on the OR network is like using a Cobra 80 CB radio in late 70's it was frowned upon because it caused interference with peoples tv/radio yet it was the best to pickup low signals and transmit much further than others don't mind being bandit again  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 17, 2016, 07:51:16 AM
SERVER RESTART at 08:00

May take up to 20 mins.

BACK UP at 08:08
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on August 19, 2016, 10:07:51 AM
Hi Tony

Just wondered if it would be possible to setup alerts for example if your DS Snrm had a large surge you could get an email alert - perhaps other alerts could be considered?

many thanks for your continued work!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 19, 2016, 10:58:48 AM
Others have asked but they are a lot of work and I don't have the time currently. If you are desperate, DSLstats will already do this and other alerts for you.

It does work as I discovered a short while back...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on August 19, 2016, 11:50:31 AM
Ok thanks for that I will have to investigate  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 21, 2016, 11:05:03 AM
Is it possible to have my username changed for privacy reasons.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 21, 2016, 04:24:35 PM
Is it possible to have my username changed for privacy reasons.
Nope.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 21, 2016, 06:30:07 PM
Can I delete my account then and start a new one?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 22, 2016, 08:07:43 AM
Can I delete my account then and start a new one?
You can register again if you want and I can delete your old account and data off the server.

I'll PM you on what to do shortly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 22, 2016, 12:52:49 PM
I'm not able to reply to your PM, tbailey2!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 22, 2016, 01:04:46 PM
Ok, I see you've registered again and can work out who you are so will delete the old records...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on August 22, 2016, 01:37:40 PM
Thanks, that's really helpful :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: dansmitherson on August 24, 2016, 09:00:20 AM
Hi can the admins of MyDSLWebStats please advise if they are blocking certain IP ranges?
I am with Spark New Zealand as my ISP, and am unable to connect to the website via Mobile or my DSL connection.
Currently I have been allocated the following IP's

115.188.169.35
203.96.123.195
115.188.123.30

If so could you please unblock the Spark NZ ip ranges.  thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 24, 2016, 09:32:40 AM
Done for all the IPs owned by your ISP. It was in a block down as allocated to China.

I did get your earlier direct mail but only have one pair of hands unfortunately and was still asleep...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: dansmitherson on August 25, 2016, 03:12:54 AM
Great thanks working now!

Couple questions, if I want to upload stats from 2 different VDSL modems, can I do it under a single account, how?
And if I donate will it enable longer data retention and more features for both modems I monitor?
 
thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 25, 2016, 07:09:48 AM
Glad it's working okay now.

Basically No and No.

You need to generate a second account for a second line and the donation only covers the line it was for.

I've sent you a PM
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 27, 2016, 03:53:21 PM
storm here errors galore if anyone wants to watch my line same as last time storm during football so cannot turn line off
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on August 28, 2016, 11:06:02 AM
  I have just moved to uno(xilo) and notice that MDWS shows my ISP as Daisy. I don't know if uno use Daisy but other tests pick my ISP as xilo.  Hardly matters but I wonder how you spot the ISP?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2016, 11:23:58 AM
They use the Daisy network/backbone as do SSE for instance (I have an ADS12+ line with them). You can Google this to confirm, one link is below:


http://www.ispreview.co.uk/review/reviews/726/reviews.html?sortReviews=mostUseful&page=23


MDWS uses a reverse IP lookup on your upload address, then through an algorithm that allocates that to an ISP as not all lookups provide any obvious result.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 28, 2016, 09:21:14 PM
Tony I like how I can zoom in on the bitloading.

I zoomed in on the adsl1 tone range where my line has power cutback on the entire range and the bitloading looks very similar to how it used to be on adsl meaning the level of cutback is reasonably accurate to match up how weak the signal is from the exchange.  Albeit with a couple of differences.

1 - on adsl the upper third of the adsl1 tones got destroyed at night as interference overwhelmed them.  This doesnt happen on the vdsl line even with the power cutback so as such those tones during darkness are better.
2 - The middle third of tones had higher bitloading on adsl suggesting they could probably reduce the cutback on the first 66% of adsl tones.

My latest calculation of sync speed without power cutback suggests I would be at about 85-88mbit up from the 71-72 I have now.  The power cutback has been eased off a bit since my line was initially activated when back then it was actually reducing some tones to 0 bitloading now they only go down to 5 bitloading.  This I think is why my line now is syncing in the low 70s vs the higher 60s it used to do on my old pair which had the more aggressive power cutback.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on September 13, 2016, 07:14:16 AM
Just out of interest, do we not get notified when G.INP is enabled anymore?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 13, 2016, 09:25:50 PM
Yes, you are still notified, no changes since it was first set up...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on September 14, 2016, 10:57:29 PM
I'm sorry about the duplicate uploads, Windows Update is trying to hurt me  :rant:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 21, 2016, 08:04:36 AM
MDWS OUTAGE 07:45-08:00
Apologies for the outage but had a wiring problem over the past few weeks and took a while to (hopefully) carry out the fixes...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: AngryMonkey on September 23, 2016, 01:40:01 PM
Hi,
Great site. However need a little help.

My user has dis-appeared from the site. HG612 logging stopped for a few days (since the 18th) and now my username doesn't appear in the list any more. I can still login. I donated, which I thought let me keep data on the site longer.

My username is AngryMonky - any idea why I've been erased?

Thanks,
AM.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2016, 02:00:14 PM
Hi,
Great site. However need a little help.

My user has dis-appeared from the site. HG612 logging stopped for a few days (since the 18th) and now my username doesn't appear in the list any more. I can still login. I donated, which I thought let me keep data on the site longer.

My username is AngryMonky - any idea why I've been erased?

Thanks,
AM.
You haven't been 'erased' - Users are removed from the dropdown list after no upload for 48 hours (have a look in the original mails). Once you start uploading again you'll reappear but may need to refresh a dropdown list to see it. Using the Range date option allows you to see all users who have uploaded in the last 3 months but that option runs much slower than the Current option.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on September 28, 2016, 11:55:18 AM
Suggestion for MyDSLWebStats

Would it make sense for some of the graphs to have an option for a logarithmic rather than linear Y axis? I was thinking of FEC for example.

With FEC, the problem is that a one off big spike as can occur during a storm can mask any background level of errors in the graph, which then aren't visible until you drill down to a section of the graph without the spike. With a Log based Y axis both the background level and the spike would all be visible.

Thoughts?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 28, 2016, 02:21:51 PM
Good idea, I could do with it myself... For the moment I've just enabled it on FEC only (the setting was already there but disabled) to see reactions.... I'll have to enable zero plots separately later (Now done). I'll make the setting switchable later via Options
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: andyfitter on September 28, 2016, 02:33:55 PM
Great! I think it makes the FEC plot far more useful.

Thanks for that!

Andy.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on September 28, 2016, 08:28:20 PM
The FEC graph now looks like a wild Bitswap snake it makes no sense to my eyes and you could have zoomed into FECS if there was a large spike which drowned out the rest zooming is part of my normal day with MDWS   ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on September 28, 2016, 09:07:29 PM
Quote
I've just enabled it on FEC

I like it; switchable would be great though.

Thanks Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2016, 08:07:12 AM
CHANGES

1) The FEC Logarithmic display discussed above is now configurable via Options and can be set On or Off via a checkbox.

2) User Country Flags are now available. I did this for myself last year but never implemented it for everyone. It is fully configurable via Options.

By default a small UK flag appears on the left of the Control Panel for the wider graphs - rather than try to determine the correct country since in the great majority of cases it will be the UK, that is the default. Where the correct country is known then it's been changed already and that ranges from various European countries to the USA, Australia, New Zealand and the Cayman Islands (I suspect the latter might be an ISP on a VPN to mask that fact).

So it's up to the User to select the appropriate country if it's not the UK. It could be done automatically but haven't had the time and there are so few instances, it's likely not worth the trouble.

If you don't want your flag shown, it can be turned off but it's pretty easy to determine anyway from the ISP in most cases which may be a way of automating it later. The UK has individual flags available for its four constituents.

The options are:

1) Hide all flags on your terminal so you don't see any at all
2) Hide your own flag so no one sees it including you
3) Select your Country, defaulting to United Kingdom

A flag only displays if the user is uploading. Initially, you may need to use F5 to refresh the page and see (or not see of that's your option) the flags.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 29, 2016, 08:26:23 AM
The logarithmic on/off works nicely now, Tony, thanks.

One small thing I've noticed in the options: in the modem section it says "Note that the Thomson/Technicolor modem/routers (which are not Broadcom-chip based) return very little stats data...". These modems are Broadcom based, but the firmware hides the Broadcom CLI and only provides a limited CLI.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 29, 2016, 08:41:21 AM
Thanks. Okay I have removed the Broadcom part.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 29, 2016, 10:21:27 AM
Tony could you please add a link so the all user stats is easily accesible without having to go through the graph interface?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 30, 2016, 07:07:33 PM
Tony could you please add a link so the all user stats is easily accesible without having to go through the graph interface?
Done, now as a link to the right of the check box options at the bottom of the main window.

However, it's now only available to Supporters and the original graph sized view has gone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on September 30, 2016, 09:27:12 PM
Thanks Tony, works a treat.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 01, 2016, 06:47:39 PM
Thanks Tony, works a treat.

One click of a mouse button and your there thanks Ronski for the suggestion and of course Tony for the implementation.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 01, 2016, 09:29:28 PM
Don't think it was my idea, Tony had said he was going to implement it before, I just reminded him.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 01, 2016, 09:40:39 PM
It was Kitz who originally requested that change ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on October 05, 2016, 09:14:58 PM
Hi Tony
Would we be able to add another latency link option for display please?. I have ipv4 and ipv6 so would be happy to add the ipv6 graph to the latency section if it was possible/any interest...

Many thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 05, 2016, 10:21:36 PM
I can't see that happening any time soon. Could you not put it against one of your other logons/lines?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on October 08, 2016, 01:05:02 PM
Done, now as a link to the right of the check box options at the bottom of the main window.

Brilliant thanks :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on October 14, 2016, 06:24:27 PM
Something weird is going on!

My router and local mydslstats show that my snr is currently 4.7 but on the web, it shows it as being in the 6s.  I also had half an hour downtime today but this isn't shown.  Any ideas? Am I somehow looking at someone else's stats?

ID is pdes.

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 14, 2016, 07:27:45 PM
Hello pdes your SNRM is showing as 4.4dB on the downstream and 6.4 dB on the upstream on MDWS, what does the DSLstats program (up-loader) to MDWS show on your PC ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 14, 2016, 08:55:11 PM
I have an eye problem at the moment that makes it difficult to see and type but...

There is something very, very wrong with your clock...

At 20:38 the upload data was showing as 01-01-2012 06:13 and that is so far out (nearly five years) I'm surprised it's even plotting! I have no idea when thus started but suggest once sorted it might start to make sense. You can see there's something wrong if you look at the times shown on the graphs...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on October 14, 2016, 09:20:51 PM
Many thanks. I recall I had something like this before and I changed the CMOS battery. Looks like it has gone again  :(  Looks like it is all ok now.

Thanks again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on October 18, 2016, 12:13:06 AM
That reminds me to turn off DSLstats on the RPI on Sunday 30 October 2016, 02:00:00 clocks are turned backward 1 hour and turn DSLstats on again  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: LaurieR on October 24, 2016, 05:21:48 PM
Could you please add the Billion 8900AX-1600 to the "your upload modem" list. Or maybe drop the "2400" from the 8900AX-2400 as they are very similar and only one other user seems to have either at the moment.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: displaced on October 25, 2016, 11:51:00 AM
Hi Tony!

I've got a quick question regarding support for uploading data to MyDSLWebStats from DSLstats running on FreeBSD.

I've managed to get DSLstats running in FreeBSD's Linux ABI-compatibility mode.  I'm hoping to get a 'portfile' submitted to the FreeBSD maintainers so any user may install DSLstats via a simple pkg install dslstats command.

I understand that DSLstats talks to MDWS via the closed-source upload15.xxx binary (where .xxx is the platform/bitness identifier).  Now, in my testing, I've got the 32-bit Linux upload15 binary running in FreeBSD.  The only changes were to 'tag' it as a Linux binary (via BSD's tagelf command, and renaming it to upload15.b32.

If I were to succeed in building a portfile for DSLstats, would you be willing to also allow me to submit a portfile for the uploader?  This would then allow BSD users of dslstats to install the uploader module via, perhaps, pkg install dslstat-mydslwebstats

I'd keep the dslstats and dslstats-mydslwebstats packages separate as they are licensed differently -- GPLv2 for the former, and whatever you'd like for the latter.  BSD being BSD, there's no issue at all with you wishing to keep the uploader closed-source.  However, I would not submit the port for distribution without your permission, nor would I take credit as the author!  I would be shown as the port maintainer and would be responsible for updating the port with any upstream updates from yourself or DSLstats.

Let me know what you think!

(apologies for contacting via the forum if inappropriate -- I couldn't find a contact email address!)

Cheers,
Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 25, 2016, 01:12:14 PM
This is down to me, Chris, and I'm quite happy for you proceed as you suggest. I haven't really thought about a licence for the upload program, and I have no wish to wrap it up in lots of legalese. So I'll just say that it's closed source and the binary is free to copy for use with DSLstats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: displaced on October 25, 2016, 02:01:42 PM
Ah, thanks Tony -- I'd got the wrong end of the stick and imagined that the MyDSLWebStats author had supplied the binary :)

I'll plough on and see how far I get!

Chris
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on October 25, 2016, 03:20:07 PM
That was Eric
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: displaced on October 25, 2016, 05:22:49 PM
*facepalm*

I'll get me coat...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2016, 08:27:30 AM
Hi Tony!
I've got a quick question regarding support for uploading data to MyDSLWebStats from DSLstats running on FreeBSD.
I believe Eric has answered your question and I'm okay with that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2016, 08:28:17 AM
Could you please add the Billion 8900AX-1600 to the "your upload modem" list. Or maybe drop the "2400" from the 8900AX-2400 as they are very similar and only one other user seems to have either at the moment.
I've added it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on October 30, 2016, 01:53:05 AM
MDWS is reporting that my connection is down when it clearly isn't, not sure why, scrub that it's working now again,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on October 30, 2016, 03:52:57 AM
clock change. It actually deals with it very well, filling in snrm graph so it doesn't look empty/offline. The DLM traffic lights show me at 95%, but 1 day a year I can live with that.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on October 30, 2016, 07:05:35 AM
I'm afraid DSLstats doesn't deal well with the clock changes, so if you use that you probably need to shut it down and restart it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Starman on October 30, 2016, 02:03:20 PM
Think MDWS hasn't handled the clock change correctly - initially I thought it was DSLStats has per roseway but having relaunched, and restarted my Pi I am now being reported as offline although I can see that stats are being uploaded correctly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on October 30, 2016, 03:53:54 PM
That's also the fault of your Pi. You've uploaded to say 2pm, restarted the Pi, which fixed it's clock to show as 1pm. You're now going to be uploading 13.01 again, and MDWS is wondering where 14:01 went, as that was supposed to be your next upload.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on October 30, 2016, 04:02:03 PM
The clock on my Pi will change at 2am, exactly the same as when the clock on my computer will.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 30, 2016, 04:05:21 PM
@j0hn
Almost..... Putting the clock back generated an hours worth of duplicate uploads and the graphs started again an hour later so it no longer shows as down...

DUPLICATE UPLOAD NOTIFICATIONS
Notification of Duplicates mail is turned off at the moment. It will be turned on again tomorrow (Monday 31st) morning at 12:00 so anyone (mostly Pi users using DSLstats where the time rarely changes when it should and around 30 are like that last time I looked) who has not put their clock right by then will get 60 Duplicate upload mails when they do.
You will also show as offline on MDWS during this time..  You need to close down and restart DSLstats (if you are using it) to get the time correct.

There is a note in the sent email about it. If you do not want the mails then turn off uploading until an hour has passed.

Also note that these users will show as being overseas on MDWS due to being in the wrong Time Zone and various bits of data will no longer display such as the Traffic Lights where available...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on October 30, 2016, 04:18:38 PM
The clock on my Pi will change at 2am, exactly the same as when the clock on my computer will.

The clock on my Pi changed but DSLstats didn't. Had to stop and restart it as advised by Eric.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on October 31, 2016, 08:08:00 AM
 I notice that my traffic lights have gone and a "*"  - outside UK,  now appears by my name. I am definitely in the UK!! I did play with the Opera vpn option a while ago but not on the Raspberry pi uploading and it is not enabled now.  I am fairly sure my IP shows as in the UK so I am a bit puzzled.  Maybe some glitch has occurred.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 31, 2016, 08:20:38 AM
Look two posts back from yours  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: les-70 on October 31, 2016, 09:06:22 AM
  Oops! Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: colintd on November 03, 2016, 08:54:05 AM
Wondering if anyone can offer some advice (and hoping this is the right place to ask)?

I've got 5 graphs setup in MyDSLWebStats, and they come up first time in Chrome and Edge.  For some reason, however, when I use the latest version of IE11, the first time I load the page all 5 graphs are set to what I have selected for the last graph.  Hitting refresh clears the problem in that window, but if I open the page again in a second tab back to the wrong graphs until I hit refresh. 

I initially thought it was something to do with cached webpages, but setting to "Update every time I visit a website" makes no difference.  I wonder whether there is some kind of race condition on initial loads?

Thoughts?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 03, 2016, 09:53:28 AM
Just on my way out but sounds like a Cookie problem and they are not being retained (they should be set to Never Expire for everything to work correctly). Please check that and come back if correctly set.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: colintd on November 03, 2016, 10:20:26 AM
I've checked and cookies are enabled.  Is there a particular cookie I should be checking for?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 03, 2016, 02:22:52 PM
Pages aren't loading fully today worked fine last night , the data in the graphs aren't loading they just say waiting and count down if set to refresh but they still dont load

Found out it was down to Level3's flakey DNS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: colintd on November 03, 2016, 05:02:19 PM
I managed to track this down to the favourite link on my favourite bar.  Copying the URL from the item into the address bar gave the right page first time, pressing the icon on the favourite bar gave the wrong graphs.  Checking the page source, identical in both cases.

I then generated a new favourite item from the working page, and amazingly this one worked, whilst the original still didn't, despite all the fields in the favourite (including permissions, icon, etc) seemingly being identical.

Life being short, I have deleted the non-working favourite, renames the new one, and all now appears fine.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on November 06, 2016, 07:41:07 PM
Team,

The PC i have been using for mydslstats and as a media centre  has given up the ghost. I am now planning to replace the PC with the Xbox one. Given the close relationship between Windows PCs and the Xbox, I was wondering whether anyone had run dslstats on the Xbox one or if there were any plans to enable this especially as Microsoft are supposedly merging their platforms.

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on November 06, 2016, 10:54:34 PM
Not a chance, I'm afraid. The development system which I use for DSLstats (Lazarus) doesn't have the capability to build XBox compatible programs.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on November 06, 2016, 11:00:19 PM
Thanks, just thought I would ask ;D

Maybe when MS have developed the Xbox platform further, there may be the capability to simply load any Windows app.

Guess i'll just have to keep my laptop running.

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on November 06, 2016, 11:07:49 PM
Guess i'll just have to keep my laptop running.

Or just purchase a Raspberry Pi.  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 21, 2016, 08:45:54 AM
Just had an upload fail alert after 1 minute, email said no uploads since 08:34 today and was received at 08:35, my settings are for a notice after 15 minutes. Strange?

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kevinduke on November 21, 2016, 09:19:18 AM
Just had an upload fail alert after 1 minute, email said no uploads since 08:34 today and was received at 08:35, my settings are for a notice after 15 minutes. Strange?

Stuart

Same for me to
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 21, 2016, 09:54:28 AM
The notifications have not been working properly for some days due to a code error so sorted that and then did a reset which caused those and about 130 others mails  ::)

I've also stopped sending notifications after 14 days of failed uploads have occurred.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on November 21, 2016, 10:20:40 AM
Thanks ....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on November 21, 2016, 10:22:33 AM
Or just purchase a Raspberry Pi.  :)

Ah, I have an old Pi kicking about.  Good idea!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on November 21, 2016, 10:23:15 AM
Thanks Tony for the update, I had the same notifications this morning and wasn't sure what happened :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on November 21, 2016, 03:17:22 PM
Thanks, just thought I would ask ;D

Maybe when MS have developed the Xbox platform further, there may be the capability to simply load any Windows app.

Guess i'll just have to keep my laptop running.

Cheers

not win32 apps which is what dsl stats is.

The universal app platform is for modern apps.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on November 21, 2016, 10:21:55 PM
Just having the weirdest problem with MDWS. My status bar is all showing ok, but my graphs are giving an 'Access permission denied' message. If I change to view another user's graph all is fine. If I change the 'Data to show' option on my graphs they display ok except when reverting to the original option displayed. I.e I can display any parameter except the one that was being displayed when the problem occured. At some point during the evening, I changed the default user agent for Firefox to IE10 and then back again I'm wondering if that caused the problem. Re-starting Firefox restores normal operation. Just thought I'd post out of interest and for information.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: keyap on December 02, 2016, 10:56:33 PM
Is there any way to change the ISP shown when logged in to the MyDSLWebStats webpage? Don't know if it matters, but mine is wrong.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 03, 2016, 08:19:52 AM
This is picked up automatically from a reverse lookup on the IP you are uploading from - in your case this is currently:
Code: [Select]
netname:        VODAFONE-FIXED-IP
descr:          Fixed IP (Static)
descr:          Vodafone Wholesale Broadband
descr:          sqyn02-bng-01 London

There are some other entries
Code: [Select]
role:           Cable and Wireless Access Ltd
or
descr:          Bulldog Communications

so I guess one of those two is your actual ISP? I can manually change it if you want?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 03, 2016, 10:05:38 AM
I think all of those are Vodafone seeing as Vodafone bought Cable and Wireless who bought Bulldog :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on December 03, 2016, 10:29:00 AM
I have the same problem with 'rate my ISP' for Origin who use Vodafone as just one of their wholesalers.   

I attempt rdns and also direct from RIPE netnames or ASN.  Despite trying, there was nothing to uniquely identify Origin, the IPs are auto dished out by Vodafone from their pool. 
About the only clue is in the description "Vodafone Wholesale Broadband" when you do a manual lookup, but unfortunately I dont get all of the descr fields returned when doing automated lookups direct from the RIPE database.

The C&W and Bulldog is just a historic thing in the RIPE db which has never been changed - Vodafone bought out the Bulldog/CW core network.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: keyap on December 03, 2016, 10:37:17 AM
Thanks all.

@tbailey2 - I'm with Origin so it would be good if you could change it to that?

Just a thought though - I apparently have a dynamic ISP, albeit I've never seen it change and some searches I've done on the IP show as static / a fixed IP?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 03, 2016, 04:18:33 PM
Done but if you are on a dynamic IP rather than fixed as the record suggests, it will change back to Vodafone if the IP address changes...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: keyap on December 03, 2016, 04:54:46 PM
Shows as Origin.

Thank you  ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on December 13, 2016, 08:12:11 PM
I seem to have a problem when viewing my own historic Bits/Tone graphs, in the drop down list I have graph for every hour of the day from 10 December, yet when I select any of them I get an error "Not available! No data is available for this user and this request! Please select another option..."

Selecting my works user name Ronskiwork the historic graphs work, the hourly graphs also start on the 10 December, previous to that there is one graph for each day at midnight, all graph dates work.

Should there be hourly graphs and any chance of fixing my home account graphs please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 13, 2016, 10:06:23 PM
Bit  ??? of an oddity that but should be okay now... There are 3 days of hourly graphs then drops back to daily graphs for up to a year or so
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on December 14, 2016, 10:16:11 AM
Thanks Tony, can view the graphs now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on December 24, 2016, 10:10:40 AM
Is everything OK at the server end?  I have two devices that say the site is not available.  Seemed OK a couple of days ago.

Cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 24, 2016, 10:51:15 AM
You stopped uploading :

Down since 22 Dec 11:34

Can you PM your IP address please and I'll see if that is the problem.

All looks okay here otherwise.

Edit:
Thanks. That IP was allocated to China at one time. Unblocked and you are uploading again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on December 24, 2016, 02:47:24 PM
Many thanks Tony. 😁
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on December 29, 2016, 09:07:40 PM
Is it feasible to add some kind of indication of if line has synced at 3,4 or 5db instead of 6db?  It would be great to be able to monitor the rollout of this with Ginp again?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 30, 2016, 03:58:08 PM
Is MDWS down as I'm unable to reach it
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on December 30, 2016, 04:05:04 PM
It did appear to be, since 15:32, but back up now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on December 30, 2016, 04:06:06 PM
Is there a problem with MDWS took ages to reach website and it says i have been down since 15:30 but no failed upload email as yet anyhow
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on December 30, 2016, 04:07:15 PM
Cheers Ronski
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 30, 2016, 04:11:08 PM
Yeah now back online, but missing some 30mins of upload data
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 31, 2016, 09:19:58 AM
Yes, I needed to change some power cabling so just did it before going out. Server didn't restart properly though so took a while to regenerate the database tables from the logs. All seems okay now.

Happy New Year to everyone  :drunk:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 31, 2016, 09:24:49 AM
Is it feasible to add some kind of indication of if line has synced at 3,4 or 5db instead of 6db?  It would be great to be able to monitor the rollout of this with Ginp again?
Looking at the SNRM graph would seem to be the best way as there's no other data I'm aware of that would tell you  :-\

I've added the current upstream and downstream SNRM figures to the Resync mails that go out after a resync if that helps so don't need to look in MDWS.

Code: [Select]
Current Downstream Sync Rate is now 32806kbps @ 6.0db SNRM
Current Upstream Sync Rate is now 8961kbps @ 6.2db SNRM
as measured at the time of this email.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on December 31, 2016, 10:34:43 AM
Good idea
Thanks :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on December 31, 2016, 10:53:37 AM


Looking at the SNRM graph would seem to be the best way as there's no other data I'm aware of that would tell you  :-\

I've added the current upstream and downstream SNRM figures to the Resync mails that go out after a resync if that helps so don't need to look in MDWS.

Code: [Select]
Current Downstream Sync Rate is now 32806kbps @ 6.0db SNRM
Current Upstream Sync Rate is now 8961kbps @ 6.2db SNRM

Thanks the email change is useful. 

I was thinking a bit more when a user syncs up you look at the db value this should be around 6+db at the moment.  If anyone syncs at 5.25db (or whatever best) or less an appropriate cell is coloured like with Ginp on/off.  Can then use the all stats page to see how well rollout is going?

The current db is not what is needed it is db at last sync?  Perhaps this as new column on all user stats page, coloured for 3, 4, 5db?

I would use it and think it would be useful for other users anyone else agree?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 31, 2016, 10:58:33 AM
The reported dB in the mail is the value at Resync when the line comes back up and uploads data, not before it Resynced - can't see any value in that.

I really don't have the time currently to undertake what you are suggesting and seems like a lot of effort for little return.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on December 31, 2016, 11:31:45 AM
I rather agree with Tony's last comment. The information is available by consulting the monitoring program directly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on December 31, 2016, 01:08:44 PM
I rather agree with Tony's last comment. The information is available by consulting the monitoring program directly.
Never mind I mustn't be explaining very well.  For example, if it is in the monitoring program how can I view your value surely it needs publishing on the MDWS site - is it already there and I am just not seeing the obvious?

I just thought it would be a nice indication of the expected (hoped) rollout of 3db targets.  If time does not permit enhancements that is understandable however.

I really valued the all user stats when gimp was rolled out and back in again so having this data was of great use to understand what btor was doing and gave hope especially to eci cab users.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on December 31, 2016, 01:40:23 PM
Happy new Year Tony and thanks for all the great facilities in 2016

Tony :P :P :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on December 31, 2016, 01:55:09 PM
Quote

I would use it and think it would be useful for other users anyone else agree?

No, sorry, can't see any point to it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on December 31, 2016, 03:00:59 PM
Never mind I mustn't be explaining very well.  For example, if it is in the monitoring program how can I view your value surely it needs publishing on the MDWS site - is it already there and I am just not seeing the obvious?

I just thought it would be a nice indication of the expected (hoped) rollout of 3db targets.  If time does not permit enhancements that is understandable however.

I didn't explain very well either. By looking at the SNRM values which are collected by the monitoring programs you can see what the SNRM was shortly after a resync, which is as near to the target SNRM as you're going to get. If the modem is already in sync before you start the monitoring program running, then the information isn't available. If you're uploading continuously to MDWS, then the same information is available there, by inspection of the graphs.

I'll add just one caveat to this: some modem/routers report the initial SNRM value in their logs, and this should be very close to the target value. You might be lucky there.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on December 31, 2016, 06:20:07 PM
I think I understand what you're asking for, to be notified if DLM sets a 3dB snrm target. I don't know how it would even be possible to tell the difference between a line with a 3dB target and a line that simply resynced with a lower snrm. This happens all the time, particularly after power cuts or a DSLAM reboot.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ejs on December 31, 2016, 06:56:16 PM
Do you mean instances when the current SNRM has already fallen by the time the first stats are collected?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on December 31, 2016, 07:36:43 PM
the stats program by BE I think simply collects once per minute, regardless of when a sync took place, since it runs remote to the modem it cannot know to do a stat run right at the sync event.  I think using the first stat after sync would not be reliable enough to see if its a changed snrm target as we have seen multiple times in the past the temporary conditions that can make a target snrm appear to have changed can be extremely short lived.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: amstel on January 10, 2017, 06:07:12 PM
Hello guys

I am very pleased with MDWS, a great work.
I have a small issue which only affect I think ADSL users and SNRM data.
If I choose 10 days for SNRM then everything is fine and I can zoom to even 1h.
But if choose any period less than 10 days it shows a blank diagram.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 10, 2017, 08:51:40 PM
Hi

Your SNRM graph display seems okay at the moment. The lack of any SNRM plots is probably due to the erratic data uploading that started earlier before you reported it. I've only seen this lack of any plots once before but never found the reason unfortunately.

I doubt it's due to it being an ADSL line, the SNRM plot is the only one that has the original data modified while plotting to show any discontinuities in the graph but it's dependent on there being sufficient current uploads to work properly which may not have been the case when you looked at it.

I'll leave it to others to pronounce on why it appears as it does but looks like a bad/intermittent connection somewhere maybe?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on January 10, 2017, 10:36:45 PM
I have recently changed my PC used to upload my stats and for a couple of uploads the PC date was set to October 2017  :cool: Yes I have a time machine  ;) However it has messed up my stats display so can you please remove the offending uploads for me please? It is uploading OK now and I can see my current stats but only by selecting the past 360 days!

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 11, 2017, 08:35:12 AM
Fixed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on January 11, 2017, 10:03:03 AM
Thanks Tony...

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lloyd on January 17, 2017, 01:22:51 PM
I wonder if I have found an issue where the traffic lights on the graph pages don't agree with the popup?  Or am I missing something?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 18, 2017, 08:37:25 AM
You are missing something...

The lights on the graph are for 'Past 24 Hours' as it says. You have the pop-up set to 'Today Cumulative'.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lloyd on January 18, 2017, 01:15:32 PM
You are missing something...

The lights on the graph are for 'Past 24 Hours' as it says. You have the pop-up set to 'Today Cumulative'.
Of course.  I should never had doubted it.   I'm ashamed to admit that I had not spotted the selector on the pop-up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on January 20, 2017, 08:57:26 PM
Just had an email advising my g3uist had started uploading again after a failure. However I can't find any confirmation that it stopped at My end.

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 20, 2017, 09:19:33 PM
Well there is definitely a hole in the uploads for the period in the resume mail...

Or do you mean you didn't receive the not uploading mail? That would be normal if the link was down for around 10-11 minutes as it doesn't send the down mail until around 11minutes (there is a second check at 10 mins after the initial 5 minutes has passed) after it occurs so often you'll only see the resume mail as that takes priority and cancels the outstanding loss mail.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on January 20, 2017, 09:32:08 PM
Didn't get the upload fail mail. Nothing to show here or on Tbb ping graph that line was down.

Going to be a mystery I suspect

Best Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 20, 2017, 09:37:55 PM
oops line should have read link...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on January 20, 2017, 10:14:26 PM
 :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on February 03, 2017, 10:01:46 AM
What info does MDWS use to work out cabinet type? and how often does it gather this data?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 03, 2017, 10:47:58 AM
The information is read from the modem by the monitoring program (DSLstats or HG612_Stats) and uploaded to MDWS every minute as part of the regular stats upload. The cabinet type is inferred from the DSLAM manufacturer, which is what the modem actually reports.

Sorry, not true :-[
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on February 03, 2017, 11:11:24 AM
I had something in the back of my brain telling me MDWS worked out the cabinet type by the tones used. No idea where I got that from.

I was previously on an ECI cabinet but now on a Huawei. MDWS still reports my line as being on an ECI cabinet. Will this update itself? I'm guessing it's not a common occurrence, and wondered if it might need manual intervention from Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 03, 2017, 11:45:04 AM
I apologise for a dose of brain fade on my part. DSLstats obtains the DSLAM type as described above, but I don't know how MDWS gets it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on February 03, 2017, 12:14:44 PM
To be honest I thought it was the opposite lol. I thought DslStats simply requested the vendor id from the DSLAM but didn't report that to MDWS, and MDWS did the guessing from tones. Are you sure that's not the case? I don't want to tell the Author of a fantastic app how his own app works but DslStats also reports DSLAM firmware. Doesn't it just send xdslcmd info --vendor
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 03, 2017, 12:28:15 PM
Yes, that's what I said (or meant) - DSLstats gets the information from the modem, using the --vendor command. I don't know how MDWS gets it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on February 03, 2017, 12:41:31 PM
apologies, I assumed by above comment you meant mine, not your own :doh:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on February 03, 2017, 01:05:09 PM
:)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 03, 2017, 01:12:23 PM
MDWS works it out from various tones being present or not present.

I need to know your MDWS user name please and I'll change it later as it's static once set.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on February 03, 2017, 01:19:57 PM
MDWS works it out from various tones being present or not present.

I need to know your MDWS user name please and I'll change it later as it's static once set.
Cheers Tony.
Username is Minted
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 03, 2017, 02:24:08 PM
Okay, done.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on February 04, 2017, 11:40:40 AM
I'm guessing the overheads would be way too high for the cabinet type to be checked on each upload, but couldn't you do it when you see the modem has resynced? Or perhaps once a day/week?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 04, 2017, 03:15:42 PM
Originally it was checked on every resync but for various reasons the result was often wrong and the entry had to corrected, sometimes more than once. So that was abandoned about 18 months ago. AFAICR the current change is the only actual one since then so setting up repeatedly checking it again seems a total waste of the limited spare time I currently have. It's easier and likely more accurate to just ask when necessary.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: pdes on February 26, 2017, 01:50:55 PM
Guys, 

How do I recover/change my memorable phrase in mydslwebstats?

Thanks

David
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on February 26, 2017, 04:33:27 PM
How do I recover/change my memorable phrase in mydslwebstats?

It was, clearly, not that memorable!  :D

Only Tony will be able to assist you. So please wait for him to make contact.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 26, 2017, 04:56:29 PM
Thanks. I did PM him but probably hasn't spotted it yet. A user can get at the phrase by either consulting their original Registration email (which I assume people keep) or by Resetting their password.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 15, 2017, 07:41:53 AM
I had an upload fail message received at 01:22 this morning but no upload OK message although it seems that I have been uploading since then OK. Was there are issue with the server after midnight?

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 15, 2017, 09:10:27 AM
Um. Seems the resume mails failed for everyone last night. And while looking at it (but not doing anything) the server promptly crashed.

So MDWS is down at the moment and may take up to 30 mins to get back online as the database has crashed and will need recovering.... It was overdue for a total restart so see what happens  :fingers:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 15, 2017, 09:19:50 AM
Tony thanks for the update. Strange issue was that as far as I can tell my system did not have any issues last night after midnight, no obvious problems with DSLStats and no error messages from it either saying it cold not report.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 15, 2017, 09:54:15 AM
MDWS was back up again at around 09:38.

There are though some 70+ users who have not automatically resumed uploading. If enabled you should receive warnings, they are certainly being sent out.

Edit 10:02
Server now frozen will have to restart and investigate but have to go out to appointment soon...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 15, 2017, 10:05:27 AM
Tony 10:04 and the website is not playing ball, unable to get in. Tried several times but still hanging.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on March 15, 2017, 12:23:22 PM
Tony

All fine with me here

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 15, 2017, 04:51:27 PM
Yes it is OK now. However I cannot account for why it stopped uploading as DSLStats did not raise any alerts and I can see all the stats in DSLStats for the time frame that data was missing. I wold have expected an alert from DSLStats providing that it only flags a good upload after acknowledgement from the server,

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 15, 2017, 08:14:59 PM
You're right, Stuart. DSLstats doesn't report a failure to upload, because at present the command which performs the upload doesn't return when it fails, so the program hangs. It's my fault, and I'm working on it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 15, 2017, 08:26:36 PM
You're right, Stuart. DSLstats doesn't report a failure to upload, because at present the command which performs the upload doesn't return when it fails, so the program hangs. It's my fault, and I'm working on it.

Thanks Eric, that means either the server was in trouble or there was a network issue which stopped the upload.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 16, 2017, 08:10:09 AM
Quote
Thanks Eric, that means either the server was in trouble or there was a network issue which stopped the upload.

Looking at the logs, there are no signs of problems with uploads to the server anywhere near or over the period in question. No one else shows missing uploads at this time. There are no errors recorded against your name for uploads which there would be if the files were refused for any reason and this would have returned an error code to DSLstats. I was unaware of a problem when the upload fails at the client end as the return error system (assuming an error is returned for whatever reason) was tested extensively during development.

If you cannot find anything to explain it at your end (I assume you checked the local event log?) then it will have to remain a mystery.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 16, 2017, 09:12:56 AM
There was definitely nothing at my end to explain this so no errors in DSLStats and nothing failing on my PC either, the only thing I can assume is that there was a network issue of some sort which prevented me uploading. I'm hoping that Eric can improve the upload checking to make sure it reports any failures and that at least will help as it may identify problems in the future.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on March 25, 2017, 08:49:06 PM
This may have been covered before but I see the thread is 107 pages. Could someone explain the function and purpose of the LED panel (DLM simulator) on the left hand side of the graphs.

cheers
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on March 25, 2017, 08:51:48 PM
This may have been covered before but I see the thread is 107 pages. Could someone explain the function and purpose of the LED panel (DLM simulator) on the left hand side of the graphs.

cheers

Hope this helps...
http://forum.kitz.co.uk/index.php/topic,15623.msg290968/topicseen.html#msg290968
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on March 25, 2017, 09:07:57 PM
Yes somewhat, Im on Xilo (Uno) and have an amber and two red on the Downstream. I just re-synced at 1pm replacing a cable and have tweaked my margin to 2.7db, what does amber and two red mean?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on March 25, 2017, 10:42:35 PM
Oh no it's that time of year when we must make sure are stats gathering equipment clock goes forward 1 hour at 01:00 on the 26/3/2017 = 02:00
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 26, 2017, 07:38:10 AM
Yes, DSLstats doesn't automatically change its time when the clocks change, so you need to restart it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 26, 2017, 08:20:08 AM
Is that why I got upload failed messages last night although the upload OK happened at 07:18 and that was before I restarted DSLStats, or is this the same thing which happened to me a while ago? DSLStats shows no errors for the time period between 0300 and 0720 which was when the OK message arrived.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 26, 2017, 09:16:13 AM
Both my connections got upload fail messages as well from 3:03 with the upload ok messages coming in at 7:15

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 26, 2017, 09:55:14 AM
I don't think these events would be caused by either of the upload programs. As you two live in the same area, perhaps there was a local networking problem?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 26, 2017, 10:03:04 AM
My works line is in Sandwich  and neither of my TBB ping monitors are showing any downtime.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on March 26, 2017, 10:33:34 AM
Looking at the MDWS graphs, nobody seems to have any gaps in the graphs during the period when you were getting the failed upload messages, and in the case of HG612_Stats the time stamps would presumably have been correct because of the way it works (launching a new instance every minute). Maybe Tony has got some gems of wisdom.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 26, 2017, 10:39:56 AM
This is strange now knowing Ronski has similar issue. I think we have different ISPs and since Sandwich is a different exchange for it to be a network issue it would be expected that it was a larger issue and seen by more folks. If it were down to timestamps it should not have corrected itself until I restarted DSLStats but for me it did as I did not restart DSLStats until after I saw all the MDWS messages until about 0745ish.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 26, 2017, 10:51:47 AM
I'm on Plusnet both at home and at work, where Stuart is on TalkTalk, also my TBB ping monitors show no down time.

(http://www.thinkbroadband.com/ping/share-thumb/321c8fee07e1bdcf54862d35c72d0cdf-26-03-2017.png) (http://www.thinkbroadband.com/ping/share/321c8fee07e1bdcf54862d35c72d0cdf-26-03-2017.html)

(http://www.thinkbroadband.com/ping/share-thumb/9ef0bc7aca2830831ea483aad4e3fd8c-26-03-2017.png) (http://www.thinkbroadband.com/ping/share/9ef0bc7aca2830831ea483aad4e3fd8c-26-03-2017.html)

I had failed upload alerts for both lines at 3:04, 4:05, 5:06 and then upload OK emails at 07:16. Note that there wasn't one at six o'clock and the minutes of each one increased by one, both alerts are set to notify after 10 minutes, and then every 60 minutes.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 26, 2017, 10:59:22 AM
My first one was at 3:03 then at 3:34, 4:04, 4:35, 5:05, 5:36 and OK at 7:15 (my timing is set to 30 mins for initial notify and repeat every 30 mins). So again nothing during the 06 hour. This is very strange for two people on different ISPs and two exchanges.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on March 26, 2017, 12:02:35 PM
I had the same a fail upload at 3.03 and a ok at 07.15. I am definitely on a different exchange and a different part of the country to Broadstairs and Ronski.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on March 26, 2017, 12:22:01 PM
Sorry but this was actually a server problem.

There is a calendar in MDWS that controls internal transitions between GMT/BST and I had forgotten to update it for this transition and so the server wasn't (simply put) running correctly when looking at user upload times.

Normally failure and okay messages are suppressed for some hours overnight for various reasons (inc due to user clocks not auto adjusting) on clock changes but this didn't happen and several hundred unwanted failure messages went out . The problem was corrected at about 05:55 as luckily I was up and about and spotted it before I watched the F1 GP. The upload resume messages were then sent out when they were automatically enabled again at 07:15.

As usual, there are loads of people (around 80) that need to update their clocks.

Note that the Resume Upload message has never reported the time that uploads resume when you receive them, just that they have done so as the message could be delayed for many hours for various reasons. 

Various people seem to get hung up over this and also mail me direct, I am considering turning off this monitoring feature completely as I likely can't tell you why any particular upload failed, plus there are some bugs in there still. Users will just have to do a bit more monitoring themselves and for some, maybe stop obsessing over their stats when there is little or nothing service affecting. The idea of the project was to help people and make it easier for others to assist them but I'm not sure this is working as intended any more.

Currently, for personal reasons, I have no plans to maker any further updates or fixes to MDWS as I just don't have the time or energy and I'm not too well either. Also trying to look after my other half who is recovering from surgery.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 26, 2017, 01:38:14 PM
No need to apologise, it didn't bother me in the slightest, and i only mentioned it as Broadstairs had in case it helped shed some light on the issue.

Hope both yourself and your wife recover quickly.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on March 26, 2017, 06:37:07 PM
I did wonder if the server might have been the issue, BUT I have also had this when it was not clock change time. My PC which runs DSLStats does indeed reset its clock at 0100hrs but according to Eric DSLStats does not change its time until restarted and I'm never up at that time nowadays....

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BigJ on March 27, 2017, 06:00:40 PM
I'm running DSLStats on a Linux VM which is set to UTC and had no idea how to change the time zone from the CLI. In case it helps someone, here's what some googling turned up. Warning: Don't change the timezone on a server machine without considering the impact.

If you're on a distro that uses the systemd "init" system eg. Debian, Ubuntu or Fedora

Check your current setting
Code: [Select]
$ timedatectl               
      Local time: Mon 2017-03-27 16:11:51 UTC
  Universal time: Mon 2017-03-27 16:11:51 UTC
        RTC time: n/a
       Time zone: Etc/UTC (UTC, +0000)
 Network time on: yes
NTP synchronized: yes
 RTC in local TZ: no

View available options
Code: [Select]
$ timedatectl list-timezones
Africa/Abidjan
Africa/Accra
Africa/Addis_Ababa
Africa/Algiers
Africa/Asmara
...

Daylight saving should be automatically accounted for if a city is selected
Code: [Select]
$ sudo timedatectl set-timezone Europe/London
Also, take a break for a while tbailey2 and look after your familiar and self. We'll still be here when you're better :)

EDIT: tidy up
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on March 28, 2017, 01:25:02 AM
MDWS says my name and +1 and the DLM traffic lights have disappeared. User name banger. any ideas?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on March 28, 2017, 06:06:31 AM
I think it might be something to do with the time, so check the time is correct your stats collection computer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: BigJ on March 28, 2017, 10:46:20 AM
I had the same banger. Adjusting the clock on the computer to British Summer Time and restarting DSLStats sorted it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on March 28, 2017, 04:00:47 PM
Cheers. It was because I had rebooted into another OS and DS had stuck an hour on the clock, all sorted now. :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on March 29, 2017, 07:45:10 PM
Anyone know what the acceptable level of ES/hour is? BT Wholesale say my line has an unacceptable level of errors and want to send an SFI Engineer.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on March 29, 2017, 07:47:24 PM
If you on the most leniant profile then averaged out its 120 ES per hour.
The middle profile is 60 per hour and the most stable profile is 30 per hour.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on March 29, 2017, 08:05:45 PM
Quote
acceptable level of ES/hour is

Your interleaving has sorted out your error seconds; but let openreach attend and see what problems they can find/sort out.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on March 29, 2017, 08:21:57 PM
If you on the most leniant profile then averaged out its 120 ES per hour.
The middle profile is 60 per hour and the most stable profile is 30 per hour.

I was getting 1200/hour last night but as Ian said interleaving has kicked in.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: GigabitEthernet on April 06, 2017, 04:34:14 PM
Bit of a long shot this but is there any way Tony might still have a copy of my Hlog from December 2016? I realise it's been over three months since I last uploaded so I will completely understand if it has been deleted by now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on April 06, 2017, 05:03:58 PM


Bit of a long shot this but is there any way Tony might still have a copy of my Hlog from December 2016? I realise it's been over three months since I last uploaded so I will completely understand if it has been deleted by now.

If the data is there this should display it?
Data to show - hlog
Date options - historic
Date to view - easily goes back a year
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on April 06, 2017, 07:46:13 PM
I'm suddenly getting minute by minute alerts for duplicate file uploads. I'm using hg612 stats. Are they real? Nothing has changed at my end!

Sent from my SM-G935F using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 06, 2017, 09:06:10 PM
I'm suddenly getting minute by minute alerts for duplicate file uploads. I'm using hg612 stats. Are they real? Nothing has changed at my end!
Yes, they are very real else you wouldn't have been sent them...

After trawling through the database here I can tell you exactly what happened but not why.

You didn't upload anything between approx 25 March 18:00 through to approx 30th March 20:00. On the 25th your local clock was correct on GMT. When uploads resumed on the 30th, your local clock had jumped forwards 2 hours (rather than 1 hour after the clock change to BST on the 29th) but no idea why. It stayed like that until 17:49 this evening when it abruptly lost an hour (again no idea why) and was back on BST as it should be.

So that meant that for the next hour, you were uploading stats that you had already uploaded, hence the duplicate messages. They would have stopped at 18:49 had you not stopped uploading yourself at 18:47.... 

Please remember that MDWS is just recording the data you are uploading, it doesn't modify it in any way.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 06, 2017, 09:06:43 PM
Bit of a long shot this but is there any way Tony might still have a copy of my Hlog from December 2016? I realise it's been over three months since I last uploaded so I will completely understand if it has been deleted by now.
Nope gone is gone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 06, 2017, 09:07:37 PM

If the data is there this should display it?
Data to show - hlog
Date options - historic
Date to view - easily goes back a year

But only if there is at least one current set of data and there is none
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on April 06, 2017, 09:12:45 PM
Yes, they are very real else you wouldn't have been sent them...

After trawling through the database here I can tell you exactly what happened but not why.

You didn't upload anything between approx 25 March 18:00 through to approx 30th March 20:00. On the 25th your local clock was correct on GMT. When uploads resumed on the 30th, your local clock had jumped forwards 2 hours (rather than 1 hour after the clock change to BST on the 29th) but no idea why. It stayed like that until 17:49 this evening when it abruptly lost an hour (again no idea why) and was back on BST as it should be.

So that meant that for the next hour, you were uploading stats that you had already uploaded, hence the duplicate messages. They would have stopped at 18:49 had you not stopped uploading yourself at 18:47.... 

Please remember that MDWS is just recording the data you are uploading, it doesn't modify it in any way.
Typical - I would have stopped it earlier but I was still at work. Thanks for looking into it, I didn't want to bombard your server, but I couldn't see anything immediately wrong. I'll double check everything again at this end, and re-enable the uploads at some point.

Thanks again - really appreciate all your efforts!

Sent from my SM-G935F using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on April 23, 2017, 11:42:20 AM
Hi Tony

Hope all well there. Just had an email to say I was uploading again on my g3uist account. I cant see any gaps in the monitoring and no eveidence here the line was down. Are you aware, perhaps ?

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 26, 2017, 08:47:41 AM
The server lost the line for about three minutes and everyone's uploads failed....

Please note that the MDWS server is currently DOWN for some maintenance and security updates. I'll post again when it's back up.

EDIT
All running again as of 09:36
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 26, 2017, 10:15:59 AM
Thanks Tony. This gave me the opportunity to check how DSLstats now behaves when MDWS is down. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 28, 2017, 08:07:49 AM
MDWS PROBLEMS

Thanks for  the mails from various users since Wednesday that there is an ongoing problem with emailed resync and other alerts/responses. In fact there are a lot more problems than that happening with quite a few internal routines not working at all for no obvious reason and I've spent a lot of time yesterday and into the small hours trying to fathom out what is wrong with no answers. This all started after a large batch of Window Updates were applied  on the morning of the 26th mostly security fixes. There were no other changes.

I'm going to try various options at restring a working version but If that doesn't succeed then it's highly likely that will be the end of MDWS as a facility and it will not be resurrected. I'm already highly stressed out with other matters, and now this, and something has to go.

Apologies. I'll leave it running as is until I can see some hope of success or otherwise.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jaydub on April 28, 2017, 09:08:16 AM
Hope you get there, Tony.  It would be a real shame if MDSW was to disappear.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 28, 2017, 09:17:36 AM
Hope you get there, Tony.  It would be a real shame if MDSW was to disappear.

I agree. It would be a real shame to see MDSW lost - I hope you can fix it Tony. Keeping fingers crossed
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 28, 2017, 09:57:25 AM
Good luck Tony, and I'm sorry to hear about your problems.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on April 28, 2017, 10:29:28 AM
Hi

I do not bother you tony, just appreciate your work so take it easy and I'm sure it'll come right in the end

Good luck

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 28, 2017, 04:02:11 PM
best of luck tony, it would be a real shame if MDWS ceased to exist as its brilliant.  If you want an extra set of eyes to help debugging then perhaps some of us can volunteer.

My suggestion is to roll back the windows updates, then install one at a time to find which update broke things.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on April 28, 2017, 08:43:55 PM
Any support I can offer very pleased to do so

Tony
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on April 29, 2017, 12:07:23 PM
Hope you manage to fix it Tony but at the end of the day your own sanity is worth more than stats ever will be

Best of luck anyway 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on April 29, 2017, 01:49:10 PM
MDWS PROBLEMS

Thanks for the mails from various users since Wednesday that there is an ongoing problem with emailed resync and other alerts/responses. In fact there are a lot more problems than that happening with quite a few internal routines not working at all for no obvious reason and I've spent a lot of time yesterday and into the small hours trying to fathom out what is wrong with no answers. This all started after a large batch of Window Updates were applied on the morning of the 26th mostly security fixes. There were no other changes.

I'm going to try various options at restring a working version but If that doesn't succeed then it's highly likely that will be the end of MDWS as a facility and it will not be resurrected. I'm already highly stressed out with other matters, and now this, and something has to go.

Apologies. I'll leave it running as is until I can see some hope of success or otherwise.
Not had any erroneous alert emails myself & didn't know there were any issues with MDWS
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on April 29, 2017, 08:43:16 PM
Good luck Tony. Everyone appreciates your efforts!

Sent from my SM-G935F using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on April 30, 2017, 11:23:28 AM
MDWS UPDATE

Sorry not to reply but thought it better to concentrate on fixing things.... Thanks for all the comments and for bearing with me.

Good News  - I'm hoping it's now all running again as intended from around 30 mins ago  :cool:

Attempting to roll back the Window Updates (and some would not do so) despite using Safe Mode, resulted in a permanent startup reboot loop.. So decided on recovering a machine backup from a few days before the problems started, then updating to the 29th from various separate overnight data/code/sql dumps I have here to keep data loss to a minimum. I've made a few essential Window Updates with no bad effects but I will need to do more so restarts will be needed.

The main problem with the lack of alert mails seems to be with Windows Tasks - I won't go into it in detail but there are about 40 of them running in the backgroundand normally no problem. However sometime in the past month or so a number had stopped working or were erratic (but I hadn't made any changes via Task Scheduler). Task Scheduler itself says the are running with successful exit code (0x0) but the code within the php files isn't actually being run! If I take the php file and run it in a browser window it works okay.... Among them were three that handle the Upload Failure alerts, Resync Alerts and one that mails me other detected problems..... So for the moment they are being run separately in a browser.

I've also updated the Email client and this is now handled securely in both directions if supported at both ends.

Also reinstated Registrations which had been turned off.

User Too-Slow
You have a problem, apparently at your end but I don't know what it is causing it I'm afraid. I see this message occasionally from the Fast CGI process that handles the data uploads (one process allocated per upload) but in your case it's happening to a majority of your uploads today - maybe something timing out at your end?:

Code: [Select]
Partial results are valid but processing is incomplete: [client nn.nnn.nn.nnn:nnnnn] mod_fcgid: can't get data from http client

which results in no upload data.

Thanks  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on April 30, 2017, 11:32:58 AM
Nice One Tony

I have my stats working nicely again now  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on April 30, 2017, 11:44:23 AM
Well done Tony. I felt for you yesterday.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on April 30, 2017, 11:46:40 AM
Thanks Tony for your work! - it is appreciated.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on April 30, 2017, 02:36:21 PM
great tony :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on April 30, 2017, 07:53:29 PM
Good Work! Much appreciated by all.

Sent from my SM-G935F using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 02, 2017, 08:00:51 AM
MDWS DOWN AGAIN  ???

It never rains but ....

For the past 12 hours or so MDWS has been unable to process/save a large number of uploads ... During a newly scheduled system backup (of the newly rescued version) early this morning drive C: was reported as being corrupt and a bit later the system failed completely...

Currently repairing the disc and will take a backup afterwards if it starts up but it will be offline for some time as a result plus I have to go out for some hours.

UPDATE 08:40
System started up okay after repair and Webserver / Database both running okay. Down still while backup runs.

UPDATE 09:08
Up again so see what happens....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on May 02, 2017, 09:10:28 AM
Hi tony

Kudos to you

If it helps you, I can courier you an old rackmount poweredge 2500 so you could maybe separate the database or use as you decide

If you wish to take this up, please pm and I'll organise asap

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 02, 2017, 12:32:20 PM
TRY AGAIN

Thanks for the offer but I do have spare machines if needed. This is primarily a software problem though.

It seems that the corrupted/repaired disk managed to zero several database tables (12GB worth!) along the way which is what caused the abortive startup a few hours back. Then MySQL wouldn't start up at all as there were so many missing files.

I've managed to resurrect it all but I'd better not say it's working for a while yet  :-X

I can see a lot of duplicate upload errors for tenbyboy2 but not sure why currently.  No one else appears to have any at the moment. Yes, there are definitely two upload instances of DSLstats running 8 secs apart....

There may well be other missing data  - I know there is a big hole between 20th Apr and 29th Apr if you use the Range option and it's not recoverable.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 03, 2017, 10:12:08 AM
Just to say that as all appears to be running well, I've started a system backup so there is one - these are normally run earlier at around 06:00 and at this time may cause some upload disruption at times...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on May 03, 2017, 10:15:12 AM
Hi tony

Kudos to you and sorry, I think you may have said over servers a long time ago. It's an age thing sorry

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on May 03, 2017, 10:33:40 AM
It's all been running smoothly since yesterday, as seen from here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on May 03, 2017, 10:41:23 AM
Thanks Eric, looks good here as well  :fingers:

I aborted the backup as realised it's a full backup not incremental and need to have the system shut down. I'll do it this afternoon so MDWS will be out for about 30 mins or so. Then I need to transfer to a fresh disc in the next few days as the current one I used is a few years old...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on May 04, 2017, 09:34:05 PM
I woke up today and found MDWS saying my sync had dropped to 32 and I had loads of upstream errors. I then rubbed my eyes in disbelief only to realise I was looking at tbailey's graph and stats and not my own.

Last night I swapped from Cent browser to Chrome and must not have selected my own stats in the Chrome window after logging in. Phew, that will teach me to install a new browser in the early hours.  :lol:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 04, 2017, 05:57:02 PM
SERVER OUTAGE 16:16-16:45

The outage earlier was due to a need to disassemble the server/hoover it out etc to add an additional 16Gb of physical memory as with the increased number of users the database is starting to swap out and slow everything down. It did it crash on the first restart (frozen) but seems okay the second time so fingers crossed.

Actually increasing the memory allocation to use a proportion of that will take place tomorrow morning and takes about 20 mins max. May need to do this more than once.

Thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Browni on June 06, 2017, 03:38:10 PM
Hi Tony,

Can you add Asus DSL-AC88U to the upload modem list please?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 06, 2017, 05:40:23 PM
Done (I'm assuming it works of course). I don't believe it's approved by BT though unless anyone knows better.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Browni on June 06, 2017, 06:00:35 PM
Thanks Tony.

I'm using the same user name here as I use on MDWS so you can see it working!

Not being approved could be interesting as I bought it from a pretty well known UK supplier of PC hardware...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on June 07, 2017, 04:42:03 PM
I have now changed my Internet provider from plusnet to idnet , how do I get this to show on   my dsl Webstats as it's still showing plusnet ,username freelander

Cheers

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 07, 2017, 06:53:16 PM
It's automatically checked around 18:00 every day and I see it has now changed...

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: freelander on June 08, 2017, 06:29:46 AM
Thanks for reply , I also now see that it has changed  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 09, 2017, 05:14:24 PM
DSLStats is telling me my validation key is failing. IS it possible to re-send the key or have I missed something else? I'm using the one I was sent originally.

Stuart

Just tried the Linux version and it validated OK using the same key so it's something Ive done wrong on the Windows version where I normally run it. Just typed it manually rather than copy/paste the code and it works!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Jasonkruys on June 17, 2017, 01:08:54 PM
Tony, evidently I have forgotten my memorable word (oh the irony). I can see a link to reset password, will this do the memorable word as well? Otherwise, would you be able to pm it to me, or send it to the registered email? Much obliged, kind sir for your continued efforts!

Sent from my SM-G935F using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on June 17, 2017, 01:20:42 PM
Hi jasonkruys

If you run dslstats, have a look in the config file, it is stored in the file

If not, yes the forgot password would give option for memorable phrase

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on June 24, 2017, 11:53:04 AM
Quote
Internal Server Error

The server encountered an internal error or misconfiguration and was unable to complete your request.

Please contact the server administrator at admin@httpd.host to inform them of the time this error occurred, and the actions you performed just before this error.

More information about this error may be available in the server error log.

Is what i'm suddenly seeing. ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on June 24, 2017, 12:03:13 PM
Yup. Same here.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 24, 2017, 12:27:02 PM
Happening here now as well.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on June 24, 2017, 12:46:22 PM
Raspberry Pi - Dslstats 6.0 - happening here also.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on June 24, 2017, 04:36:52 PM
Appears to be completely offline, as the server wasn't replying to the app that uploads the data in Wireshark , hope it hasn't broke again
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on June 24, 2017, 06:03:53 PM
Also offline here as well.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on June 24, 2017, 11:42:31 PM
Offline here also
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 25, 2017, 08:06:13 AM
I managed to get my hands on a desktop at the B&B I am staying at and spent most of the night there using Teamviewer to get at everything as I carry a copy on a USB stick on car keyring ::)

There is now a backup from Thursday running locally that seems okay and I'm currently reloading the database tables from an automatic dump at 11:00 yesterday morning just before  it went wrong. Takes ages... Once complete I'll bring it back online in stages hopefully. Obviously there will be a large hole in the recent stats.

Apologies for a load of duplicated mail earlier when the mail server came  back up and sent a couple of days backlog it didn't think it had sent in one go... It's possible there will be more.

The server runs on a virtual machine and looks like it suddenly forgot how to load it properly.  No idea why. It does seem to be running slowly though so may not be fully right yet.

 :fingers:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: d2d4j on June 25, 2017, 08:18:29 AM
Hi tbailey2

Kudos to you

I'm sorry, others may not agree, but personally I would have preferred for you to have a good break and review your servers when your back from your break.

I appreciate though your almighty effort to bring back online, so please do not take the above wrong, as I have the same mindset for correcting things I'm responsible for, even when on holiday.

As I said, kudos to you

Many thanks

John
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: broadstairs on June 25, 2017, 08:36:11 AM
This is an effort well above and beyond  Tony. I agree with John, this is a very useful system but it is not a life threatening matter which needed your attention while away on a break. Yes we very much appreciate everything you do on this but I and I think John and others will agree that it does not require you to ruin your weekend away by doing this.

Stuart
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on June 25, 2017, 08:44:21 AM
I also agree with John & Stuart, although I myself am guilty of pulling out the laptop and fixing things whilst away. Enjoy the rest of your break.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on June 25, 2017, 09:54:07 AM
I totally agree with the above. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on June 25, 2017, 04:07:39 PM
+1
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: g3uiss on June 25, 2017, 04:49:45 PM
+2
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on June 25, 2017, 05:33:35 PM
+3
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on June 25, 2017, 05:45:10 PM
+4
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on June 25, 2017, 07:18:36 PM
As I've said in the past he's a cheeky monkey but has a heart of gold and good developer all this will be going to make his head even bigger and why not :thumbs: 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 26, 2017, 08:45:45 AM
Back now. Thanks for the comments but that's me. If I can sort it I will.

Seems to be running okay currently. I need to make a few config changes which means an Apache restart but this is usually very quick.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on June 26, 2017, 11:52:39 AM
Tony

Don't know if this is related or not but for a while now once I add the link to my TBB latency monitor it works fine for a few hours
then the graph stops updating. the monitor on TBB is still working as expected.
Once I create a new graph link on TBB and update the setting in the latency monitor works again for a few hours then stops

If you take a look at my id kwillers at the moment you'll see it seem ed to stop updating around midnight



Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 26, 2017, 01:02:58 PM
Strange.

The large file you see in the popup is taken directly off the TBB server and it's currently collecting this URL from TBB:

https://www.thinkbroadband.com/broadband/monitoring/quality/share/9779469c16531be336885fdfbf5e7db81a1f8be9-25-06-2017.png (https://www.thinkbroadband.com/broadband/monitoring/quality/share/9779469c16531be336885fdfbf5e7db81a1f8be9-25-06-2017.png)

That file has a date on the end - it's the file they generate at midnight for historical viewing. You are only one in the listings here with such a dated file when viewed in real time from TBB. I generate a similar file for use in the multiple latency display but that is stored locally, not on TBB! The small thumbnail looks correct though.

Ah!

Your config entry in MDWS is wrong. That is the URL you have entered there and that's why it's showing that. You need to find the correct URL when you add it with no date on the end.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on June 26, 2017, 01:59:01 PM
Slides off slowly feeling embarrassed  :-[ :-[

You are correct I had indeed used the wrong link !!!!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 26, 2017, 05:05:17 PM
For SHEEPIE2 - MAIL ERROR

You are currently uploading duplicate files but the mail we are sending you every minute is bouncing.

Your mail client is misconfigured and returns:

This is the mail system at host ***.a.mx.globalgold.co.uk.

I'm sorry to have to inform you that your message could not
be delivered to one or more recipients. It's attached below.

***@l***n.co.uk>: Relay access denied (in reply to RCPT TO command)

And the attachment is a notification of a Duplicate upload!

EDIT:
Same applies to Resync mails... Duplicates have now stopped.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on June 27, 2017, 11:32:15 PM
RESYNC MAILS TIMING

Just to say that a load of resync mails just went out at 23:17 after the process that sends them had frozen for about 13 hours and was restarted. The resyncs are real but they all say they happened at 23:17 since they are normally sent out in real time (the correct time they actually happened you can check on the SNRM graph listing and elsewhere). I've altered the code to reflect the actual resync time in the mail if this happens again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 04, 2017, 03:11:19 PM
Tony,

Posted a query on a new thread a few days ago ref.the MDWS phone app., I now note that the MDWS support refers exclusively to this thread, was not sure of the format to submit a query within this thread, have just re-posted as a reply to yourself, apologies if this is the incorrect protocol.
The query was (narrative copied from original):

The mobile phone application of MDWS does not appear to work on my particular mobile phone, a Motorola Moto G (2nd Gen) running Android V.6.0.
Have tried 2 different Android browsers, Google Chrome and Firefox, results are the same.
Can log in normally but my data is displayed in numerical format only, no graphical display as per the illustrations on the MDWS help pages.

The mobile URL displays full graphics when accessed via my desktop PC running Win. 8.1 with Firefox browser.

Any suggestions appreciated.

Many thanks for a fantastic data monitoring facility, now running 24/7 on my old RPi Mk. 1 B, wealth of information.   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 04, 2017, 09:09:22 PM
I thought I had replied to your other post but obviously not. I certainly composed something but obviously got diverted and didn't  :'(

It's not something I've looked at since it was put on over two years ago but it's not an app though, just normal web pages but small.

It runs fine on all my Samsung Galaxy phones (3, 5 and 7) but I hardly ever use it preferring the normal full web version. However, graphs are not generated the same way as the web ones but use a much simpler jquery library so that's probably where the problem lies. 

Does the main web version work on your Motorola? If it does you'd be better off using that probably.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 04, 2017, 10:04:12 PM
Tony, thanks for the reply.

Does the main web version work on your Motorola? If it does you'd be better off using that probably.

Sorry, I don't know exactly what you mean by this, I am just entering the same URL into my phone browser, either Firefox or Google Chrome as per the "Open the Mobile Version" icon on the main site page, all the information is there on the phone just not in graphical format as it appears on my desktop PC or your help files.

Just tried the app. on the wife's Samsung Galaxy J3, exact same results.

I would appear to be doing something wrong !
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 04, 2017, 10:16:22 PM
The same URL you use for your desktop PC but on the Motorola in a browser...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 05, 2017, 12:13:03 AM
Yes, that's exactly what I am doing as stated, could not see any other means of accessing on the mobile, results as reported on both phones.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 05, 2017, 08:06:00 AM
SERVER PROBLEMS LAST NIGHT & THIS MORNING

MDWS went down at around 22:40 last night. Not sure what is going on but looks like a possible virus (can't find one so far) or something misbehaving. Something is changing file permissions and then deleting one particular file (AV doesn't show anything logged) and the web server fails as a result!

I'll bring a backup online later but have to rebuild the database tables which takes a while. Then set about finding what it is - probably have to take server up and down. You will get resent old notification emails when it comes back up but difficult to stop.

UPDATE at 09:35

Should be back up soon and may also have found what is causing the strange problem.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 05, 2017, 10:08:30 AM
Yes, that's exactly what I am doing as stated, could not see any other means of accessing on the mobile, results as reported on both phones.

I'm, not sure from the above you understand what I mean  :-\

Can you run MDWS on your Motorola as you would run it on your Desktop, not via the Mobile link.

Like the attached.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 05, 2017, 10:40:31 AM
Apologies for being particularly slow on the uptake on this issue, the penny has now dropped, use the normal site URL not the mobile link URL on my mobile browser !
Yes, this works perfectly with both Firefox and Google Chrome on my phone.

Could the mobile app. issue be associated with the fact that Adobe Flash is no longer used / supported on Android, it certainly seems to be something associated with graphic's resolution, I have been trying to install the last archieved Android version available on my phone, it's supposed to be possible but I have not managed to achieve this yet.

I appreciate that it was very likely a bad time to bother you last night with the site issues, it's great to see it up and running again this morning, your dedication in maintaining this facility is very much appreciated. 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 05, 2017, 11:25:03 AM
Okay  :cool:

No Flash is not used at all but a good thought.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on July 05, 2017, 01:06:47 PM
Perhaps a screen shot of what you are seeing - "just numbers" - would help?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on July 05, 2017, 01:21:45 PM
Talking of the mobile web page my andriod samsung was fine but I keep getting this error now?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 05, 2017, 01:47:36 PM
Tony, Yes I eventually did get Adobe Flash installed and set up on Dolphin browser, just the same as per Chrome & Firefox which don't support Flash.
Have noticed that it is now very difficult to un-install app's. with Android V.6 (marshmallow), I have virtually filled my memory with these additional, trial app's., only get an option to "stop" or "update" these now, no un-install option, that's progress I suppose ?

Dray, Sorry, not sure how to accomplish a screen shot from my mobile and attach ?
What I am seeing on my phone after logging in is all my correct data, ie. stats, users etc. but in numeric format, no graphics or errors messages displayed, data is all there.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on July 05, 2017, 02:23:51 PM
@Tiify  OFF TOPIC

You'll only get the uninstall option for apps you've installed,  if it's not in your app manager you can do in from Play Store. Pre installed apps can't be uninstalled unless your rooted. I'm on Android  6 and the options there in my app manager.

Screen shot method varies by phone, so best Google it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 05, 2017, 02:34:44 PM
Talking of the mobile web page my andriod samsung was fine but I keep getting this error now?

Should (hopefully) be okay now...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 05, 2017, 02:40:00 PM
Perhaps a screen shot of what you are seeing - "just numbers" - would help?
Possibly just the top part of the stats page....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on July 05, 2017, 04:01:37 PM
Thanks Tony. All good
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 05, 2017, 04:30:47 PM
@ Ronski OFF TOPIC

Yes, I appreciate that only phone apps. which I installed can be removed, it's only these I am trying to un-install.
The new un-install method that updated with marshmallow, drag & drop from the main desktop screen certainly does not offer me the un-install option, neither does the old method from the apps. listing as is indicated by many of the Google'd help sites, most strange !

I will discover how to get a screen shot from my phone and post later when I get a bit of time.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 05, 2017, 05:48:33 PM
OK, finally mastered screen shots on my phone, see attached.
This is what I get when entering URL www.mydslwebstats.co.uk/mm/index.html to my mobile browser.

However, I have now discovered, more by accident than anything else, that if I access and sign into the main site on my phone browser then activate the mobile app. link at the top of the screen I get a perfect, mobile app. display complete with graphics, happy days.

Sorry for any confusion I may have caused, I'am still on a steep learing curve, thanks to all contributors.
At least I now know how to get a screen snapshot from my phone !
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 05, 2017, 09:06:37 PM
On a slightly different topic:

I wonder what method RPi users adopt to transfer their stored graphs / data files from Pi to their main media area, in my case a Win. 8.1 desktop PC., as my Pi is the old Mk. 1 B model memory is tight and I move the files on a regular basis.

I've found that FileZilla Client is very easy to use, yes, it is a manual process and there are probably much more elegant solutions for the more experienced Linux users but this works for me.
One could argue that there is no need to store anything as the historic data is all there on MDWS, especially with 24/7 uploading, however, on the very odd occasion when something happens to the server at least the data for the outage period is still recorded locally.   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on July 05, 2017, 09:43:45 PM
Quote
I wonder what method RPi users adopt to transfer

I don't bother, been using DSLStats starting 20/10/2015 and only using 150MiB and still have 9.8GiB free on the SD Card.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 07, 2017, 11:42:48 PM
Looking at the stat's of users on the MDWS site, I note that quite a lot of members are shown as "G.Inp inactive" as opposed to my stat's which shows nothing as G.Inp has never been active on my line.

In all of these cases it looks to me like G.Inp would improve DS error rates if applied, ie., all parties that have G.Inp active are showing very low DS ES rates.
Of course DS interleaving would have a similar effect but at a cost of DS synch. speed and increased latency, G.Inp appears to impose less of these losses than interleaving by itself.

So why is G.Inp inactive on these lines when it once was active and appeared to be effective ?
Is this just due to the ongoing compatability issues with the ECI cabinets, have not checked if all the G.Inp inactive lines are on ECI cabinets. 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on July 08, 2017, 12:24:06 AM
So why is G.Inp inactive on these lines when it once was active and appeared to be effective ?
Is this just due to the ongoing compatability issues with the ECI cabinets, have not checked if all the G.Inp inactive lines are on ECI cabinets.

It is, as you postulate, down to the ECI Hi-FOCuS M41 Mini-Shelf MSAN firmware problems.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on July 08, 2017, 03:43:13 AM
Those on Huawei cabinets who have had G.INP but no longer do have either had a DLM reset or have changed ISP.
DLM never removes G.INP.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 08, 2017, 09:12:54 AM
Thanks to both for the very informative responses, I'm still on a steep learning curve and every day is a school day, the wealth of comparative data that is available on MDWS prompts so many questions on my part.

I am still waiting patiently for G.Inp to be applied to my line (Huawei cabinet & compatable router) with just over 4 weeks on fibre now, I did a manual re-synch yesterday (leaving the router off for 1 hr. to avoid upsetting DLM) to see if that will nudge any action sooner rather than later.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on July 08, 2017, 12:29:32 PM
DLM will never take action during a manual resync, unless it's to punish you for too many resyncs. It acts automatically in the early A.M based on the previous days ES.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on July 08, 2017, 01:02:33 PM
Yes J0hn, I appreciate that this is the case, I have already observed this as my line did originally convert from ADSL and went fast path, then after a few days DLM did re-synch with DS interleaving, totally understandable as I had indeed been getting high ES rates before DLM intervened.
After 4 days, DLM put me back on DS fast path, as you said, both events occured in the early hours of the morning.
I did obey the "at least 2 X 15min. period delay" rule before re-booting the modem, in fact I waited over an hour to keep DLM stat's happy.

However, there certainly appears to be a grey area regarding the application of G.Inp, I have diligently read all available kitz information on the subject and posted on this forum but still don't have a clear understanding on this.
I'am beginning to believe that my Huawei cabinet is not G.Inp enabled !
 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 13, 2017, 03:47:51 PM
I need to take the server down for a short while to make some changes so, no,  it hasn't crashed again!

Back up at 16:05
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 18, 2017, 07:48:08 AM
RESYNC ALERTS

The resync e-mail alert system has been broken for some time now and only about 25% of users get their mails (if not disabled by a user).

The summary listing that's always been available at the top right of the SNRM pane is correct though and will show you more information on any resync if needed (see attachment).

The good news though is that, as of yesterday, the e-mail alert system is now working again after a complete rewrite over the past few weeks and everyone who wants them should now be receiving alerts. If you don't see them please check your SPAM etc folders.

Also the Resyncs/LOS Pane is now working properly again for the bottom summary list.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on July 18, 2017, 04:05:45 PM
glad my problems helped in your work :p
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 19, 2017, 10:00:49 AM
Thanks - but that facility isn't new, it has been there for around two years on MDWS, I was just using you as an example ...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on July 26, 2017, 10:18:43 PM
Is 'All User Stats' available on Basic Version (5 day version) on MWDS?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on July 26, 2017, 10:23:11 PM
I did reply to your original post but posts crossed...

See here (http://forum.kitz.co.uk/index.php/topic,14361.msg334649/topicseen.html#msg334649)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on July 26, 2017, 10:24:06 PM
Ta.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: craig288 on August 04, 2017, 09:54:49 AM
Hi, my 1st post here so 1st of all, Great web site and stats gathering so thumbs up to all involved.

I wonder if someone could help me though?

I installed the mydslstats some time ago, a year or two, and the stats were all being gathered and uploaded fine.
I then left it to do its thing and haven't checked for a few months but they now don't seem to be being uploaded.
Could someone help?

Craig
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on August 04, 2017, 09:59:42 AM
Suggest you download the latest version for your upload machine and upgrade.Then use the test button to check if it can validate. If you are unable to recover the login details it may be easier to create a new account. Make sure your upload device time is correct too.

Are you using dslstats or hg612 stats?

Dslstats 
http://dslstats.me.uk/downloads.html

Hg612 
http://www.kitz.co.uk/routers/hg612stats.htm

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: craig288 on August 04, 2017, 10:07:26 AM
Thanks for replying skyeci, I am running v5.9 of dslstats on my raspberry pi and its been running really well for some time.
I have updated the version of dslstats from time to time but I haven't updated to v6 yet, only just seen it on the forum.

I can go to the upload to dslstats tab under Configuration and it shows my username and validation key but when I try and click on Check Now all I see is "Unable to Check at present" in Red under the Check now button.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on August 04, 2017, 10:14:28 AM
I use a pi3 as well. I would manually download the latest pi version then copy paste over your exsisting install and try again. Also you could login to mdws on line to check your account is still active/working...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: craig288 on August 04, 2017, 10:23:59 AM
Thanks skyeci, I have logged in to mdws to check my account is still active and its fine.

I'll take a look at v6 then and see how I get on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 04, 2017, 10:26:48 AM
That error occurs if DSLstats is unable to contact MDWS for some reason. If DSLstats is otherwise running normally and recording data locally, then it has a good connection to the router, and that's not the cause of the problem. It could possibly be that the SD card is wearing out (they don't last forever, and DSLstats does make frequent reads and writes). But in the first instance I suggest that you follow skyeci's advice, install the latest version and see how it goes.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: craig288 on August 04, 2017, 10:32:31 AM
Thanks roseway will look into your suggestions.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on August 04, 2017, 10:52:20 AM
Might be worth updating your pi too if you havent done it for a while at the same time. Let us know how you get on.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitzuser87430 on August 04, 2017, 05:37:09 PM
Tony

Is it possible to add an option to hide either Upstream or downstream per graph; main reason is as I am on G.dmt my upstream attenuation is high (15 -16)  and downstream is only about 6 the "resolution" is poor.

Ian
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 04, 2017, 05:58:54 PM
Never tried but won't be easy. I'll add it to the list but likely to be a long time....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 04, 2017, 08:55:00 PM
tony I have noticed a possible issue.

for the last 2 days I have used 2 different zyxel routers, but it still reports me using an 8800nl.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on August 04, 2017, 09:28:30 PM
That because you have to change it manually from the options on the website :P
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 04, 2017, 09:51:36 PM
ahhh :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 06, 2017, 06:34:06 PM
Tony can you please add "Zyxel VMG3925-B10B" to the modem selection settings, thanks.  It works fine with dslstats and hg612 modem stats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 06, 2017, 08:19:39 PM
Done  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 06, 2017, 09:16:26 PM
thanks bud
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 09, 2017, 09:49:16 PM
I think this has been asked before but is it possible to see the vectoring status in mydslwebstats?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 09, 2017, 11:45:36 PM
Nope.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on August 15, 2017, 07:17:08 AM
Hi Tony, quick question.
Does MDWS delete the TBB latency monitor when it detects an I.P change? I keep having to re-add the link and turn the option back on.
I just noticed it disappear again in the last half an hour and I have performed a resync in that time so wondered if it was related.

TBB now allow hostnames with the BQM latency graphs so even with a dynamic I.P I can keep the same graph.

Unrelated, I was just updating my current modem in the options page on MDWS and there's only Zyxel VMG1312-B to select.
The 2 variants of that model are the VMG1312-B10A & VMG1312-B10D
Not hugely important but thought it looked a little odd in the list with the surrounding model names/versions being complete.

edit: over a year since I donated to this great project. had my money's worth! donated again  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 15, 2017, 08:10:20 AM
Yes it does if you have the Options entry set to mail you when the IP changes. I received a copy mail at 06:31 for you so the option to mail must have been turned on (just checked the code to make sure it's working correctly) - have you not received the mail? If you turn the mail option off then it will not delete the entry but I don't think this will work as the IP will have changed so MDWS will be monitoring the wrong IP despite what it says in the options entry. I don't believe it can work from here as it stands without an IP address.

Currently the option to mail is turned off for you so it should not delete the entry next time - the mail setting isn't altered.

I've added the modem - when it was originally added the user who asked me to add it just asked for VMG1312-B ....

And thanks for the donation.


EDIT:
Arrghhhhh  :paperbag:

I thought I'd delve into the SMTP log and discovered that your mail wasn't there. Further checking shows that no one, for a very long time, if ever, has received any mail for this facility! It should now work - a small coding error that doesn't jump immediately out which no doubt a few of you will recognise -  using == instead of = ....

Sorry  :-[
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on August 15, 2017, 02:31:15 PM
yes I had the option set to mail me when my I.P changed, but disabled it just before making my post.
Just checked my email account and you're right I've never received an I.P change email from MDWS.

Thanks for explaining how it works. Glad it helped you fix something :D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on August 26, 2017, 04:45:37 PM
Since the MWDS Gui was changed for vectoring  the layout seems to be malformed
 I attached a screen shot of what i mean  it's like the stats are overlaying other info underneath them The graph size settings seem to cause the issue unless i use the default size


UPDATE: I think i found the culprit, was a setting in FF browser  where i had ages ago set  the page zoom to 110% (text only)   zoom the whole page works fine, as did my previous setting until today



Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 27, 2017, 09:18:21 PM
Has anyone noticed the past 24 hour errored seconds DS & US traffic lights don't match what is shown in the errored second graph, I should have 13 ES but it's only showing 2 ES and checked a few other MDWS users and it's the same issue.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on August 27, 2017, 09:57:06 PM
Indeed my US ES don't match unless I am misunderstanding the timings of each. eg when does the traffic light timing begin as the graph is midnight?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 27, 2017, 10:06:56 PM
Has anyone noticed the past 24 hour errored seconds DS & US traffic lights don't match what is shown in the errored second graph, I should have 13 ES but it's only showing 2 ES and checked a few other MDWS users and it's the same issue.
A quick glance says a Windows Task has failed some 10 hours ago and the data hasn't been updated properly for ES and SES so all traffic lights are incorrect. The graphs are correct as they source from elsewhere. This may take a while to sort out,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 27, 2017, 10:08:43 PM
Indeed my US ES don't match unless I am misunderstanding the timings of each. eg when does the traffic light timing begin as the graph is midnight?
If you hover over the lights it tells you - Last 24 hours.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on August 27, 2017, 11:40:19 PM
If you hover over the lights it tells you - Last 24 hours.

So is it a rolling start time unlike the graphs?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 28, 2017, 12:06:25 AM
According to kits dlm calculator it's 24 hours, 00.00-24.00
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2017, 07:08:44 AM
So is it a rolling start time unlike the graphs?

Yes that's what I said earlier. It's been explained before but the idea is that at a glance you get a better idea of the general status of the errors doing it on a rolling basis rather than having to wait until after midnight to see what it was!! If you need a more accurate answer then use the popup calculator. It's been that way ever since it was introduced over two years ago.

The graph uses 24 hours resetting at midnight because that's what the DLM uses to make a decision.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2017, 07:11:48 AM
According to kits dlm calculator it's 24 hours, 00.00-24.00
00:00 to 23:59 inc

24:00 == 00:00
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2017, 07:14:03 AM
The Windows Task was resurrected at 23:00 last night and is running again. It means the 24 hours rolling figures will not be accurate until late this evening.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2017, 07:39:00 AM
MDWS VECTORING SUPPORT

There is now support for a line's Vectoring Status. BUT it is only available if you are using DSLStats and version 6.0.6 or greater. It is not supported by HG612 Modem Stats (currently but may never be).

There is a separate thread (http://forum.kitz.co.uk/index.php/topic,20199.0.html) for this feature with more details.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on August 28, 2017, 09:11:18 PM
MDWS VECTORING SUPPORT

There is now support for a line's Vectoring Status. BUT it is only available if you are using DSLStats and version 6.0.6 or greater. It is not supported by HG612 Modem Stats (currently but may never be).

There is a separate thread (http://forum.kitz.co.uk/index.php/topic,20199.0.html) for this feature with more details.
Well the majority of current VDSL2 modems won't support G fast anyway,and it will be quite possibly years before most of us see it, let alone bother buying it. but for the have's is nice to know  i suppose
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on August 28, 2017, 10:15:57 PM
The Windows Task was resurrected at 23:00 last night and is running again. It means the 24 hours rolling figures will not be accurate until late this evening.

I am not normally OCD about this stuff Tony most of the time I blame it on my equipment, As Fernando Alonso said during his race this weekend "it's not going to change my life" though a nice Mercedes engine would  ;D
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: RealAleMadrid on August 28, 2017, 10:45:30 PM
@Tommy45 - are you aware that an increasing number of VDSL2 circuits have vectoring enabled, although I believe only on BDUK financed cabinets in order to achieve the required speed targets. So actually not anything to do with G.Fast.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 28, 2017, 10:57:43 PM
Well the majority of current VDSL2 modems won't support G fast anyway,and it will be quite possibly years before most of us see it, let alone bother buying it. but for the have's is nice to know  i suppose
Eh? Vectoring on its own is perfectly well able to increase a line's speed by using noise cancelling technology that reduces interference from adjacent lines or other services. G.FAST doesn't come into it (yet).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 29, 2017, 08:21:34 AM
SERVER RESTART

The server is currently shutting down and restarting. May take up to 15 mins...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on August 29, 2017, 10:04:54 AM
Wow this is a long 15mins is it stuck on off?  ;) I think i was answering someone else's post re G fast and posted in the wrong place possible about HG 612 modem stats possibly not adding support for vectoring As vectoring won't become available to the majority i was  bringing G fast into the conversation as that is likely to be next, hence why most of the current modems available  not supporting it,
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on August 29, 2017, 11:29:51 AM
@Tommy45 - are you aware that an increasing number of VDSL2 circuits have vectoring enabled, although I believe only on BDUK financed cabinets in order to achieve the required speed targets. So actually not anything to do with G.Fast.
Yes, but their coverage is tiny compared to Openreach, those who are not on BDUK cabs will not ever see vectoring As Openreach would sooner sell a new product G fast instead , which still isn't true fibre
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on August 29, 2017, 02:35:01 PM
Has MWDS been down? I have a huge gap for today and I am testing a new router although my ISPs quality monitor says router has been up.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on August 29, 2017, 02:38:02 PM
Has MWDS been down? I have a huge gap for today and I am testing a new router although my ISPs quality monitor says router has been up.
the site was unreachable for me since sometime this morning back online now though
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Dray on August 29, 2017, 02:38:53 PM
Been down for about 8 hours
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 29, 2017, 02:43:25 PM
MDWS RUNNING AGAIN

Hopefully it's back up running again after 3 hours of resurrecting it all interrupted by a round trip up the M23/M25 to rescue someone stuck at a service station which delayed things somewhat....

The disk crashed in a spectacular manner and was completely unrepairable, mainly because it would not run any executable files any more. And it a WD Red NAS drive and only a month or so old.

No idea why yet but getting all the data back in from a system backup plus various db and other dumps to get it as up to data as possible takes ages.  There is of course a large hole in the data from 05:10 to 14:13 or so.

Some users may have seen duplicate e-mails from several days back despite clearing the queue first.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on August 29, 2017, 02:59:16 PM
Thanks Tony. :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on August 29, 2017, 03:12:25 PM
Thank you for all that work Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 31, 2017, 12:42:02 PM
Tony since you added vectoring, I found the layout of the top bar is messed up at 100% zoom level quite badly, at my usual 120% zoom its partially mitigated but still not as good as before the change, I think the cause is the 3 lines of text in the vectoring box causing an increased height of the bar.

I wonder if it better to put initials such as VNE instead of vectoring not enabled, with full description only shown on hover?

Some more info, set graph size to standard to see the layout problem, when set to original the layout is working as it should.  Original also is missing the vectoring information which probably also explains why it looks good as well. :)

Ok ignore my post, but I will keep the post here in case others had the same problem.

The problem was I had fiddled with my min font setting in chrome which blocked the font size tony set on the site, after I lowered it again the layout is correct.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 31, 2017, 01:12:48 PM
You need to post a screen grab or two as cannot reproduce here and I'll see if I can work out the problem. You are running the same version of Chrome as me and your screen res is the same  horizontally as mine at 2560px. The height of the graph shouldn't affected anything except for Original which has a lot less info anyway. I can zoom from 75 to 250% with no effect.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on August 31, 2017, 01:24:35 PM
Is fine tony, I edited my post to reflect the situation. :)  Was my fault.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on August 31, 2017, 03:11:48 PM
Thanks.

I was going to add if you text-zoom or override the font then all is lost I'm afraid.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 03, 2017, 08:06:13 AM
SERVER MAINTENANCE

MDWS will be down shortly for software maintenance - I will not predict for how long this time. A second downtime will probably happen tomorrow morning if today's  goes well.

down at 08:24 back up at 08:40 :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 04, 2017, 08:01:59 AM
SERVER MAINTENANCE

As mentioned yesterday MDWS will go down shortly. This hardware and software update will take longer and there is no restoration time at the moment.

BACK UP at 12:42
So turn off server and start upgrade. Knock on door 'UK Power Networks here, we need to turn off your power shortly for about three hours'  >:D
Title: Re: MyDSLWebStats - vmg1312-b10d, not vmg1312-b10b in options
Post by: 22over7 on September 20, 2017, 03:08:59 PM
I doubt it makes a real difference to anything, but when I click on "options", under upload modem there's VMG1312-B10A and VMG1312-B10B. I assume the latter is a typo for VMG1312-B10D?  AFAICG, there's no such thing as a "-B10B". Having changed mine from (legacy) hg612 to vmg1312-b10b, I (Sandreck, on 6.0.6) see no difference, except in the labelling at the bottom.

On another (trivial) matter, when I set the graph size to anything other than "original" (on firefox), I can see nothing corresponding to "data to show". (Something seems to flicker up and get drawn over when the display loads up). No, I have not fiddled with font sizes.   Mind you, it's trivial to go to "original" size, select things there, and then go back to "extra large". 

Many thanks for providing this great amenity.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2017, 03:27:44 PM
Zyxel seem to think otherwise - from their website:

The ZyXEL VMG1312-B10B Wireless N VDSL2 4-ports gateway with USB provides VDSL2 of up to profile 17a ....

https://www.zyxel.com/me/en/promotions/promotion_20130409_504076_me_en.shtml

There won't be any difference, it's just there so people can see what modem you are using.

And I have no idea on the second problem I'm afraid.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on September 20, 2017, 07:18:15 PM
You're right of course.  B10B is a thing. Nevertheless, there *is* such a thing as the VMG1312-B10D, which works well with mydslstats. 

Apparently Kitz uses one (on ADSL), enthusiastically.  (UPDATE: actually, that doesn't seem to be true now. Sorry.)
On VDSL it may not be so good, as I might be discovering. 

For general information, it might be worth making an entry for it in your next non-beta release.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on September 20, 2017, 07:27:08 PM
Quote
Apparently Kitz uses one (on ADSL), enthusiastically.  On VDSL it may not be so good, as I might be discovering.
Are you sure? Never seen her say that. She has a VMG8324-B10A on VDSL2.

The VMG1312-B10A has a better chipset than the VMG1312-B10D, on VDSL2 anyway. I've never seen a comparison of the 2 on an ADSL service. Also never seen a B variant. and no idea what chipset it uses either.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on September 20, 2017, 09:00:14 PM
Damn. I've updated my post above so as not to mislead. I've searched for what I thought I remembered, and failed to find what I hallucinated.  I can't even find anybody being particularly enthusiastic about the VMG1312-B10D. Sorry again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on September 20, 2017, 09:19:39 PM
Damn. I've updated my post above so as not to mislead. I've searched for what I thought I remembered, and failed to find what I hallucinated.  I can't even find anybody being particularly enthusiastic about the VMG1312-B10D. Sorry again.

Are you not confusing Kitz with Mr B*cat who uses a B10D on an ADSL2+ line I think. Maybe he will see this post or the discussion and correct as appropriate.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 20, 2017, 11:09:00 PM
You're right of course.  B10B is a thing. Nevertheless, there *is* such a thing as the VMG1312-B10D, which works well with mydslstats. 

Apparently Kitz uses one (on ADSL), enthusiastically.  (UPDATE: actually, that doesn't seem to be true now. Sorry.)
On VDSL it may not be so good, as I might be discovering. 

For general information, it might be worth making an entry for it in your next non-beta release.

I believe there is confusion in abundance here in this and other posts in this current topic along the way???

The VMG1312-B10D is already there as a selectable entry on MyDSLWebStats but from your last remark you actually appear to be talking about roseway's DSLStats that uploads the data to MyDSLWebStats since you talk about a non-beta release and MyDSLWebStats doesn't have those. Plus 'mydslstats' doesn't exist...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: burakkucat on September 21, 2017, 12:04:26 AM
Apparently Kitz uses one (on ADSL), enthusiastically.  (UPDATE: actually, that doesn't seem to be true now. Sorry.)

<cough> Another fur-ball . . . I think you will find that is me, myself and I.  ;)  :angel:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 21, 2017, 07:38:59 AM
You're right of course.  B10B is a thing. Nevertheless, there *is* such a thing as the VMG1312-B10D, which works well with mydslstats. 

Apparently Kitz uses one (on ADSL), enthusiastically.  (UPDATE: actually, that doesn't seem to be true now. Sorry.)
On VDSL it may not be so good, as I might be discovering. 

For general information, it might be worth making an entry for it in your next non-beta release.

As Tony has pointed out, this refers to DSLstats, not MyDSLWebStats (MDWS). There are already selectable options for VMG1312-B10A and -B10D in recent pre-releases of DSLstats.

To avoid confusion, please only make reports relating to MDWS in this thread.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2017, 08:44:54 AM
SERVER DOWNTIME

MDWS will be down shortly for some maintenance and a bit of a rewire. Hopefully not for too long..

BACK UP
Was off from 09:01 to 09:08
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on September 23, 2017, 10:00:28 AM
That was a snappy one, Tony :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2017, 10:36:32 AM
Yes, a welcome change and nothing went awry  ::)  :fingers:

EDIT
Spoke too soon but okay now (hopefully)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on September 23, 2017, 03:32:01 PM
graph data in the panes seems a little slower to load/delayed, been like that for a month iirc  the site loads ok as do the pane templates what contain the data selected
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: summat on September 23, 2017, 06:22:18 PM
I've moved house and am now uploading data from a new line but things are all out of alignment.

My username (summat) is not showing on the dropdown list so I can't look at my own stats in detail, and in the all user stats (where I do exist) its saying I'm on an ECI cab; it USED to be ECI, but I'm now on a Huawei in new house.

Any chance my stats/record/etc could be reset?

I guess I'll make a new login if I have to but I'd prefer not to need to!

Edit: Just noticed that list says it only shows people uploading within last 48h... I'll wait a bit longer and see if I pop up!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on September 23, 2017, 06:45:24 PM
Tony will need to manually change the cabinet for you, which I'm sure he will when he sees your request  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2017, 07:45:14 PM
I've moved house and am now uploading data from a new line but things are all out of alignment.

My username (summat) is not showing on the dropdown list so I can't look at my own stats in detail, and in the all user stats (where I do exist) its saying I'm on an ECI cab; it USED to be ECI, but I'm now on a Huawei in new house.

Any chance my stats/record/etc could be reset?

All done  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on September 23, 2017, 07:56:57 PM
graph data in the panes seems a little slower to load/delayed, been like that for a month iirc  the site loads ok as do the pane templates what contain the data selected
Took a while to find this but now back to where it was  ;) It was actually about 2.7s slower than normal.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on September 23, 2017, 11:47:18 PM
Seemed longer than that, but is a lot quicker now
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on October 05, 2017, 06:22:57 PM
Hi Tony

I use the mobile app most days but today it seems to be taking much longer to load/refresh. In the past it was lighting quick. Just wondering if something was not working properly.

Many thanks for a great application all the same.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 05, 2017, 10:02:11 PM
Can't see anything 'wrong' from this end but it has no internal stats so can't say if it's changed load times. Seems zippy enough on my Galaxy S7 via 4G.

It does look like it needs a bit of a rewrite though as it's over two years since it was coded and many things have changed elsewhere in the system since to speed things up. For a start it's listing all users active in the last three months or so when it should only be be 10 days. And in the process using data that is slower to read and so on...

I'll see what I can do but no promises.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on October 05, 2017, 11:06:21 PM
Hi Tony

It's very odd. It was taking a long time most the day but its cleared this evening, as in back to the same as yesterday and many days before that.

I was on a couple of different networks today so I know it wasnt my home connection ...

Seems ok  again now.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 11, 2017, 04:47:48 PM
Hi Tony,

I am trying to register my son as a new user but keep getting "user name already registered", have tried three what I would consider fairly unique combinations of user names but getting the same result, can't see any of these already listed on the "all users" listing although I appreciate that only active users are listed, can't activate the "all users" option.

My first choice for user name is "smpay-37" (obviously without speech marks) is this actually already registered ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on October 11, 2017, 05:11:57 PM
Are you using the same email address? I believe it needs to be a different email address not already in use on MDWS.
If that isn't the reason then have you tried from a different browser or with the browser in incognito mode?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 11, 2017, 05:28:18 PM
I think the message you are seeing is 'You already have an existing registration on MDWS!' as the one you quote does not exists as a response. The existing user is you,

You cannot normally register another user name on a terminal with an existing registration. Using another terminal will be okay as long as it's never been used with MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 11, 2017, 05:58:43 PM
I think the message you are seeing is 'You already have an existing registration on MDWS!' as the one you quote does not exists as a response. The existing user is you,

You cannot normally register another user name on a terminal with an existing registration. Using another terminal will be okay as long as it's never been used with MDWS.

Tony, you are absolutely correct, apologies for the mis-quote from memory which is getting shorter by the day !
Yes, I did indeed complete my own registration on this PC and my daughters registration on her PC, was just trying to speed up the process before I fire up the new router & RPi on my son's line, will now complete the registration at the home location.

I take it I will be able to complete the donation process for the new user name from my own terminal after it is registered, as usual, payment process to be completed by parents ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 11, 2017, 06:28:07 PM
I take it I will be able to complete the donation process for the new user name from my own terminal after it is registered, as usual, payment process to be completed by parents ?
Yes, as long as you add in the username in the correct way...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 11, 2017, 07:58:59 PM
Many thanks Tony, all sorted, submitted registration on my laptop which I had not used for previous reg's..
Donation also sorted on PayPal, no isues there.
The new ID won't be up and running just yet until I get time to install the new router and RPi, hopefully within the next few days.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2017, 09:52:37 AM
POWER

Just a warning that the power has been off here for 5 mins - there is probably another 25 left in UPS so... My attainable has gone from 34 to 58Mb !!

Back up at 09:57 and back to normal.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 13, 2017, 12:10:47 PM
Many thanks Tony, all sorted, submitted registration on my laptop which I had not used for previous reg's..
Donation also sorted on PayPal, no isues there.
The new ID won't be up and running just yet until I get time to install the new router and RPi, hopefully within the next few days.

You seem to have problem on the RPi you are using on the new line (ID: smpay-37) although it is uploading okay BUT  - the clock is about 1 day and 21 hours SLOW which is causing some 'interesting' effects such as 0% uploads in past 24 hours and inability to identify the cab type (it thinks you are NOT in the UK). I suggest you correct that a.s.a.p. to get things back to normal.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 13, 2017, 01:20:03 PM
You seem to have problem on the RPi you are using on the new line (ID: smpay-37) although it is uploading okay BUT  - the clock is about 1 day and 21 hours SLOW which is causing some 'interesting' effects such as 0% uploads in past 24 hours and inability to identify the cab type (it thinks you are NOT in the UK). I suggest you correct that a.s.a.p. to get things back to normal.

Just got the replacement router and RPi fired up on my son's BT line last night, yes, I had noticed, the Rpi appears not to be updating it's time & date on line as it should, obviously it has internet access as it's uploading stat's ?
The setup is exactly the same as my daughters installation using a RPi Zero W (ID cruth211) I just copied the memory card from this and changed the authorisation code, e-mail address etc. to suit.

Will address this as soon as possible, ie. when the wife brings the car back, thank's for the notification.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 13, 2017, 05:46:01 PM
You seem to have problem on the RPi you are using on the new line (ID: smpay-37) although it is uploading okay BUT  - the clock is about 1 day and 21 hours SLOW which is causing some 'interesting' effects such as 0% uploads in past 24 hours and inability to identify the cab type (it thinks you are NOT in the UK). I suggest you correct that a.s.a.p. to get things back to normal.

OK Tony, sorted now I believe.
This is the third RPi I have set up on DSLStats to MDWS and the first time I have had this issue.
The Raspbian utility which manages the date & time, "ntp" was all correctly configured and running, however, as the time & date were so far out this was out of range for dynamic correction, 100 mins. max. deviation I believe, had to stop the routine, manually correct then re-start all from command line, appears to be tracking normally now.

Every day's a school day !
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: slipbye on October 15, 2017, 01:28:21 PM
Hi Tony,

Not sure if i'm missing something but i can't see my own name in the dropdown list anymore. I've changed from adsl to fttc so not sure if that has affected anything or i'm just going blind. My username is slipbye if that helps?

Thank you :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 15, 2017, 01:53:49 PM
Well I could see why you weren't showing and you are now but nothing caused it at your end. Odd though, your modem says you are on VDSL but the upload speeds are terrible and (still?) looks like an ADSL line?

Thanks for the donation BTW but that doesn't generally make you disappear  :-X
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: slipbye on October 15, 2017, 02:06:22 PM
Thanks for your help Tony, Can see my stats now :)

Moved over to Vodafone fttc a week or so ago (better than 1 meg adsl!) long way from cab. Moved over to a zyxel 8924 so I could check stats as I think it's banded me now, will see how it goes now I've binned that Vodafone router.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: av1874 on October 16, 2017, 10:28:42 PM
Hi wonder if someone can help

My username is v6villain on dsl stats. I am able to record my stats but when i try and view them via the website I am unable to see my stats  and I do not show on the drop down list.  The exact problem the above poster has had.

Any suggestions how to fix this

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 16, 2017, 11:29:16 PM
You should be okay now and can see what the problem was for both you and the previous user. Will fix properly tomorrow...

You might look in the DSLStats Event log and see if there are any clues to the erratic uploads.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lockdown on October 18, 2017, 08:26:33 AM
Hi Tony,

I have the same issue as the previous two users whereby I appear to have dropped off the web UI. Username is lockdown.

Thanks

Sent from my Pixel using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2017, 09:44:11 AM
That's because you haven't uploaded anything since the 19th August at 20:21 ....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on October 18, 2017, 10:52:37 AM
Tony, could you display the date/time of the users last upload beside the username in the page headings? That might reduce queries of this type.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2017, 11:07:07 AM
If you mean right at the top of the page when logged in yes, good idea  :cool:
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2017, 12:00:12 PM
Okay that's done.  It appears under the user name on the info line as that already has an Ajax update timer running every 30 secs
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lockdown on October 18, 2017, 01:41:56 PM
That's because you haven't uploaded anything since the 19th August at 20:21 ....
Well I checked the client a couple of days ago and it had been up for many days. I also verified the loging credentials with the test button and all reported well.

I will check again tonight and report back.

Sent from my Pixel using Tapatalk

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: av1874 on October 18, 2017, 03:36:10 PM
Hi my upload percentage display seems to have gone.  I have checked in options and no settings have changed

Thanks

Username v6villain
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2017, 03:45:14 PM
Can't see any reason why, it's visible here and is set to show although that was updated very recently but don't know what it was set to before.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: av1874 on October 18, 2017, 04:00:57 PM
Hi it was always set to show, then I had a play with options . Since then its not visible, even though I returned the setting to show percentage.

Definitely not visible to me
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2017, 04:17:47 PM
The percent box does not show on the small Original graphs which is what you are using at the moment despite being a Supporter. Change to one of the other larger sizes and it will re-appear...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 18, 2017, 04:20:59 PM
Well I checked the client a couple of days ago and it had been up for many days. I also verified the login credentials with the test button and all reported well.

I will check again tonight and report back.

Sent from my Pixel using Tapatalk

Is the Upload data to MyDSLWebStats check box set (under the green text) in DSLStats?

I have put a trace on and there is nothing under your username being uploaded and then rejected for instance. Have you checked the DSLStats Event log for possible errors?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: av1874 on October 18, 2017, 04:27:46 PM
The percent box does not show on the small Original graphs which is what you are using at the moment despite being a Supporter. Change to one of the other larger sizes and it will re-appear...

Thanks all sorted
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: lockdown on October 19, 2017, 09:43:07 AM
Is the Upload data to MyDSLWebStats check box set (under the green text) in DSLStats?

I have put a trace on and there is nothing under your username being uploaded and then rejected for instance. Have you checked the DSLStats Event log for possible errors?
My mistake. I'd stupidily moved the executable out of the working directory so it couldn't find upload16.rpi.

All working now.

Thanks!

Sent from my Pixel using Tapatalk

Title: Re: MyDSLWebStats - firefox display issues
Post by: 22over7 on October 22, 2017, 09:25:33 AM
I mentioned this once before, but have some more info.  It has to do with the display of "new-style" pages like "Standard", as opposed to "old-style" original.
The problem is that the thing/panel/box that holds the traffic-lights etc sometimes overflows its boundaries (so grows vertically and overwrites
interesting buttons).  In my case I wildly guess this is because my username has 8 characters;
eg. kitz's graphs show fine, because the username is short enough.  It seems to me there are
so many things in this box (if that's the right word), it will be prone to overflow its allocated space.

Maybe if various words are discarded, eg the label "Status" in addition to the username,  the overflow may be
less likely?

I have no idea if this happens on Chrome as I've forgotten some security phrase I'd need to try it out.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 22, 2017, 01:27:28 PM
I can't see any problem here on any of the five browsers I have available. It has been reported in the past and the problem seems to be that the browser is not set to use the default 100% font setting or less but has been increased/zoomed and this causes the overflow.

Attached is a status bar for a user with a 10 character username and all in caps which is about the widest you can have, Even then there is space to spare.

A screen grab from you would be helpful to see what is likely happening along with a username please.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on October 22, 2017, 02:26:23 PM

tbailey2:

Quote
A screen grab from you would be helpful to see what is likely happening along with a username please.

I (hope I've) added a screen shot as an attachment. It includes my username.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 22, 2017, 03:18:54 PM
This is what I see here via Firefox 56.0 on default settings - and there is more than you have as the percent box is also displayed...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on October 22, 2017, 04:10:31 PM
I'm also using firefox 56.0 (on a Mac: 10.11.6).

I was finally able to get decent results after going to firefox settings, language and appearance, advanced,
and then disallowing pages to use their own fonts.

I've no recollection of ever touching that setting, or what the default is.

Thanks for taking the trouble to look.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 22, 2017, 05:24:03 PM
The default appears to be Allow pages to choose their own fonts. I am set to that and if I uncheck it then it all looks pretty horrible and uses serifed fonts.

There is something strange about your screen grab. That status bar is defined at 950 pixels wide and whatever the display resolution is, it should always be that size in a screen grab. Your screen grab though is ~1024 px wide which is odd. I wonder if the very high PPI of more recent mac displays has any effect here but I wouldn't have thought so - I don't have one to check...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on October 22, 2017, 07:31:12 PM
I hardly understand what a screen grab is. My attachment was just something I rectangled off my screen with a mouse, a bit bigger than the troublesome panel/box/thing. Anyway, I've no winge with MDWS now on my computer : it looks fine, though I don't know why.

My elderly display might be slightly unusual: it is 1920 x 1200. That's a little deeper in aspect than usual.

Obviously, I've no real idea how webpages like MyDslWebstats's are assembled; but that doesn't stop me
speculating wildly.


Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on October 22, 2017, 10:38:24 PM
I've just been playing with zoom + once to increase everything including the table width, then zoom text only and zoom in some more and have managed to create a version of the basic edition screen that looks very, very similar to 22over7's screen shot. This is on Firefox 56 on Win 10.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 26, 2017, 02:38:51 PM
Hi Tony,

Have noticed this morning that most active users, myself included, are sitting at an approx. a 95% upload figure which does not decrease despite uploads being current.
Initially thought that I had an issue, from previous experience when my RPi clock has been incorrect this was the effect produced, however, I have re-booted/re-started my RPi/DSLStats with no change.

Noted that there appeared to have been an outage on all users I have checked at approx. 02:00 hrs. to 03:00 hrs. this morning, just wondering if anything is going on @ "mission control" ?

Apologies if you are alread aware of this situation, thought I would advise as no current notifications that I can see. 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2017, 03:10:59 PM
Yes there was an outage and the uploads won't reach 100% again (assuming no other outages) until 03:06 tomorrow...

What happened I have no idea  ???

I thought at first that maybe OR were working on the cab as the TBB Ping to here failed for the whole hour but there was no resync at all when it came back up. Nothing recorded anywhere here in logs and no power dropouts (plus everything is on UPS). Odd thing is that another terminal here that runs 24 hours completely lost DNS and couldn't find any URLs or the local LAN this morning. Eventually after restarting this and that, I gave up and had to power it off and back on for it to work again. The MDWS server was still running all through it and everything reconnected quite happily when whatever it was went away.

 I hope it's not connected (sic) with an extremely large hole the water board dug on Monday for a water feed to a new property that closed the road for two days and that got filled in again yesterday...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 26, 2017, 04:01:44 PM
OK Tony, many thanks for the update.
Yes, lets hope there's nothing sinister associated with the "large hole !

I appreciate that users won't achieve 100% upload until 24 hrs. has expired, it's just that my stat's (and virtually every active user I've looked at) are sitting @ 94/95%, from previous observations of outage (from whatever source) the percentage upload figure starts to progressively increment towards 100% as soon as data comm's is re-established, this does not appear to be happening in this case ?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 26, 2017, 04:20:02 PM
Nope, it never increments for a single outage like that, it cant possibly do so... But if there are several outages then it will increment once the 24 hour anniversary of the first is reached.

Edit:
That is, if you can see an outage on a 24hr graph, it won't change the percentage upload figure until the leading edge of the outage disappears off the left of the graph...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 26, 2017, 05:30:44 PM
Ahh, We live and learn !

I am obviously confusing this with my recent experiences with the 3 systems I look after, mine, son's and daughter's where I had issues with DSLStats not running on their respective RPi's and in one instance the RPi's clock being so badly out it could not correct itself, in these cases, once data uploading was re-established (and the RPi clock was correct) the percentage upload indicator started to increment towards 100%.

Did not appreciate that an outage at your end of the system would not produce the same results, now I know !
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on October 26, 2017, 10:48:47 PM
The difference is what happened in the 24 hours before the outage.

With the server outage there was continuous connection before. It was out for about an hour so at just after 3am when it came back it had recorded one about hour of outage during the previous 24 hour period from 3am the previous day. At 4am it is still the same amount of outage during the 24 hours from 4am the previous day - so the same percentage. That will continue for about 23 hours until it is exactly 24 hours after the outage started when the percentage will climb reaching 100% exactly 24 hours after the outage ended.

With your experience with the RPi's not uploading at all during the previous 24 hours the uptime will start at 0% and climb back to 100% 24 hours after they started uploading again.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: toulouse on October 27, 2017, 12:51:04 PM
Hello all,

In a moment of what I can only think of as being madness this morning, I appear to have cleared out my browser history, and now I am unable to log in to MDWS. I have my username and password, but for the life of me I cannot remember what my memorable phrase is or was. Pretty memorable, huh.

I assume there must be a recovery mechanism for this self inflicted issue, but I am unable to see how I should proceed.

Any pointers to get me back into MDWS would be greatly appreciated.

toulouse
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 27, 2017, 01:07:55 PM
Reset your password...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on October 27, 2017, 01:31:49 PM
The difference is what happened in the 24 hours before the outage.

With the server outage there was continuous connection before. It was out for about an hour so at just after 3am when it came back it had recorded one about hour of outage during the previous 24 hour period from 3am the previous day. At 4am it is still the same amount of outage during the 24 hours from 4am the previous day - so the same percentage. That will continue for about 23 hours until it is exactly 24 hours after the outage started when the percentage will climb reaching 100% exactly 24 hours after the outage ended.

With your experience with the RPi's not uploading at all during the previous 24 hours the uptime will start at 0% and climb back to 100% 24 hours after they started uploading again.

Thanks for the explanation, makes sense now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on October 27, 2017, 02:44:38 PM
I've just been playing with zoom + once to increase everything including the table width, then zoom text only and zoom in some more and have managed to create a version of the basic edition screen that looks very, very similar to 22over7's screen shot.

I've found my "wrong" setting in Firefox 56, and learnt something about zooming by several experiments.
For some unknown reason in preferences/language&appearance/advanced/ I had a minimum font size set.

When this size is set to "None", which I guess is the default, the MyDSLWebStats pages look perfect.
(This is not affected by the setting about sites being allowed to choose fonts.)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on October 29, 2017, 08:44:18 AM
Just a reminder that a lot of users need to update their clocks this morning.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on October 29, 2017, 09:25:35 AM
Yes and currently they are:

audiruss*** AvonHouse*** bigg*** billybudd*** chakobsa*** chouse*** derekh*** donnermike*** frogfoot10*** ip75*** loonylion*** NGDragon*** Pet0r*** Pet0r-2*** RDSSky*** spiralarms*** syserr0r*** UNCLEKNOBB***

The great majority of these are RPi users as always.

You can see these in the uploaders list at the bottom of the main window if you haven't hidden that list...

RPi Users
If you are running an RPi you may well need to reset the time on it as the change of time from BST to GMT/UTC and vice versa doesn't always work and also need to restart DSLStats as that will not pick up the change otherwise. The RPi command is:

sudo dpkg-reconfigure tzdata and select Europe and London

Leave it for 5 minutes after setting, then restart DSLStats

You'll get Duplicate Upload mails once you reset the clock (because you've already uploaded the current hour!) so either switch off MDWS uploads for an hour or have a cup of tea/coffee.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 02, 2017, 07:04:11 PM
There seems to be a small issue with the top pane not displaying the data /loading fully, i have tried reducing the number  and still, the top pane isn't loading, If only 1 pane selected it doesn't load , yesterday or the day before it would load minutes later, but the list of users didn't load at all , that list at the bottom is now loading fine,  using FF56.02
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 03, 2017, 08:41:01 AM
@tom34
I can't see any problems with the rate at which data was being delivered to you yesterday from looking at the server logs and my real time Dashboard. Everything on MDWS is logged and timed per user for all graphs and other data. It shows on average 110-180 milliseconds for you per graph, which is normal, to finish sending the data BUT it all then has to be processed LOCALLY by the browser at your end which is where the problem probably lies.

It certainly won't help hammering the server as you were with manual whole page refreshes every few seconds as eventually it will drop your connection for a while but this doesn't work as well as I like - I may have to improve that at this rate. Reloading the entire page takes a lot of resources as against the minute or so auto refreshes of data that takes place under normal operation and is how the system was designed to run locally along with intermittent page refreshes that do result from changing various settings

The remote part of the Google API was very slow at times yesterday and taking quite a while at times to respond to Ajax calls which will cause long delays in frame loading on the user side (and Google doesn't allow the code to be stored and called/run locally). Can't say I noticed what you are specifically  reporting though with the first pane/frame yesterday.

The very slow response a few days back did happen - a programme on the server went rogue and started eating all the memory. This meant that the database table caching of normally about 20Gb of data started being eroded and eventually the data was being fetched mostly off off the disk (which is an Enterprise class SSD now) and was very slow by comparison to normal as a result. Killing the prog and restarting it eventually got everything back to normal.

However, quite often what I DO notice is that a browser (any browser) will, for want of a better description, 'seize up' in stages while running MDWS and eventually stop responding. Repeated fast manual refreshing just makes it worse and the only cure is to exit the browser and start again. MDWS is very resource hungry as all the data processing to display what you see on the screen is performed by the browser locally and the more panes you have the quicker it will get to that stage. Five panes is about the maximum and higher than this is not sustainable from experiments I've made in the past..

Past making those comments there isn't much I can do but see if reloading (i.e exit/restart) the browser gets things back to normal.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on November 03, 2017, 08:46:07 PM
Well it has been working fine today must of been down to the web browser i use, sorry about that
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: ktz392837 on November 04, 2017, 03:48:23 PM
Can anyone help with the meaning of the values in the XTR section? Eg what does B: 10 mean etc?  TIA
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 05, 2017, 08:39:42 AM
They were added just under a couple of years ago at the request of one of the resident Kitz experts at stats analysis - there is a discussion starting roughly here (http://forum.kitz.co.uk/index.php/topic,17054.msg313897.html#msg313897) if you can get your head round it.

In there is also this on basically what they mean (originally from Kitz web pages) but not all these are displayed on MDWS as the data is not available

Reed Solomon Parameters

MSGc = Number of bytes in overhead channel message
K = Number of bytes in the DMT Frame
B = Number of bytes in the data frame
N = NFEC = Length of codeword         (N = K + R)
R = RFEC = RS check bytes / Amount of redundancy
S = Symbols per codeword
T = Number of dataframes in an OH subframe/ Data frames over sync bytes
Q = Number of RS codewords per DTU (g.inp)
V = Number of padding octets per DTU (g.inp)

Interleaving Parameters

I = Number of Interleaver branches / The interleaver block size in bytes.  Should be a sub-multiple of N
M = Incremental delay / Number of Mux Data Frames in FEC Data Frame/RScodeword
D = Interleave Depth      (D = M * I + 1)
L = LSYMB = Number of bits per symbol in the latency path / Number of bits in PMD data frame


Interleaving introduces a delay of M * I * (I-1)
Actual delay - ADSL  shown in ms =  [S x D]/4   
Actual delay - If retransmission is used this specifies the actual value of the time independent component of the delay due to retransmission only.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on November 06, 2017, 05:03:42 PM
Minor

I may be the first thats gone through this sequence

Line had G.INP for months
Vectoring went on recently and user kwillers was displayed as "kwillers GV" on MyDSLWebStats - correct

Port moved today as there was fault on my current port

Vectoring still on but G.INP disabled, hope it goes back on soon or my ES will be huge :-)
Anyway userid is showing "kwillers g" which is correct for G.INP

No mention of the V for vectoring   

Telnet data

Stats recorded 06 Nov 2017 17:02:26

DSLAM/MSAN type:           BDCM:0xa48c / v0xa48c
Modem/router firmware:     AnnexA version - A2pv6F039g1.d24m
DSL mode:                  VDSL2 Profile 17a
Status:                    Showtime
Uptime:                     0 hour 32 min 53 sec
Resyncs:                   7 (since 18 Oct 2017 15:57:25)
         
            Downstream   Upstream
Line attenuation (dB):     19.1      0.0
Signal attenuation (dB):   Not monitored      
Connection speed (kbps):   74126      11722
SNR margin (dB):           7.6      6.7
Power (dBm):               13.5      7.6
Interleave depth:          1      1
INP:                       0      0
G.INP:                     Not enabled      Not enabled
Vectoring status:          1 (VECT_FULL)      

RSCorr/RS (%):             N/A      0.0004
RSUnCorr/RS (%):           N/A      0.0000
ES/hour:                   32.2      3.42
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 06, 2017, 05:19:32 PM
It's early days on vectoring and haven't seen this before.

There was an assumption that you couldn't have vectoring without G.INP when this was set up but as your router is reporting vectoring is on at the moment (vectoring is reported in real time from each upload) then that can't be right. I've altered it for now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on November 06, 2017, 06:30:32 PM
I just hope that vectoring does not stop G.INP gong back on or I'll be turning all the light red in no time !!!!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: nivek1612 on November 07, 2017, 10:42:43 AM
G.INP back on approx 16 hours after the port move. But i was throwing so many errors it was bound to be quick

 
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on November 11, 2017, 09:14:44 PM
Unable to logon anymore has something changed? Logon boxes are now displayed under the bottom border.

Nevermind refreshed page and all boxes displayed.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 27, 2017, 07:18:18 AM
I am getting bombarded with resync emails is there an issue
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on November 27, 2017, 10:25:27 AM
I am getting bombarded with resync emails is there an issue
Yes, looks like your modem managed to upset everything...

The counters that record the length of time the line has been up had both been reporting figures stuck at the same value since around 14:00 on 26th Nov until 19:26 when the line went down. The line was down until 06:36 this morning when the line came back up but the counters were stuck again - but at a much lower value which then initiated a resync alert. Trouble is it stayed down stuck at the same value and since the system expects the counter to increase every second (or be lower when a resync occurs) that the system got confused by this unexpected behaviour and tried to record and send alerts every minute until another restart/resync at 07:41 got everything at your end running okay again.

You can see the static values on your Uptime graph.

Past that I don't have the time to investigate, it took nearly two hours to work it  out this far! Never seen this modem behavior before though since 2014.... Whether it's a faulty modem or not I have no idea but it seems possible.

EDIT:
Wonder where the 20,000+ ES count the evening before came from? It was still extremely high this morning before the resync
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: daveesh1 on November 27, 2017, 02:05:05 PM
Thanks for that Tony. I forced the re-sync at 07.41  since then I have only had on email which is the one I knew was coming. Have no idea what caused all the errors yesterday but I am paying for it now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: machare on November 30, 2017, 07:50:53 PM
If you donate for MyDSLWebStats what benefits are available apart from being able to store more days data?

Can you see additional data such as Traffic for example.   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2017, 09:03:31 AM
Hi

There isn't a specific listing but most of the facilities are explained on the site's Homepage (https://www.mydslwebstats.co.uk/) including screen grabs of the improved GUI cf what you are seeing currently. The change log also has some details but is not up to data. I'll try to come up with a specific lost once I can find some time. There is no Traffic data available.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: machare on December 01, 2017, 12:10:28 PM
My question was really about whether there any additional features are made available if you make a donation, apart from being able to store more data.

What would be really nice would be able to see a list of users and such parameters as their connection speed,  and or SNR margin/attenuation.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 01, 2017, 12:44:36 PM
My question was really about whether there any additional features are made available if you make a donation, apart from being able to store more data.

What would be really nice would be able to see a list of users and such parameters as their connection speed,  and or SNR margin/attenuation.

You need to look and read where I said please as it's explained there and there's also a Help system.

With the facilities you already have you can see the data you mention and around 45 other parameters by working through the user list as you appear to have found already. If you donate, there's also a single page listing many more important parameters for all active users.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on December 01, 2017, 01:51:26 PM
My question was really about whether there any additional features are made available if you make a donation, apart from being able to store more data.

What would be really nice would be able to see a list of users and such parameters as their connection speed,  and or SNR margin/attenuation.

£10 is hardly going to break the bank for what is a very useful facility even if you don't get anything extra, which you will.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: machare on December 01, 2017, 04:13:08 PM
£10 is hardly going to break the bank for what is a very useful facility even if you don't get anything extra, which you will.

I am curious as to how you have found the facility useful?  All the information it displays about my own connection is also available directly from DSLStats.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on December 01, 2017, 04:27:19 PM
I am curious as to how you have found the facility useful?  All the information it displays about my own connection is also available directly from DSLStats.

But only a maximum of 24hrs worth of data rather than a years worth on one screen,  you can't see other user's information etc etc
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: machare on December 01, 2017, 04:32:40 PM
Thank you.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: 22over7 on December 01, 2017, 04:40:28 PM
Quote
I am curious as to how you have found the facility useful?

I find it (MSWS) useful, as someone who struggles to interpret raw modem stats, because of the graphical presentation, that exposes puzzling phenomena. It's an educational tool.

I'm curious as to what you mean by "traffic". It seems almost a philosophical question.  How might that be conjured out of raw modem data, with no knowledge of higher-level protocols? It seems to that if that is a measurable quantity, it can only be something upstream routers could, er, guess at. I wonder (and would like to know, genuinely)  how ISPs that impose traffic limits measure it.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: licquorice on December 01, 2017, 04:46:02 PM
DSL stats can be configured to monitor traffic.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: machare on December 01, 2017, 04:52:13 PM
I find it (MSWS) useful, as someone who struggles to interpret raw modem stats, because of the graphical presentation, that exposes puzzling phenomena. It's an educational tool.
 

DSLstats does show nice graphs of many parameters.

Quote
I'm curious as to what you mean by "traffic". It seems almost a philosophical question.  How might that be conjured out of raw modem data, with no knowledge of higher-level protocols? It seems to that if that is a measurable quantity, it can only be something upstream routers could, er, guess at. I wonder (and would like to know, genuinely)  how ISPs that impose traffic limits measure it.

For me, DSLstats stats shows a graph of Traffic up and down in KB/min.  My Zyxel VMG8924-B10A router does have counters which I can see on its GUI.   
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on December 01, 2017, 07:19:03 PM
Donating allows you to increase the graph size also. I don't think I could go back to using the smaller graphs now.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on December 01, 2017, 07:50:09 PM
I also find it useful to be able to look at my home/work & brothers connections, I make a donation every year. A lot of work and hours, not to mention money goes into keeping it running. The same goes for the Kitz forum/website which I also donate to.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: fergie on December 05, 2017, 10:37:12 AM
Hi all!  Long time lurker, first time poster!

Just got myself a new TP-Link Archer VR2800 to replace my failing Asus AC68U (I tried the AC88U, but it died within 12 hours!)

Followed instructions at http://forum.kitz.co.uk/index.php/topic,14377.0.html and now have DSLstats up and running on a Raspberry Pi and feeding into MyDSLWebStats :)

Now just need to wait an age for DLM to restore my speeds, caused by damn flaky Asus firmware!

You may want to add the router to the compatibility list ;)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 05, 2017, 03:01:23 PM
Okay, done  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jaydub on December 10, 2017, 09:57:42 PM
How does MDWS identify your ISP.

I'm currently with Aquiss so my ISP is Entanet owned, yet it is showing as Talk Talk in the All Users view.

Is this something I have configured or is MDWS using the IP address to tray and work out which ISP you are with?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on December 10, 2017, 10:10:02 PM
Probably by IP block
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jaydub on December 11, 2017, 12:21:58 PM
Reckon so.  Migrated to IDNet overnight and MDWS has picked up that change OK.

Just slightly bemused why an IP address for Aquiss that comes out of an Entanet block was showing as TalkTalk.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 11, 2017, 02:56:52 PM
Because the IP that was recorded in the database for you was from a Talk Talk block (from January I guess when you first registered, maybe it had been reallocated since). When you started uploading again yesterday after a very long time it updated to Entanet around 23:00 on a periodic check but you then resynched and it went to IDNet....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jaydub on December 11, 2017, 03:48:07 PM
Because the IP that was recorded in the database for you was from a Talk Talk block (from January I guess when you first registered, maybe it had been reallocated since). When you started uploading again yesterday after a very long time it updated to Entanet around 23:00 on a periodic check but you then resynched and it went to IDNet....

Thanks for the confirmation, Tony.

There was certainly a large gap in my uploads.  Because I am uploading using a Docker VM on a Mac, I don't tend to run it after a machine restart unless I consciously want to track what's happening with my connection.

I was on a Pulse8 TTB connection until a month ago, so the TT reference must have been from prior uploads.

I did start uploading again from the early hours on the 3rd December and had what looks to be an interrupted upload for 3.5 days.  I have had some technical issues with Kitematic since Friday, which I only spotted yesterday evening, which will explain a further restart of the upload yesterday.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on December 11, 2017, 07:53:36 PM
Has the server just been restarted?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 11, 2017, 08:50:04 PM
No, there was a power cut around 19:35 and the modem/router is not currently on a UPS (new battery awaited) so it resynched....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on December 12, 2017, 09:14:58 AM
Something must have restarted because although I didn't have dslstats running during the day yesterday (I started it after your blip), at 19:51:39 I was sent an email to say I hadn't been uploading since 00:20:37 when I shut down the previous night (I have it set to not repeat the emails).

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adrianw on December 12, 2017, 06:45:50 PM
I want to register another line in a different location with MDWS, now that it has something monitorable rather than a HH5.
No matter what variations of real name, user name, email address etc that I tried, I get "You already have an existing registration on MDWS!".
What am I missing?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 12, 2017, 07:30:46 PM
You cannot normally register another user name on a terminal with an existing registration. Using another terminal will be okay as long as the details have never been used with MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adrianw on December 12, 2017, 07:45:18 PM
Thanks Tony. Yes, the PC I am attempting to register from has been used with MDWS. I'll try a laptop which I don't think has been used. Though, if it is the IP address which matters, (the same due to NAT), I'll be reduced to seeing what happens from a 4G Android phone.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: adrianw on December 12, 2017, 11:54:49 PM
Doing the whole set up of my second account from a 4G Nexus 5x worked (different email address needed), and I can now view both lines' 24 hour stats in a couple of panes for a single PC log on. Bliss. I will be able to easily monitor the progress of DLM on a line I have just had switched from BT to AAISP. User adrianws if anybody is interested. My home line (adrianw) will be migrating from Plusnet to AAISP early next year.

My thanks to the authors of the  HG612 firmware mods, DSLstats and MDWS.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jabz on December 14, 2017, 08:43:22 PM
Hi Tony
it appears a few more of the ip ranges that my ISP uses is blocked by mydslwebstats. As a result, my stats have been wiped off the server as it couldn't update for a while.

I tried contacting you via email but you address is failing with an error (sent via gmail), error is 454 TLS not available due to temporary reason.

Here is their whole netblock for my ISP, please unblock all the range.
The Spark retail broadband IP Address range is in AS4771.

https://bgp.he.net/AS4771#_prefixes

thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on December 14, 2017, 09:24:40 PM
Hi

Yes, you've not uploaded since August 6th, hence the deletion in November. The problem mail I have no idea - that response is often used by Google to greylist a message as possible spam but I don't see anything here. You could try changing your email (or I can do that for you) to a non-Google address and see if that works I suppose. I assume you have upload fail monitoring turned on, if so then there have been no bounces here and I assume you have only just recently  noticed the lack of uploads.

Sorry, but there is no way I can find the time to get that list into the system, it's way way too big and there are several different places it could be happening. It is one of the problems of allowing non-UK users which wasn't the original intention. The server suffers all day long from attacks and there are a lot of blocking systems in use although New Zealand isn't one of the intentional blocks..

The best I can do is, as I've done before, to allow the current IP block you are using if you PM me your current IP for both lines if different. Can you get a fixed IP range to use?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Chrysalis on December 26, 2017, 12:54:20 AM
I dont really know whats limited if you dont donate as I donated very close to when it got launched since I found the project very useful and I know it helps others as well.  I have since donated more times and will continue to do in future.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: sincx on December 31, 2017, 06:44:48 PM
Hello,

I'm a little confused as MyDSLWebStats is not collecting any uploaded data from my PiZero running DSLStats 6.1. Logged in as sincx. It was all working until the 29th December.

I've checked that the DSLStats is running and getting data from my modem and the MyDSLWebStats Configuration page  on DSLStats v6.1 confirms I'm connected to MyDSLWebStats.

I also have Internet connectivity from the PiZero.

I've tried everything I can think of including rebooting the PIZero.

I'm confused and would appreciate any help.

Thanks and a Happy New Year,

sincx
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 01, 2018, 10:35:47 AM
Hi

Sorry for delay in replying...

I've had a look around and can't see anything at this end that is or would stop you uploading. You can obviously see the MDWS server and are using it this morning. I put a monitor on the upload system and cannot see any sign of anything being uploaded by you reaching the server or being rejected etc. This is not IP related as yours hasn't changed for ages and you would not see the server if it was blocked.

There were no server events at this end around the point you stopped uploading (18:53 was the last upload on the 29th).

At the moment I have few ideas but it does look like it's something at your end but have little idea what. Don't know what would happen if your RPi clock was way out (like months or years) maybe? I assume there are no relevant events in the DSLStats Events Log like multiple 'Cannot connect to modem' or continual Timeouts etc?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: sincx on January 01, 2018, 11:48:00 AM
Dear tbailey2,

Thanks for the reply. I left the piZero off last night and this morning I reverted to using DSLStats v5.9 instead of v6.1.  It is now uploading OK.

The PiZero is running Raspian 8 Jessie. I had updated to DSLStats v6.1 on the 29th December !

There appears to an issue with DSLStats v6.1 not uploading to the server in this configuration.

Many thanks for your help

sincx
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 01, 2018, 12:25:47 PM
Okay although it would have saved effort if you had mentioned the upgrade coincided with the failure....

The minimum recommended version of DSLstats for use with MDWS is 6.0.6 as prior to that there were various bugs affecting RPis, unwanted multiple uploads, plus Vectoring was not supported. This isn't enforced at the moment but may well be in the future. I guess there are differences in the software on the PiZero (I only know it's smaller so presumably you are short of space)  compared to the version DSLstats was compiled with or for but that's not my department. Maybe reverting to a 'normal' earlier compatible version of the RPi would be better for use with MDWS if there is a problem otherwise?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: sincx on January 01, 2018, 12:42:49 PM
Dear tbailey2,

Apologies for not stating that i had updated to DSLStats v6.1. I did not realise that the update and failure to upload were related as I had been directly monitoring the DSLStats on the Pi via VNC.

I'll look into it further to whether the PiZero is compatible with the v6 series software.

Thanks again for your help it is much appreciated.

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 01, 2018, 12:43:27 PM
There are currently 57 people using the RPi V6.1 version of DSLstats and successfully uploading to MDWS. I don't know how many of these use the Pi Zero, so the limitations of the Pi Zero could possibly be the explanation. V6.1 does use a little more memory because of its support for VDSL2 profile 35b, but I doubt if that's the explanation. It would have been useful to see if there were any relevant entries in the event log.

It might be worth trying version 6.0.6 as Tony suggests. You can download it here: http://dslstats.me.uk/files/dslstats32RPi-6.0.6.zip

Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on January 01, 2018, 12:50:43 PM
Hi both,

For information, I updated both of the RPi Zero W's I look after (son & daughter) to DSLStats V.6.1 as soon as it became available without any issues, also running Raspbian Jessie with all latest updates on 16Gb. memory cards.

Same applies to my own installation running on an old Mk.1B RPi.

Edit:
MDWS RPI Zero W ID's, smpay-37 & cruth211
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: sincx on January 01, 2018, 05:32:26 PM
I've tried v6.06 and that also fails to upload. and so I've temporiarly gone back to v5.9  I think that a re-install of Raspbian and the  DSLStats V.6.1 is required on my PiZero.

Many thanks for all the advice
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tiffy on January 01, 2018, 05:59:20 PM
Don't know how long your RPi has been in service running DSLStats 24/7 but another point to bear in mind is that memory cards do have a limited life expectancy and DSLStats program is much more demanding by comparison to the other functions such as photo image or music files storage normally associated with them.

As you can still run earlier DSLStats program revisions successfully, partial program corruption is probably not the case, card failure is usually more dramatic and prevents booting, however just something to be aware of.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: NewtronStar on January 01, 2018, 08:36:04 PM
one thing I've noticed with latest Raspbian Stretch it does not have any telnet loaded in this firmware you will have to install it yourself, yet DSLstats works fine on Stretch without telnet you will just not be able to telnet into the RPi.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 01, 2018, 10:39:46 PM
Quote
DSLstats works fine on Stretch without telnet

Yes, DSLstats has its own telnet client built in.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: dgilbert2 on January 12, 2018, 07:25:35 PM
Just to let you know that the Donate system still seems to have problems with the error message below. I donated manually in the end  :)

"Cannot read property 'replace' of undefined"
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 12, 2018, 07:51:12 PM
Don't think I've ever seen that before? When did that happen? How do you donate automatically then?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: dgilbert2 on January 12, 2018, 07:57:10 PM
I press "donate" from MyDSLWebStats, enter a value, press donate and then the error occurs.

I manually donated a few days ago to the email which you picked up manually  :)

All the emails I sent about this bounced  :(
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 12, 2018, 08:49:11 PM
The error is from Javascript and that runs locally in your browser on your terminal. There is no mention of replace in the code used to invoke the PayPal form that is sent to you where you type your details into so looks like it's in the PayPal code itself since it happens when you try to submit the donation. All other donations have gone through 'automatically' quite happily before and since yours so I don't know what is happening. If you try to send a manual donation the mail that arrives here is encrypted and can't be read automatically hence the mail you received -
- which I typed myself since the original mail was totally unreadable.

As for mail bounces I have no idea ..... since they don't arrive here. What is the reason given for the bounce? If it doesn't like our server (and I'm not aware of any current problems elsewhere) then can you try a different email provider please? Google sometimes greylists mail thinking it's spam but that's supposed to be temporary but sometimes isn't..

What Browser are you using?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: dgilbert2 on January 12, 2018, 09:01:25 PM
I've done some testing for you.

I have the same problem on Windows 10 - Chrome, Edge, Firefox.

Also on a Windows 7 machine - Chrome, Internet Explorer.

All very strange, but nothing works for me.

Email error (using gmail);

Message not delivered
There was a problem delivering your message to tonyb@mydsl*******uk. See the technical details below or try resending in a few minutes.
The response was:
454 TLS not available due to temporary reason

Hope some of this helps  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 13, 2018, 09:03:13 AM
I cannot find anything further on the script error plus someone made a donation successfully shortly afterwards in the normal way - I suspect to see what happened  ;)

The mail problem should be okay now after a change here but needs more investigations, it seems to be limited to Google mail.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: dgilbert2 on January 13, 2018, 09:36:22 AM
Out of curiosity I just tried sending you a small test donation. This time I entered my card details rather than pressing the login to Paypal and this time it worked.

Must be something on my Paypal account?!

At least I know how to get it working now  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Westie on January 14, 2018, 11:37:13 PM
Are there plans to add the Technicolor DGA4130 to the drop-down list of modem/routers on MDWS? Is there an issue with it not being on the MCT list (only the non-existent DGA1430)?
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 15, 2018, 08:45:14 AM
I'm not aware of this but I see it's been pointed out in the past (via Google) that 1430 may be a typo on the MCT list but no one has ever confirmed this that I can find but I have no knowledge or control over that.

I'll add it if someone can verify that it works but current Technicolor refs start TGnnn and there are no DGAnnn listed on MDWS, only DGnnnn for Netgear (maybe a rebrand?).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 15, 2018, 10:07:18 AM
I've been using the DGA4130 for a while. It does have to be unlocked to obtain telnet access, but with that proviso I can confirm that it works very well indeed. I'm quite certain that the 1430 in the MCT list is a typo, because DGA1430 doesn't exist. So yes, please do add it to the MDWS list ,Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 15, 2018, 10:23:41 AM
Is it a Technicolor then please despite the ref letters? MDWS has them as Thom/Tech....
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 15, 2018, 11:29:26 AM
Yes it is Technicolor (which is a Thomson company).
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 15, 2018, 12:11:24 PM
Okay it's added (As a Thom/Tech)..
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: roseway on January 15, 2018, 03:58:39 PM
Thanks Tony.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Westie on January 15, 2018, 05:11:57 PM
Thanks from me too. MDWS profile duly amended!
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tommy45 on January 18, 2018, 04:14:36 AM
MDWS  showing my connection as down from 03:09 today,  no loss of sync or networking issues that I'm aware of, is it something your side?  the HG612 Modem Stats app, seems to be working as normal
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: banger on January 18, 2018, 04:48:43 AM
Mine still up using DSLStats was thinking power cut at Tony's but cant be.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Ronski on January 18, 2018, 06:10:40 AM
MDWS  showing my connection as down from 03:09 today,  no loss of sync or networking issues that I'm aware of, is it something your side?  the HG612 Modem Stats app, seems to be working as normal

You've possibly got a hung instance of hg612 stats, check the time the last stats where read in the GUI.

If it's not current restart the PC.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 18, 2018, 08:35:00 AM
He's been up since 04:34 and no problems here...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on January 24, 2018, 02:02:39 PM
Power is out here for past 15 mins, not sure what's left on UPS poss 30 mins so when it goes ..... ???

Okay back up again. Overhead power cable fault
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Westie on January 24, 2018, 03:31:33 PM
Thanks for the note, Tony. I've been out today, and initially thought something was wrong my end when I noticed the gap in the MDWS trace!

I really appreciate the time and effort you put in to maintaining the site. It's a great tool to be able to compare one's own figures with others.

George
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Westie on February 08, 2018, 12:08:42 AM
Could someone please point me to where I can change the ISP shown on MDWS? (I changed from Plusnet to Vodafone just over a week ago.)

Or is it automatic, & I just need to exercise a little patience?  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: jelv on February 08, 2018, 08:55:24 AM
See http://forum.kitz.co.uk/index.php/topic,14361.msg360386.html#msg360386 in this topic.

Reckon you need to wait for Tony to come along.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 08, 2018, 11:02:04 AM
There is no reverse DNS published for your current IP Block so trying to look up the ISP automatically (using a provided function) fails and just returns the IP address. The IP change itself was detected by MDWS within a couple of minutes of the change but it leaves the ISP as it was under those circumstances which are fairly rare.

A manual WHOIS will get it though. I've changed it.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: Westie on February 08, 2018, 01:45:57 PM
Thanks Tony.  :)

There definitely seems to be something 'odd' about Vodafone. Unless I manually set the DNS servers, my own router declares "DNS fail" or something similar, and I get no internet access even though I have sync on the broadband. Using the Vodafone supplied router, I have no such trouble most of the time...although that did lose the internet for 10 minutes the other night without losing sync. However, the VF router doesn't give line stats, so combined with its unreliability it's a no-go for me.

EDIT:
Curioser and curioser...the Vodafone DNS servers are now working  ???
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: DrLlama on February 08, 2018, 11:30:05 PM
I am unable to access the MyDSLWebStats site from my home IP (202.67.x.x) but works fine from my work address (posting from there now), both IP's are in Australia one on Exetel (works) the other on Dodo (blocked?).

What, if anything can be done to fix it?

Thanks
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: j0hn on February 09, 2018, 02:29:26 AM
Send Tony (tbailey2) a PM with your home IP.
http://forum.kitz.co.uk/index.php?action=pm;sa=send;u=7779

It's primarily a UK service and I'm pretty sure Tony blocks entire IP ranges for security reasons.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: DrLlama on February 09, 2018, 03:26:38 AM
Thanks j0hn, pm sent.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 12, 2018, 04:50:52 PM
hi Tony

Could I check please if there is an issue between mdws and tbb charts? If I click on the latency link I get no charts and the only option on the ISP list is any...

thanks.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 12, 2018, 07:03:18 PM
There was a problem  - a number of background processes hadn't run since Sunday morning due to a server crash early in the morning. It automatically restarted at the time but not everything did successfully. It's running now but there were a lot of delayed resync and other alerts sent out at 18:40 in one go.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 12, 2018, 07:29:39 PM
thanks for sorting  :)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: gt94sss2 on February 13, 2018, 10:48:56 PM
There was a problem  - a number of background processes hadn't run since Sunday morning due to a server crash early in the morning. It automatically restarted at the time but not everything did successfully. It's running now but there were a lot of delayed resync and other alerts sent out at 18:40 in one go.

I presume something similar must have happened today

My line resynced at 01:32 and I got an (expected) "G.INP has now been disabled for your line" message about 5 minutes later but the Line Resync alert itself didn't turn up until 11:36

Many thanks for your continued support of this wonderful facility
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 14, 2018, 08:42:11 AM
Yes, I've altered a few things to see if it stops.

EDIT
There seems to be a DNS problem so I've changed the provider...
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: tbailey2 on February 14, 2018, 08:44:46 AM
thanks for sorting  :)
BTW you are still on the list from ages ago to get alerts when a cab gets G.INP and it's ECI.... Not seen one yet.

I am currently on 3dB/ECI if you look but nothing to do with that test.
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: skyeci on February 14, 2018, 08:48:05 AM
cheers. I still do check once a day  ;D  lol...
2 years come april for its elusive return... ::)
Title: Re: MyDSLWebStats - Remote Web-based Monitoring
Post by: kitz on March 04, 2018, 02:33:23 PM
Due to Tony's sad announcement here (http://forum.kitz.co.uk/index.php?topic=21151.0) regarding the impending closure of MDWS, I'm splitting off that post and locking this thread.   
All comments should be posted in the new thread here (http://forum.kitz.co.uk/index.php?topic=21151.0).

MyDSLWebStats (MDWS) is closing down on Monday 12th March 2018

It is with some regret that I have to announce the closure of MyDSLWebstats. There are many reasons behind this but it's mostly due to the fact that it's taken over my life to the extent that it is about to become a victim of its own success as it's just proving too much for me to cope with. The server is also showing signs of overload recently with a rapidly increasing user base and would likely need a rewrite to get over this. I also have increasing difficulty coding/concentrating these days now I'm 73.

Another major problem is the looming implementation of GDPR (General Data Protection Regulation) on May 25th. Since I am advised that even as an individual I hold sufficient data on everyone Registered as using MDWS to come under its umbrella, I just don't have the resources or effort needed at my age to get involved in meeting the many requirements it enforces or face the possible penalties it imposes so all that data has to go.

MDWS started as a pure experiment in 2014 with no idea if it was even feasible but it eventually was up and running with a lot of unpaid effort from all those involved (BaldEagle1, roseway, Ronski and tbailey2). We have since lost contact with one of the founding contributors (BaldEagle1) who wrote HG612 Modem Stats which now runs unsupported, which has put more pressure on roseway  when changes are needed to DSLStats.

So on Monday 12th March 2018 MDWS will become unavailable. If anyone wants a refund of any recent donation(s) they made I can do so on request but please do so quickly. Please cancel any standing orders related to donations and you will need to stop uploading by the cessation date else you will just be wasting your bandwidth.

MDWS is no longer accepting Donations or new Registrations as of today.

Thanks for your support over the years and hope the facility was useful to you.


On behalf of the members of the kitz forum, I'd like to thank Tony for creating MDWS and keeping it running for the past 4 years...  and also wish him all the best for the future.