Kitz ADSL Broadband Information
adsl spacer  
Support this site
Home Broadband ISPs Tech Routers Wiki Forum
 
     
   Compare ISP   Rate your ISP
 
Please login or register.

Login with username, password and session length
Advanced search  

News:

Pages: 1 2 [3] 4 5 6

Author Topic: DSLstats after the demise of MDWS  (Read 4869 times)

g3uiss

  • Reg Member
  • ***
  • Posts: 167
    • Midas Solutions
Re: DSLstats after the demise of MDWS
« Reply #30 on: March 06, 2018, 06:10:45 PM »

Hi All

Just in case Iím always willing to help with the GDPR.

I always used HG612 stats, but will now change to DSLstats.

From what I read going forward  the two differences really are only the loss of the ability to see a large range of users stats, and itís availability from any device anywhere.

The first issue isnít easily overcome but Iím sure KITZ could create an area here for members to post any graphs they require input or advice on from DSL stats, and the second exists to view data locally on a network via a browser already.

All the work is much appreciated I can help if necessary as well with server space and SMTP servers for non ISP specific email, as I did for some time for MDWS.

Tony
Logged

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31060
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #31 on: March 06, 2018, 07:09:34 PM »

I could make it a CSV file, but DSLstats has some users in countries where they use a comma as a decimal point.

I don't think it makes much difference Eric, you'd still need a function to read the file and break it down into an array.
Thus explode for space delimited files or something like fgetcsv for csv files.   The end result is the same. 
Maybe its just me but I find explode easier for files which dont contain text strings that contain spaces.
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31060
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #32 on: March 06, 2018, 07:22:12 PM »

The first issue isnít easily overcome but Iím sure KITZ could create an area here for members to post any graphs they require input or advice on from DSL stats, and the second exists to view data locally on a network via a browser already.

I already allow attachments and with all due respect I think a lot of people fail to appreciate that I have my own running costs.   :(

Not wanting to moan but one of the largest parts of my storage is already graphs from stats as it is and as I mentioned on the main site earlier this year I am going to have to buy additional storage myself this year.   I'm one of the few places that allows them.  Whilst it may only be £10+VAT more per month, my hosting costs have already increased this year due to inflation.

My income from advertising has been a zilch for the past 3 months due to ad-blockers.  Not a single penny this year!   ISP clicks have totally dried up because of cash back sites.    I get very few donations and if it wasn't for a couple of people who do support then to be quite frank I'd be up the creek without a paddle long before now.       
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

g3uiss

  • Reg Member
  • ***
  • Posts: 167
    • Midas Solutions
Re: DSLstats after the demise of MDWS
« Reply #33 on: March 06, 2018, 07:40:19 PM »

I already allow attachments and with all due respect I think a lot of people fail to appreciate that I have my own running costs.   :(
 

Sorry didnít want to suggest anything that would increase your costs or admin. It was just a thought to address the concerns users seem to have. For me Iím just interested in seeing my stats periodically.

I know you may have concerns about GDPR (which if you need Iím happy to help) but if users want a facility perhaps some donation for use of certain areas appropriate. You do great work maintaining this site. Great stuff canít always be free.

Again sorry for any concern my post created

Tony
Logged

d2d4j

  • Reg Member
  • ***
  • Posts: 645
Re: DSLstats after the demise of MDWS
« Reply #34 on: March 06, 2018, 08:27:27 PM »

Hi

I was thinking about this, and from what I can understand, part of the issue is been able to view graphs publicly, including other users graphs

I know itís not the same, but I was thinking perhaps about a gallery to allow registered users to upload their graphs.

Please would anyone be interested in this and if so, what would you be prepared to pay per year

This would give you full gallery access from anywhere with broadband on any device (including mobiles iPads etc through an app or browser)

Many thanks

John
Logged

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31060
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #35 on: March 06, 2018, 08:48:23 PM »

Quote
I was thinking about this, and from what I can understand, part of the issue is been able to view graphs publicly, including other users graphs

I believe so.   Hence my suggestion for making each user responsible for their own graphs and no problems if they want to publicly share with others.

Quote
I was thinking perhaps about a gallery to allow registered users to upload their graphs.
If the graphs are images, then file sizes and storage could soon mount up.
Using raw data from DSLstats and then something like google charts to draw the graphs would keep storage to a minimum.

Alternatively there's also this which JID did a couple of years ago.    In its current format its only doing live graphing though and I'm not sure about historic info. 
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

d2d4j

  • Reg Member
  • ***
  • Posts: 645
Re: DSLstats after the demise of MDWS
« Reply #36 on: March 06, 2018, 09:40:17 PM »

Hi

@kitz thank you - yes your totally correct sorry

In that case, for a simple quick solution, I could create a single domain with sub domains, for users to ftp the webserver file into their folder for subdomain and then visible from anywhere

Their time frequency would be up to themselves to decide (minute, 5 minutes hourly etc) although it would not keep historic data so guess it might be simplistic not to do it as users would use dslstats webserver

The current users of our hosting could just do this anyway, as they have full hosting capabilities as well as email

Itís a hard one and just shows the excellent work tony did

Many thanks

John
Logged

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39098
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #37 on: March 06, 2018, 10:51:15 PM »

My plan is that the data which DSLstats saves (and perhaps uploads somewhere) will have a filename which includes the date and time, so history will be preserved for as long as the user wants and the store has capacity. If all the available data is saved every minute, this will amount to about 4 GB a year.
« Last Edit: March 06, 2018, 11:01:09 PM by roseway »
Logged
  Eric

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31060
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #38 on: March 07, 2018, 12:05:06 AM »

Quote
about 4 GB a year.

That's a bit larger than I anticipated.   :(
I have a HG612 modem stats log from 25/07/2016 which is 660MB

But when I look at the data contained, it appears to be only basic line stats.   I guess its bits/SNR per tone QLN/hlog etc type data which will increase file size.

Code: [Select]
25/07/2016 20:13 79987 20000 7.0 12.5 5.9 5.9 83805 30404 PTM 850 18 0 390 731 0 218562 0 0 0 0 60.712 0 390 0 132124761 76362 0 850 18 0 0 3400835 0 0 0 0 1 1 122 62 12 0 0 0 0 0 0 0 0.7 18.5 28.1 0.0 11.0 24.5 38.5 0.6 18.3 28.1 0.0 10.7 24.4 38.5 14.2 13.1 12.3 0.0 7.0 7.0 7.0 -6.0 -25.6 5.6 0.0 12.0 7.4 7.4 Showtime 0 0 L0 17a ON ON No Showtime 0.0 0.0 239 236 1 1 23 5 0 16 0.0955 0.3771 20104 5410 30 0 30 0 3547761395 0 29704784 0 0 0 0 59 59 0.00 0.00 1.65 6.15 0.00 0.00 116.09 202.87 588 12 VDSL2 0 0 0 0 0.00 0.00 0.00 0.00 0 0 1 0 0 0 7 0 0 0 0 0 0 0 NO_G.INP 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.00 0.00 0.00 0.00 0.00 0.00 0 0 0.00 0.00 0.00 0.00 0.00 0.00
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

burakkucat

  • Global Moderator
  • Senior Kitizen
  • *
  • Posts: 22242
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: DSLstats after the demise of MDWS
« Reply #39 on: March 07, 2018, 01:05:42 AM »

. . . when I look at the data contained, it appears to be only basic line stats.

Yes, I can confirm that the data is that harvested from "xdslcmd info --stats" and "xdslcmd info --pbParams" commands, along with selected deltas.
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39098
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #40 on: March 07, 2018, 07:22:50 AM »

As suggested above, the considerable majority of that 4 GB is in the per-tone data, not the main stats. What Tony did to cope with this is to have the per-tone data uploaded only once per hour. If I stick to this arrangement, the annual total will be a lot less.
Logged
  Eric

skyeci

  • Kitizen
  • ****
  • Posts: 1113
    • skyECI line stats
Re: DSLstats after the demise of MDWS
« Reply #41 on: March 08, 2018, 10:42:05 AM »

I know its slightly off topic but with MDWS closing will there be any way we can somewhere find other TBB charts. Its useful to see other connections latency etc. I know not everyone possibly uses this feature but be good if we can somehow see other charts that were linked from mdws...?

Logged
Sky Fibre Pro -  Billion 8800nl v1 (bridge mode) + Opnsense(i5 Qotom) with IPV6 , AC-88U WAP- ECI cab, G.INP disabled 16th April 2016.
 
click for  line stats

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39098
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #42 on: March 08, 2018, 11:01:18 AM »

Sorry, but I'm not going to be able to fit that in.
Logged
  Eric

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31060
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #43 on: March 08, 2018, 12:11:44 PM »

Just in case Iím always willing to help with the GDPR.

Thank you.    I'm currently trying to wade though the minefield myself to aid better understanding, but there is one area I'm still hazy about.   There's a couple of things I do need to check first, but if you don't mind I may at some time pick your brains if I get stuck.
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39098
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #44 on: March 08, 2018, 03:12:26 PM »

Another option for me is to extend the "delete snapshots after X days" to indefinite.
That way allow the user to store as much historical data as they please.
I've not looked into the MWDS folder as of yet due to my own time constraints, but I assume it's an a format that is excellable...

It's already possible to configure snapshots to never be deleted. Simply untick the option "Delete snapshots older than".

The format for the MDWS uploads is CSV for the four tone related sets (SNR per tone, QLN, HLog and Bitloading) and space separated for the regular stats.
Logged
  Eric
Pages: 1 2 [3] 4 5 6