Kitz ADSL Broadband Information
adsl spacer  
Support this site
Home Broadband ISPs Tech Routers Wiki Forum
 
     
   Compare ISP   Rate your ISP
 
Please login or register.

Login with username, password and session length
Advanced search  

News:

Pages: 1 [2] 3 4 ... 6

Author Topic: DSLstats after the demise of MDWS  (Read 5045 times)

d2d4j

  • Reg Member
  • ***
  • Posts: 654
Re: DSLstats after the demise of MDWS
« Reply #15 on: March 06, 2018, 07:57:49 AM »

Hi

Iím sorry for lateness, just getting over a chest infection sorry

@kitz, thank you for thinking about me and yes, would certainly look at your suggestion for those who would want to use it

Many thanks

John
Logged

KingJ

  • Member
  • **
  • Posts: 42
  • Į\_(ツ)_/Į
    • Miscellaneous Knowledge
Re: DSLstats after the demise of MDWS
« Reply #16 on: March 06, 2018, 09:49:12 AM »

My issue with DSLStats is that I am running it on an iMac using Nallar's Docker version.

When I look at where the snapshots are held it gives the location as /root/.dslstats/, which presumably is where the files will be stored under Linux.

However this doesn't relate to an identified location on teh Mac.  Is it possible to access these files?

When you first ran the container, you should have specified a -v flag. In Docker, this mounts an external directory path from your host inside the container. The setup instructions specify that you should mount an external folder on to the /config directory internally - so anything inside the container that's written to /config will be persisted and accessible on the mapped folder on your external host (in this case, your iMac).

So, to persist and view the snapshots you've got two options;

  • Mount an additional volume in to /root/.dslstats in the container. This will persist and make available any data written to that folder.
  • Change the snapshot directory in dslstats to write to a subdirectory of /config (e.g. /config/snapshots) - i.e. taking advantage of the already persisted volume
Logged

andyfitter

  • Reg Member
  • ***
  • Posts: 136
Re: DSLstats after the demise of MDWS
« Reply #17 on: March 06, 2018, 11:06:19 AM »

I think the problem is that the directory locations on offer are the Linux choices and IO can't point it to something meaningful from a Mac perspective.

I have also just tried to set up the web server configuration and can't get any joy in terms of being able to access the stats.  I am running a Netgear Orbi so have the PC on the Orbi LAN as 10.0.0.2 and have separate network configuration set up with the iMac as 192.168.1.100 for picking up the sats from the modem.  Trying to access either 192.168.1.100:55555/snrm.html or 10.0.0.2:55555/snrm.html just gives me a site not reached message in Chrome.

Am I missing something or is this just an issue with running DSLStats under Docker?

Arenít there problems with the web server under Docker, mentioned on the github page? I believe it runs its own web server on port 8080
Logged

les-70

  • Kitizen
  • ****
  • Posts: 1225
Re: DSLstats after the demise of MDWS
« Reply #18 on: March 06, 2018, 11:39:29 AM »

   Might it be possible to extend the time per page on DSLstats graphs to more than 24 hours?   Up to 7 days or even a month would give more MDWS like visibility of things if you don't look at things every day.  If a week is possible then an option to save snapshots every 7 days would be nice.  If a month is possible I think the monthly option is already there.   This would also make looking a things back in time via the saved snapshots a much easier task.

   I have no idea how easy or hard that might be.    I doubt that it would matter if for graphs longer than 24 hours days the sample times needed to have a bigger minimum value. 
Logged

Dray

  • Kitizen
  • ****
  • Posts: 2362
Re: DSLstats after the demise of MDWS
« Reply #19 on: March 06, 2018, 11:56:48 AM »


Is there anyone prepared to make some standardised GUI's for the graphs  (I realise DSLstats has some basic ones) based on the data that is normally uploaded to MDWS
Are the current MDWS graphs created by Google Charts? https://developers.google.com/chart/
Logged

d2d4j

  • Reg Member
  • ***
  • Posts: 654
Re: DSLstats after the demise of MDWS
« Reply #20 on: March 06, 2018, 11:58:13 AM »

Hi dray

That was my understanding re google charts

Many thanks

John
Logged

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31187
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #21 on: March 06, 2018, 12:48:02 PM »

Are the current MDWS graphs created by Google Charts? https://developers.google.com/chart/

Yes I was looking at google charts last night. In fact I was actually looking at their Line charts here.

But its not quite so simple as having the charts, you'd also need something which would accept the data from DSLstats, update the data then send it to be able to graph it to the chart.
If you were running it on your own website, you'd need to update and retain the data.    I'm not sure how its currently done, but last night I was looking at the info sent from kitz_live_modem_stats.log.

It's currently sent as space delimited file, so first step would be to break down into an array for each item, something like the function explode should do that.
Code: [Select]
$file = "kitz_live_modem_stats.log";
$stats = file_get_contents($file);
$arr_stats = explode(" ", $stats);
output would be something like

Code: [Select]
print_r($arr_stats);

Array
(
    [0] => 06/03/2018
    [1] => 12:20
    [2] => 72629
    [3] => 20000
    [4] => 6.2
    [5] => 6.8
    [6] => 6.8
    [7] => 72641
    [8] => 28686
    [9] => PTM
    [10] => 0.00
    [11] => 0.00
    [12] => 0
    etc
)

You'd then need to identify what each stat in the array is and name it, so you can identify which piece of data you want for the particular graph you want to display....  and that's just the easy bit.

There's lots of other areas you need to think about.
 - How is the data automatically going to be uploaded to your webserver
 - How are you going to keep a permanent record of all the stats so that each new incoming data is added to the record
 - Code for sending an array to the graph...  there's some code here which may help
 - You'd need .html templates to output the graph to.

Unfortunately this isn't going to be a 2 minute job just because there is such a thing as google charts  :(
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 31187
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: DSLstats after the demise of MDWS
« Reply #22 on: March 06, 2018, 01:00:30 PM »

Although GDPR is one of the reasons Tony cant do this any more, its not the only reason.

Quote
The server is also showing signs of overload recently with a rapidly increasing user base and would likely need a rewrite to get over this.

Think about it, his database is currently holding data for many hundreds of users.
For each and everyone of those users there is rows upon rows of data being updated every minute for numerous types of graphs.

He had a pretty decent spec server running in his own home, so if there were any probs he could quickly fix his code and have control over his own db.

Whilst a single user graphs would probably cope perfectly well on a shared server and fairly basic type hosting, when you start having to deal with data from hundreds of people then you need something a lot more powerful running on its own system.    That doesn't come cheap and is going to require a huge commitment from anyone wanting to take it over :(

 
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

jelv

  • Helpful
  • Reg Member
  • *
  • Posts: 847
Re: DSLstats after the demise of MDWS
« Reply #23 on: March 06, 2018, 01:13:48 PM »

@jelv: Yes, I can add an option to specify the location of the webserver files. I don't know if the directory selector dialog will be able to link directly to the NAS box, so you may have to map it to a local directory as you mentioned.

Does that include changing the current check box "Enable webserver" to have three options (Off, Create pages only, Create pages and enable webserver)? The port would only be needed for the last option.

I've tried changing the snapshot directory to \\nasbox\sharename\DSLStats and it worked - and I can view the contents of the webserver directory remotely via my existing webserver port forwarding (the problem with using this method this is that it also puts the snapshots directories on the webserver).

One thing I didn't point out in my previous post is point out the advantage that being able to write the webserver files to my existing webserver means I don't have to set up an additional port forward for 55555.
Logged
Programming today is a race between software engineers striving to build bigger and better idiot-proof programs, and the Universe trying to produce bigger and better idiots. So far, the Universe is winning. Rick Cook, The Wizardry Compiled

broadstairs

  • Kitizen
  • ****
  • Posts: 3068
Re: DSLstats after the demise of MDWS
« Reply #24 on: March 06, 2018, 01:15:18 PM »

To be honest given Eric's situation with his time available I think the best answer is for some form of file saved as perhaps a zip file containing the data currently sent to MDWS. As long as the format is known then it would be easy for individuals to decide whether or not it is worth it for them to create some kind of database to contain it or just to archive it in case it is needed. As has already been noted the saved graphs etc can contain pretty much all the data needed. I have started archiving this off to my NAS pending something more compact being available.

Stuart
Logged
ISP:TalkTalk Connection:FTTC Cab:ECI Router:Netgear D6220

Ronski

  • Moderator
  • Kitizen
  • *
  • Posts: 2685
Re: DSLstats after the demise of MDWS
« Reply #25 on: March 06, 2018, 01:29:23 PM »

With hg612 stats it saves all the stats to one log file, although I do split them off every year, so the stats data is always there. Theres also the graphs but unless manually run are only for  a 1 day period.

My brother might be tempted to write something for better on the fly graphing, but given his total lack of time I'm not holding out much hope.
Logged
Formerly restrained by ECI and ali,  now surfing along at 388/21  ;D

ktz392837

  • Reg Member
  • ***
  • Posts: 350
Re: DSLstats after the demise of MDWS
« Reply #26 on: March 06, 2018, 02:11:31 PM »



   Might it be possible to extend the time per page on DSLstats graphs to more than 24 hours?   Up to 7 days or even a month would give more MDWS like visibility of things if you don't look at things every day.  If a week is possible then an option to save snapshots every 7 days would be nice.  If a month is possible I think the monthly option is already there.   This would also make looking a things back in time via the saved snapshots a much easier task.
I too would really love it if the graphs could cover more than 24h (7d would probably fit on the existing size of graph not sure whether 30d would be a bit of a squeeze) but roseway has already stated his time is limited so I didn't want to push my luck above what I already suggested ;)

Think most graphs are a rolling 24h (ES isnt though for me).  Having the ability to increase the timeframe covered for all charts would reduce the need for as many snapshots.

Logged

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39163
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #27 on: March 06, 2018, 02:46:44 PM »

@jelv: I've put it on the todo list, but the list is getting longer...
Logged
  Eric

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39163
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #28 on: March 06, 2018, 02:48:56 PM »

@les-70: also on the list.
Logged
  Eric

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 39163
  • Penguins CAN fly
    • DSLstats
Re: DSLstats after the demise of MDWS
« Reply #29 on: March 06, 2018, 04:34:58 PM »

It's currently sent as space delimited file, so first step would be to break down into an array for each item, ...

I could make it a CSV file, but DSLstats has some users in countries where they use a comma as a decimal point. The other zipped files for HLog, QLN, etc are in CSV format because all the values are whole numbers.
Logged
  Eric
Pages: 1 [2] 3 4 ... 6