Kitz ADSL Broadband Information
adsl spacer  
Support this site
Home Broadband ISPs Tech Routers Wiki Forum
 
     
   Compare ISP   Rate your ISP
   Glossary   Glossary
 
Please login or register.

Login with username, password and session length
Advanced search  

News:

Pages: [1] 2

Author Topic: DSLstats pre-release version 6.5.6  (Read 6432 times)

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 43613
  • Penguins CAN fly
    • DSLstats
DSLstats pre-release version 6.5.6
« on: May 21, 2018, 10:53:51 AM »

The main change in this version is that SFTP uploads are now working. An external program (curl) is used for this. Linux and Raspberry Pi users must install curl on their systems for this to work. This needs to be built with SSH support, and it's assumed that this will be the case with most modern Linux systems. An appropriate version of curl is included in the Windows version, and all the files in the archive should be copied to their destination.

Full list of changes since v6.5.2:
  • SFTP upload now works properly on all supported platforms
  • uploading is disabled after four upload/login failures in succession
  • time/day stamps of data store files are now tied to the start of processing after collecting the data from the modem
  • the time between successive webserver uploads can be adjusted between 1 and 60 minutes
http://dslstats.me.uk/downloads.html
Logged
  Eric

broadstairs

  • Kitizen
  • ****
  • Posts: 3700
Re: DSLstats pre-release version 6.5.6
« Reply #1 on: May 21, 2018, 12:51:07 PM »

Running here OK although only using plain FTP currently.

Stuart
Logged
ISP:Vodafone Router:Vodafone Wi-Fi hub FTTP

tiffy

  • Kitizen
  • ****
  • Posts: 1328
Re: DSLstats pre-release version 6.5.6
« Reply #2 on: May 21, 2018, 12:57:31 PM »

@roseway:
Eric, many thanks for your latest program revision and hard work on the project, very much appreciated.

Ref. installing "curl" on RPi's:
Currently running a RPi 3B+ with Raspbian Stretch on my home system, tried to install curl by the simple method:
sudo apt-get update
sudo apt-get install php5-curl  (errors produced, would not install)

Googled RPi support forums and this was suggested:
sudo apt-get update
sudo apt-get install libcurl4-openssl-dev  (this installed without errors)

Tried the same "curl" install process on one of my remote RPi Zero W's still running Raspbian Jessie:
Both "curl" install options worked without any errors, installed the later "libcurl4" last so presume it will be active.

Unfortunately, I still have the same issue with WS Upload to my LAN FTP server on my Win 8.1 desktop PC, all permutations of FTP, Upload URL & Upload Dir still produce a test failure although the previously reported program "lock up" when using PC IP address has now been cured.

Otherwise the program revision is up and running on all my RPi's with no noted anomalies to date.
Logged
Vodafone FTTP 200/28, VF THG3000 Hub

marjohn56

  • Reg Member
  • ***
  • Posts: 118
Re: DSLstats pre-release version 6.5.6
« Reply #3 on: May 21, 2018, 02:18:20 PM »

Nice one Eric.. excellent work, thank you very much.
Logged
OPNsense 18.* - Billion Bridge - Qotom Q355G4 - ISP - ZEN U.K.

Team Rebellion Member

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 43613
  • Penguins CAN fly
    • DSLstats
Re: DSLstats pre-release version 6.5.6
« Reply #4 on: May 21, 2018, 03:41:52 PM »

@tiffy: To install curl, this is what you should do:

Code: [Select]
sudo apt-get update
sudo apt-get install curl

This installs curl and libcurl3. You don't need the other packages you mentioned.
Logged
  Eric

marjohn56

  • Reg Member
  • ***
  • Posts: 118
Re: DSLstats pre-release version 6.5.6
« Reply #5 on: May 21, 2018, 03:48:39 PM »

Eric, I appear to have an issue with data upload, The stats.log is being uploaded into the data folder, i.e. "server/DSLstats_data" not "server/DSLstats_data/2018-05-21", are you aware of this?

Also I am seeing fec.html and crc.html in the DSLstats_data folder too...
« Last Edit: May 21, 2018, 03:51:09 PM by marjohn56 »
Logged
OPNsense 18.* - Billion Bridge - Qotom Q355G4 - ISP - ZEN U.K.

Team Rebellion Member

tiffy

  • Kitizen
  • ****
  • Posts: 1328
Re: DSLstats pre-release version 6.5.6
« Reply #6 on: May 21, 2018, 03:51:39 PM »

@tiffy: To install curl, this is what you should do:

Code: [Select]
sudo apt-get update
sudo apt-get install curl

This installs curl and libcurl3.

OK Eric, even more simple and obvious !
Was not sure on the format so Googled and got the options quoted.
Just making the point that Raspbian Stretch and Jessie appeared to react differently to the first option.

Will try the obvious option you suggested on my second remote RPi Zero W which is not updated yet.
Logged
Vodafone FTTP 200/28, VF THG3000 Hub

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 43613
  • Penguins CAN fly
    • DSLstats
Re: DSLstats pre-release version 6.5.6
« Reply #7 on: May 21, 2018, 04:16:04 PM »

Eric, I appear to have an issue with data upload, The stats.log is being uploaded into the data folder, i.e. "server/DSLstats_data" not "server/DSLstats_data/2018-05-21", are you aware of this?

Also I am seeing fec.html and crc.html in the DSLstats_data folder too...

On the second point, those two files are uploaded when you press the Test button. I meant to change their names to test1 and test2 to make their function clear, but didn't get around to it.

On the first point, I didn't specifically test the data store uploads this time because I didn't think the behaviour had changed in this version, but it looks as though I was wrong. I'll look into this and report back.
Logged
  Eric

broadstairs

  • Kitizen
  • ****
  • Posts: 3700
Re: DSLstats pre-release version 6.5.6
« Reply #8 on: May 21, 2018, 05:16:29 PM »

Yes the FTP of stats.log goes to the datastore directory not the daily directory as it used to, however the local file is correctly in the datastore directory in a daily directory.

Stuart
Logged
ISP:Vodafone Router:Vodafone Wi-Fi hub FTTP

marjohn56

  • Reg Member
  • ***
  • Posts: 118
Re: DSLstats pre-release version 6.5.6
« Reply #9 on: May 21, 2018, 05:38:19 PM »

On the second point, those two files are uploaded when you press the Test button. I meant to change their names to test1 and test2 to make their function clear, but didn't get around to it.

You're just trying to confuse me.. :)

On the first point, I didn't specifically test the data store uploads this time because I didn't think the behaviour had changed in this version, but it looks as though I was wrong. I'll look into this and report back.

Cool. I think Ned has PM'd you with more info so I know your on the case.

KR
Logged
OPNsense 18.* - Billion Bridge - Qotom Q355G4 - ISP - ZEN U.K.

Team Rebellion Member

Chrysalis

  • Content Team
  • Addicted Kitizen
  • *
  • Posts: 7407
  • VM Gig1 - AAISP CF
Re: DSLstats pre-release version 6.5.6
« Reply #10 on: May 22, 2018, 01:11:47 PM »

Special thanks from me to Eric on the continued work he is putting into dslstats.

The SFTP support significantly lowers resource usage on both client side and server side for uploads vs standard FTP as well as speeding it up, so this will help greatly when we get a new centralised service up and running.
Logged

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 43613
  • Penguins CAN fly
    • DSLstats
Re: DSLstats pre-release version 6.5.6
« Reply #11 on: May 22, 2018, 01:29:29 PM »

Thanks Chris.
Logged
  Eric

roseway

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 43613
  • Penguins CAN fly
    • DSLstats
Re: DSLstats pre-release version 6.5.6
« Reply #12 on: May 22, 2018, 07:11:03 PM »

Concerning the Data Store upload issue, I've located the cause and fixed it for the next release.
Logged
  Eric

g3uiss

  • Kitizen
  • ****
  • Posts: 1151
  • You never too old to learn but soon I may be
    • Midas Solutions
Re: DSLstats pre-release version 6.5.6
« Reply #13 on: May 22, 2018, 09:28:59 PM »

Stuart

I found but after  one upload using SFTP , DSLstats hung, needing a forced restart. Then I found all the SFTP settings were blank, I've tried twice with the same results

However I’ve just realised my hosting needs FTPS I assume that’s not included. I can connect and upload using P21 and the middle option, but as above crashes after one upload.

Tony
« Last Edit: May 22, 2018, 10:19:38 PM by g3uiss »
Logged
Cerebus FTTP 500/70 Draytec 2927 VOXI 4G fallback.

Browni

  • Reg Member
  • ***
  • Posts: 137
Re: DSLstats pre-release version 6.5.6
« Reply #14 on: May 22, 2018, 10:29:56 PM »

This one crashes out with the error "" is an invalid integer, looks like that's been there since build 6.5.2

I believe you narrowed that down to pbparams and the figures I see on 6.5 using a G.fast connection are here

Code: [Select]
bcm_xdslctl info --pbParams
bcm_xdslctl: ADSL driver and PHY status
Status: Showtime
Last Retrain Reason:    0
Last initialization procedure status:   0
Max:    Upstream rate = 34767 Kbps, Downstream rate = 198057 Kbps
Bearer: 0, Upstream rate = 34651 Kbps, Downstream rate = 198057 Kbps

Discovery Phase (Initial) Band Plan
US: (368,1930)
DS: (368,1930)
Medley Phase (Final) Band Plan
US: (368,1339)
DS: (368,1211)
VDSL Port Details               Upstream                Downstream
Attainable Net Data Rate:        34767 kbps             198057 kbps
Actual Aggregate Tx Power:          2.8 dBm                 0.0 dBm
====================================================================================
  VDSL Band Status U0 U1 U2 U3 U4 D1 D2 D3
  Line Attenuation(dB): N/A 0.0 N/A N/A N/A 37.7 N/A N/A
Signal Attenuation(dB): N/A 0.0 N/A N/A N/A 37.7 N/A N/A
        SNR Margin(dB): N/A 0.0 N/A N/A N/A 0.0 N/A N/A
         TX Power(dBm): N/A 0.0 N/A N/A N/A 0.0 N/A N/A
        kl0(dBx100):      N/A     N/A     N/A     N/A     N/A     N/A     N/A     N/A   
/ #


New territory!
Pages: [1] 2
 

anything