Kitz Forum

Broadband Related => Router Monitoring Software => Topic started by: Bald_Eagle1 on March 02, 2013, 10:43:27 PM

Title: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 02, 2013, 10:43:27 PM
A small package of connection statistics logging/graphing programs has been recently devoloped from the original batch file script versions.

These programs are more robust than the scripted versions and are much quicker in use to boot.

Thanks to RONSKI's efforts, everything can now be set up using a GUI settings editor for fully automated data harvesting & graphing via user-defined scheduled events.

.Net does need to be installed to make full use of RONSKI's settings editor.
.Net version 4 has been used for extensive testing of the programs on systems ranging from XP Home Edition to Windows 7 & related Home Server versions.

However, users can still manually edit a text based configuration ini file if choosing not to install .Net
AFAIK, .Net was already included with Windows versions starting with Vista, so installing it is probably only relevant for the few XP users who don't already have it installed.



Resyncs are now detected (if monitoring 24/7) & the data is immediately logged, along with optional graphing.

The mis-reported FEC/CRC errors issue from the HG612's own buggy GUI has also been dealt with.

The output is almost identical to later scripted versions, just that there is more of it to assist with trouble-shooting problematic connections.

Once a reliable download site has been chosen, I'll post links here accordingly, so watch this space  ;)

At some stage in the not too distant future, these programs are also likely to be converted back to their Linux and ADSL roots, as originally developed by Burakkucat, along with asbokid's input.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 02, 2013, 10:44:15 PM
For the past two months or so I've been developing a settings editor to set up Bald_Eagles excellent updated logging programs, along with testing them.

To do this I've had to learn VB.Net, and I haven't really programmed since I was a teenager, about 30 years ago.

So take it easy if you find anything not quite right, but please do let us know.

We'll update the thread and the first post when it's available for download
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 04, 2013, 03:44:42 PM
Download is now live at Freewarefiles.com (http://www.freewarefiles.com/HG612-Modem-Stats_program_84567.html), I'm sure the Eagle will be along soon to update the first post.

Edit: If upgrading to the new version don't forget to backup any logs/graphs just in case. In my experience it is perfectly fine to keep your modem log file, I'm still using the same one I started last August.

Also if you like it then please rate it and leave a review on Freeware files, if you have any problems then let us know.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: roseway on March 04, 2013, 04:05:00 PM
Unfortunately that link doesn't work.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Finguz on March 04, 2013, 04:35:04 PM
http://www.freewarefiles.com/HG612-Modem-Stats_program_84567.html

That 1 should be ok :)
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 04, 2013, 04:43:23 PM
Thanks, link fixed, must of forgot to check that one  :-[
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: roseway on March 04, 2013, 04:50:06 PM
:)

It works now, and the file downloads correctly.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 07, 2013, 07:11:04 AM
Just to let everyone know that the editor requires dot.net version 4, or else it won't run.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 10, 2013, 07:26:43 AM
Has anyone tried this out yet?

General constructive feedback/criticism is most welcomed, but I’m particularly interested to hear about how users found the setting up process, any problems & suggestions for potential future improvement and development.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: krypton on March 10, 2013, 08:24:18 PM
It would be nice if this program could be used for other broadcom-based devices too.
Are you planning to keep it exclusive for the HG612?
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 10, 2013, 09:09:29 PM
I did convert the script versions for use with some other Broadcom routers such as Netgear, Zoom X7N etc. so I may do the same with the program version at some stage.

It did start life as a Linux program for ADSL connections & I have just Window-ised it & added graphing elements for VDSL2 connections so it shouldn't be too major a task to get it to work with other Broadcom devices.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: roseway on March 10, 2013, 10:43:51 PM
Quote
it shouldn't be too major a task to get it to work with other Broadcom devices.

You may find the wiki page on Broadcom routers helpful: http://wiki.kitz.co.uk/index.php?title=BCM_routers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 10, 2013, 11:04:28 PM
You may find the wiki page on Broadcom routers helpful: http://wiki.kitz.co.uk/index.php?title=BCM_routers

Thanks for that link.
It will be useful for when/if I eventually get a round tuit.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 11, 2013, 04:41:39 PM
Hi Bald_Eagle,

I have downloaded the program and installed it on my Windows 8 Pro p.c, however for the scheduled task this doesn't seem to be running.  It basicall ran it once when the program was installed and the scheduled task was created, it now says 'Task Scheduler did not launch task "\HG612 Stats Program" because instance "{c6e7f7ce-69c5-4e66-9434-3955f1653a08}" of the same task is already running.'

I previousy used the older version of the program before it was nicely packaged on my Windows 7 workstation and it had a file called modem_log which doesn't seem to be present on the windows 8 workstation, wonder if this is because the scheduled task is not running.

Any advice
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 11, 2013, 09:11:00 PM
There is an ongoing discussion & possible solution regarding Windows 8 & the use of the programs part way down the thread here:-

http://forums.thinkbroadband.com/fibre/f/4216317-huawei-hg612-stats-and-graphing-programs-for-windows-users.html

I don't have access to a Windows 8 machine, so I am unable to test anything myself.

EDIT:
Please let me know if you find a workaround & we'll include it in the first update we release.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 11, 2013, 10:51:06 PM
Hi Bald Eagle,

Thanks for the information, I did some tests and it seems that in Windows 8 if I change the settings under settingd 'If task is already running, the the following rule applies:'  the rule is set to 'Stop the existing instance'

This seems to work, I can see the logs being updated and the history log showing the task running and then stopping.  Will let it run for a bit longer.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 12, 2013, 07:51:58 AM
Are you logged into Windows using a Username & Password or just a Username?

Also, does it now update the logs silently or do you briefly see either the command window or activity on the task bar each minute?

I have not even seen a Windows 8 installation at all yet, so I have no idea how it works, what to expect or what it looks like.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 12, 2013, 09:52:22 AM
Hi,

The program seems to be running smoothly, there is now a logfile and this is being updated, plus I set it up to produce graphs every hour and this is working fine.

With regards to the Task Scheduler I set the task up to run under a service account (with password) this way it will continue to run even if someone else is logged on.  I had a look on the web and found this was a good article on scheduled tasks in Windows 8

http://technet.microsoft.com/en-us/library/cc725745.aspx

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 12, 2013, 10:14:50 AM
I've worked out how to create a task which runs using the system account, this means we will be able to run the exe, thus not requiring the vbs script  for Vista onwards, it also means no need to supply a username or password.

I'll try and alter the editor this week, and then let you have a copy to test if you wouldn't mind?
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 12, 2013, 10:30:05 AM
Hi Ronski,

More than willing to give it a try, just let me know.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 12, 2013, 12:49:04 PM
Thanks Korben, I'll let you know when I've made the changes.

I've also checked on XP and I will be able to set that up to use the system account as well :-)
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 13, 2013, 09:48:20 AM
Hi Ronski,

More than willing to give it a try, just let me know.

Cheers

I've sent you a PM with a link to a file, and instructions, hopefully it will work, thanks for testing.

I couldn't create a task programatically to run under the system user account, so have simply compiled the VBS script to an exe, hopefully this will fix the problem.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 13, 2013, 08:09:25 PM
Hi Ronski,

The new exe seems to work a treat, ? I have replied by PM.

Will leave it running overnight and let you know the results.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 14, 2013, 01:12:23 PM
Thanks for testing, the other user on tbb forums has also confirmed it works.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 14, 2013, 01:19:45 PM
Hi Ronski,

The program seems to run for a few hours and then it stops, looks like it doesn't restart.  No errors were seen on the p.c, the log has the last entry as the program stopping but nothing after that.

Restarted it and left it but found it stopped again a few hours later.  Will double check the p.c tonight but never saw anything obvious.

Will let you know.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 14, 2013, 01:29:00 PM
Does task manager show any HG612_ Stats.exe processes running?

What's the error code against the task in task manager?

Bald_Eagle may know what other things to check, there maybe something in the events logs.

I'm probably going to install a virtual machine of W8, so I will also be able to test.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 14, 2013, 01:34:44 PM
Hi Ronski,

Looking at task scheduler it shows the task as stopped/ready, the history on task scheduler shows it stopped correctly but this was not in error.  Looking at the history you can see the tasking starting then stopping and so on, then you have it stopping but not starting.

Checked task manager and it doesnt show the program as running,  I also check Norton's as it originally took exception to the EXE and stuck it in quarantine, but I restored it and told it not to bother about it as it wasnt a virus.

If I need to check any other logs or attach them let me know, hopefully Bald_Eagle might know of other logs to check.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 14, 2013, 04:28:49 PM
That is odd, have you checked the task is setup correctly? Perhaps export the task and post it somewhere/or attach it here (note the allowed file types), so I can download it and take a look if need be - the only identifiable information will be your pc's name and your username, and you can change that  with notepad if you want to.

I've had no reports of problems from the other tester, but not sure if he's running it 24/7.

Is this running on a laptop or a PC? As I think by default the task will not run if on batteries.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 14, 2013, 07:08:03 PM

If I need to check any other logs or attach them let me know, hopefully Bald_Eagle might know of other logs to check.


Snippets from ERROR.LOG (stored in the Ongoing_Stas folder) from around the time the task stopped may give some clues, as might sight of the HG612_stats.ini file (stored in the Scripts folder).

If the timings of the task stopping coincide with any scheduled current (snapshot) logging/graphing, details from Current_ERROR.LOG (stored in the Current_Stats folder) may also assist.


Did you use the previous batch file scripted version?
If so, have you disabled/deleted the 24/7 logging task from that to avoid any clashes with the program versions?

In Task Scheduler, the Last Run Result should be 0x0
Could you confirm that was the case when the task stopped running?

Does your PC 'hibernate' after a period of non-use?

Is the actual running time before stopping identical in the cases where it did stop running?



I don't know how Windows 8 works, but do you see any instances of these running permanently in Task Manager:-

cmd.exe
conhost.exe

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 14, 2013, 08:44:06 PM
Hi,
Please find attached copies of the logs and other info, the timings of the task stopping dont coincide with anything else, the task when ran with the hg612_stats.exe ran during the same period without an issue other than having to have in the task the part to stop any running instance when it was starting a new one.
The times of the new exe running before it stopped was 13/3 18:54 - 20:22 and then 22:32 - 00:53.  On both times the task stopped cleanly but it didnt seem to restart a minute later.  Also it doesn't seem to run for a set period before it stops.

The p.c is set not to hibernate, the only thing that is set to switch off is the monitor.

With regards to cmd.exe and conhost.exe dont see these running all the time.

Let me know if you need any more info.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 14, 2013, 09:47:35 PM
As the program runs for a while via a scheduled task without any apparent problems, the indication is that there may be a problem either with the task setup, or there is a bug in Task Scheduler itself.
If it was a program problem, it probably wouldn't run at all or it would start to run & generate an error code.

There was a bug in Vista in that user generated scheduled tasks could sometimes stop running for no apparent reason.
This was fixed in Windows 7, but it may just be possible that Windows 8 is also affected.

It may just be worth testing by creating a batch file containing just this detail:-

echo %time% >> C:\Utilities\HG612_Modem_Stats\Scripts\Schedule_Test.TXT

Then create a scheduled task to run the batch file every minute, using identical details to the stats task.

If that also stops running after a few hours, we could probably rule out a program problem, then start looking at Task Scheduler itself for an answer.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 14, 2013, 10:47:32 PM
Hi Bald_Eagle,

Will create and task for the bat file and let you know.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 15, 2013, 08:19:40 AM
I can confirm that the task stops, in my case after about 3 hours. This was running Windows 8 Enterprise on Virtual Box.

I didn't have chance to look at why it stopped as I got to bed at 12:15 this morning, then one of our drivers broke down at 1 am, so I had to sort that, so am suffering with sleep deprivation at the moment :sleep: :sleep: :sleep: :sleep:

Korben, can you create your own task to run the HG612_Run.exe every minute and see how that goes please?
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 15, 2013, 09:34:25 AM
Hi,

Both tasks stopped at 00:42, I configured the 2nd test one the same as the auto created one through the editor.  Had a look through the looks and couldn't see anything that looked like it would stop the tasks from running again.  It seems to be that they run and stop correctly but dont start-up again.  The only thing I saw in the logs around the same time was VSS shutting down due to ideal timeout.

Will create a new task to run the new exe but do this as a native Windows 8 task and see how that goes.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 16, 2013, 10:58:00 AM
Hi Ronski,

Created a manual task on Windows 8 and it has been running for over 24 hours so far, will continue to monitor and let you know.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 16, 2013, 12:16:44 PM
Can you let me know what settings you used for the task please.

I tried something slightly different last night, and it stopped after ten minutes, but the next run time was still updating, I'll have to check the last run time. 

I think it may be a problem when tasks are created with schtasks,  I will need to get onto the ms forums and see what the professionals think.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 16, 2013, 01:13:53 PM
Hi Ronski,

I have attached screenshots showing the task.

Let me know if you require any further information.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 16, 2013, 04:42:23 PM
It may not be relevant, but the programs were developed on Windows 7 machines, with the task configured for Windows Vista, Windows Server 2008.

If that configuration is still available in W8, it may just be worth a shot at running the task similarly configured.

There is a similar & known issue in Vista where the task stops running after a few hours/days or following a PC reboot.
Ticking the "Do not store password" box seems to fix that.

 
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 17, 2013, 01:36:12 PM
Hi Bald_Eagle,

The amended task continues to run, so I will now alter this to cover running in a Vista/Windows 7 environment.

Will let you know how this goes.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on March 17, 2013, 01:54:06 PM
Hi Bald_Eagle,

The amended task continues to run, so I will now alter this to cover running in a Vista/Windows 7 environment.

Will let you know how this goes.

How long has it now been running?

I'd be inclined to just make one change at a time & test things for a few days, otherwise there's no absolute certainty which change actually made the difference.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 17, 2013, 02:25:45 PM
Hi Bald_Eagle1,

Its been running since 10:00 on Friday, all I have done now is to change the 'configure for' from Windows 8 to Windows 7 Windows server 2008 this also covers Vista.  So far it is still running.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on March 17, 2013, 02:46:35 PM
Stephen's (over on the TBB forums) task had been running ok for days, maybe even a week, and then it stopped - he's not sure if it was a task created by the editor and then modified, or one he created.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on March 18, 2013, 06:32:59 PM
Hi Ronski,

The task I created from a new continues to run, I amended this yesterday to run as a windows 7/vista task and it is still running.  Unfortunately my p.c is only ever on for 5 days at the most before it is shutdown, this all depends on my working pattern.

So far the task has been running since it was originally created manually on the 15 March.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: graemev on April 14, 2013, 12:26:39 PM
Hi, Just unlocked my HG612

I'm trying to get hold of the original Linux scripts  ... I can only find ms-DOS bat files .... an I don't have any dos/window-boxes.

Does anyone here have a reference?
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: asbokid on April 14, 2013, 02:02:54 PM
Hi Graeme,

Welcome to the forum.  Burakkucat's graphing script is here:

http://drive.google.com/folderview?id=0B6wW18mYskvBMTEyNzk2MTQtNWEyNC00NTBlLWFiMjYtNTg0MDdhMTBlNDdk

cheers, a
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: graemev on April 14, 2013, 03:01:54 PM
Am I missing something here , these seem to be yet more window-box bat files ?  ... the instructions say:

These WINDOWS only batch files, along with a few other utilities that need to
be downloaded and installed, will allow you to generate relevant graphs for
the Huawei HG612 modem's connection stats, simply by double clicking the relevant
batch file icons.

They have been developed and converted to batch files from the original Linux
script (Graph.sh) by Bald_Eagle1, with much assistance and advice from asbokid
and burakkucat


Is there in fact only graph.sh to format the data? .... no script to collect the data (even though the box supports ssh so I assume you could automate totally from the Linux end?)
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: asbokid on April 14, 2013, 03:18:51 PM
Yup, that's about right. Only a graph scripting program.  I guess that people have done their own thing with the scraping, and aside Paul's (Bald_Eagle1) which is for Windows, people haven't shared their code.  There's telnet as well as ssh to make it easier for harvesting.

cheers, a
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: roseway on April 14, 2013, 03:36:37 PM
In the meantime, rs-ux works fine with the HG612 if you'd like to give it a try.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: ColinS on April 14, 2013, 06:53:58 PM
Am I missing something here , these seem to be yet more window-box bat files ?  ... the instructions say:

These WINDOWS only batch files, along with a few other utilities that need to
be downloaded and installed, will allow you to generate relevant graphs for
the Huawei HG612 modem's connection stats, simply by double clicking the relevant
batch file icons.

They have been developed and converted to batch files from the original Linux
script (Graph.sh) by Bald_Eagle1, with much assistance and advice from asbokid
and burakkucat


Is there in fact only graph.sh to format the data? .... no script to collect the data (even though the box supports ssh so I assume you could automate totally from the Linux end?)

I hestitate to contradict anything A has to say, but no, that's not right.   :-[ ... And I was right to do so (hesitate!), as I now see he was not referring to B-E's programs

B-E did originally develop them (for Windows) using .bat files, but even those still used PLink and the like to telnet into the box, access the busy box shell and issue the correct xdslcmd commands.

In his latest version, the .bat files have been replaced with programmatic equivalents.  So, they also collect the stats as well as graphing it, and a very good job both Paul and Eric make of both of their tools.  They each have their own advantages IMHO.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: asbokid on April 14, 2013, 09:09:46 PM
Oh god, i don't belong on any pedestal, colin!  Except as an expert in being wrong, or even totally wrong!  It turns out that there is a Linux harvesting script.   Perhaps B*cat when he's uncurled from his weekend slumber, will remind us where it is hidden!  cheers, a
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: burakkucat on April 14, 2013, 10:49:30 PM
Meow?  ???

I have a variety of Bash scripts (controlled by a cron job) that I would use if I need to collect the raw data. They, in turn, have been superseded by the binary version of the harvesting code -- the code that Bald_Eagle1 subsequently forked to create his magnificent utility, which is usable by those persons whose computers are driven by BGW.  :tongue:

Please let me know of your e-mail address (by PM), Graeme and I will send you copies of the HG612.{c,h} files (Version 0.20 (12/2012)), along with anything else that I think may be of use.  :)
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 15, 2013, 12:57:11 PM
Hi,

I have had the windows program working fine, however I needed to power down the HG612, I then onced tit had been powered back up to set the date and time using the bat file, but nothing seems to happens the time remains as it was before.

Any suggestions on what might be wrong or any alternative method of setting the correct time on HG612

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 15, 2013, 01:16:03 PM

Any suggestions on what might be wrong or any alternative method of setting the correct time on HG612



You could try this compiled program version instead of the bat file:-

https://docs.google.com/file/d/0B7Kcea04kkOENGZfcGkzSHI4OVU/edit?usp=sharing


Download it & store it in the Scripts folder with the other programs & please let me know if it works for you.



EDIT:

The first update is almost ready, which along with including additional graphs etc, also includes automatically resetting the modem's clock whenever a resync is detected.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 16, 2013, 10:59:00 AM
Hi Bald_Eagle1,

Many thanks this did the trick.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 19, 2013, 01:34:38 PM
Hi,

I have been using this program for some time now without any issues however in th elast few days I have noticed multiple occurences of HG612_stats.exe running, only used to have 1 running now either 2 or more.

What I have also noticed that the amount of cpu utilisation has increased up to 28% per instance, normally it was around 7% or less.

Any ideas on what I need to do in order to resolve this ?

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 19, 2013, 01:48:02 PM
Are you seeing this in Windows Task manager?

If so, are any instances reported as Below Normal Priority?
If so, you could simply end those processes.


Also, are you seeing many ONGOING files in the Scripts folder?
These should be auto-deleted temporary files, only remaining when HG612_stats.exe is 'stuck' or crashed before completing.

If you note the date & time of any ONGOING files, you could check the relevant around the relevant dates/times in ERROR.LOG (in the Ongoing_Stats folder) for any possible clues as to what might have happened.

HG612_stats.exe should start & complete within 2 seconds or so every minute & should only take longer if it is waiting for HG612_current_stats.exe to complete or if something like an intensive virus scan is taking place & hogging the PC's resources.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 19, 2013, 03:11:43 PM
Hi Bald_Eagle1,

Am seesing the instances in Windows Task Manager and did manage to end them leaving the last one started running and they all were running as Below Normal Priority.

With regards to the ONGOING Files there are 5 from today and 2 from yesterday.  The program so far hasn't crashed or reported as crashing.

I checked the error log but it looked okay around the times of the ongoing files but nothing stood out as indicating the error.

Cant see what has changed on the pc, been no changes to the security software, cant seem to account for the exe running at 28% near enough constantly.  The pc itself is a 3.00GHZ Quad AMD with 16GB RAM.

Should I look to stop the whole lot and restart it from new and create a new ini file ?

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 19, 2013, 03:55:36 PM
If you watch Task Manager and a new instance of HG612_stats.exe pops up for a couple of seconds every minute, then you should end the process of the remaining one that is still showing as running.



That should clear things without the need to create any new files.

Could you post the details of your ini file here though, just for me to see if there are any potential 'clashes'?

I presume modem_stats.log is still being correctly updated every minute?
BTW, What size is it now?
Mine is around 18MB & I don't really see any issues (but I have recently improved the efficiency of dealing with large log files).

The data harvesting programs should easily run on a very old & low spec PC i.e. Pentium 3 with only 256 MB of RAM.
The graphing takes a while longer though.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 19, 2013, 07:38:16 PM
Hi Bald Eagle,

I shutdown the pc and restarted and within an hour there were 3 .exe running, I have watched task manager and did see some new exes being created and then they disappeared. The other 3 continued to run at rought 27% each.  I attach a doc showing some screenprints and the isrunning files of which there is 2.  I also atach a copy of the ini whcih was last changed/created 13/3.

The modem log is being updated and is some 58MB in size and the first entry is dated 11/3/13.

Let me know if you need any other log or file.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 19, 2013, 10:53:01 PM
Your Task Manager looks different to mine.
Are you running Windows 8?

It seems odd that you have 2 ONGOING files created within 0.006 of a second of each other.
You don't have 2 versions of the program running on a schedule do you?
I ran 2 versions when testing & would occasionally see a few ONGOING files that hadn't been deleted.

If you are only running one version, maybe one instance of HG612_stats.exe had been delayed by something the PC was doing at the time.
Can you think of any resource hungry programs that may have been running at that time?

Could you post a snippet from your ERROR.LOG, say from 17:20 to 17:30?


What is Schedule_Test.TXT & does it run once every minute?


Do you see any unexplained gaps in any of your ongoing graphs?

Could you attach a copy of today's montage for me to take a look at?



Your ini file looks fine.

Do you ever see any 'stuck' HG612_current_stats.exe processes in Task Manager?





Quote
I presume modem_stats.log is still being correctly updated every minute?
BTW, What size is it now?
Mine is around 18MB & I don't really see any issues (but I have recently improved the efficiency of dealing with large log files).

Sorry, I mis-typed there.
I should have stated Mine is around 180MB.

It goes back to October 2012.


Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 20, 2013, 09:39:25 PM
Hi Bald Eagle,

Since I last updated you something really weird is going on since I last terminated the ongoing running exe's.

I find that it is no longer collecting stats, the error log continues to log but not much else it does report that the sync data is 0

I run the teststats2.bat from the old version of the program to see what that did and it threw up errors reporting 'FATAL ERROR: Network error: Connection refused
The process tried to write to a nonexistent pipe.' and further errors.  I tried DSLstats and that reported invalid response from the modem, yet the modem is working and i can access it thru IE.  It is getting all rather strange and nothing has changed on the pc.  Am going to do some further investigation and if need be restore to an earlier version but that wont resolve the issue of the multiple exe's running.

I will let you know how it goes and respond more fully to your questions.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 20, 2013, 10:04:43 PM
Hmmm.

Very strange behaviour.

I see you can still still access the modem's GUI?

If so, what do you see in Device information?

This is from my modem, using the original BLOB:-

Product type  EchoLife HG612   
Hardware version  VER.B 
Software version  V100R001C01B028SP10 
Firmware version  A2pv6C030b.d22g 
Batch number  BC1P10.028.A2pv6C030b.d22g 
System up time  42 days 3 hours 5 minutes 6 seconds 



Also, can you still access the xDSL stats in the WAN menu?

If not, can you access the modem via Telnet:-

Telnet 192.168.1.1 (or whatever IP address your modem is using).

If you can access it via Telnet (admin, admin, sh) can you still run the usual commands & receive 'sensible' output?:-

xdslcmd info --pbParams
xdslcmd info --stats
xdslcmd info --show


Have you tried powering the modem completely off & back on again?

If you try running HG612_stats.exe by double clicking it, does it provide any meaningful output?
I suppose it's just remotely possible that your virus checker has flagged up a false-positive & is blocking both HG612_stats.exe & DSLstats.exe whenever they try to access the modem.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 20, 2013, 11:33:51 PM
Hi Bald Eagle,

I can still logoin to the modems gui (see attached doc) and the logs look good, however I tried using putty, which I had used last week on the modem and it at first opened at session but never gave me a session/login it looks like the router is refusing any telnet sessions.

I haven't rebooted the modem yet but will look to do that mid morning, its all very strange, am wondering if the modem was giving back strange responses caused the issue with hg612 exe and now the modem is worse.

Have checked the AV software and no signs of it blocking anything, I also attach a copy of the error log as requested, and an extract from the current one.

Have tried running the exe directly a window opened and then closed quickly before I could see what was on the screen.


Cheers


Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: roseway on June 21, 2013, 07:20:47 AM
Could it be that there are some unterminated telnet sessions still open on the router? Perhaps the telnet timeout has been inadvertently set to 'Never'?
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 21, 2013, 07:38:39 AM
Just a thought..................

I have only seen the non existent pipe message when more than one connection to the modem is attempted at the same time.
Hence the Connect error in ERROR.LOG.

Were you/are you running my program/script at the same time as Eric's DSLstats program?

My programs/scripts use the PC's system time to schedule the data harvests & I think DSLstats uses its own internal timer.
Both versions of my script/program should completely exit as soon as a harvest has completed.

Possibly one event 'catches up' with the other & both programs attempt to connect to the modem at the same time, causing neither to actually make the connection.

I have seen that happen occasionally when I have been running both programs together.

My script version connects via telnet to the modem & my program version connects directly.


I'm not 100% sure, but I think that DSLstats connects to the modem via a telnet session.

Perhaps Eric could confirm the timer & connection method?



If you do have both programs running together, it may be worth completely quiting one of them to see if the other resumes properly (after ending any 'stuck' processes (including CMD.exe).

When running HG612_stats.exe by double-clicking, you should usually see meaningful data scrolling for around 2 seconds.
If it is far too quick to view anything, it is confirmation that a connection to the modem has failed.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: roseway on June 21, 2013, 08:25:20 AM
Quote
I'm not 100% sure, but I think that DSLstats connects to the modem via a telnet session.

Perhaps Eric could confirm the timer & connection method?

DSLstats gets all its data via telnet. It logs on and logs off again for each sample. Sampling is initiated by a software timer.

I frequently have two instances of it running at the same time, and it never seems to cause conflicts, so I think that the HG612 (and probably many other modem/routers) is quite happy with more than one simultaneous live telnet session. But there is presumably a limit, although I have no idea what it is.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 21, 2013, 10:30:19 AM
Hi Guys,

Thanks for the info, regarding using dlsstats and the HG612 one, the HG612 runs whenever the pc is on, and I only run the dslstats manually adhoc as a quck check.

Am going to try to run them on a laptop thisd way at least will rule out if the p.c is causing a problem connecting via telnet to the modem, and will also help diagnose the other problems with HG612 hopefully, although it may not help determine whats behind the issues if any on the pc.

If I get the same response with the laptop will look to reboot the modem later today, strange as the modem was only rebotted some 24 days ago and before that it had been on and not rebotted for over 120 days.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 21, 2013, 03:33:08 PM
Folks,

I tried my laptop and for dslstats got the same results looks like the modem rejecting telnet connections.  For HG612 it wasn't returning anything.

I rebooted the modem and all seems to be normal both for dslstats and for HG612 stats, what is also good to see mno more multiple occurences of the exe running or basically even seeing one running constantly.

On the subject of the modem am at a loss as to why this happened as it had previously been up for over 120 days without an issue.  Any views on using one of the later blobs on it, am using the original one for hacked HG612 and notice there is a newer one with possible increase in download sync speed.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 21, 2013, 07:17:59 PM
Folks,

I tried my laptop and for dslstats got the same results looks like the modem rejecting telnet connections.  For HG612 it wasn't returning anything.

I rebooted the modem and all seems to be normal both for dslstats and for HG612 stats, what is also good to see mno more multiple occurences of the exe running or basically even seeing one running constantly.


That's good news  :)


Quote
On the subject of the modem am at a loss as to why this happened as it had previously been up for over 120 days without an issue.  Any views on using one of the later blobs on it, am using the original one for hacked HG612 and notice there is a newer one with possible increase in download sync speed.

The new BLOB does seem to deliver slightly higher sync speeds, but the raw bitloading data is only updated at a resync rather than dynamically as with the original BLOB.

I reverted to the original BLOB, just so I could see changes in my connection since increased crosstalk seems to have robbed me of almost 10Mb on a like for like basis.

I didn't see any problems at all when using the new BLOB.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 21, 2013, 08:03:00 PM
Hi Bald Eagle,

Thats good to know about the new blob, pity about the bitloading raw data,  I suspect am possibly suffering from crosstalk but other than undrstanding the sync speed I get lost in those figures. My sync speed has decreased from about 70MB down to an average 66MB, in saying that although the sync speed was 70MB my profile was 66MB and it is now down at 63MB.

I was previously syncing lower at 66MB with a profile of 64.58MB till a BTOP came to resolve a loss of my home phone (01/13) and advised that was due to damaged cables in the cab most likely by a contractor at which point the sync went up to 70MB but the profile stayed the same.  Suppose just one of those things with more and more people taking FTTC.

Any chance you could give a once over of some of my stats and let me know what you think ?

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 21, 2013, 09:34:36 PM

Any chance you could give a once over of some of my stats and let me know what you think ?


Sure. Post the zipped logs or graphs & I'll take a look.

It would be useful to see some from a long time ago (if you still have them) to compare against recent ones for changes.

A change in the QLN graphs would indicate the effect (or not) of increased crosstalk.

EDIT:

I initially mentioned the Hlog graphs by mistake.
I have now corrected the original message to correctly state QLN graphs.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 22, 2013, 01:55:27 PM
Hi Bald Eagle,

Thanks for the offer to look over the stats, I have attached some before the BTOR resolved the fault and after, the stats for 18/12/12 show it after BTOR had been.

I will post the stats in two parts let me know if these are sufficient I rhink I selected the correct images to attach.

CHeers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 22, 2013, 01:57:14 PM
Hi Bald Eagle

Part Deux
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 22, 2013, 03:55:03 PM
Apart from the ongoing stats montage from 17th June (when your modem seemingly needed a reboot to clear things), it looks like a very solid connection.

Your QLN graphs show a little background noise (-140 dBm would be ideal), but it seems to remain pretty constant as your SNRM & Attainable rate graphs hardly fluctuate.

You are still on fastpath with very few errors & your connection manages to stay up for many days at a time.
A few error seconds & CRC errors on a fastpath connection are to be expected when not on a perfectly quiet connection, but they are obviously below the level where DLM would feel the need to take corrective action by applying Interleaving & thus reducing sync speeds.

As your SNRM is around the 6dB target, it indicates your connection is more or less maxing out the connection's capabilities, although it seems slightly unusual for it to achieve the full 20Mbps US sync speed whilst achieving below 80 Mbps DS sync speed.
Perhaps the background noise level in the QLN graph explains the lower than 80 Mbps DS.


Do you have any Plink logs or snapshot montage graphs from when DS sync speed was a few Mbps higher for comparison purposes?


What distance are you from the cabinet?


EDIT:
As it seems that you now have quite a large modem_stats.log file & assuming the logging has been fairly continuous 24/7 since you started logging, you could manually run graphpd.exe & enter say 140 d for 140 days (or some other quite large value) to see how the connection has fluctauted (or not) over a long period of time.

It will take a while to plot the graphs, but it might be interesting to see.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 22, 2013, 07:11:59 PM
Hi Bald Eaqgle,

Many thanks for the analysis it makes some interesting reading.

I have attached the plink logs and the data from the graphd ran at 140 days.  Concerning the distance from the CAB am about 200m as the crow flies and all the cabling is underground.  Couldn't say how many twists and turns it makes.  It does look like that every block of terraced houses has a BT feed coming up from the ground into one of the ends of the block.

Let me know if you need anything else. 

I had a spare HG612 and have put the newwer blob on this, I might when I go to redo the cabling to the UPS install this inplace of the other hacked HG612.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 23, 2013, 09:15:33 AM

I have attached the plink logs and the data from the graphd ran at 140 days.  Concerning the distance from the CAB am about 200m as the crow flies and all the cabling is underground.  Couldn't say how many twists and turns it makes.  It does look like that every block of terraced houses has a BT feed coming up from the ground into one of the ends of the block.

Let me know if you need anything else. 

I see the ongoing graphs for the period start at 22:27, 11/03/2013.

Can you go back even further (to before the phone problem was repaired) & also include the FULL_MONTY montage?

Looking at the DS SNRM graphs in particular, we can see a number of small 'dips'.
I wonder if these have always been present?

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 23, 2013, 10:16:21 AM
Just for 'interest', compare your stats with another 80/20 service.

I believe the other service is around 150m from the cabinet.
Perhaps ColinS would care to confirm as it's his connection.

Coilin's connection shows slightly more background noise at some frequencies, but attenuation is quite a bit lower.

Hence a completely different looking bitloading pattern & 'better' SNR & Hlog graphs.

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 23, 2013, 11:52:23 AM
Hi Bald Eagle,

Please find attached the plink log and montage for 3/10/12 looks like the oldest stats I have on the 80/20 service, and stats for 12//12/12 which was before I noticed the phone was dead.  That said even though the phone was dead the FTTC continued to operate.

Am going to look on some backup tapes to see if I have anything older, I know I don't have any for when I was on the 40/2 it was only after I moved to 80/20 did I get another HG612 and unlock that.

It is interesting in comparing the stats of ColinS observing a better SNR.
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Bald_Eagle1 on June 23, 2013, 08:45:05 PM

Please find attached the plink log and montage for 3/10/12 looks like the oldest stats I have on the 80/20 service, and stats for 12//12/12 which was before I noticed the phone was dead.  That said even though the phone was dead the FTTC continued to operate.

Am going to look on some backup tapes to see if I have anything older, I know I don't have any for when I was on the 40/2 it was only after I moved to 80/20 did I get another HG612 and unlock that.




Here's an animation of 5 Plink log graphs from your connection, starting 03/10/2012.

It doesn't seem to have changed much at all.

The bitloading looks poorer in the October 2012 graphs, probably due to the connection syncing at a quieter time of day than when the Plink log was obtained:-

(http://t.imgbox.com/adtsU0EE.jpg) (http://imgbox.com/adtsU0EE)

Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Korben_dallas on June 27, 2013, 05:23:43 PM
Hi Bald Eagle,

Again my thanks for taking the time to analyse my data,  it is good to know that there is nothing seriously wrong.

I look forward to the next release of the HG612 Stats program.

Cheers
Title: Re: Huawei HG612 Stats & Graphing Programs for VDSL2 (FTTC) Windows Users
Post by: Ronski on August 31, 2013, 07:20:59 PM
For anybody finding this thread from previous links there is a new thread for version 1.1 (http://forum.kitz.co.uk/index.php/topic,12738.0.html)