Kitz Forum

Broadband Related => FTTC and FTTP Issues => Topic started by: tristan on July 15, 2012, 12:51:11 PM

Title: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 15, 2012, 12:51:11 PM
Hello all,

I'm looking for some help interpreting my line stats from xdslcmd for BT Infinity. The issue:

- Our house is in the middle of nowhere exchange-speaking so I am well aware we will never get the full speed (I had hoped to get >2 mbps download, however!)
- We were initially given an estimate of 'up to 20.4 mbps' which was revised to 5 mbps when the install was completed.
- We are now getting ~1.4 mbps on a good day, 0.7 mbps on a bad...

Attached are some graphs from xdslcmd over a few days.

Is my line just too bad?
Is there anything I can do?
Who would be best to contact at BT about this and how?
Will BT re-lay lines if it can be shown the connection is so bad?

I've posted to the BT forums (http://community.bt.com/t5/BT-Infinity/Rural-speed-issue-help-interpreting-xdslcmd-stats/m-p/573567/highlight/false#M54226), contacted the moderators and tweeted to try and get it looked into.

All help gratefully received.

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on July 15, 2012, 03:30:26 PM
Hello Tristan

I don't know how BT where able to go ahead with fibre installation with a revised estimate of 5Mbps, How far are you from the Large Green cabinet (Fibre) ?

Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 15, 2012, 03:48:24 PM
Hey - I'm just looking into that now. I was led to believe that we were at the top end of the range for ADSL (5 km?) so presumably the distance to the cabinet should be less. Trying to work out how to get the exact location of cabinet. Any tips?
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on July 15, 2012, 03:57:00 PM
If you know where the exchange is usually the line from the exchange runs under the roads to the Cabinet then again along the road to your telegraph pole.

there is a postcode cab checker out there but it does not show you the true location.

the problem is fibre is worse over long distances adsl is better over long distances
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on July 15, 2012, 04:12:41 PM
If it helps Tristan you can compare my stats with yours and I am 0.53 miles (852 meters) from cabinet.


Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on July 15, 2012, 06:46:59 PM
Hello Tristan

I don't know how BT where able to go ahead with fibre installation with a revised estimate of 5Mbps, How far are you from the Large Green cabinet (Fibre) ?

Until recently, the protocols were that if once installed, the engineer had to ring the Fibre SMC if it ended up as a sub 15Meg product. Now, the proviso is that if the finished article is less than half the predicted speed. At 1.4Meg, the OP obviously has a shout.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 15, 2012, 07:02:57 PM
Until recently, the protocols were that if once installed, the engineer had to ring the Fibre SMC if it ended up as a sub 15Meg product. Now, the proviso is that if the finished article is less than half the predicted speed. At 1.4Meg, the OP obviously has a shout.

Thanks for this. Are you suggesting that BT Wholesale / SMC might help to get a solution? I am quite nervous as, some years ago, I was under the impression that if the connection supplied wasn't over a particular level, BT would simply switch it off. Meaning no internet access for us!

On the ThinkBroadband forum I'm getting some help finding the cabinet and getting a rough distance.

http://forums.thinkbroadband.com/fibre/f/4140623-rural-fttc-issue-help-interpret-xdslcmd-stats.html#Post4140704
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on July 15, 2012, 07:47:58 PM
Hello Tristan,

Welcome to kitz.co.uk!

- We are now getting ~1.4 mbps on a good day, 0.7 mbps on a bad...

What speeds were you getting on ADSL?   At a guess, the poor performance may be due to a faulty line rather than the extended distance. Notice the heavy noise even on the lowest subcarriers. 

Can you beg, borrow or steal a Mole, Hawk or similar to run some TDR tests?  They would reveal the loop length and could reveal a high resistance fault causing that high attenuation and noise.

cheers, a
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 15, 2012, 08:20:43 PM
Hello Tristan,

Welcome to kitz.co.uk!

- We are now getting ~1.4 mbps on a good day, 0.7 mbps on a bad...

What speeds were you getting on ADSL?   At a guess, the poor performance may be due to a faulty line rather than the extended distance. Notice the heavy noise even on the lowest subcarriers. 

Can you beg, borrow or steal a Mole, Hawk or similar to run some TDR tests?  They would reveal the loop length and could reveal a high resistance fault causing that high attenuation and noise.

cheers, a

We were getting a whopping 512 down and 256 up. But at least it was pretty constant. When it was windy or rainy (typical for our bit of Northern Ireland) the connection would drop, but we could live with that!

Alas, I doubt I'd be able to get any kit to do TDR tests. Your point about the attenuation and noise is what I'd like to be able to take to BT to state my case about getting something done. I am getting called back tomorrow by someone who has raised a fault with BT wholesale, and I'd like to be able to direct the discussion somewhat. He has stated that our connection measurements were the worst he has seen...

I doubt I am alone in this - we are not the only people in my area (countless farms etc) who are probably less technically adept and resorting to satellite connections.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on July 15, 2012, 09:11:49 PM
When it was windy or rainy (typical for our bit of Northern Ireland) the connection would drop, but we could live with that!

Alas, I doubt I'd be able to get any kit to do TDR tests. Your point about the attenuation and noise is what I'd like to be able to take to BT to state my case about getting something done.

If it is going to be a protracted case, it's maybe worth getting a Mole (as little as £40 from ebay).  Useful to point the engineer towards the likely location of the fault, if there is one.  You still only got 512Mbps with ADSL (1?).  How far is the exchange?

Based on your estimated loop length, maybe plot a graph of attenuation vs frequency, using the BT cable reference model. With ideal parameters, i.e. a loop formed from one continuous, homogeneous pair of 0.5mm copper, the graph should illustrate the magnitude of the attenuation you might expect.

Quote
I am getting called back tomorrow by someone who has raised a fault with BT wholesale, and I'd like to be able to direct the discussion somewhat. He has stated that our connection measurements were the worst he has seen...

Don't worry. The dentist said the same about Our Wayne's teeth, but he soon had them whipped out  :-X

Not so sure that BT will be willing to remove your rotten cabling. Is there any evidence of a fault in the voiceband?  Crackling, hissing, etc?

Quote
We were getting a whopping 512 down and 256 up. But at least it was pretty constant. When it was windy or rainy (typical for our bit of Northern Ireland) the connection would drop, but we could live with that!

That is evidence of a fault.   In a rural area, much of your line is pole-strung?  With well-made joints, there still shouldn't be any disconnections, though.

cheers, a
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 15, 2012, 09:33:22 PM
If it is going to be a protracted case, it's maybe worth getting a Mole (as little as £40 from ebay).  Useful to point the engineer towards the likely location of the fault, if there is one.  You still only got 512Mbps with ADSL (1?).  How far is the exchange?

Thanks, I'll look one up. Yep, only 512... I believe we are just over 4 miles by road from the exchange. However, we are much closer to different exchange - I remember asking about being moved... It focussed the mind on what to download! Whilst I was doing my PhD I'd try to work from home over holidays etc. That's when all the time spent doing things from the command line paid off! I couldn't get enough bandwidth for a decent X forward or VNC.

Based on your estimated loop length, maybe plot a graph of attenuation vs frequency, using the BT cable reference model. With ideal parameters, i.e. a loop formed from one continuous, homogenous pair of 0.5mm copper, the graph should illustrate the magnitude of the attenuation you might expect.

Quote
I doubt I am alone in this - we are not the only people in my area (countless farms etc) who are probably less technically adept and resorting to satellite connections.

Kudos to the late Sir Arthur C. Clarke..

Arthur C Clarke, king of sci-fi and 'inventor' of the 'geostationary satellite'  :D

How right you are, sir. I'm loathe to give any of the satellite broadband companies my money, however, until they are more reasonably priced!

I hadn't realised you had developed the hacked firmware for the HG612 - excellent work! I'll read up on the BT reference model and get something coded up.

Thanks for your help.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Bald_Eagle1 on July 15, 2012, 11:38:08 PM
Looking at your pbParams stats, it is clear that your connection can only use some of the lowest frequency downstream band D1.

Signal & Line Attenuation is 35dB or so for that band in which a little less than 500 bit-loading tones are useable.

These lower tones are at ADSL2+ frequencies & with attenuation of 35dB, the Kitz ADSL calculator suggests a line length of 2.5km & a sync speed of 11712 kbps.

Even the typical attenuation of 13.81 dB per km, used for 0.5mm copper in calculations etc. suggests 2.5km or so line length (from the cabinet for FTTC).

I have attached the graphs from a 1600m or so connection for comparison purposes.
Again, only the lowest frequency D1 band is useable.
However, sync speed is much higher than on your connection.

I notice your DS TX Power seems quite low which no doubt has some effect on sync speed.
Mine is usually around 12dBmV to 13 dBmV over around 1000m & the graphed example reports 11.1dBmV.

If your cabinet is a long way from the exchange, nearby ADSL signals will already have weakened due to the copper distance from the exchange.
So to avoid your own FTTC connection drowning them with crosstalk, it could be that your power levels have been reduced accordingly, thus lowering your own sync speed.

There may also be other factors to consider such as very high error counts, high Interleaving depth etc.

Would it be possible for you to post a copy/copies of your xdslcmd log(s) for us to have a closer look? Windows or Linux format would be O.K.

The Windows version of the scripts also uses "xdslcmd info --stats" for data.
It would be good to include that too.

All the relevant data results in a Windows log file of around 330KB in size (too large to upload to this forum).
However, zipped, the filesize is around 61KB, so can be uploaded here.

I have to admit that I have no realistic idea what FTTC sync speeds you should expect for your line length (assumed 2.5km).
However, I would have thought it could/should be a little better than you report.

Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 16, 2012, 09:19:20 PM
Cheers Bald_Eagle1, I'll get those extra logs posted tomorrow. I'm working remotely so I need to make sure someone leaves a computer on so I can ssh in to it!

This is all very interesting - I have a lot of reading to do!

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 16, 2012, 10:25:14 PM
Would it be possible for you to post a copy/copies of your xdslcmd log(s) for us to have a closer look? Windows or Linux format would be O.K.

The Windows version of the scripts also uses "xdslcmd info --stats" for data.
It would be good to include that too.

All the relevant data results in a Windows log file of around 330KB in size (too large to upload to this forum).
However, zipped, the filesize is around 61KB, so can be uploaded here.

Actually - was able to get in and generate the attached file. Is this any use? I can change my script to get any other figures.

Thanks,

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 16, 2012, 10:47:56 PM
And a 2nd set after doing a remote reboot (using equipcmd 33) as the download speed is truly terrible... 281 kbps. Unbelievable.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Bald_Eagle1 on July 16, 2012, 11:23:52 PM

Actually - was able to get in and generate the attached file. Is this any use? I can change my script to get any other figures.


That log was fine for generating the "snapshot" graphs.

I have attached the montage produced by my script to get the plots into the same format as mine for comparison purposes.

It really is a poor connection isn't it?

Has it gradually deteriorated over a few days, or has it always fluctuated?

Your current DS sync speed of only 281 Kbps is unbelievably low, yet your Interleaving depth, Impulse Noise Protection & delay are quite low values:-


D:      5      21
INP:      3.00      4.00
delay:      6.00      8.00


Strangely, pbParams is reporting that all 3 DS bands are useable:-

Medley Phase (Final) Band Plan
US: (0,95)
DS: (32,859) (1216,1963) (2792,3959)

Usually only the useable bands are reported.

Power levels also look rather strange:-

Pwr(dBm):    101.2       10.4

It's hard to say what the issue could be.
Maybe a faulty modem throwing up spurious results?
Possibly a line fault?

Is your best sync speed the 1997 Kbps as shown in a couple of your previous graphs?

Your error seconds aren't the highest values I have seen for the 17 hours or so connection up time, neither are various other errors.

Does your connection regularly resync "on the fly"?
Retrain Reason:   2 suggests a resync rather than a reboot that would be reason 0.

The modem's inbuilt logs (when enabled) should keep tabs on all disconnections/reconnections.

As I haven't previously seen any VDSL2 stats from such a long line, I don't know if the performance (lack of) you are seeing is "typical" or not.

Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Bald_Eagle1 on July 16, 2012, 11:33:14 PM
And a 2nd set after doing a remote reboot (using equipcmd 33) as the download speed is truly terrible... 281 kbps. Unbelievable.


TBH, that's not much better (383 Kbps), but some of the stats do now look a little more valid.

The BT Care forum didn't seem too helpful:-
"we  cannot advise  on problems of this nature as  the openreach modem is a locked device  and it is against forum rules  to advise on hacked devices"

Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on July 17, 2012, 12:16:24 AM
I am getting called back tomorrow by someone who has raised a fault with BT wholesale, and I'd like to be able to direct the discussion somewhat. He has stated that our connection measurements were the worst he has seen...

From your stats (up to DMT#512)..

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww3.picturepush.com%2Fphoto%2Fa%2F8748391%2F480%2Ftristan%2Fqln.png&hash=f98faaad45092e5f715bb070c0db2d16d81d59aa) (http://picturepush.com/public/8748391)

In terms of RF pollution, it looks like BBC Radio 4 has the slight lead over RTE Radio 1.

It's time that BBC Radio 4 (AM) was told to pipe down with its pips.  My sympathies - we suffer constant online harassment from Edwina Currie (BBC Radio 5 on 693kHz).

On a serious point, it's difficult to see what you could do. Are you on very elevated ground? Does BT ever shield pole-strung cable to solve RF ingress? 

cheers, a

P.S. cold comfort for you, perhaps, but there is a fun project here - the programmatic analysis of QLN data from CPE to recover geolocation data from RF ingress.

There are some algorithm ideas here for "cluster detection", using the opencv function library. [1]

Perhaps the key to success is to geolocate using the QLN noise spikes from the 'tiddler' commercial stations since their transmitter output power (i.e. reception range) will generally be much lower than for the national radio stations.

[1] http://stackoverflow.com/questions/356035/algorithm-for-detecting-clusters-of-dots
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on July 17, 2012, 12:23:05 AM
Quote
The BT Care forum didn't seem too helpful:-
"we  cannot advise  on problems of this nature as  the openreach modem is a locked device  and it is against forum rules  to advise on hacked devices

I read that post on the BT Forum to Bald_Eagle1, God help me if I need help there  :'(
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 17, 2012, 09:55:30 PM
In terms of RF pollution, it looks like BBC Radio 4 has the slight lead over RTE Radio 1.

It's time that BBC Radio 4 (AM) was told to pipe down with its pips.  My sympathies - we suffer constant online harassment from Edwina Currie (BBC Radio 5 on 693kHz).

On a serious point, it's difficult to see what you could do. Are you on very elevated ground? Does BT ever shield pole-strung cable to solve RF ingress? 

Wow - so are you saying there is so much RF 'cross talk' from LW and MW that, potentially, our line is too noisy? Would this stem from not-properly-covered wiring/junction boxes etc? The wiring by us could be _very_ old. We are on a pretty flat piece of rural NI (http://goo.gl/maps/7bsT).

Hard to know the cause for sure but BT are sending someone down to look at the line from cabinet to the house tomorrow. I'll take your input and try to get the engineer to check for the things you mentioned.

Thanks again,

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on July 18, 2012, 04:52:10 AM
RF ingress from AM broadcast radio certainly adds a lot of noise within those bands, but that only affects the lowest (ADSL1) subcarriers. So what else is going on higher up in the VDSL2 spectrum?   It looks pleasantly quiet between DMTs #470 - #490, but then it gets noisy again around DMT#1400 and DMT#1700.

Hope you get some resolution.

cheers, a
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Bald_Eagle1 on July 18, 2012, 08:51:17 AM
Hi Tristan,

This & the preceding messages may, or may not be of interest to you:-

http://forums.thinkbroadband.com/fibre/f/4141202-fibre-help-pleaseeee.html?page=1&fpart=2#Post4141310
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 18, 2012, 12:15:19 PM
Hmm, so we may be in a fix... Thanks for all the help and I'll report the outcome later. It is frustrating being in London and having to liaise with BT via my mother who is at home!

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on July 18, 2012, 12:46:12 PM
I would go back into the BT forums again this time without the Stats, and ask for a Moderator to look into your very Slow Infinity package, yes you are 2X faster than your old ADSL but someone in BT said your expected download would be 20Mbps which is not right.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on July 19, 2012, 12:43:48 PM
Guys,

Thanks once again for all your input. What did we do before the internet?

So the BT came down and checked our socket, and line -> road. Agreed there was a problem after, funnily, the tool gizmo they use couldn't sync at all to the cabinet. Off he went to the cabinet to check, and yep, a problem. He did something at the cabinet end and, overnight, our reported speed has improved. See attached.

I'm guessing this will change (hopefully upwards) over the next few days? The one thing that is strange is that our actual download speed hasn't changed (a quick test by my sister using one of the speed tester sites indicates ~0.25 mbps). I also attach the latest stats.

The engineer is checking back tomorrow I think so it we should be able to get that seen to. It would be interesting to know if the interference is still present so we can get him to check each length of line for problems.

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Bald_Eagle1 on July 19, 2012, 02:43:54 PM
That looks a lot better.

The noise spikes are still present at the lower frequencies, but your SNRM of 10.0dB suggests some more can be squeezed out speed-wise.

The connection may require a DLM reset back to a wide open profile & be allowed to retrain to a stable level accordingly, although it doesn't appear to be "stuck" as sync speed has increased to 3929 Kbbs.

Sometimes the ROUTER/HUB (NOT the MODEM) needs disconnecting/reconnecting to force a new PPP session without actually causing a resync.
This usually resets IP Profile to be in relation to sync speed (96.79% of it to be quite precise for FTTC connections).
Your IP Profile may be currently stuck at the level applied when sync speed was much lower.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 17, 2012, 01:29:24 PM
Guys,

Thought you might like an update. BT (via their Twitter folk) have been very helpful. However, BT Wholesale (or whoever it is that comes out) are not quite there.

We have had countless visits - checking the cabinet (fault found) to checking the house internal cabling and replacing it (no fault found but they thought they'd give it a go anyway). I get the impression the people called out are 'installers' rather than engineers (when will the UK protect that term?). I am having it escalated as high as I can via BT, although the constant back and forth with BT Wholesale is incredibly frustrating.

The new findings are:

1) it is not the internal house cabling/box on the wall
2) it is not the cabinet
3) something is happening between midnight and 5am that causes the speed to drop (according to BT Wholesale)
4) the BT machine fails to sync when they plug it in...

What I am trying to do is gather together the evidence I have with some interpretation suitable for the BT folk to pass on to BT Wholesale and propose some next steps (check the copper might be a good one).

Bald_Eagle1, asbokid, would you be willing to check what I write to ensure it is technically correct and, more importantly, useful for whoever this gets escalated to?

Attached is the latest stats output and plot.

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: burakkucat on August 17, 2012, 05:42:41 PM
Quote
However, BT Wholesale (or whoever it is that comes out) . . .

They will be employees of Openreach, a division of the BT Group plc.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Bald_Eagle1 on August 17, 2012, 07:33:20 PM
Hi Tristan,


I have been looking through your latest stats & a few of them look "strange" when compared against any other VDSL2 stats that I have looked at over almost a year now.


Retrain Reason 2 - usual reason for an "on the fly" resync.



Medley Phase (Final) Band Plan
US: (0,95)
DS: (32,859) (1216,1963) (2792,3959)  

That suggests that after training up from the reboot, all 3 downstream bands are available for bit-loading.
That is surprising, as connections with such high attenuation as yours simply do not show all 3 bands as being available at Medley Phase.

e.g. My connection is quite poor for VDSL2, but much better than yours.
However, I still can't use all the bands at Medley Phase:-

Medley Phase (Final) Band Plan
US: (0,95) (868,1207)
DS: (32,859) (1216,1963) 


DS Attainable Rate 2368 Kbps - The lowest I have seen on a VDSL2 connection.

Sync speed 410 Kbps - By far the lowest I have seen & less than 1/5 your Attainable Rate.

SNRM 19.5 dB - suggests your connection is able to achieve a higher sync speed, perhaps approaching the 2368 Kbps.

Really high attenuation, also confirmed in the Hlog graph.

Available seconds (AS:) 16949   (around 4.7 hours) matches the reported Since Link time = 4 hours 42 min 27 sec, so O.K.

UnAvailable seconds (UAS:)      10283      10283 - The highest I have seen on ANY connection.

Serious Error Seconds (SES:)      423      0 - Looks quite high.

Error Seconds (ES:)      32922      4787 - Not sure where that is from. Adding DS SES, UAS & AS together only comes to 27655.

Pwr(dBm):   1.5      10.4 - DS at 1.5 looks really low. Mine is 12.4, roughly double my US of 6.3.

Interleaving (D:)      7      1 - Really low, almost OFF, suggesting a really stable connection.



As you appear to be a Linux user, you are unable to monitor & graph your ongoing stats 24/7 using our scripts, so we are unable to see what happens between midnight & 5am.
However, Eric (Roseway) has been developing Windows & Linux versions of a monitoring program that you may be able to leave running overnight, auto-generating snapshot graphs at intervals. This may yield SOME clues?
(see this thread :-   http://forum.kitz.co.uk/index.php/topic,11534.0.html)



Code: [Select]

# xdslcmd info --pbParams
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 2
Max: Upstream rate = 1160 Kbps, Downstream rate = 2368 Kbps
Path: 0, Upstream rate = 1160 Kbps, Downstream rate = 410 Kbps

Discovery Phase (Initial) Band Plan
US: (0,95) (868,1207) (1972,2783)
DS: (32,859) (1216,1963) (2792,3959)
Medley Phase (Final) Band Plan
US: (0,95)
DS: (32,859) (1216,1963) (2792,3959)
       VDSL Port Details       Upstream        Downstream
Attainable Net Data Rate:       1160 kbps          2368 kbps
Actual Aggregate Tx Power:       10.4 dBm           1.5 dBm
============================================================================
  VDSL Band Status        U0      U1      U2      U3      D1      D2      D3
  Line Attenuation(dB): 20.5 84.0   N/A   N/A 35.5 0.1 0.1
Signal Attenuation(dB): 18.9   N/A   N/A   N/A 35.5 0.1 0.1
        SNR Margin(dB): 6.2   N/A   N/A   N/A 19.5 0.0 0.0
         TX Power(dBm): 10.5   N/A   N/A   N/A 1.5 -128.0 -128.0



Code: [Select]

# xdslcmd info --stats
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason: 2
Max: Upstream rate = 1164 Kbps, Downstream rate = 2384 Kbps
Path: 0, Upstream rate = 1160 Kbps, Downstream rate = 410 Kbps

Link Power State: L0
Mode: VDSL2 Annex B
VDSL2 Profile: Profile 17a
TPS-TC: PTM Mode
Trellis: U:ON /D:ON
Line Status: No Defect
Training Status: Showtime
Down Up
SNR (dB): 19.6 6.3
Attn(dB): 0.0 0.0
Pwr(dBm): 1.5 10.4
VDSL2 framing
Path 0
B: 57 31
M: 1 1
T: 4 51
R: 16 0
S: 4.4755 0.8620
L: 143 297
D: 7 1
I: 80 32
N: 80 32
Counters
Path 0
OHF: 1257032 15452
OHFErr: 0 0
RS: 15087415 1324715
RSCorr: 5889 0
RSUnCorr: 0 0

Path 0
HEC: 0 0
OCD: 0 0
LCD: 0 0
Total Cells: 13076794 0
Data Cells: 338654 0
Drop Cells: 0
Bit Errors: 0 0

ES: 32922 4787
SES: 423 0
UAS: 10283 10283
AS: 16949

Path 0
INP: 3.00 0.00
PER: 13.42 10.98
delay: 7.00 0.00
OR: 46.47 23.29

Bitswap: 16 3




Unfortunately, I don’t know what all that means in terms of faults.

I would be very tempted though to try another unlocked modem (just to eliminate hardware issues & see if the same “strange” data is obtained).

FWIW, I have attached Windows versions of your snapshot graphs, using the data from your most recent log file.


Cheers,


 Paul.


EDIT:

Edited the comment about Retrain Reason.
Retrain Reason 2 is usually from an "on the fly" DLM initiated resync, & possibly a resync caused by a profile change.
Retrain Reason 0 is usually from a reboot.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 17, 2012, 08:42:21 PM
Tristan quoted ...................

"I get the impression the people called out are 'installers' rather than engineers".

As a qualified Electrical Engineer, I can understand your comments fully. But for pedants sake, the term 'Engineer' has been banded about for eon's when referring to 'us' Openreach guys. God only knows who or how it became so, but I can tell you that it wasn't from BT. As far back as I can remember, we have always been known professionally as 'Technicians'.

Only when I was on the 'Power & BES' group was I referred to as a 'Power engineer'. On this side of the fence, dependant on skill set, we are called Technician 2B (T2B), Technician 2A (T2A), and the following are grades that are still tagged to individuals, but are now obsolete and will be lost as and when the individuals retire. They are Technician 1 (T1), Senior Technician (ST) and Technical Officer (TO).

As you will see, nowhere in our descrip do we refer to ourselves as 'engineers'. So the term is protected as far as BT are concerned. ;) :)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on August 17, 2012, 10:03:28 PM
Hello Tristan,

The RF interference from AM broadcast radio looks dramatic, but when quantified by the number of tones affected by the ingress, it probably doesn't impact the overall DSL performance that badly.

Channel bandwidth in Europe for AM broadcast radio is only 9kHz, meaning that ingress from an AM radio station should only impact two or three DSL subcarriers.

Using a re-purposed wavelet-based peak-det algorithm:  [1]

Code: [Select]
$ R
library(MassSpecWavelet)
# Loading required package: waveslim
qlnDAT <- read.table("qln.txt", colClasses = c(rep("NULL",1), rep("numeric",1)), header=TRUE)
qlnMAT <- data.matrix(qlnDAT)
wCoefs <- cwt(qlnMAT, scales=seq(1,31,1), wavelet='mexh')
localMax <- getLocalMaximumCWT(wCoefs)
ridgeList <- getRidge(localMax)
majorPeakInfo <- identifyMajorPeaks(qlnMAT, nearbyPeak=TRUE, ridgeList, wCoefs, SNR.Th=1)
peakIndex <- majorPeakInfo$peakIndex
#

The tones notably affected by AM broadcast ingress (and other RFI) are the following.  From a total of some 4000 tones, it's not that many, really.   The line attenuation is the real service killer...

Code: [Select]
peakIndex

   127    167    188    211    238    253    282    311    451    562    763
   777    858   1216   1324   1391   1405   1430   1506   1604   1687   1704
  1736   1791   1885   1962   2799   2819   2913   2970   3006   3099   3192
  3286   3324   3380   3433   3472   3537   3567   3763   3959

And plotted..

Code: [Select]
plotPeak(qlnMAT, peakIndex, main=paste("identified QLN peaks"))

(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww1.picturepush.com%2Fphoto%2Fa%2F8997424%2F480%2Ftristan%2FScreenshot-from-2012-08-17-21%253A14%253A38.png&hash=f39f157b97e778789d270dd2ade767c4aba63d14) (http://picturepush.com/public/8997424)

Suggesting that the real problem, as Paul has already said, is the high attenuation on the line. A consequence, as you mentioned before, of suffering a loop of considerable length. An unfortunate property of the twisted pair. As such, even if every joint was re-made between your home and the cabinet, it still might not result in an improvement.

What can be done?  It's optimistic to hope that any more tweaking by Openreach is going to improve the performance - short of running fibre to your doorstep. As such, I would be tempted to ditch DSL and look for another solution.

What about establishing a private point-to-point microwave link from your community to the nearest town?  It sounds very expensive or complicated but it's neither.  Just a few hundred pounds and an afternoon's work can result in a surprisingly good job.

There is a specialist firm, Stella Doradus, in Waterford, [2] who sell all the kit needed. Helpful people too :)  With a pair of high gain (22dBi) parabolic dishes and good quality transceivers, it is possible to form a decent microwave link of some miles. With the right antennas, a point-to-point wi-fi bridge of 25 miles even using domestic 802.11 kit, isn't unheard of  ;)

cheers, a


[1] http://forum.kitz.co.uk/index.php/topic,11503.msg221918.html#msg221918
[2] http://www.stelladoradus.com/

Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: burakkucat on August 17, 2012, 10:33:38 PM
Quote
As far back as I can remember, we have always been known professionally as 'Technicians'.

It goes back to the days before Black Sheep even existed as a little Black Lamb . . . back to the days when the General Post Office provided the nation's telephone service. I first heard the descriptor "GPO Telephone Engineer" used in the 1950s.

Before all-figure numbering was introduced, when one wished to report a fault with the telephone service one would dial ENG and the call would then be answered at the fault desk of the local exchange -- usually with the one word: "Engineers". Immediately after all-figure numbering had been introduced, the number 151 was used as the replacement for the ENG code.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 18, 2012, 07:22:58 AM
Interesting stuff, BK. Wasn't aware of that. :o :)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on August 18, 2012, 08:04:06 PM
Would good coaxial sheilding help provent AM interference on the BT copper wire infrustucture ? 

I say this as the 1970's & 80's phone lines was not designed for high frequencys (Fibre)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: burakkucat on August 19, 2012, 02:46:37 AM
In theory a screened twisted pair (with the screening earthed at both ends) would be a great improvement.  :)

In practice such a configuration would never be installed.  :(
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: c6em on August 19, 2012, 07:46:31 PM

It would indeed be interesting to know how much of the typical MW radio ingress into the line is due to the general line length E sides & D sides (underground) and how much is due to the last 50 yards of unshielded overhead drop wire.

Incidentally the specification for lay of the twists in std BT black sheathed drop wire is one twist every 89mm in the case of the orange/white pair and every 95mm in the case of the green/black pair.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 19, 2012, 07:50:11 PM
Nice one c6em, I didn't know that. May I ask where you get that info from, for my own personal use ? :)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: c6em on August 19, 2012, 10:02:38 PM

I first noted it from an un-recorded source and added to my personal knowlege store!
Then I saw it listed more recently with the same figures in a pdf document of a cable spec from B3 Cables Solutions - External 2 pair dropwire - complying with BT spec CW 1411
Finally I have taken to pieces a decades old gash/scrap section of dropwire and confirmed the figures as being correct.  I was doing this just to check whether the very early black dropwire stuff was indeed twisted pair.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 20, 2012, 02:08:35 PM
Thanks c6em, and  :lol: at you disecting an old DW to prove it !! Like yer style. ;D
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 20, 2012, 09:26:17 PM
I have been looking through your latest stats & a few of them look "strange" when compared against any other VDSL2 stats that I have looked at over almost a year now.

Thanks Ballk_Eagle1. This is most useful. I'm going to pass this on to the chap who's coming out tomorrow morning to take yet another look.

It really is quite frustrating - a new person comes each time, re-runs the same tests, says they can't understand what's going on, then tells us it needs to be escalated. When he leaves the max download will be ~5MB and the actual >4MB (due to the reset) so he goes away thinking they have made an improvement. Then overnight/the next few days it drops back down necessitating a more urgent next visit!

I'll will try and run those scripts you mentioned on a Mac that I have remote access to (how I run vdslcmd from here in London) and see if there's anything interesting.

What a saga!
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 20, 2012, 09:28:50 PM
Tristan quoted ...................

"I get the impression the people called out are 'installers' rather than engineers".

As a qualified Electrical Engineer, I can understand your comments fully. But for pedants sake, the term 'Engineer' has been banded about for eon's when referring to 'us' Openreach guys. God only knows who or how it became so, but I can tell you that it wasn't from BT. As far back as I can remember, we have always been known professionally as 'Technicians'.

Only when I was on the 'Power & BES' group was I referred to as a 'Power engineer'. On this side of the fence, dependant on skill set, we are called Technician 2B (T2B), Technician 2A (T2A), and the following are grades that are still tagged to individuals, but are now obsolete and will be lost as and when the individuals retire. They are Technician 1 (T1), Senior Technician (ST) and Technical Officer (TO).

As you will see, nowhere in our descrip do we refer to ourselves as 'engineers'. So the term is protected as far as BT are concerned. ;) :)

That's interesting. Thanks for the input. Who would be the best person to get this escalated to? A TO? I'm not sure who has been coming out but as they are on their own they can't check any individual stretch of line for us (they need 3 people I think to operate the cherry picker?) - each says it needs escalated so I guess we are gradually working our way up the ranks!
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 20, 2012, 10:46:59 PM
The RF interference from AM broadcast radio looks dramatic, but when quantified by the number of tones affected by the ingress, it probably doesn't impact the overall DSL performance that badly.

Channel bandwidth in Europe for AM broadcast radio is only 9kHz, meaning that ingress from an AM radio station should only impact two or three DSL subcarriers.

Using a re-purposed wavelet-based peak-det algorithm:
The tones notably affected by AM broadcast ingress (and other RFI) are the following.  From a total of some 4000 tones, it's not that many, really.   The line attenuation is the real service killer...

Suggesting that the real problem, as Paul has already said, is the high attenuation on the line. A consequence, as you mentioned before, of suffering a loop of considerable length. An unfortunate property of the twisted pair. As such, even if every joint was re-made between your home and the cabinet, it still might not result in an improvement.

What can be done?  It's optimistic to hope that any more tweaking by Openreach is going to improve the performance - short of running fibre to your doorstep. As such, I would be tempted to ditch DSL and look for another solution.

What about establishing a private point-to-point microwave link from your community to the nearest town?  It sounds very expensive or complicated but it's neither.  Just a few hundred pounds and an afternoon's work can result in a surprisingly good job.

There is a specialist firm, Stella Doradus, in Waterford, [2] who sell all the kit needed. Helpful people too :)  With a pair of high gain (22dBi) parabolic dishes and good quality transceivers, it is possible to form a decent microwave link of some miles. With the right antennas, a point-to-point wi-fi bridge of 25 miles even using domestic 802.11 kit, isn't unheard of  ;)

Thanks so much for this. I might try and replicate your work, just out of interest, and fire up R - not used it much and more accustomed to C/Fortran/Matlab.

As I wrote above another 'technician' (;-) ) is coming out tomorrow. I'll report all the help you guys have provided and hope that the guy sent out is suitably technical and willing to have a quick read to see if he agrees; the last guy was the best so far but maybe didn't have the level of knowledge contained within this forum. He did have some tales of broadband not working for folk and it taking weeks to work out that it was due to an electric fence being nailed to a cross-field pole. This has a high likelihood of occurring where we are!

As I see it, we have three issues that require checking/explaining:

1) The attenuation, if it can't be lowered by the discovery of any obscure issue along the line, is as you say the crux of it. OpenReach tell us it's >3.5km long, but our measurement makes it just over 2km. It is almost entirely above ground so we can follow it from the cabinet along the side of the road and to our house. Would there be any possibility of length reduction? Excess cable taken out? Checking that our line isn't doing any silly routing.

2) Why did the connection give a good stable 4mb (good enough for us) for a period of time before getting awful? Is it usual for the modem to initially sync at 4 or 5mb if the line can't sustain it? ie, if it did it once why can't it remain at that level?

3) The modem. This is the one bit of kit they haven't replaced in part, I think, due to the fact that the OpenReach diagnostic machine can't sync at all! Maybe a lightning strike frazzled something inside.

Regarding solutions, I agree - a microwave link would be a good one. We'd have to find a willing volunteer to host the base! I wonder if BT would allow us to nail it to the pole next to the cabinet! I'll ring those guys tomorrow and also google for suppliers closer by to see if any of the farms near us already have such a setup we could get involved with (we have one of the most advanced milking parlours in the UK nearby and I guess they would have a decent internet connection...).

The other, albeit slim, option might be to switch to an alternative line we had activated for ISDN some years ago (for a "civic" job posting, so we had no dealings with the management of it) that goes to a different exchange - the line goes left at the bottom of the drive rather than right... This would still be a long way from the cabinet but maybe just good enough. Were there similar length/attenuation specs for ISDN? This could be why the installation was done in that manner... We'll ask tomorrow for the guy to maybe check it if possible.

Thanks again,

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 20, 2012, 11:01:22 PM

It would indeed be interesting to know how much of the typical MW radio ingress into the line is due to the general line length E sides & D sides (underground) and how much is due to the last 50 yards of unshielded overhead drop wire.

Incidentally the specification for lay of the twists in std BT black sheathed drop wire is one twist every 89mm in the case of the orange/white pair and every 95mm in the case of the green/black pair.

So for the shortest possible path from cabinet -> home you would want green/black used? Although the difference would be small it could be significant in my case!
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 20, 2012, 11:12:32 PM
While I'm on a splurge of posting, attached is the temporal variation of our reported speeds since ~10th July.

Each point in green above 5000 bps is when an engineer came out and requested a reset on the line. The purple line shows a somewhat consistent decrease over time after each visit. Our upload is rock solid! Always seeking a positive, me. :-)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 21, 2012, 12:15:41 PM

It would indeed be interesting to know how much of the typical MW radio ingress into the line is due to the general line length E sides & D sides (underground) and how much is due to the last 50 yards of unshielded overhead drop wire.

Incidentally the specification for lay of the twists in std BT black sheathed drop wire is one twist every 89mm in the case of the orange/white pair and every 95mm in the case of the green/black pair.

So for the shortest possible path from cabinet -> home you would want green/black used? Although the difference would be small it could be significant in my case!

Unfortunately, it wouldn't make any noticeable difference to place you on the 'Green/Black', as it would only apply to the span from your house to the telegraph pole. The 'Green/Black' doesn't go all the way back to the PCP I'm afraid. :)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 21, 2012, 12:22:53 PM
Tristan quoted ...................

"I get the impression the people called out are 'installers' rather than engineers".

As a qualified Electrical Engineer, I can understand your comments fully. But for pedants sake, the term 'Engineer' has been banded about for eon's when referring to 'us' Openreach guys. God only knows who or how it became so, but I can tell you that it wasn't from BT. As far back as I can remember, we have always been known professionally as 'Technicians'.

Only when I was on the 'Power & BES' group was I referred to as a 'Power engineer'. On this side of the fence, dependant on skill set, we are called Technician 2B (T2B), Technician 2A (T2A), and the following are grades that are still tagged to individuals, but are now obsolete and will be lost as and when the individuals retire. They are Technician 1 (T1), Senior Technician (ST) and Technical Officer (TO).

As you will see, nowhere in our descrip do we refer to ourselves as 'engineers'. So the term is protected as far as BT are concerned. ;) :)

That's interesting. Thanks for the input. Who would be the best person to get this escalated to? A TO? I'm not sure who has been coming out but as they are on their own they can't check any individual stretch of line for us (they need 3 people I think to operate the cherry picker?) - each says it needs escalated so I guess we are gradually working our way up the ranks!

Bear in mind this is BT we are talking about Tristan. It certainly does not follow that the higher the grading, the greater their level of knowledge. Maybe in other industries, but we seem to apply a 'Bottom-about-face' policy. This is a massive subject though, and not really for this thread. So in a nutshell, the chap/chapess you need is a 'Multi-skilled CSE with Broadband and Fibre skills'. These are actually T2A's (like myself), and although they are amongst the lower paid technicians, they actually know far more than the other obsolete ranks. Pole-testers are T1 ranks, but don't know their left from their right  ;).   
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 21, 2012, 12:32:45 PM
Bear in mind this is BT we are talking about Tristan. It certainly does not follow that the higher the grading, the greater their level of knowledge. Maybe in other industries, but we seem to apply a 'Bottom-about-face' policy. This is a massive subject though, and not really for this thread. So in a nutshell, the chap/chapess you need is a 'Multi-skilled CSE with Broadband and Fibre skills'. These are actually T2A's (like myself), and although they are amongst the lower paid technicians, they actually know far more than the other obsolete ranks. Pole-testers are T1 ranks, but don't know their left from their right  ;).

Ahhhh. Interesting. That squares nicely with my experience. If only we could get someone who would check the line along the route! It does seem the older guys are a bit 'stuck in their ways' and don't quite cope with the changing pace. The last guy who came out recommended we got a 3G dongle for our internet needs! If only we had 3G coverage!

The best BT guy I ever met was a former BBC sound engineer (worked in the studios there recording orchestras and the like) who just loved signals, music and electronics. He fixed my BB in a flat in Glasgow and replaced the old linen(?) covered aluminium (it was silver and didn't look at all like copper) when he probably shouldn't have and seemed to really know his stuff. We had a great chat about hi-fis and speaker positioning.

Unfortunately, it wouldn't make any noticeable difference to place you on the 'Green/Black', as it would only apply to the span from your house to the telegraph pole. The 'Green/Black' doesn't go all the way back to the PCP I'm afraid. :)

Apparently we have aluminium cabling between us and the cabinet anyhow...

That is the current thinking of the guy out today who is muttering that our infinity 'should never have been installed'. Although they are still refusing to see where along the line his infinity diagnostic box stops syncing.

Am I wrong in thinking that a simple approach would be:

1) find a junction approx 1/2 way along the line
2) if diagnostic box syncs and shows all is fine, then
3) go along a 1/2 of the remaining distance to the next junction
4) repeat sync test
5) etc

They keep saying that the line is 'perfect' but the sense I get (again this is me managing this remotely) is that they are looking at voice frequencies and not higher ones...
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on August 21, 2012, 09:56:36 PM
Sorry Tristan but at the very start of your thread I was amazed that OR/BT put you on Fibre with your very low line throughput at the start.

BT/OR should not have moved you to Fibre unless the your line was capable of 15megs +

If this was my line with FTTC I would end the contract with BT give OFcom a call or email

http://www.ofcom.org.uk/
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 22, 2012, 07:36:59 AM
Sorry Tristan but at the very start of your thread I was amazed that OR/BT put you on Fibre with your very low line throughput at the start.

BT/OR should not have moved you to Fibre unless the your line was capable of 15megs +If this was my line with FTTC I would end the contract with BT give OFcom a call or email

http://www.ofcom.org.uk/

Incorrect. 'Sub 15 Meg' circuits have always been around, but once upon a time we had to ring every man and his dog to make sure everyone was happy for the circuit to remain on FTTC. The chap who had only ever got 0.5Meg was always more than happy to be getting (for example) 5Meg, and as such I have never reinstated a 'sub 15 Meg' product back to ADSL.

Plus, we don't need to ring anybody these days. If the EU is happy with 'Sub 15', then job done.

Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: burakkucat on August 22, 2012, 04:33:38 PM
Further to Black Sheep's explanation of the Openreach policy, I would like to suggest that the consciousness of a 15 Mbps DS lower-limit has arisen from BT Retail's marketing of their Infinity products.

Please remember that BT Retail is just a CP who purchases a the GEA product from Openreach and then resells it to its own end-users with its own name, terms of supply, etc, applied to it. It is true to say that there are no BT Retail Infinity installations that are sub-15 Mbs DS. However they, BT Retail, do offer another product -- the name escapes me at the moment -- that is something like Faster Broadband with Fibre. It is all just a marketing exercise by BT Retail!   ;)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on August 22, 2012, 05:39:34 PM
ah that may explain it burakkucat so Tristan is not on BT Infinity 1 or 2 he is using FTTC equipment but because its sub 15 Mbs it can't be call'd BT Infinity.

I wonder if tristan is still paying the £18.00 (BT Infinity 1) for his non BT infinity service ?
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 22, 2012, 05:58:13 PM
Cheers guys. Things are not looking good. And, yep, we are still paying full price!

The latest engineer said it should never have been installed. He checked our end (again), the cabinet (again) and removed any lightning protection. He didn't check the connection at any of the junctions along the way unfortunately and we still haven't had the 'boost' (is that the right term?) team out.

Attached are the line stats I ran at roughly 5 min intervals (there are a few gaps I think due to failed telnetting) from a few minutes (as long as it took me to write the script) from when he left to when I realised the line had gone to pot again. ATTDR is plotted on the 2nd Y axis.

As you can see the SNMR increases abruptly over 5 mins, just as the DS TxPwr drops along with the ATTDR. Would anyone car to hazard a guess why this would happen? Other than it being a long line of course... Also, is there anything else I could plot to shed any light? Now I have the script all I have to do is change the line number to read from my stats files.

Thanks,

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on August 22, 2012, 09:30:27 PM
Sorry Tristan but at the very start of your thread I was amazed that OR/BT put you on Fibre with your very low line throughput at the start.

BT/OR should not have moved you to Fibre unless the your line was capable of 15megs +If this was my line with FTTC I would end the contract with BT give OFcom a call or email

http://www.ofcom.org.uk/

Incorrect. 'Sub 15 Meg' circuits have always been around, but once upon a time we had to ring every man and his dog to make sure everyone was happy for the circuit to remain on FTTC. The chap who had only ever got 0.5Meg was always more than happy to be getting (for example) 5Meg, and as such I have never reinstated a 'sub 15 Meg' product back to ADSL.

Plus, we don't need to ring anybody these days. If the EU is happy with 'Sub 15', then job done.

And Black Sheep   if you came to me to buy a PC and I told you this will speed up your computing experience you hand me over your hard earned cash, then I tell you well it won't be as fast as I said it would be !

You would be peeved off or you would ask for your Money Back  ;)
Job not done Right !!!
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 22, 2012, 09:46:59 PM
Newtron .......... I was merely pointing out that your comment about 'Sub 15 Meg' was incorrect. There are thousands of this kind of connection out there.

If I was going to buy a PC from you, I would expect definitives about it's operating specification. This is because every component within that PC will be a 'known value'.
When ordering Broadband (ADSL or VDSL) there are so many 'unknowns', that only an estimate can be given. Granted, the early estimate the OP was given of 20Meg was amazingly wrong, but an estimate nontheless.

If there is no possible further enhancement on this OP's circuit, then I'm absolutely certain the OP would get his money back, especially if he presents proof of the '20Meg estimate'.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: NewtronStar on August 22, 2012, 10:10:29 PM
Newtron .......... I was merely pointing out that your comment about 'Sub 15 Meg' was incorrect. There are thousands of this kind of connection out there.

If I was going to buy a PC from you, I would expect definitives about it's operating specification. This is because every component within that PC will be a 'known value'.
When ordering Broadband (ADSL or VDSL) there are so many 'unknowns', that only an estimate can be given. Granted, the early estimate the OP was given of 20Meg was amazingly wrong, but an estimate nontheless.

If there is no possible further enhancement on this OP's circuit, then I'm absolutely certain the OP would get his money back, especially if he presents proof of the '20Meg estimate'.

Well thats it somehow tristan was given an estimate of 20.4megs for FTTC he may have used the BT web site http://www.dslchecker.bt.com/adsl/adslchecker.welcome which gave him a 20.4mbps false estimate, but by the time you have signed up for FTTC with BT and then an engineer comes round to install the HG612 to find your only going to get 5Mbps it's to late your stuck in a 18 month contract  :'(
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on August 23, 2012, 03:31:51 AM
...
As you can see the SNMR increases abruptly over 5 mins, just as the DS TxPwr drops along with the ATTDR. Would anyone care to hazard a guess why this would happen? Other than it being a long line of course...

Downstream Transmitter Power is determined and controlled by the DSLAM.   Why is it doing that?   To mitigate DSL crosstalk onto other pairs, perhaps?  If the DSLAM transceiver's output power is being cut back - i.e., that's not a reporting error - I can't think of any other reason.

Quote
Also, is there anything else I could plot to shed any light?..

Maybe some physical tests with TDR equipment to discover whether there are any major points of impedance mismatch between your home and the cabinet. Those would cause reflection losses in the signal.  The abutment of aluminium and copper conductors in your line, if that's what you've got, doesn't sound very promising.

Did you previously have better bandwidth with ADSL?

cheers, a
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 23, 2012, 12:31:57 PM
Well thats it somehow tristan was given an estimate of 20.4megs for FTTC he may have used the BT web site http://www.dslchecker.bt.com/adsl/adslchecker.welcome which gave him a 20.4mbps false estimate, but by the time you have signed up for FTTC with BT and then an engineer comes round to install the HG612 to find your only going to get 5Mbps it's to late your stuck in a 18 month contract  :'(

That's exactly what happened. We double, even triple, checked with the BT folk we could speak to in disbelief at the estimate before we signed up.

As part of the box ticking process yesterday we were asked to run the BT speedtest thing and report back; my mum (I can't run it remotely) accidentally put our number in the broadband checker and emailed me the estimate. Almost jumped for joy as if the problem had been resolved! Then I checked... 0.16 Mbps down, 0.6 up. Oh well.
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 23, 2012, 12:54:45 PM
...
As you can see the SNMR increases abruptly over 5 mins, just as the DS TxPwr drops along with the ATTDR. Would anyone care to hazard a guess why this would happen? Other than it being a long line of course...

Downstream Transmitter Power is determined and controlled by the DSLAM.   Why is it doing that?   To mitigate DSL crosstalk onto other pairs, perhaps?  If the DSLAM transceiver's output power is being cut back - i.e., that's not a reporting error - I can't think of any other reason.

Interesting. I've fed the graph and your suggestions (above and below) to BT via twitter. Hopefully it would get passed on to OR.

Also, is there anything else I could plot to shed any light?..
Maybe some physical tests with TDR equipment to discover whether there are any major points of impedance mismatch between your home and the cabinet. Those would cause reflection losses in the signal.  The abutment of aluminium and copper conductors in your line, if that's what you've got, doesn't sound very promising.

Would OR conduct such a test as a matter of course? ie, I assume they have a SOP/checklist they go through, and would this be on it? Anyhow, I've asked to have it done!

Did you previously have better bandwidth with ADSL?

We got a solid 512 kbps down and 256 up. I never bothered to pay for a higher speed as there was no guarantee of getting it! But again, when it rained or was overly windy this would drop off too - but it work afterwards.

We are preparing a nice letter to OFCOM in NI detailing all this. There seems to be less pressure on BT to upgrade/maintain their infrastructure in rural areas to actually support infinity. They have received public money to install the cabinets, and it mustn't be economic to make them of any use (we aren't the only people in our area to have this issue, one of the OR folk confided...). And then public money is also being spent to try and get coverage by other means: http://www.nwewn.com (awful website, but seemingly our only hope without finding a friendly person who'll allow us to stick a microwave transmitter on their property).

Tristan
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on August 23, 2012, 01:40:31 PM
As you can see the SNMR increases abruptly over 5 mins, just as the DS TxPwr drops along with the ATTDR. Would anyone care to hazard a guess why this would happen? Other than it being a long line of course...
Downstream Transmitter Power is determined and controlled by the DSLAM.   Why is it doing that?   To mitigate DSL crosstalk onto other pairs, perhaps?  If the DSLAM transceiver's output power is being cut back - i.e., that's not a reporting error - I can't think of any other reason.

Ahh, apparently, according to my mother, an engineer some engineers ago reduced the power on the line to make it more stable. The analogy he used was that of a leaky hosepipe. If you turn on the water pressure too high a lot of water will escape through the gaps. If you turn the pressure down you lose less along the way.

Is crosstalk a strong function of length? Or would, say, a really old bit of line that might have some damage along the way have higher crosstalk to a newer bit of line?
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on August 25, 2012, 12:58:13 AM
Hi Tristan,

Would OR conduct such a test as a matter of course? ie, I assume they have a SOP/checklist they go through, and would this be on it? Anyhow, I've asked to have it done!

I don't know. Probably not.

Quote
We got a solid 512 kbps down and 256 up. I never bothered to pay for a higher speed as there was no guarantee of getting it! But again, when it rained or was overly windy this would drop off too - but it work afterwards.

That is very poor though, and unreliable too.  I would be tempted to run my own TDR tests on the line (in all weathers), to perhaps identify the reason and location of the fault.  And perhaps even DIY the repair to save Openreach any more trouble :-X

Quote
We are preparing a nice letter to OFCOM in NI detailing all this. There seems to be less pressure on BT to upgrade/maintain their infrastructure in rural areas to actually support infinity. They have received public money to install the cabinets, and it mustn't be economic to make them of any use (we aren't the only people in our area to have this issue, one of the OR folk confided...). And then public money is also being spent to try and get coverage by other means: http://www.nwewn.com (awful website, but seemingly our only hope without finding a friendly person who'll allow us to stick a microwave transmitter on their property).

My views on re-nationising BT didn't go down very well last time, so I will keep them to myself!

The microwave p2p dishes can be quite discreet. A few weeks ago we were admiring a microwave p2p set-up on a very isolated farm of alpacas(!) on the Long Mynd (AONB) in the Welsh Borders.

cheers, a
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on August 25, 2012, 01:28:09 AM
As you can see the SNMR increases abruptly over 5 mins, just as the DS TxPwr drops along with the ATTDR. Would anyone care to hazard a guess why this would happen? Other than it being a long line of course...
Downstream Transmitter Power is determined and controlled by the DSLAM.   Why is it doing that?   To mitigate DSL crosstalk onto other pairs, perhaps?  If the DSLAM transceiver's output power is being cut back - i.e., that's not a reporting error - I can't think of any other reason.

Ahh, apparently, according to my mother, an engineer some engineers ago reduced the power on the line to make it more stable. The analogy he used was that of a leaky hosepipe. If you turn on the water pressure too high a lot of water will escape through the gaps. If you turn the pressure down you lose less along the way.

God knows. Not something I understand.  Perhaps one of our resident (off-duty) Openreach engineers could explain?

This would be general "line gain" ? In terms of transmission line theory,  when the TX power is increased, the SNR increases (further elevating the signal above the background noise), and the reliability of the communication is therefore enhanced (reduced bit error rate, or similar measure).  But there's a compromise when too great a TX power causes crosstalk onto other twisted pairs in the same cable bundles from you to the cabinet/exchange.   DSL services on those pairs will interpret that crosstalk as noise and it will impair the transmissions on those lines.  That's why CPE (and DSLAM linecards) have Power Spectral Density (PSD) masks. They are laid down by Ofcom.  The PSD masks limit the TX power according to frequency, in the hope of limiting that crosstalk, for the benefit of all subscribers.

That said, the DSLAM appears to be cutting back its TX power some time after initialisation. Yet, the PSD mask should be in place at the initialisation.  I really don't know. Sorry.

Quote
Is crosstalk a strong function of length? Or would, say, a really old bit of line that might have some damage along the way have higher crosstalk to a newer bit of line?

There are two types of DSL crosstalk, near-end (NEXT) and far-end (FEXT).   FEXT must be a function of loop length. The further away is the far-end, the more noise the signal will acquire en route.  NEXT must presumably have some correlation to length, too.  A signal from a long loop arrives at the DSLAM very degraded, so NEXT would only aggravate that.

The line statistics data obtainable from a CPE modem, e.g. the HG612, is limited insofar as it is only frequency domain-based. The metrics Hlog, SNR, Bit Loading, QLN, obtained from the modem are all measured per subcarrier or DSL tone or bin, spaced every 4312.5 Hz.  Those statistics are not going to capture Repetitive Electrical Impulse Noise (REIN) - an electric fence discharging every two seconds, perhaps.  Nor are they likely to show a physical fault in the copper pair. Perhaps a high resistance joint or a bridged tap on the line.  Only something like a TDR will identify those problems.    The HG612 captures data (HLin) which could, in theory,  be transformed into the time domain, for those purposes.  Les-70 (from this very forum) investigated this to some length, but a breakthrough remains elusive   ???

cheers, a
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: Black Sheep on August 25, 2012, 08:04:02 AM
Quick response as am off to work.

We 'technicians ( ;)), can not have the power trimmed back, or up for that matter. It depends on what ones interpretation of 'power' is though ?? The engineer may have been talking in 'Laymans terms' in order that your mother may understand better. Its far easier to say I've adjusted the power, than tring to explain SNR to somebody who doesn't know, or even care what it is.
The onlt time that I've known actual true power be reduced on a circuit, is when they've had ADSL(Re) switched off due to the increased cross-talk affecting other circuits in the cable.

It's highly unlikely NEXT is affecting your circuit, but FEXT is more than probable. Dependant on the engineers knowledge, he could carry out a wideband noise test at perhaps the Cabinet to look for FEXT, and the circuits integrity ?? He wont be able to test for this at the Exchange, as the meter will likely pick up NEXT due to the large ammounts of power leaving the MDF at that particular point, thus giving a false reading. :)
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on September 03, 2012, 07:05:20 PM
An update:

After another couple of engineer/technician visits we seem to have exasperated them enough to get action. Of note:

1) No-one who has visited recognises any of the stats/graphs/advice I've collected from here. From that I mean the acronyms (FEXT, NEXT), the values, what they might show etc. I'm guessing BTNI haven't got as clued-up tech guys? I fear they are still working in the 'voice realm'. I'll include this in my letter to OFCOM.

2) My mother and sister
a) walked along the 2.5k route the cable takes taking photos of the various dodgy-looking bits of cable/junctions (cover pealing away etc)
b) read up on proximity to electrical cables (crossing 33kV lines requires phone cables to be buried?)

3) Showing the pictures to the technician and actually taking the guy to the places of concern convinced him to get the cherry picker out.

Resulting in:

4) OR have agreed to replace a stretch of cabling. Only 120m, but a start. No word on when this will happen.

Now, what chance has a non-techie, less belligerent rural-dweller got of getting an issue like this resolved?? Again, something that will be asked of BT/OR in my letter.

Anyway, on to the numbers. I've been taking stats at ~3 min intervals since the last engineer visit (graph attached showing SNMR, TxPwr, ATTNDR, Actual speed, and, for a laugh, temperature from a local weather station - I can also show wind speed, humidity, rain fall, lightning etc). There are a few interesting things of note.

1) Between 3am and 5am the line collapses for 5-15 mins (the 'vertical' lines)
2) There are seemingly predictable variations through the day (a decrease in SNMR D from 1800 to the 'collapse'
3) A 'collapse' occurs close to the coldest temperature :-)
4) The interleaving values (not shown for clarity) are high, but are steady between each 'collapse'

Now, BT also pointed out this 'collapse' some time ago as something unusual.

Any thoughts on this?
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: asbokid on September 03, 2012, 09:24:09 PM
Great work, Tristan.

It looks like you've uncovered a clear (and close) correlation between SNR and temperature. The rises and falls of SNR closely relate to outside temperature. The transmission behaviour of the cable itself can't be responding so dramatically to temperature changes.   So that points towards poor splicing at one or more joints along your loop.

And since, in terms of the speed at which those SNR changes occur, that probably eliminates water ingress as the fault.  Ingressed water in the cable would take many hours or even days of warm temperature to dry out, with much more damped improvements in SNR than you have recorded.

A series of TDR taken at strategic points in time could locate the site of the errant joint(s).    Is Openreach able to expend the manpower these days to do that?  Maybe not.


British Telecom workforce by year

Year     Workforce
1984     400,000 (state-owned GPO)
1990     239,000
1995,    137,500
2008     120,000
2009     105,000 + 42,000 contractors/agency workers
2010     90,000
2012     27,000 + 75,000 agency / "flexi" workers
2015     43    (upper estimate)


cheers, a

http://www.fundinguniverse.com/company-histories/bt-group-plc-history/
http://www.guardian.co.uk/business/2009/may/14/bt-cuts-15000-jobs-annual-loss
http://news.bbc.co.uk/1/hi/business/8049276.stm
http://www.employersforcarers.org/business-case/case-study-bt
Title: Re: Rural BT Infinity issue - help interpreting stats
Post by: tristan on September 04, 2012, 02:29:59 PM
Great work, Tristan.

It looks like you've uncovered a clear (and close) correlation between SNR and temperature. The rises and falls of SNR closely relate to outside temperature. The transmission behaviour of the cable itself can't be responding so dramatically to temperature changes.   So that points towards poor splicing at one or more joints along your loop.

And since, in terms of the speed at which those SNR changes occur, that probably eliminates water ingress as the fault.  Ingressed water in the cable would take many hours or even days of warm temperature to dry out, with much more damped improvements in SNR than you have recorded.

A series of TDR taken at strategic points in time could locate the site of the errant joint(s).    Is Openreach able to expend the manpower these days to do that?  Maybe not.

Cheers! Not sure we're quite there yet, but a small victory was had this morning: 3 BT vans turned up and replaced a good couple of hundred m of line (longer than they had planned). In their words the line was 'in tatters' - it looked like farm machinery had got tangled up at some point. So much for OR's proclamations that the line was perfect! The pairs were exposed to the elements apparently.

Our BB is back on but the speed seems set at the pre-replacement level. Guess we need to get a reset done?