Kitz Forum

Broadband Related => FTTC and FTTP Issues => Topic started by: William Grimsley on April 22, 2016, 09:05:00 PM

Title: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 22, 2016, 09:05:00 PM
Hi guys,

I think we've taken over too much of daveesh1's thread, or should I say, I have. So, I've made a new thread so we can keep anything else that happens related to one thread. I hope this is ok?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 22, 2016, 09:36:13 PM
I think DLM's going to intervene again in a minute, it just did but didn't make any changes...
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 23, 2016, 03:24:20 AM
if no changes were made then it probably wasnt a DLM intervention.

Just leave the line alone and wait a couple of days for DLM to do something.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Ronski on April 23, 2016, 08:37:09 AM
Changes were made, the  sync  dropped slightly, in fact there have been several small changes after banding was removed. Hopefully g.inp will be applied soon and that will reduce the errors.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 23, 2016, 08:52:06 AM
What changes ronski?

interleaving, delay and inp all stayed the same.

I see no way to see all the line settings on MDWS.

I see now when hovering over XTR, some extra data is revealed but how do you see the historical data to compare?

Posted in the MDWS thread about this as to not derail this thread, I do see the sync was RDI so suggests is DLM but I dont see any changed parameters.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 09:25:24 AM
That's what I'm confused about, to say the line was experiencing a lot of Downstream CRC spikes, I wouldn't have been surprised if it was an LOS.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 23, 2016, 10:29:01 AM
Looking at your Bitswap/min graph over 2 days, it looks like something comes on at 17.00 and goes off at 9.00 daily which is producing a lot of interference. Is that the central heating?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 10:46:13 AM
We have underfloor heating, but it could well be the heat pump... I will have a word with him when he calls me later or his back from holiday on Monday.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 23, 2016, 11:04:10 AM
I'd say DLM will imminently be doing something to the line, the traffic lights are all red now.

Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 23, 2016, 11:04:44 AM
popcorn time
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 11:24:03 AM
Yeah, they've been red for some time now, quite surprised nothing has happened yet!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 23, 2016, 11:28:59 AM
The Err Secs are weird.   The SNRm is still what I'd class as giving cause for concern for there.   Its still hovering within 1dB range and lines should be able to cope with this.   Bearing in mind line length its going to be more sensitive to noise anyhow and is one of those that would without doubt benefit from g.inp for error stability.

Openreach will not be bothered about such SNRm fluctuations - its too small and considered within normal realms of operating level.
Heck even the other week my own upstream fluctuated between 13.4 and 11.8 and I dont have a clue what it was about.

>> popcorn time

Im afraid not for me.   Last night, I got in.  Sat at the PC, and aside from opening a bottle of wine spend the whole evening sat posting on the forum.  It was only late on I realised I hadnt even cooked or eaten. :/   Its not something I intend to do today as I have lots to do and am out of here.   Its a glorious day and Im not spending it at the PC.   Have a good day everyone   :sun:


 
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 11:32:27 AM
Good plan, kitz. I think we've just got to take some time away from scrutinising the graphs and just take it as it goes from now on. I've already realised that I've spend too much time watching these graphs and need to get doing something else. :lol:

Hmm, I wonder when we'll get another resync.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 03:48:00 PM
The line is still up after the last DLM resync, quite surprised.

I have no idea why but the Downstream Attainable Rate keeps fluctuating violently!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 05:42:57 PM
I am very surprised to see you with all three reds lit up on MDWS DLM error status indicator, did the engineer give you the local loop distance to the cabinet  ?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 05:53:19 PM
It's around 700 m the length of my line about 25% the length of my original ADSL length.

I'm slightly concerned at how much the Upstream SNR Margin is fluctuating...

On a different note, does anyone know how to find how much we are currently paying for our BT package?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: licquorice on April 23, 2016, 05:56:07 PM
You should have had an email after you re-contracted to the 52M stating prices.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 05:57:29 PM
Thank you, licquorice. You're a star.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 23, 2016, 06:06:07 PM
Your downstream attainable will fluctuate with your SNR Margin.

Your router calculates the attainable rate, and one of the parameters is the SNR margin on the downstream. As this fluctuates then so does the attainable.


Sent from my iPad using Tapatalk
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 06:16:08 PM
It's not actually doing that though, the Downstream Attainable Rate is rising and lowering more than the Downstream SNR Margin.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: aesmith on April 23, 2016, 06:19:35 PM
I am very surprised to see you with all three reds lit up on MDWS DLM error status indicator

No error correction in place yet.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 06:21:01 PM
To say my line was described as being "the best pair in the cabinet", it should be able to run fine on fastpath...
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 06:27:24 PM
Hmm 700 meters it should be better than my 1000 meter line for errored seconds on fastpath which would get 1700-2000 per day and you have had 3306 in just over a day  ???
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 06:35:33 PM
Yeah, may text Glenn next week see what he thinks.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: licquorice on April 23, 2016, 06:49:07 PM
Thank you, licquorice. You're a star.

That's not what you usually call me  :D :D :D
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 06:53:52 PM
You and everyone else have been really helpful even if I haven't come over that way! :lol:
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 07:00:41 PM
Yeah, may text Glenn next week see what he thinks.

My knowledge over 3 years of looking at stats your Upstream SNRm swing is not uncommon the reason could be down to REIN/RFI on the lower frequency bands U0 30 - 138khz or U1 3816 - 5162Khz used on FTTC
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 07:01:58 PM
Thanks, NS. Nice burst of Downstream SES then, how many SES does it take for the sync to drop? 50?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 07:21:09 PM
Thanks, NS. Nice burst of Downstream SES then, how many SES does it take for the sync to drop? 50?

That's the DLM 24 hour question, having had a DLM reset yesterday at 12:44 the DLM has not seen the 24 hours worth of stats yet that will happen on sunday in the wee small hours (4-7am)

G.INP should kick in on Monday again in the wee small hours (4-7am)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 07:27:02 PM
Yes, so hopefully we'll get a resync tonight and see what happens.

I'm predicting G.INP and Downstream Rate of 45 Mbps.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 07:39:09 PM
Yeap that is what I have noticed over the years the DLM gathers those relevant stats during the course of a 24 period at 15 minute intervals and then will act on what it sees after the 24 hour period has ended.

Still don't know why it does this in the wee small hours is 6am the start or end of the DLM 24 hours  :-\
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 07:43:02 PM
Normally, it's midnight. But, I had an RDI just before 9 pm yesterday...
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 07:58:30 PM
But it didn't change anything at 9pm that I can see
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 23, 2016, 09:29:22 PM
When I had G.INP applied it was at 7am DLM resynced the line.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 09:32:34 PM
Ooo, sounds awesome! Did anyone get a speed increase with this? :lol: :lol: :lol: :lol: :lol:
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 23, 2016, 09:34:04 PM
Was a bit odd actually as I'd been on an interleaved profile for ages. And then G.INP was launched and within a week it was applied but at a strange time as normally DLM resyncs in early hours to avoid disruption to service.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 11:44:21 PM
Well, it looks like my line is going to get a bit of a wake up call tonight!


Admin - Note that jamie said it improved his line which was previously interleaved and had FEC
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 23, 2016, 11:53:12 PM
Well, it looks like my line is going to get a bit of a wake up call tonight!

What do you think is going to happen tonight on your line ?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 23, 2016, 11:54:40 PM
Well, what do you think? Possibly G.INP and/or interleaving.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 24, 2016, 12:03:08 AM
48 hours has not passed for G.INP to be reinitialized, so what next ?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: daveesh1 on April 24, 2016, 06:43:24 AM
Well as of 06.30 DLM has still not acted even though his line is showing as  Red..
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 24, 2016, 07:20:50 AM
G,INP seems to need more than 24 hours to activate.  Just have to keep waiting.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 10:09:27 AM
Hmm, very strange. Will see what happens tomorrow.

It's probably good that I lied in today, means less time watching... :lol:
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 10:35:51 AM
I think I've found the reason for the noise on upstream... I think it may well be just the strong sun expanding the copper wire...
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 24, 2016, 10:38:03 AM
Last time I got G.INP back 3-4 days after a DLM reset.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 02:04:31 PM
I've been told by mlmclaren that G.INP will increase my line rate! :D
Title: Re: William Grimsley's Line - After DLM Reset
Post by: S.Stephenson on April 24, 2016, 02:09:20 PM
I've been told by mlmclaren that G.INP will increase my line rate! :D

You won't really know until it actually happens....

Staring at it isn't going to make G.INP activate quicker, it will just make it drag on and on.

Best thing to do is just wait for the e-mail from DSLWS, in fact if you were to benefit in real terms from G.INP then you'd notice it being activated and wouldn't have to watch it constantly.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 02:13:47 PM
I'm not watching MDWS constantly! ;D
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 02:53:45 PM
G.INP can not improve the line rate on a line which does not have INP, Interleaving or FEC. :(
G.INP can only give back any overheads taken from FEC and Interleaving.
G.INP can stablise a line experiencing errors, by reducing the error rate. 

Your line is now on an open profile, no INP, no Interleaving, no FEC overhead.   There's no where it can get any additional speed from unless your SNRm is slightly better. 

The reason I said last week that G.INP would help you, is because at that time, you were banded at 35k... and had Interleaving, INP & FEC applied.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 02:56:07 PM
But, why? Like I've said interleaved ADSL lines have increased line rates, whereas fastpath ADSL lines have lower line rates...

I may have been banded at 35 Mbps but without the banding, my line would have probably been syncing at around 40 Mbps, so when G.INP activated, the line rate would increase further.


Admin note - This is NOT the case.   FEC overheads will reduce line rate in 99% of cases.
You are correct that without banding the line would sync at 40Mbps. - But it wont with Interleaving and FEC/INP.
See below for proof
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 03:28:19 PM
Heres the proof when you had interleaving.

Quote
18/04/2016 - Full Line stats immediately after product upgrade.
   Note: Cap still in place. G.INP removed and Interleaving and Forward Error Correction applied.  Overheads from FEC redundancy reduce line rate.

xDSL
Mode   VDSL2
Traffic Type   PTM
Status   Up
Link Power State   L0
Downstream   Upstream
Line Coding (Trellis)   On   On
SNR Margin (dB)   6.6   6.3
Attenuation (dB)   25.8   0.0
Output Power (dBm)   12.0   5.8
Attainable Rate (Kbps)   45458   8015
Rate (Kbps)   34999   8015
B (# of bytes in Mux Data Frame)   47   239
M (# of Mux Data Frames in an RS codeword)   1   1
T (# of Mux Data Frames in an OH sub-frame)   64   42
R (# of redundancy bytes in the RS codeword)   14   0
S (# of data symbols over which the RS code word spans)   0.0436   0.9514
L (# of bits transmitted in each data symbol)   11368   2018
D (interleaver depth)   743   1
I (interleaver block size in bytes)   62   120
N (RS codeword size)   62   240
Delay (msec)   8   0

Note only 6.6db.    Interleaving/INP/FEC eat into your SNR Margin.
Its your SNRM that dictates your sync speed, but those overheads also artificially inflate max attainable on some routers.
Thats why I said a few days back I estimated you'd get ~42 Mbps.   That is why I also put that note on there for passing to the engineer.
I had a strong suspicion that your router was artificially inflating your max attainable due to FEC overheads.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 03:33:21 PM
Now compare to these - when you werent interleaved

Quote
02/02/16 - Line stats with new router

              Downstream   Upstream
   Line attenuation (dB):     25.8      0.0
   Signal attenuation (dB):   Not monitored     
   Connection speed (kbps):   35000      8493
   SNR margin (dB):           9.7      6.7
   Power (dBm):               12.0      5.8
   Interleave depth:          8      2
   INP:                       54.00      53.00
   G.INP:                     Enabled
   Attainable Rate (Kbps)     44479   8897     

   RSCorr/RS (%):             0.0001      0.0010
   RSUnCorr/RS (%):           0.0000      0.0000
   ES/hour:                   0      0

See now how your SNRM was 9.7dB?   That means you had far more available sync speed, because INP wasnt eating into anything,  but you were being capped.

G.INP can give back what INP takes away, but it cant magic more speed from nowhere. :(
You may get a little bit more if the framing params change..  and a bit more if your SNRm is different...  but it wont be that much.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 03:39:11 PM
Quote
Like I've said interleaved ADSL lines have increased line rates, whereas fastpath ADSL lines have lower line rates...

Im sorry, but Ive read that sentence about 6 times, and Im not sure what you are trying to say.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 04:19:22 PM
Fair enough. What I'm trying to say is on ADSL the line rate is normally higher when the line is in an intereleaved state rather than a fastpath state.

I'm not trying to be rude here, but I still think as other like mlmclaren have pointed out that when G.INP activates, my line rate will go up by 4 - 5 Mbps...


Admin note:  [here you obviously disagree when I said G.INP can't magic up 4/5 Mbps on a line which is on open profile]
Title: Re: William Grimsley's Line - After DLM Reset
Post by: roseway on April 24, 2016, 04:32:26 PM
Then you'll have to wait to find out. You've been given the best advice available, and if you choose not to believe it, that's up to you. But wishful thinking won't achieve anything.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 05:03:32 PM
I'm not saying a definite answer, I'm just trying to discuss this interesting possibility.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 24, 2016, 05:12:39 PM
William when your line was banded at 35000 kbps the SNRm will increase, just like manually capping your sync on the HG612 or 8800nl the SNRm will increase but with less sync rate

The Banding of your circuit from 40000 kbps to 35000 kbps causd the SNRm to be much higher than the 6dB target margin

Now do you understand
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 24, 2016, 05:14:31 PM
I've been told by mlmclaren that G.INP will increase my line rate! :D
Did he say how G.INP will increase your line rate?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: tbailey2 on April 24, 2016, 05:28:39 PM
IMHO, I think you will LOSE some sync speed, maybe 1-2mbps.

G.INP is an error correction protocol and needs bandwidth to perform that. You don't have any spare b/width now as you are not interleaved (and you already gained 5mbps or so from being unbanded) so I doubt it can magic up some for Bearer 1 to do its job and sort your current horrendous errors. So that bandwidth surely has to be stolen from the existing amount available.....

Feel free to correct me if I'm wrong.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: burakkucat on April 24, 2016, 05:55:32 PM
. . . but I still think as other like mlmclaren have pointed out that when G.INP activates, my line rate will go up by 4 - 5 Mbps...

Unfortunately that is just not correct.  :no:
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 06:10:26 PM
Alright, fine. Sorry.

NS, yes I do understand.

I can see why you think that I may loose speed, Tony. Maybe interleaving works differently on FTTC, but I always thought like previously mentioned that G.INP was like interleaving (error correction), but obviously not. Ok, maybe mlmclaren can chip in with his reasons...

I have asked mlmclaren to post in this read with his reasons...

Admin note Interleaving does not work any differently on FTTC.
G.INP is an advanced form of error correction that only corrects when an error has occured.  Unlike FEC which carries redundancy 100% of the time
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 06:15:31 PM
>> What I'm trying to say is on ADSL the line rate is normally higher when the line is in an intereleaved state rather than a fastpath state.

I think I understand what you mean now.   Yes the maximum line rate does get inflated when the line is interleaved, but unfortunately its a false figure :/

 
This is something we have been aware of for years that some modem/routers do when the line has INP applied.   
INP/FEC has overheads which are carried 'outside' of the actual sync.  The figure is just that, an estimate by the modem, but these FEC overheads skew the estimate and a lot of modems increase the max attainable rate, but its a false figure that must never be relied on.

Go look at Chrys's line stats on MDWS - he doesnt have G.INP or INP/FEC nor is he banded. 

His current sync rate is:   72089
His max attainable rate is: 72948
His SNR Margin is 6.3dB

Its the 0.3bB which will give him that little bit of extra speed if he was to perform a resync at this moment in time.
His modem is correctly calculating the max attainable.

Now lets look at Callumpy's line - he has INP=3

His current sync rate is:   72079
His max attainable rate is: 84156
His SNR Margin is 6.3dB

Practically the same stats as Chrys.  So why the additional 11Mbps max line rate? 
Its a false figure that has been inflated because of FEC overheads.  INP/FEC has eaten into his SNRm   

There will be some additional speed in there that G.INP could give back... I'd estimate around 7 Mbps for Callumpy's line.


G.INP is a replacement for INP.  They are both methods of error protection.  G.INP is just more efficient.
If the line doesnt already have INP then it cant give any more.

-----

There is one other thing that wombat and I have been looking at which we haven't yet got the to bottom of and thats the effect of the framing parameters.    These are to do with the size of the data transmitted in a frame (packet) and those R & N values etc that you may see us discussing from time to time.

Framing parameters is why some lines will sync at say 80000, yet another may sync at 79987.   Framing parameters are slightly different with g.inp so you may get also get a wee bit more speed on top say 0.5-1Mbps, but it wont give you 46Mb when youre currently syncing at 40098 with 6.3dB...  You may get another ~1Mbps or so depending on time of day you sync.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 06:20:14 PM
Framing parameters is why some lines will sync at say 80000, yet another may sync at 79987.   Framing parameters are slightly different with g.inp so you may get also get a wee bit more speed on top say 0.5-1Mbps, but it wont give you 46Mb when youre currently syncing at 40098 with 6.3dB...  You may get another ~1Mbps or so depending on time of day you sync.

That's interesting, as I was syncing at 1 Mbps higher yesterday! :lol:

Thanks for the rest of your post, I didn't want to quote it all and reply to it but understand it all.

Admin note:  You missed the point I was proving whereby and Interleaved Line skews the maximum attainable rate.
The 1Mbps of higher sync was down to having better SNR at that moment in time.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: ejs on April 24, 2016, 06:33:37 PM
I certainly get a higher ADSL2 line rate with interleaving on than with interleaving off. Yes, the actual line rate, not the max attainable rate.

Essentially, I think the modem takes the error correction ability of the interleaving and FEC into account when determining what speed it can establish a stable connection at.

In more technical terms, I think that "taking into account" is sometimes known as the coding gain. The modem has to determine the best speed it can get, subject to the line and environment itself, and various parameters, one of which is the bit error ratio. The bit error ratio is defined as being after the bits have been through the interleaving/FEC processing. So when the modem knows its has a certain level of error correction, it can take that into account when determining what speed it can connect at and meet the bit error ratio requirement.

The FEC data occupies a portion of the line's bandwidth, this is not included in the line rate reported by the modem. So the interleaving/FEC process does not necessarily have to result in an overall reduction in the net data rate, it depends on if the bandwidth used by the FEC data is greater than what extra bandwidth is obtained from the coding gain.

I'm not so sure if the modem can take the error correction ability of G.INP into account when determining what speed it connects at, but if that's allowed, then yes, G.INP could result in a higher speed. G.INP also adds some more parameters that affect the line initialisation process.

@tbailey2
Aren't the retransmitted DTUs sent over the same bearer that they were originally sent over the first time? So extra bandwidth is only needed for the acknowledgements that control the retransmissions, the RRC adds 24 bits every data frame, which the G.998.4 PDF says works out at 96kbit/s.

@kitz
Err, G.INP does not replace INP. INP is a calculated value that shows the level of error protection provided by either FEC and interleaving, or the retransmission procedure of G.INP. G.INP provides higher levels of INP. I wouldn't say INP is a method of error protection either. If say the DLM decides to set the INP level to 3, then the DSLAM has to set the interleaving depth and FEC ratio to provide that level of INP.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 06:41:46 PM
To start, I think we need to give ejs a massive clap for that information, some of that went straight over my head but I think I've got the jist of it.

ejs, are you basically saying that even if FEC wasn't applied to the line in it's current state, G.INP COULD increase the line rate? Or, have I still got this wrong?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 06:57:39 PM
@ejs

I was trying to simplify it for William. 

Ive already tried linking to INP (http://www.kitz.co.uk/adsl/interleaving.htm) & G.INP (http://G.INP) on more than one occasion, so was just taking it down to a basic level of understanding.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 07:01:44 PM
Just had my first Downstream CRC spike of the evening, I'm very surprised the line didn't loose sync! Everyone started breaking up on TeamSpeak!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 24, 2016, 07:05:30 PM
I think we need to give ejs a massive clap for that information.

I would if he/she could predict your sync rate before G.INP is activated on your circuit  ;)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 24, 2016, 07:08:25 PM
Ive already tried linking to INP (http://www.kitz.co.uk/adsl/interleaving.htm) & G.INP (http://G.INP) on more than one occasion, so was just taking it down to a basic level of understanding.

I do read the web pages, kitz. But, you can never rely on information that's for general use for one specific circuit.

Admin Note:  Any info on the main site is technical facts and how the technology works.   These facts should in theory apply to ALL lines.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: ejs on April 24, 2016, 07:14:31 PM
I'm not so sure if the modem can take the error correction ability of G.INP into account when determining what speed it connects at, but if that's allowed, then yes, G.INP could result in a higher speed. G.INP also adds some more parameters that affect the line initialisation process.

Now that I've eventually posted that and thought about it a little more, no, G.INP probably can't really be used to increase the line speed in the same was as interleaving and FEC add coding gain. The difference is that the interleaving and FEC is going to be there whether there's anything for it to correct or not, so you might as well use it. With G.INP however, using more retransmissions would use more bandwidth, so you wouldn't want to overdo it and aim for a higher speed anticipating to do a lot of retransmitting to fix the errors, because all that retransmitting would use too much bandwidth.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 07:25:44 PM
Quote
I certainly get a higher ADSL2 line rate with interleaving on than with interleaving off.

Interleaving/FEC usually reduces the line rate, because of the redundancy overheads.
Thats why G.INP was invented - to quote Broadcom (Inventor of PhyR/Retranmission) -

"Traditional methods of error correction steal your bandwidth."

The RS + Interleaver scheme suffers from a high overhead burden because for every errored byte, two
additional overhead bytes must be transmitted to allow for a successful FEC correction. For example,
assuming that an overhead of 10% correctable is tolerable, correcting a burst of 1 ms of impulsive noise
(INP = 4 DMT symbols) requires an interleaver depth (or delay) of minimum 10 ms:


The two reasons why most people complain about standard INP with Interleaving and FEC is
1) Increased Latency.
2) Reduction of sync speeds.

---
ETA
Forgot to add link (https://www.broadcom.com/collateral/wp/XDSL-WP101-R.pdf).
Title: Re: William Grimsley's Line - After DLM Reset
Post by: ejs on April 24, 2016, 07:32:20 PM
kitz, that same Broadcom whitepaper also complains about the coding gain, saying that it's been "double-booked", which it describes as "organized cheating".
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 07:32:51 PM
Quote
With G.INP however, using more retransmissions would use more bandwidth, so you wouldn't want to overdo it and aim for a higher speed anticipating to do a lot of retransmitting to fix the errors, because all that retransmitting would use too much bandwidth.

Retransmission is 'hidden' from view.  It only penalises [throughput] speed when in use.
This is why for certain types of noise, such as constant REIN, then traditional Interleave & FEC is more beneficial.
G.INP/Retransmission/PhyR works best on burst type noise such as SHINE.

Reference  ASSIA (http://www.assia-inc.com/wp-content/uploads/2015/04/DSL_Expresse_Retransmission.pdf)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 24, 2016, 07:40:05 PM
The two reasons why most people complain about standard INP with Interleaving and FEC is
1) Increased Latency.
2) Reduction of sync speeds.

G.INP has decreased latency from 45ms to 30ms distance to London server 371 miles but I don't know the true route.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 07:44:53 PM
@ ejs

Yes it does

"RS FEC capabilities are, therefore, double-booked. In practice, an additional 2–3 dB margin is required
to recover the expected BER and INP figures, at the cost of huge capacity loss"


This is why you get the reduction in capacity, because it 'eats' into at the SNR margin.
That 2-3dB less margin results in even less available sync speed available to the EU.   :(
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 24, 2016, 08:08:27 PM
@NS

ejs, is very knowledgeable - far more than me when it comes to modem/routers/firmware etc.
I may have more knowledge about some of the things that BTw do such as their backhauls and 21CN etc.
Then you have people like wombat who can soak knowledge up for fun, and is exceedingly good at throwing out facts and figures.
There's more names I could mention, but if I start doing that, then I'll be here all night and still possibly miss someone out.

We often throw ideas at each other in the name of advancing knowledge for everyone.
This is what makes some forums excellent resources.     We all put bits and pieces together and work as a team, where everyone plays their part. :)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 24, 2016, 08:24:30 PM
@NS

ejs, is very knowledgeable - far more than me when it comes to modem/routers/firmware etc.


But I don't give a monkeys about modems & firmware my interest is on BTw unless he can unlock my BB2 and make it work with DSLstats
Title: Re: William Grimsley's Line - After DLM Reset
Post by: ejs on April 24, 2016, 08:33:38 PM
The reduction in capacity comes from the amount of bandwidth used to carry the FEC data.

"RS FEC capabilities are, therefore, double-booked. In practice, an additional 2–3 dB margin is required
to recover the expected BER and INP figures, at the cost of huge capacity loss"

I think what the Broadcom whitepaper is saying, is that if you switch on interleaving to fix errors, and then what interleaving does is also add coding gain, you'll be back where you started needing to fix errors. It's saying interleaving isn't much good at fixing errors, so you'll also need to increase the target noise margin.

That Broadcom whitepaper also talks about how with PhyR, the FEC can then be used to provide additional benefit:
Quote
As retransmission is also complementary to RS encoding, the RS overhead can now be selected solely
to optimize the coding gain. Thus, RS encoding becomes a benefit rather than an overhead.

I think interleaving (and the FEC that goes with it) gets an unfairly bad reputation, not helped by the fact it only gets switched on when the DLM decides your line is performing badly without it. I know my ADSL2 line works better with interleaving on, and I get a little more downstream bandwidth, and I had to get Plusnet to have interleaving switched permanently on to stop the DLM turning it off. The trouble is, rather than using interleaving to optimise the line towards more bandwidth rather than lower latency, interleaving only gets used to try to correct errors, but it's not really powerful enough at that.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 12:13:25 AM
I have asked mlmclaren to post in this read with his reasons...

Hi guys, Will's asked me to 'chip in' to this thread as he's been asking my advice and experiances with VDSL and DLM...

As he correctly mentioned I did say that he 'would' see some sort of speed increase with G.INP.... in my experiance G.INP (most recently) added a further max attaible bandwidth to my line, this was also the case for my line at my previous address which saw an increase of 7000kbps when using G.INP compared to Fast Path...

Now my experiance will more than likel be different for William, williams line may well be at a fair distance from the DSLAM where as both my lines have been within 350 metres distance but impacted by various quality and interference issues...

I think its hard to tell what will happen with William's line until it actually switches profile, that may take a while but based on his MDWS I would say it will be enabled to settle the errors on his line....its just a shame theres no definate time frame for when this will happen, but based on his line being reset back to fastpath on both DS & US... where as resets from G.INP only step down to Interleaving on DS now... so the recent engineer must have requested a new line profile.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 25, 2016, 07:34:18 AM
I see it resynced this morning and interleaving has been applied. Lost around 3mbps sync on downstream.

DLM obviously wants to interleave first. There was a lot of errors mind.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 08:49:02 AM
Ok, my line is in a state of mess right now, the Downstream interleaver depth has shot up! I may as well have stuck with the banded line.

I just ran a speed test and saw that my IP had changed and then found my ping had increased to nearly the pings of dial up and that my download speed had dropped, thanks DLM.

Oh, and it looks like my line can achieve a Downstream Rate of 44.7 Mbps as we always thought...


Admin note:  Yet again you have ignored repeated advice that maximum line rate displayed on a modem for a line which is interleaved line is not correct.  44.7Mbps is a skewed figure.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: gazaai on April 25, 2016, 08:55:18 AM
Are you sure you don't have a fault
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 25, 2016, 09:01:24 AM
William have you read anything people have said?

There is a post kitz made where she discussed in depth how when interleaving is applied the modem incorrectly calculates the attainable rate.

Your line is capable of your attainable rate you had yesterday not this new one.

The reason your pings are high is due to interleaving. It had a lot of errors and so you'll just have to now wait like everyone else to see if G.Inp is applied.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 09:05:26 AM
I will contact Glenn this morning about it.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 09:05:46 AM
Yes, of course I did, jid. I am only making an observation!


Admin note

No you didnt you said quote "it looks like my line can achieve a Downstream Rate of 44.7 Mbps as we always thought..."
Jamie was pointing out to you that you hadn't been reading what had been said, and once again decided that 44.7 would be a true figure despite being advised to the contrary that it wasn't.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 25, 2016, 09:07:05 AM
Yes, of course I did, jid. I am only making an observation!

Your line is not capable of 44mbps in its current state.

You can contact the engineer but I didn't think they could do anything unless a job is open?

In fairness you just have to wait for DLM nothing can really speed it up.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 09:11:20 AM
If nothing can speed up, then I'm not sure what else I could do other than to contact Glenn...

Like I've said in the past, some of you which have been quoted "gurus" said my line would get G.INP first not interleaving which has now made everything worse. Maybe from now on, I'll read everything up myself and not rely on others...

--
Admin Note: This "guru" said quote:
There is one thing now that I am uncertain about and that is what DLM will do next.   
In theory it should apply g.inp,   but because its on open profile..  Im not sure


You had obviously ignoring my post because it wasnt what you wanted to hear - link (http://forum.kitz.co.uk/index.php/topic,17532.msg320908.html#msg320908)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 25, 2016, 09:18:18 AM
That is your own opinion.

We advise we don't know exactly what's going on for the DLM system but we've a good idea.

Your line is a mess it's obviously got noise issues or a fault which your engineer said there wasn't. If he said the line was perfect according to the JDSU then there's probably nothing more that can be done other than to deal with it.

You're lucky to get an engineer without a charge as your line is working within its limits I would think. Squeezing a few more mbps usually doesn't get an engineer so you're lucky you got that.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 09:27:11 AM
It's not an opinion! I'm stating what people have said!

Yes, you've just stated it's got noise issues so it needs to be reported whether or not it's within the "estimates" that are always wrong anyway.

I have yet to recieve a charge and I certainly won't be paying for it as we as customers expect the fastest speeds whether it be a few Mbps or more from the cabinet!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 25, 2016, 09:30:48 AM
Your opinion I was referring to your comment about members lack of knowledge.

Not exactly paying customers receive the best possible as its an up to product. It is a noisy line but getting Openreach to fix it is difficult to impossible depending on the source of noise. It could be in your property, a neighbouring property etc.

The estimates given are the clean and impacted ranges and they practically dictate your line and whether BT do anything about it.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: roseway on April 25, 2016, 09:46:20 AM
William, you're going to have to calm down. People are trying to help, and you seem to ignore a lot of the advice.

Quote
Maybe from now on, I'll read everything up myself and not rely on others...

That's a rather inappropriate comment in the circumstances. Nobody is perfect, but there are several knowledgeable people with long experience of these systems who have tried very hard to guide you in a sensible direction. You don't have to follow anyone's advice, but when you ignore a lot of it you can't then complain that the advice wasn't good enough.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 25, 2016, 09:48:48 AM
It looks like interleaving has been applied which has reduced your sync speed by 2.5 Mbps
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 25, 2016, 09:53:42 AM
engineer cant do jack without an assigned job, I been buddies with my install engineer for years now, but he couldnt do anything until he got my speed boost job.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 09:56:47 AM
roseway,

I am not saying anyone is perfect, but to say that I've had such a wide range of advice from people with one person saying G.INP will be applied, one person says interleaving will be applied and another says nothing will be applied to the line, then what am I supposed to think, hey?

I will likely be logging a telephony fault at some point today.

Thanks.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 25, 2016, 10:06:52 AM
My advice was for you to leave it alone for a couple of weeks
Title: Re: William Grimsley's Line - After DLM Reset
Post by: roseway on April 25, 2016, 10:18:00 AM
I am not saying anyone is perfect, but to say that I've had such a wide range of advice from people with one person saying G.INP will be applied, one person says interleaving will be applied and another says nothing will be applied to the line, then what am I supposed to think, hey?

So you've been confused by different people giving conflicting advice. That's the nature of forums, I'm afraid. You have to learn to assess the credibility of advice. That's why Kitz took the lead and gave you a full and clear explanation of the relevant parameters, including an explanation of what G.Inp does and doesn't do. You chose to believe different advice because it suited your expectation of higher speeds.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 25, 2016, 10:30:35 AM
I would describe G.INP as "on demand" error correction whereas interleaving is "always on" even when not required.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 10:57:33 AM
roseway,

Sorry, but that's also incorrect. I am not believing people's advice because it suits what I like to hear, why are you presuming everything? Because it's me and for that reason, "I'M OUT!".
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 25, 2016, 11:14:56 AM
Looks like william is in a bad mood perhaps because he is now back to a massive 2mbit over the banded speed :)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 11:18:30 AM
Of course, people advised me I'd get 46 Mbps and now you're all wrong and everything's gone pear shaped, why I donated to this website now I have no idea...

Remember, I post my actual thoughts, I don't edit posts to match what everyone wants to hear and if you don't like that then fine I'll stop posting.


----
Admin note:   Yet again its you who is talking about 46Mbps - Ive told you countless times that the 46Mbps is a skewed figure because of FEC overheads and I estimated ~42Mbps with G.INP

As regards to the donation - I refunded £5-00 back to your account yesterday - Well before I saw this rude comment.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 25, 2016, 11:19:29 AM
Yes we all said you would get a large boost in speed.

No we didnt, it was you telling us that.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 11:20:21 AM
Not ALL I said some!

Guys, please just accept that you're wrong. You advised me things that were never accurate, you assumed that my attainable rate was real to then find out it wasn't, what a load of tosh. Never again.


Admin note.
NO we did not.  We constantly said it was an inflated figure.   You even argued with me when I said this, and YOU insisted that you would get 46Mbps
Title: Re: William Grimsley's Line - After DLM Reset
Post by: jid on April 25, 2016, 11:46:51 AM
Just leave it alone and let it do its job.

You're just eventually going to annoy engineers by trying to get them to come out.  Report it via the proper channels and then it will hopefully get resolved that way.

I'm no longer giving advice in this thread other than to say just wait for it to sort itself out.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 11:48:30 AM
Well, seen as we seem to get the same engineer "Glenn" every time, it's unlikely he will get annoyed.

I am leaving it alone, all the resync on MDWS are from Glenn or DLM not ME.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 11:56:06 AM
Damn it William,  thought I was bad....

Interleaving is all in the process... I agree the systems at BT for DLM have gone really weird but then that what happens when they're trying to deal with all sort of dirrent chipset specs and configuration requirements...

Firstly 8ms increase is still less than the average virgin media connections minimum latency... so hardly anything dial up.... I made remark to G.INP taking its time to come on your line due to the line being reset back to fast path... the DSLAM and DLM systems have probably not yet configured themselves properly for your modem's support.

2mbps is tiny ammount to lose my friend, don't get so outraged by it... hell I've lost 50Mbps on my line... (I admit I had my strop about that, but I didn't bite the hands that fed me advice)

Just leave it alone to do its thing, if you keep getting it messed with and reset it will just take longer.... also BT will say its within range, or even that theirs nothing they can do (like me)

I'm sorry that you thought my experiance would be identical for you but as I mentioned last night, both my lines have been short with 16db attenution figure... yours isn't.

Now don't worry about it  ;D
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 12:00:03 PM
Ok, thanks mlmclaren. At least someone on here cares and actually is willing to help, not forgetting digitalnemesis.


------
Admin note.
What a rude and derogatory statement.    I have spent hours and hours and hours trying to help you. 
I have spent time trying to explain to you things, when I should be doing something else.
Many others have given up their time to help :(
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 25, 2016, 12:01:28 PM
Ok, thanks mlmclaren. At least someone on here cares and actually is willing to help, not forgetting digitalnemesis.

Get an engineer booked mate.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 12:01:34 PM
Ok, thanks mlmclaren. At least someone on here cares and actually is willing to help, not forgetting digitalnemesis.

I appreciate that William, but so is everybody else...

I'm not sure why you think otherwise.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 12:02:20 PM
Get an engineer booked mate.

Why do think theirs requirement for another engineer?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 25, 2016, 12:04:08 PM

He mentioned there is still noise present.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 12:05:30 PM

Oh right, fair enough then a phone engineer is needed.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 25, 2016, 12:06:12 PM

Good luck to him, it's a mission getting an engineer booked tbh.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 12:13:32 PM

Not if you go through the right channels, however if noise is present then there should be no argument involved.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 12:15:14 PM
People are arguing on the BT Care Community Forums that because my phone is cordless they think it's just the noise with the phone but I don't want it to get the point where the noise gets worse and I then phone up, I am awaiting a text from Glenn to see what he thinks.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 25, 2016, 12:31:25 PM
Not if you go through the right channels, however if noise is present then there should be no argument involved.

If it's offshore support he'll get fobbed off with "sir your line is within speed estimates".  :lol:
Title: Re: William Grimsley's Line - After DLM Reset
Post by: roseway on April 25, 2016, 01:01:04 PM
I've gone through this, removing the unnecessary nested quotes. Please guys, take note of http://forum.kitz.co.uk/index.php/topic,17608.0.html
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 04:49:52 PM
At least I can do something right! Hey, Eric! :lol:

If it's offshore support he'll get fobbed off with "sir your line is within speed estimates".  :lol:

Yes, and you'll probably get "Allahu Akbar" shouted down the phone line! :lol:
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 05:45:45 PM
That's why I contact BT cares twitter team chat instead... they gave me a link which I gave to William previously which gets you through to one of them...

I belive they are UK or IRL based.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 05:46:49 PM
Yes, exactly. I hope I don't get banned for saying "Allahu Abkbar". LOL.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 25, 2016, 05:50:11 PM
Depends what the forums rules of religion is... all you've done is claim God is Great or something along those lines...

Does make me curse when kids on Xbox used to scream this before blowing themselves up though....
Title: Re: William Grimsley's Line - After DLM Reset
Post by: niemand on April 25, 2016, 05:57:44 PM
People are arguing on the BT Care Community Forums that because my phone is cordless they think it's just the noise with the phone but I don't want it to get the point where the noise gets worse and I then phone up, I am awaiting a text from Glenn to see what he thinks.

This could be interesting given Glenn told you your line was spot on. You're telling him he was wrong. See how he reacts.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Bowdon on April 25, 2016, 06:13:13 PM
Is there any way you can plug in a corded phone?

If a corded phone is getting noise on the line then raise it as a voice fault.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 06:14:50 PM
Sorry, we don't have a corded phone but I could buy one. I'm not saying he was wrong, I told him I was getting a bit of line noise. For heaven sake people STOP GOING AT ME! Rage quit!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 25, 2016, 06:18:45 PM
How did you know you had line noise without a phone to hear it on?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 06:19:39 PM
I have a cordless phone! ::)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 25, 2016, 06:20:52 PM
The noise must be bad to hear it on that, they usually do noise-cancelling. Which is why corded phones are recommended for trouble shooting, plus the fact that the base station can interfere with VDSL
Title: Re: William Grimsley's Line - After DLM Reset
Post by: William Grimsley on April 25, 2016, 06:44:37 PM
Ok, thanks for your help.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 25, 2016, 07:27:29 PM
Jeeze I can't even be at my friends funeral without getting a mod report.   Not read all posts as on mobile.  However I will state I'm not happy on the slightest.  You chose to ignore my advise that I reckoned 42mb instead correcting me that it would be 46.   I've spent countless hours trying to explain how interleaving and error correction reduces speed but you thought you knew best and chose only to read the bits you wanted.

I most certainly am not in the mood right now to discuss further.  Your posts are insulting towards those that have tried to help.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 26, 2016, 05:13:20 PM
Only just had time to read this thread in full and to be quite frank, I am disgusted at some of the comments.
The moderators and admin have always tried to make allowances for Williams condition, far more than most would.

For that all we have gotten is snide comments such as "At least someone on here cares and actually is willing to help" and you rubbishing information from people who have tried to help.

I have spent hours and hours trying to help William and he has repeatedly chosen to ignore that advice, preferring to read what he wants.  I have never said he would get 46Mbps and tried on numerous occasions that I estimate it would be nearer 42Mbps with G.INP.   A fact that William chose to ignore as along with the detailed reasons why FEC causes overhead and why when a line is interleaved then the sync rate goes down.

Despite the fact being told I was away at a funeral, its not a good idea to constantly fire off emails to me.   
I don't have the SMTP set up on my phone for the website, only incoming redirects to my personal e-mail for mod notifications.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: lcl00 on April 26, 2016, 07:28:31 PM
I've been following along (silently) and I must stand alongside you on this one.  I've seen the admins and moderators make substantial allowances for William's ASC.  I know quite a lot about this condition and the difficulty that people with it can face, and by giving them the leeway you have would mean the world to many of my friends in the same situation.  Thanks, kitz. :)

William, however, clearly has not realized that an ASC is NOT a carte blanche to say and do what you want and to treat people however you fancy.  Just because you're frustrated does not give you the right to stomp around and treat people horribly.  This is especially true when you've blatantly ignored or misconstrued what someone has *helpfully* said to you because it didn't meet your expectations.  The people on this forum have gone out of their way MASSIVELY to put up with the bombarding that this board has been subjected to (1000+ posts in a very short space of time!).  They've helped enormously responding to loads of posts.  One minute they get 'thanks' and then lambasted the next.  It is simply not fair, nor acceptable, to do this to people.  I hope that William soon comes to a very swift realization that life will be VERY difficult if conduct in this manner continues.  Had he been on any other forum, he would've long been banned, and I have a feeling that if it continues at this rate, that could well happen here too.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 26, 2016, 07:57:04 PM
I've been following along (silently) and I must stand alongside you on this one.  I've seen the admins and moderators make substantial allowances for William's ASC.  I know quite a lot about this condition and the difficulty that people with it can face, and by giving them the leeway you have would mean the world to many of my friends in the same situation.

Thanks for naming the condition - ASC

I'm just looking at these

http://www.cheshireautism.org.uk/asc/what-is-autism-spectrum-condition/

https://www.livingwellessex.org/autism-in-the-community/helping-people-with-autism-in-public/
Title: Re: William Grimsley's Line - After DLM Reset
Post by: lcl00 on April 26, 2016, 08:09:17 PM
The Autistic Spectrum is vast and covers a substantial set of different issues along the spectrum.  It's quite an interesting and complex condition, and many of those are incredibly intelligent and present abilities substantially beyond that of those of us deemed 'typical' for want of a better word.  William does appear to be a smart young lad, but unfortunately his social skills still require a little work.  I have no doubt that he'll get there... but I did feel it necessary to point out that being respectful of others is not optional.  I'm not suggesting by any means that it's easy, especially with the large amount of interpretation that can be taken from text on a forum, but 'speaking your mind', is not always acceptable social conduct.  I know if I'd spoken my mind every time I felt like it, I'd have quite a few less teeth!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 01:00:38 AM
It seems unfair to talk about William when he isnt around to speak for himself, but in view of the fact that he is quite open about his illness and even had it in his signature that he has Asperger's Syndrome.   I only mention it now for the sake of correctness.   

It is for that reason, we gave him some additional lea-way and why we tried so hard to help. But there comes a point where it becomes unfair to others when behaviour gets unacceptable.

Anyhow that isnt the reason I re-opened the thread, its because I had something further to add re the G.INP discussion.   Ive just not got around to making that post yet.


PS..  Its not new news,  just a discussion on the general technology behind Error Correction.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: lcl00 on April 27, 2016, 06:33:39 AM
It seems unfair to talk about William when he isnt around to speak for himself, but in view of the fact that he is quite open about his illness and even had it in his signature that he has Asperger's Syndrome.   I only mention it now for the sake of correctness.   

It is for that reason, we gave him some additional lea-way and why we tried so hard to help. But there comes a point where it becomes unfair to others when behaviour gets unacceptable.

Anyhow that isnt the reason I re-opened the thread, its because I had something further to add re the G.INP discussion.   Ive just not got around to making that post yet.


PS..  Its not new news,  just a discussion on the general technology behind Error Correction.

Apologies, I actually assumed William was indeed still around to see the posts!  I only knew of the condition because he does, fortunately, speak of it.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: atkinsong on April 27, 2016, 08:07:28 AM
He was actually in the active users list last night when you posted but presumably chose not to respond.

I think you posted very wise words, and if William can in any way learn from them then I believe it will do him more good than any advice we can give him regarding his DSL connection.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: les-70 on April 27, 2016, 09:21:01 AM
  I hope the DLM on his line will relent and go to G.inp.  That with a speed increase relative to interleaving and the ping improvement may cheer him up. Currently it is my impression that we don't quiet know how the DLM operates with the addition of G.inp.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 27, 2016, 10:39:08 AM
it does indeed seem DLM behaviour has changed lately in regards to g.inp which might be why what was predicted did not happen.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 11:16:53 AM
@lcl00

My comment wasn't aimed at you lcl00, but rather the post I was making. :)

@chrys

I commented last week

There is one thing now that I am uncertain about and that is what DLM will do next.   
In theory it should apply g.inp,   but because its on open profile..  Im not sure.  :(

My concern was how soon lines from an open profile may either have g.inp applied first... or go to Interleaved like Ian said was the new default. 
... or even in view of the fact that g.inp at the time appeared to be suspended for some lines,  I was aware of the situation last year whereby Openreach stopped applying g.inp to reset lines until they had done all the other mopping up.

We dont have sufficient evidence yet to say either way what is happening :/
Title: Re: William Grimsley's Line - After DLM Reset
Post by: aesmith on April 27, 2016, 11:21:39 AM
His upstream noise margin is all over the place.  Is that right for FTTC? 
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 27, 2016, 11:29:30 AM
His upstream noise margin is all over the place.  Is that right for FTTC?

Yeah I just checked that, 4.7dB at the moment, doesn't look good... I wonder if he's uploading though???

When I was downloading stuff before my SNR would drop by around .5dB... that was before my line ended up impacted by issues, I'll download something from Steam and see how mine copes it copes, then propbably repeat by doing an upload...
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 27, 2016, 12:30:42 PM
When I was downloading stuff before my SNR would drop by around .5dB... that was before my line ended up impacted by issues, I'll download something from Steam and see how mine copes, then propbably repeat by doing an upload...

Well finished my DS test and it seems that those issues mentioned above have now disspeared since... I should think so too based on my recent capabilty loss  ::)

Did a couple of small uploads and that don't seem to have shown any blips on my SNR.

Might be worth William trying to get Openreach out again, though he is gonna have to prove theres an issue, which currently might be too early to say...

Based on my line, it seems to have stablised itself over the last cpuple of days where it was very choppy (similar to Williams minus the near 2db SNR drops) so maybe we need to wait for things to get themselves sorted and the line get configured properly by DLM...

I do wonder why Openreach engineer 'Glen' decided to push the line right the way back to be a newbie though, both my engineers didn't do that, though both my engineers did say they couldn't keep up with all the changes that keep being made to DLM and that they where barely notified of any changes.

EDIT: Maybe 'Glen' reset the line to fast path as the BT test equipment they use isn't G.INP capable and he wanted to get raw results and sync rates from the line.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 12:54:40 PM
No - as I mentioned a couple of weeks ago, it appears there may be 2 types of DLM reset.

In theory a DLM reset should trigger Interleaving by default now if the line is g.inp compatible.   This is what we now see for the vast majority of cases.

However, there have been just 2 recorded instances (Dave & Williams - both within the past couple of weeks)  whereby a full reset has been undertaken that has taken the line back to Open Profile as if the line is brand spanking new.     

Open profile has nothing on at all - its wide open.  But within 48 hrs DLM should apply some profile. 
Williams was wide open and that is how I knew that there was no way g.inp could make any further speed improvements.   
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 27, 2016, 01:19:00 PM
I take it most people are still getting G.INP applied back on to there lines after a DLM reset on Huawies


Admin - edit quotes
Title: Re: William Grimsley's Line - After DLM Reset
Post by: licquorice on April 27, 2016, 01:57:32 PM
Prior to upgrading, my line was banded at 35M with G.Inp applied. After my reset due to upgrading to 55/10, my line was still banded at 35 but with interleaving. Interleaving was removed after a few days, no G.Inp applied  to date. Don't quite understand why it wasn't removed when I was first banded before the upgrade as I don't appear to need it currently.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 27, 2016, 02:47:03 PM
Wait, so when you upgraded from 40/10 to 55/10 you automatically had a DLM reset with the same ISP?


Admin edit - quotes
Title: Re: William Grimsley's Line - After DLM Reset
Post by: licquorice on April 27, 2016, 02:48:35 PM
Yes, but not a full reset, it didn't remove the banding.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 02:50:25 PM
I'm not trying to be funny.   I'm just trying to be realistic.

If William had been uploading for longer we would know what would be normal for his line.
Whilst it is apparent that his line is noisy.  We must bear in mind that 'Glen' already did line checks and confirmed the line was ok and of good quality.

BT expects variance in SNRmargin - in fact DSL technology is built to expect variance and anything up to 3dB is considered 'normal'.
It is precisely why things like FEC, Interleaving, INP and now G.INP was invented - to protect against this noise.
Unless there is a voice affecting fault then what can BT do?

I suspect it may be low level HR fault, which may in time develop into something more serious, but in the meantime HR faults are extremely difficult to track down.  FACT.

Look at my stats below - Note the variance of 24dB on the upstream.  I had about a dozen visits by about 8 different engineers and none of them could track it down until voice was impacted extremely badly.  The line was dropping out totally each time the phone rang and I had large amount of tones in the D1 band where there was hardly any bit loading.

My upstream got banded at 10Mbps at one point and you can see from the graph that my upstream attainable was varying between 37Mbps to 10Mbps. BT really dont give a rats bottom about upstream.  You can see that my downstream SNRm was also dropping from 12dB to 0dB when the phone rang.
It took me 2 months to get that fixed and I found it quite stressful, so what is trying to get a 2dB variance fixed going to do for William.

If William hadnt messed with his line & DLM to get himself banded, then g.inp would still be on that line taking care of the errors and he wouldnt be any the wiser.
Now that he has interleaving, that now puts him ILQ green.  ILQ green is good.  ILQ amber is OK.   

What REALLY concerns me, is that one of the visiting engineers implied I was getting hooked up on line stats, because I showed him the graphs below...  so in all honesty what has William got to go on, other than a 2dB variance..  and how far is that going to get him when DLM is now ILQ green.

It also concerns me that some BT boffins are aware of how easy it is to get hooked on line stats and that some will go into acute state of worry for what is normal parameters.     Ringing any bells?   Is it any wonder why certain ISPs lock their routers so that such info unnecessarily panics their users,  Ive seen William get anxious at a 0.1dB change. 

If I thought for one minute there was an audible voice fault, then I would be backing him all the way...  but without that what are the realistic chances of BT being able to track it down without weeks of ping-pong.
The sad fact is, if there is a small HR fault as I suspect there may be, we should know by now that it is exceedingly hard to fix.
... and here are us sat waiting for a train crash to occur.

Yes there does appear to be a problem with banding, and I will try and get some further clarification on this...  but the fact remains if William hadnt messed then g.inp would still be sat there doing its thing keeping his line stable.

The only reason I backed him last week is trying to get rid of the banding by getting a reset.   So the banding has gone, but his line is still now with interleaving in a slightly better state than it was when he first got the upgrade. As he's now syncing at 37.5 Mbps.

G.INP needs to get back on that line, perhaps in time it will.   Im not saying when it will be though, because thats where my doubts lay.   We've seen some on here say it's taken about 5 days. 


----
ETA
Oops I forgot to add the stats.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 02:52:32 PM
@NS.   Not sure - havent seen any examples.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: atkinsong on April 27, 2016, 03:06:22 PM
In addition to all the previous comments re difficulty in getting BT to investigate, it should be remembered that when William posted the DSL Checker results for his line (on the BT Community Forums) it gave a CLEAN estimate of 34.2 to 25 down, and 7.4 to 5.6 up!
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 03:10:57 PM
Yes good point.  :(
Even though I dont much agree with the use of figures in the DSL checker, they are there for a reason.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 27, 2016, 03:14:00 PM
What is a fault is a matter of opinon.

BT boffins opinion of something been normal can be different to someone else's opinion.

I always look at it two ways.

1 - is there something sticking out that is clearly not right, in my opinion a varying snrm that is gradual and at similar times of day every day is ok, just a noisy line, but if it jumps up and down suddenly and is unpredictable I would consider it worthy of investigation, this is just my opinion.
2 - What do openreach treat as a fault, this is important because if openreach dont consider it a fault, then its going to be a waste of time.  Although if the problem is significant such e.g. halved line speed, then I would still push it.  But if its minor e.g. 5% loss of speed, then its probably not worth the bother.

There is nothing wrong with monitoring stats and it does help with diagnosis e.g. without even knowing the basics such as sync speed, when there is a throughput drop you left guessing at the reason.

So whilst it might be ok to say the boffins dont want people to know because they panic, there is also the element they dont want people to know so that actual faults dont get reported.  As after all they a commercial company trying to maximise profits.

Kitz in regards to your engineer telling you to not get fixated on stats, your line did actually have a fault.  He was essentially trying to mislead you.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: hagrid on April 27, 2016, 03:32:48 PM
I was put onto the 55/10 product at around 3am on Monday the 18th and I was put on an open profile 9999/54998 (i.e no g.inp and an interleave of 1/1) the line did a re-sync at 5am on the 20th and remained the same. I am now 9 days into what I presume is a new 10 day initial training period and I am still on an open profile.

output of xdslcmd info --stats included for info.

xdslcmd info --stats
xdslcmd: ADSL driver and PHY status
Status: Showtime
Retrain Reason:   1
Last initialization procedure status:   0
Max:   Upstream rate = 22821 Kbps, Downstream rate = 63208 Kbps
Bearer:   0, Upstream rate = 9999 Kbps, Downstream rate = 54998 Kbps

Link Power State:   L0
Mode:         VDSL2 Annex B
VDSL2 Profile:      Profile 17a
TPS-TC:         PTM Mode(0x0)
Trellis:      U:ON /D:ON
Line Status:      No Defect
Training Status:   Showtime
      Down      Up
SNR (dB):    8.5       21.8
Attn(dB):    11.8       0.0
Pwr(dBm):    14.0      -1.2
         VDSL2 framing
         Bearer 0
MSGc:      17      58
B:      239      236
M:      1      1
T:      64      23
R:      0      16
S:      0.1389      0.7543
L:      13824      2694
D:      1      1
I:      240      127
N:      240      254
         Counters
         Bearer 0
OHF:      287727016      503799
OHFErr:      295      338
RS:      0      2397987
RSCorr:      0      2093
RSUnCorr:   0      0

         Bearer 0
HEC:      577      0
OCD:      27      0
LCD:      27      0
Total Cells:   3426411664      0
Data Cells:   586743317      0
Drop Cells:   0
Bit Errors:   0      0

ES:      138      370
SES:      22      0
UAS:      131      109
AS:      641904

         Bearer 0
INP:      0.00      0.00
INPRein:   0.00      0.00
delay:      0      0
PER:      2.23      8.70
OR:      82.47      58.79
AgR:      55080.84   10057.90

Bitswap:   319775/319775      122/122

Total time = 1 days 17 hours 6 min 57 sec
FEC:      0      2346
CRC:      5397      395
ES:      138      370
SES:      22      0
UAS:      131      109
LOS:      2      0
LOF:      20      0
LOM:      0      0
Latest 15 minutes time = 6 min 57 sec
FEC:      0      0
CRC:      0      0
ES:      0      0
SES:      0      0
UAS:      0      0
LOS:      0      0
LOF:      0      0
LOM:      0      0
Previous 15 minutes time = 15 min 0 sec
FEC:      0      0
CRC:      0      0
ES:      0      0
SES:      0      0
UAS:      0      0
LOS:      0      0
LOF:      0      0
LOM:      0      0
Latest 1 day time = 17 hours 6 min 57 sec
FEC:      0      55
CRC:      5      23
ES:      4      23
SES:      0      0
UAS:      0      0
LOS:      0      0
LOF:      0      0
LOM:      0      0
Previous 1 day time = 24 hours 0 sec
FEC:      0      561
CRC:      180      110
ES:      28      50
SES:      0      0
UAS:      0      0
LOS:      0      0
LOF:      0      0
LOM:      0      0
Since Link time = 7 days 10 hours 18 min 23 sec
FEC:      0      2093
CRC:      295      338
ES:      91      276
SES:      0      0
UAS:      0      0
LOS:      0      0
LOF:      0      0
LOM:      0      0
#

DSLAM/MSAN type:           BDCM:0xa48c / v0xa48c
Title: Re: William Grimsley's Line - After DLM Reset
Post by: digitalnemesis on April 27, 2016, 04:01:56 PM
@hagrid did you migrate from BT 40/10 to 55/10? So you automatically had a DLM reset without asking?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: hagrid on April 27, 2016, 04:23:00 PM
I migrated to 55/10 from 40/10 to take advantage of the extra speed downstream and as I was out of contract saved about £1.16 a month compared to what I was paying for the unlimited infinity 1 package with weekend calls.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 04:28:40 PM
>> So whilst it might be ok to say the boffins dont want people to know because they panic, there is also the element they dont want people to know so that actual faults dont get reported.

I totally agree.   I'm all for having stats available because they do show up problems.
I'm saying saying that when people get obsessive about 1dB variations then it strengthens the argument for the other side :(

>> Kitz in regards to your engineer telling you to not get fixated on stats, your line did actually have a fault.  He was essentially trying to mislead you.

I know this.   Same engineer also tried to tell me that CRCs didn't matter and that it was FEC's that were important.   Because my line didnt have any FEC's then it was perfectly fine.    Think about it for a moment.   The line at that particular time wasn't interleaved, of course it wouldnt have any FEC.
I should add this was not a Openreach Engineer gone through the ranks, but one of those BT took on at the time when they needed staff quickly and were recruiting ex military.   He was ex-navy and then proceeded to argue the case about FEC with me.
Seriously he chose the wrong person to try that one on, but can you imagine if that had been anyone else... such as William... or joe bloggs.

The result was a high level complaint went in via my ISP - its all documented in my thread a couple of years ago.   I was at that point about to throw the towel in.
I didnt say anything to him - I never do when it comes to my own faults..  but the next guy who turned up damn well knew who I was, so that must have filtered up from Plusnet and then back down through openreach, because I had never ever said to any of them whom I was.   He just probably thought I was a woman who didnt have a clue.     
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 27, 2016, 05:18:05 PM
yeah I agree some people get obsessive about minor issues, william I think was over obsessed with his banding. Thats why I tried to tell him he wasnt going to achieve a big deal unbanding the line.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 27, 2016, 05:36:41 PM
@Kitz I am quite happy to watch my DS SNRm drop each evening by 1dB it's been doing this since day one when I starting to monitoring my line stats it is a bit annoying but that is part of this lines characteristic.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dave2150 on April 27, 2016, 06:01:28 PM
@Kitz I am quite happy to watch my DS SNRm drop each evening by 1dB it's been doing this since day one when I starting to monitoring my line stats it is a bit annoying but that is part of this lines characteristic.

I always assumed slight SNR fluctuations were to be expected - since the sun's electromagnetic interference impacts all our lines, unless someone has a completely underground line from PCP to house.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 27, 2016, 06:14:09 PM
I always assumed slight SNR fluctuations were to be expected - since the sun's electromagnetic interference impacts all our lines, unless someone has a completely underground line from PCP to house.

Radio propagation is what causes radio china & Romania to take 1dB away when the sun goes down.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: burakkucat on April 27, 2016, 06:49:42 PM
I am currently monitoring William's circuit via MDWS.

There is a consistent rise and fall of both DS & US SNRM over a typical 24 hour period. Perfectly normal and to be expected.

However superimposed on that rise and fall of the US SNRM is a period of what I shall describe as "craziness". It only appears to be present during the hours of daylight. What could be the cause? At present I don't know.  :-\
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 27, 2016, 07:19:57 PM
It only appears to be present during the hours of daylight. What could be the cause? At present I don't know.  :-\

Could it be caused by Economy 7 storage heaters they come on during the day and release the heat in the evening & night

edit: never mind that would be midnight to 7am
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 08:13:10 PM
7-10ish?  The heat coming off William watching line stats?

.

..

....

That was a joke!!!  

More serious note...  as I mentioned last week, its a swing and not direct REIN like to be able to say its 'x' being switched on.
Swings are exceedingly hard to pin point as they can be a build up of several things, or something heating up.. or anything really.
Although I do acknowledge the line is noisy, this is primarily why I think it may end up causing more stress and something that may never be found...  unless it is HR in which case it will need to get worse, before its found. :(

Im not trying to let BT off the hook, but when all their tests come back clear and theres no real spiking you could end up on a road to nowhere for nothing.


Title: Re: William Grimsley's Line - After DLM Reset
Post by: tbailey2 on April 27, 2016, 08:17:01 PM
Have you looked at his BitSwaps over say 5 days....
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 27, 2016, 08:23:16 PM
Doesnt really tell me much, other than more bit swapping going on when the SNRm is at its lowest which isnt surprising.

Bit surprised at more activity since Interleaving and FEC, but Im not sure what to make about that.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: NewtronStar on April 27, 2016, 09:43:41 PM
I have small HR issue on my line but it's not service effecting and no way am I going to get 5 or 6 engineers out to trace a possible small fault which they won't find, and HR faults need to really bad and service effecting before an OR Engineer can find the fault.

Title: Re: William Grimsley's Line - After DLM Reset
Post by: burakkucat on April 27, 2016, 09:56:04 PM
The "silly period", by consideration of the US SNRM, can be seen to be between 0600 - 2000 hours. It does not show any of the really violent swings that are characteristic of a HR or semi-conductive joint.

We are uncertain as to the degree of audible noise that may be heard when the telephone is used.

Ideally we need to see the graphical results for a time period when an incoming call is being signalled on that circuit. Ideally make use of the faultsman's ring-back, initiate the backwards call and unplug the telephone. Leave it for at least one minute or longer. (I can't recall if there is a time-out on the facility.) Assuming that the "ringing" voltage has been applied to the circuit for at least one minute then any potential effect on the SNRM should be visible by viewing the relevant plot.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: d2d4j on April 27, 2016, 10:17:36 PM
Hi

I hope you don't mind, but there were 1 post by William which to me, is a possible reason and one I have come across before.

I'm sure he posted that the overhead wire passes by trees, or through branches of trees.

I am not sure of the degree of ingress of the branches to the overhead wire, but if the branches are touching the wire, or touch the wire during breezes or windy conditions, I have experienced conditions similar which caused issues on dsl connections, which disappeared when the branches were cut down so they no longer were able to touch the wire

It's just a thought for a possible explanation of the issues

I stress this may not increase any speed beyond what the connection is capable off, but would likely stabilise the connection

I hope that helps but sorry if I'm wrong

Many thanks

John
Title: Re: William Grimsley's Line - After DLM Reset
Post by: burakkucat on April 27, 2016, 10:58:53 PM
Thank you John. Yes, now that you have mentioned it I, too, can recall that post . . .

I know what Black Sheep would do if he was tasked to fault-find on that circuit -- he would get his drop-cable measuring rods and use them to hit the cable whilst someone else monitored the line.

It could well be that abrasion by the tree branches have damaged the cable's insulation.

However, I am having a problem in attempting to rationalise why the "silly period" in the US SNRM only appears during the hours of daylight.  :-\
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 28, 2016, 04:59:58 AM
I would say swings of this nature are unusual on the US, I couldn't find any other MDWS user's with such swings (admittedly I didn't check many).  Although at the same time this swing will be within normal operating parameters as far as openreach are concerned, they only care about service affecting problems, so e.g. if the line drops out or if the speed is significantly below estimates. It is the reason why we have lines with a 6db margin not 0db, because of swings.

I also would never consider a passed JDSU test as decent evidence of a fault free line, that test by design will only detect very severe problems. But that is the agreement CPs have with openreach, that test only needs to pass and assuming GEA tests also pass, openreach are free to declare a line as fault free.

Ironically my current pair throws up an alert on the JDSU, my engineer spent a few hours doing a pair swap and gave me the pair with the best sync, and then proceeded to tell me in a gutted manner the JDSU didnt like the pair, I told him to not worry about it.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 28, 2016, 10:50:22 AM
I think most those of us whom continue to monitor on MDWS are the geeks and therefore by nature are most likely to have optimised their lines as best we can.

I too havent gone through MDWS too far, but if you look at just the A's then aesmith, alecR and andy265 all have a line that doesnt look perfect and Im not counting those that swing by 1dB. 

Swings are accepted event by DSL technology world-wide, its not just an Openreach. I'm certain I read a tech journal many years (10yrs?) ago (and if you look back on some really old posts of mine Im sure I will have said this many times) that 3dB was considered quite within normal parameters for swings.
As you say its why we have 6dB SNRm, some overseas ISPs use 9dB and didnt TT at one time use 9dB as the norm? 
Several years ago before Sky started using G.INP on their adsl2+ lines by default they had a very high level of INP set by default which also took SNRM to 9dB and a high level of Interleave that sometimes they would tone down.

What I fear here is that William may have been led to believe that something drastic is wrong with his line, when it is still operating within normal params.  Yes he could call out an engineer, but if there is a slim chance the engineer is going to see the daily swing, then what do we expect that engineer to do?   This is a downside of adsl over copper.

---

BTW if you go look at my own upstream SNRM for the past 180 days, note my upstream variance regularly going between 13.5dB and even down to 11.5dB - the straight line in the middle was no monitoring because I was testing another router. So I will snapshot a zoom in from that period showing swings between 13.3dB and 11.5dB.

One thing I find interesting and Ive been meaning to tell, because I thought it may also interest others.
In March I happened to notice an Openreach van parked on my neighbours drive.  After he went I noticed that MY downstream SNRm jumped up by 0.5dB.   

My downstream generally sat at about 6.8dB, but note how on Mar 10 it jumps to 7.3dB.  At first I thought perhaps it was a crosstalker, but no its continued to stay around there.  I asked my neighbour about the visit and she said "the wires in her grey box had disintegrated" - basically exactly the same corrosion of the metal terminals in the BT66 that I had had 2 years ago when I had a fault.   I know its not a big deal, but I found it odd that she'd had a line fault and immediately after that was fixed, I gained 0.5dB. I wonder how common place this is?       
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 28, 2016, 12:33:02 PM
I know this.   Same engineer also tried to tell me that CRCs didn't matter and that it was FEC's that were important.   Because my line didnt have any FEC's then it was perfectly fine.    Think about it for a moment.   The line at that particular time wasn't interleaved, of course it wouldnt have any FEC.
I should add this was not a Openreach Engineer gone through the ranks, but one of those BT took on at the time when they needed staff quickly and were recruiting ex military.   He was ex-navy and then proceeded to argue the case about FEC with me.
Seriously he chose the wrong person to try that one on, but can you imagine if that had been anyone else... such as William... or joe bloggs.

I had this same problem, both times... the 2nd time wasn't so bad though it was after I explained I understood the technolgy more than he may of thought...

The reality seems that Openreach don't want us to see or understand DSL.... maybe it will the next big Watchdog investigation where somebody goes in undercover and catches them dishing out the lessons on talking .....

Unfortunatly when it comes to talking about DSL stats or even comparing them, everyone should just ask one question which is "Does it work.... and what does BT Wholesale say you'll get"

I knew something was fishy with my address when the lines got put into the system properly.... they way the ranges of speed where changed on BT Wholesales checker....

The ranges really widened up after I ordered, specially on the 'Impacted' side of things.... I mean 67 - 35 is a bit of a joke...

and that leads me to my next question which is "what specifies a clean line to an impacted line?" is my line now classed as impacted? or does the system of "an engineer tested line is clean and self install is impacted?"

These issue we all keep seeing on VDSL such as crosstalk are only getting worse, the offers from CP's are getting very good at making people upgrade and the increase in bandwdith requirement in the 'basic' household is also grown pretty fast.

My grandparents currently have a Sky LLU connection at around 10/1... this is sufficient enough for them to do browsing and streaming but due to them streaming alot more and also now owning smartphone's and them looking at content heavy webpages its starting to have a drag on the connection, there's also the case that the Skype call quality at 1Mb/s is rubbish and it can take an age for them to backup photo's to Onedrive or upload a video from an event or holiday....

So at some point in the next 6 - 12 months I can emagine they will be getting popped onto VDSL... I can't see them being the only people in the boat, surely there is many more.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: niemand on April 28, 2016, 12:58:26 PM
The reality seems that Openreach don't want us to see or understand DSL.... maybe it will the next big Watchdog investigation where somebody goes in undercover and catches them dishing out the lessons on talking .....

This can be said for every large operator, though. All of them want to simply present a black box you plug into and the Interwebs come out. For 99% of the population this works just fine, too. The big boys have to cater to the lowest common denominator :)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 28, 2016, 01:17:37 PM
This can be said for every large operator, though. All of them want to simply present a black box you plug into and the Interwebs come out. For 99% of the population this works just fine, too. The big boys have to cater to the lowest common denominator :)

True...
Title: Re: William Grimsley's Line - After DLM Reset
Post by: gt94sss2 on April 28, 2016, 02:40:40 PM
I have small HR issue on my line but it's not service effecting and no way am I going to get 5 or 6 engineers out to trace a possible small fault which they won't find, and HR faults need to really bad and service effecting before an OR Engineer can find the fault.

It also concerns me that some BT boffins are aware of how easy it is to get hooked on line stats and that some will go into acute state of worry for what is normal parameters.     Ringing any bells?   Is it any wonder why certain ISPs lock their routers so that such info unnecessarily panics their users

I have to say that I have seen a number of posts where users are concerned about very minor variations in their stats for lines which otherwise appear to operating fine, objecting to the fact that due to DLM their ping times are higher than they used to be or having unrealistic expectations about the impact of crosstalk etc.

What one has to realise is that if Openreach do come out and touch the physical line, there is a possibility that a line which may not have had a major problem before could then be more likely to go wrong (as another recent thread demonstrates).

Like NS I suspect I have a HR fault and some noise on my line but its going to have to get worse before Openreach can find it..
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 28, 2016, 02:49:47 PM
My favourite one is when I had an aggressive engineer tell me my estimated speed, is the speed at the cabinet and then it declines further to my property :D
Title: Re: William Grimsley's Line - After DLM Reset
Post by: WWWombat on April 28, 2016, 03:05:34 PM
Wow. It's taken me a while to work through this thread... I'll make a few separate posts on the things I noted of interest.

On the physical reality:
I agree that swings are part and parcel of DSL of all types - it is part of the price to pay for re-purposing an old voice network, and the variety of installations that comes with such a network, into a high-speed data network.

I was always of the opinion that under 1dB was a good line, and that up to 3dB could be expected. From this, I thought the reasoning for a 6dB target was to allow the swing to go no lower than 3dB ... because the 3dB margin was where the errors really started to bite.

My belief, therefore, that use of margins below 6dB is something to be restricted until the variance of a line could be shown to be well below 3dB.

Crosstalk is a spanner in the works of this thinking. Especially for VDSL2. And it makes a bigger spanner if the disturber has a habit of turning their modem off.

Title: Re: William Grimsley's Line - After DLM Reset
Post by: WWWombat on April 28, 2016, 03:06:58 PM
On the technology of "impulse noise protection":
My weakest point on understanding the aspects of DSL is indeed "coding gain" - especially when you include the hidden parts, such as trellis coding, and then start combining them as inner/outer pairs. (@kitz; I might like hoovering up knowledge, but something like this (http://www.josephboutros.org/Qtheta_large_n_anyR_html/node4.html) makes even my eyes glaze over)

I noted @ejs made a comment about whether a G.INP-enabled modem could make predictions about the improvements in coding gain, and attempt to make an allowance for extra speed. That is an interesting avenue to explore, alongside the relative efficiency of different methods.

However, I tend to think that we are seeing the "allowance for extra speed" come out in a different way; and that BT are recognising this added efficiency through this different way: By allowing the target margin to drop below 6dB. By allowing the target margin to drop below 6dB, they are inviting more (raw) bit errors into the stream, under the belief that the new system can cope with, and fix, more errors.

Of course, we still have some amount of FEC and interleaving on G.INP-activated lines, but at a much lighter level. I wonder what the different coding gains are for different levels of FEC/interleaving? I assume it can vary...

Incidentally, I do believe it is possible for the sync speed to improve with G.INP on lines that had no previous FEC/interleaving intervention (i.e. INP=0). I don't know why - the standard framing parameters didn't explain it - so my assumption was that it was either in the re-framing that came about with G.INP or it was in the coding. The gain would be highest for those who would swap from lines with INP=3+, but modest improvements seemed to happen.

This graph seems to back that up:
(https://forum.kitz.co.uk/proxy.php?request=http%3A%2F%2Fwww.kitz.co.uk%2Fadsl%2Fimages%2Fretransmission_linespeeds.png&hash=61511e250c704ca3d3bd60ad72cbf04e6da91944)
If most lines (those with INP=0) would stay the same, shouldn't there be a lot of dots placed along the unity line?

An old ISPreview (http://www.ispreview.co.uk/index.php/2015/04/bt-openreach-briefs-uk-fttc-fibre-broadband-isps-on-g-inp-issues.html) article (describing the approach being taken for G.INP mk.II) includes this quote:
Quote
For the majority of lines, we have noticed a small (1-2Mbit/s) increase in line speeds, as a result of retransmission enabling the DLM to increase the headline rates. … Note that in some instances the available memory in the modem can limit the maximum headline rate, by a few Mbit/s, however this is quite rare

I'm not sure what to make of part of that quote. "Enabling DLM to increase the headline rates" ??? Surely (at the time) DLM hadn't intervened on "the majority of lines"? Not in the sense we knew it in early 2015, anyway. Where DLM had intervened old-style, then the improvement would likely be much more than 1-2Mbps - eg around 4mbps on a 40Mbps line would be more normal.

The ISP Forum in April 2015 also stated that:
Quote
Generally has positive impact on experience and headline rates
– 6 fold improvement in error performance
– Majority lines seen small increase in speed 1-2Mbps

Title: Re: William Grimsley's Line - After DLM Reset
Post by: WWWombat on April 28, 2016, 03:09:04 PM
On William's line:
From MDWS, the behaviour looks entirely like we would have expected 18 months ago, prior to the introduction of G.INP in any form.

- Before the DLM reset, DLM had intervened (INP=3, delay=8, banded)
- Before the DLM reset, the line was seeing bit errors from 7pm through to 7am, peaking before midnight. This generated many FECs, but almost no CRCs nor ESs.
- At the reset, an open profile is put in place (INP=0, unbanded)
- The sync and attainable speeds roughly matched, in the region of 40-41Mbps.
- After the reset, the line continued seeing bit errors in the same 7pm-7am period. These now appeared as many CRCs, with a high level of ESs, and quite a lot of SESs.
- The ES rate, around 3,000 per 24 hours, looked to be enough to trigger DLM intervention
- DLM intervened, with "low interleaving" (INP=3, delay=8, unbanded)
- After intervention, actual sync speed dropped 10%ish to around 37Mbps, while attainable rose 10%ish to around 45Mbps.
- Since DLM intervention, the line continues seeing bit errors in the same 7pm-7am period. These have reverted to FECs with almost no CRCs, ESs or SESs.
- The volume of FECs appears, at first glance, to be higher than before the DLM reset. Perhaps because the line is running slightly faster, at a slightly lower SNRM.

I know of no good reason why William's line seems to have gone back to 2014 behaviour though.
- Why didn't the reset put the line onto a "low interleaving" setting?
- Why, on intervention, didn't it turn on re-transmission?

The main issue right now is, perhaps, to figure out the cause of the biterrors. There's a bit of me that wonders about streetlights - especially if some of them turn off around midnight.

As it stands, the difference between sync speed (37Mbps) and attainable speed (45Mbps) seems to be explained by the standard artifact of the presence of FEC and interleaving. If DLM de-intervened, both speeds would like settle at the intermediate value of 41Mbps again. If G.INP was applied to the open profile, then the best guess would match BT's statements: perhaps an extra 1-2Mbps could be gained.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: WWWombat on April 28, 2016, 03:25:50 PM
and that leads me to my next question which is "what specifies a clean line to an impacted line?" is my line now classed as impacted? or does the system of "an engineer tested line is clean and self install is impacted?"

I split it out with two factors, the line itself, and the installation:

- The line itself is either clean or impacted. If clean, it has no faults. If impacted, it has faults that can cause reduced speeds.
It is perfectly possible for a self-installed FTTC product to be a clean line with no faults.

- Openreach really care whether a line can be assured to be clean and fault-free, or whether it must be assumed to be impacted. This assurance only comes from an engineer installation, as the engineer runs tests; without the assurance, with a self-install, no-one knows for sure.

- With the assurance of an engineer install, Openreach are willing to commit to speeds in the A range. Without the assurance, Openreach are only willing to commit to speeds in the B range.

- The assurance is only felt when you wish to report a fault where the only symptom is low speed. If you bought self-install, then you will be ignored until the speed has dropped well below the B range. If you bought an engineer install, then you will only be ignored until you fall well below the A range. If you want better service in the event of a fault, you maybe should choose the engineer installation in the first place. Its almost like buying an extra warranty.

You'd think that, if you started with a self-install, and then had an engineer around to check for faults, you'd get promoted from the B range to the assurance of the A range. I wonder if this happens.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Chrysalis on April 28, 2016, 03:47:42 PM
wow thats news, so all these new self installs openreach will now only look at the impacted range?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: Dray on April 28, 2016, 03:58:27 PM
I wonder if customers are informed of that before sale?
Title: Re: William Grimsley's Line - After DLM Reset
Post by: WWWombat on April 28, 2016, 05:16:56 PM
BTW's FTTC Handbook says this:
Quote
When customers order Self Install they should understand that there is a higher risk of the line being impacted with wiring issues and End Users getting lower line and throughput rates. We recommend that CPs use Range B Broadband Availability Checker (BBAC) values when providing estimated speeds to their customers.

Customers might not be informed about the reason why range B is being used, but the estimates provided by the ISP at point of sale (they all do this, right) should indeed come from range B.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: mlmclaren on April 28, 2016, 11:15:31 PM
BTW's FTTC Handbook says this:
Quote
When customers order Self Install they should understand that there is a higher risk of the line being impacted with wiring issues and End Users getting lower line and throughput rates. We recommend that CPs use Range B Broadband Availability Checker (BBAC) values when providing estimated speeds to their customers.

Customers might not be informed about the reason why range B is being used, but the estimates provided by the ISP at point of sale (they all do this, right) should indeed come from range B.

That would explain why some ISP's range the speed from the worst of B to the best of A....

So due to my VDSL being activated remotely instead of an engineer visit I could well be demoted to range B... however I did have an engineer visit to activate and test the phone... he was supposed to do VDSL too but BT hadn't ordered it and it had to be expedited to the next morning under a complaint....

I get the feeling that with Openreach's movedment's regarding the removal of CP equipment and pushing self installs could lead to the BTw checker removing the 2 ranges and resulting in one range for all.  ::)
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 29, 2016, 02:53:40 PM
Quote from: wwwombat
I was always of the opinion that under 1dB was a good line, and that up to 3dB could be expected. From this, I thought the reasoning for a 6dB target was to allow the swing to go no lower than 3dB ... because the 3dB margin was where the errors really started to bite.

Thats always been the case of how I've understood things were supposed to work and why I keep saying 3dB is considered normal - going right back to the days when rate adaptive DSL was first introduced.  Its not an Openreach thing, its world wide DSL technology thing.
Prior to that on fixed rate lines (512, 1Mb 2Mb) it was 6dB that was required.

We seem to have lost sight of the fact that swings are considered normal over copper and its why I dont want anyone going off on a wild goose chase for something which is highly likely to come back 'no fault found'.

Quote
On the technology of "impulse noise protection":
My weakest point on understanding the aspects of DSL is indeed "coding gain" - especially when you include the hidden parts, such as trellis coding, and then start combining them as inner/outer pairs.

I know :(  When I see all the complicated formulas which show how it works,  my eyes just glaze over Im afraid.

Quote
I noted @ejs made a comment about whether a G.INP-enabled modem could make predictions about the improvements in coding gain, and attempt to make an allowance for extra speed. That is an interesting avenue to explore, alongside the relative efficiency of different methods.

I was about to respond to ejs about the Broadcom white paper (which is why I re-opened this thread) and talk a little bit about coding gain and 'double booked' a couple of days ago.    I'd typed a long reply, but had to go out and left it unfinished... only to have FF crash and I lost the post.  :'(  I shall go back to that post again and try recreate what I was originally going to say.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 29, 2016, 03:16:21 PM
@ejs

I think when it says doubled booked its talking about the overheads required for FEC... and also when using INP that can further reduce the line rate.
INP is about applying sufficient protection against noise to ensure that 'x' DMT symbols can be recovered in the event of noise burst.
 
AIUI when it starts going on about the BER, I think its trying to say, that when you adjust the Bit Error Rate to increase error protection, then this 'takes away' SNRm.  I think coding gain is what makes the differential between the true SNR and the SNR margin.

ie this is what makes the SNRm increase/decrease at each stage of INP.   

eg. 

INP = 3 may take an additional 3bB of SNRm from the actual SNR value
INP = 4 may take an additional 6dB of SNRm from the actual SNR value

[I made up those SNRm figures - they could vary depending on various factors such as line rate and Im not about to start playing with complicated formulae]

So when its saying 'double booked' I'm assuming they mean FEC overheads and any adjustments to the BER which will adjust the SNRm further.   I could be wrong, that's the way I read it.
Quote
I think what the Broadcom whitepaper is saying, is that if you switch on interleaving to fix errors, and then what interleaving does is also add coding gain,

Interleaving itself doesnt fix errors, it chops up and spreads the data, so that if there is a noise burst, FEC has an increased chance of being able to correctly re-assemble the data.
Its FEC/INP adds coding gain.  Coding gain is the amount of SNR used by Error Protection to reach the desired BER rate compared against a line without RS encoding.

Although you can have FEC without interleaving, interleaving on its own without is useless.  But unfortunately it is interleaving that adds latency and delay.   This is a brief and crude example why delay occurs

Original data packets:
     abcd efgh ijkl mnop

Interleaved packets:
     aeim bfjn cgko dhlp

So not only the time taken to chop up and reassemble the data,  but it has to wait longer for data packet containing 'abcd' to arrive... because it cant re-assemble it until packet containing 'mnop' also arrives.

If we increase the depth we get:
     abcde fghij klmno pqrst uvwxy

Interleaved:
     afkpu bglqv chmrw dinsx ejoty

So now we have to wait for a 5 packet spread which takes longer to receive before data can be re-assembled.. and more delay.
The above are just examples to show in a very simplified way. Packets dont really contain only 4 or 5 chars but by using the alphabet its easier to see what is happening to the data stream.

Quote
I know my ADSL2 line works better with interleaving on, and I get a little more downstream bandwidth,

I'm not disputing that you may do.     
But the DSL theory is that FEC will always reduce line rate because of overheads.   There was some advances in RS coding algorithms ie (s=1/2 mode) which actually made for more efficient overheads, but once FEC is on, then those overheads are going to be there.
When on ADSL2+, FEC reduced my line rate of 24Mbps down to about 18.5Mbps :(

Quote
rather than using interleaving to optimise the line towards more bandwidth rather than lower latency, interleaving only gets used to try to correct errors, but it's not really powerful enough at that.

Interleaving cant correct any errors at all.  Its spreads data to help protect against burst errors.   Its FEC which does the all the error correcting.   
When they say Interleaving improves FEC, its because FEC has more chance of being able to recover from a single noise burst.

eg if the noise burst was
     abcd e--- ijkl mnop

on interleaved data, that same noise burst would be
     aeim b--- cgko dhlp

after its been de-interleaved then the actual damage of the noise burst would be
     a-cd e-gh i-kl m-op


FEC stands little chance of recovering packet e---, but it can easily correct a-cd e-gh i-kl m-op and therefore no data loss.
   
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 29, 2016, 03:24:56 PM
Quote from: wwwombat
I tend to think that we are seeing the "allowance for extra speed" come out in a different way; and that BT are recognising this added efficiency through this different way: By allowing the target margin to drop below 6dB. By allowing the target margin to drop below 6dB, they are inviting more (raw) bit errors into the stream, under the belief that the new system can cope with, and fix, more errors.

Wondering if they could lower BER probability, in the confidence that retransmission is so effective.  Whilst true SNR will always remain the same, changing parameters could affect the differential between SNR and SNRm.    I don't know enough about this though and its why I dont even begin to touch it on the main site because it is so complicated.    :(
Title: Re: William Grimsley's Line - After DLM Reset
Post by: ejs on April 29, 2016, 06:58:33 PM
@ejs

I think when it says doubled booked its talking about the overheads required for FEC... and also when using INP that can further reduce the line rate.
INP is about applying sufficient protection against noise to ensure that 'x' DMT symbols can be recovered in the event of noise burst.
 
AIUI when it starts going on about the BER, I think its trying to say, that when you adjust the Bit Error Rate to increase error protection, then this 'takes away' SNRm.  I think coding gain is what makes the differential between the true SNR and the SNR margin.
I'm sorry but I don't think that's correct. If you adjusted the Bit Error Rate, you would get a lower speed, with Interleaving+FEC or without. It's talking about the BER because it's saying interleaving+FEC can't achieve a BER suitable for IPTV, not without increasing the target SNRM which would reduce the bandwidth further. And then it talks about how PhyR can achieve a much better BER at a 0dB margin than the interleaver+FEC can at 3dB.

ie this is what makes the SNRm increase/decrease at each stage of INP.   

eg. 

INP = 3 may take an additional 3bB of SNRm from the actual SNR value
INP = 4 may take an additional 6dB of SNRm from the actual SNR value

[I made up those SNRm figures - they could vary depending on various factors such as line rate and Im not about to start playing with complicated formulae]
I think considering increasing INP levels as "taking away from the actual SNRM" is an unhelpful way of looking at it. There may have been a "sync speed" (net data rate) reduction comparable to changing the target SNRM, but I think the entire net data rate reduction comes from the amount of bandwidth used to carry the FEC data. Providing higher INP levels would require a greater portion of the line's bandwidth to be allocated for carrying the FEC data. Perhaps it would be useful to calculate the "gross" line rate, adding the bandwidth used for FEC data to the net data rate, to see if that shows that the total bandwidth is all still there.

Regarding the "inflated" attainable net data rate, that may be because the original definition for the attainable rate was poorly defined, or defined to be the highest possible rate, taking into account some parameters, but ignoring others. G.993.2 mentions two attainable rate methods, 11.4.1.1.7.1 is the basic method, which can take into account "all available coding gains" within the maximum latency, but it does not mention it must meet the required minimum INP level. Following that it describes an improved method for the attainable rate, which can take into account far more parameters including the minimum INP level, but support for the improved method is optional. Then G.998.4 section C.1.4.2 makes further additions to the improved attainable rate method. I do not know of any VDSL2 modems which mention which attainable rate method they use.

So when its saying 'double booked' I'm assuming they mean FEC overheads and any adjustments to the BER which will adjust the SNRm further.   I could be wrong, that's the way I read it.
The Broadcom whitepaper usually said over-booked rather than double-booked. It was happy enough to book the RS coding gain for use with PhyR.
I don't think there are any adjustments to the BER being considered. Technically speaking, I think the SNRM is defined as the maximum increase in noise power for which the BER would be maintained. The BER is another parameter that would affect the line speed achieved, but I don't think it should be somehow "converted" into an equivalent change in the SNRM.

Quote
I think what the Broadcom whitepaper is saying, is that if you switch on interleaving to fix errors, and then what interleaving does is also add coding gain,
That was me being lazy and saying interleaving to mean "interleaving+FEC" or even "FEC (Interleaving + RS Coding)".

Quote
I know my ADSL2 line works better with interleaving on, and I get a little more downstream bandwidth,
Ditto. Thinking of "switching on interleaving" as in setting the DLM to have interleaving+FEC as "opt in".

Quote
rather than using interleaving to optimise the line towards more bandwidth rather than lower latency, interleaving only gets used to try to correct errors, but it's not really powerful enough at that.
Yes, and again, interleaving to mean interleaving+FEC.

Quote from: That Broadcom Whitepaper
DSL technologies, including ADSL1/2/2+ and VDSL2, define a Forward Error Correction (FEC) scheme
based on a combination of RS coding and convolutional interleaving to provide extra coding gain in first
instance and, by extension, protection against impulsive noise (SHINE or REIN).

But the DSL theory is that FEC will always reduce line rate because of overheads.
That doesn't take into account the effect of this coding gain. If the benefit of the coding gain is greater than the overheads, the net data rate can be higher.
The other aspect of the theory is the effect of the constraints of the minimum INP level and maximum delay, which could greatly reduce the maximum rate on a line that might otherwise be short enough to get the full 24Mb on ADSL2+.

Coding gain is a positive, an advantage, it improves your speed. Even that Broadcom whitepaper mentioned that with PhyR, RS encoding (FEC) can be used to increase bandwidth.
Quote from: That Broadcom Whitepaper
As retransmission is also complementary to RS encoding, the RS overhead can now be selected solely
to optimize the coding gain. Thus, RS encoding becomes a benefit rather than an overhead.

If you are not using RS coding (FEC) to provide INP, then the RS coding can be used only for increasing the bandwidth. Obviously the coding gain would need to increase the total bandwidth by more than what the FEC data uses for it to be of overall benefit and increase the net data rate. Even when the FEC+interleaving is being used to provide INP, the coding gain (benefit) can still be taken into account, even though in most cases, the bandwidth used by the FEC data takes up more bandwidth than what's added by the coding gain, and so the net data rate is reduced.

Quote from: http://www.cs.cmu.edu/~guyb/realworld/reedsolomon/reed_solomon_codes.html
Coding Gain

The advantage of using Reed-Solomon codes is that the probability of an error remaining in the decoded data is (usually) much lower than the probability of an error if Reed-Solomon is not used. This is often described as coding gain.

Example: A digital communication system is designed to operate at a Bit Error Ratio (BER) of 10-9, i.e. no more than 1 in 109 bits are received in error. This can be achieved by boosting the power of the transmitter or by adding Reed-Solomon (or another type of Forward Error Correction). Reed-Solomon allows the system to achieve this target BER with a lower transmitter output power. The power "saving" given by Reed-Solomon (in decibels) is the coding gain.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: ejs on April 30, 2016, 08:01:30 AM
I did a bit more reading of the ITU DSL documents about the BER.

On ADSL2/2+ the bit error ratio is an adjustable parameter, error_max can be set for an error ratio of 10-3, 10-5 or 10-7.

On VDSL2 the bit error ratio is a constant, to not exceed 10-7.

I can't quite work out how the Broadcom whitepaper got:
Quote
With the typical error patterns observed in DSL modems, a BER of 10–7 at 30 Mbps translates into one error every 13 seconds!
It may have something to do with those "typical error patterns observed in DSL modems" rather than a simplistic one bit error every 107 = 10,000,000 bits.

If e.g. Openreach wanted to achieve fewer errors than the nominal maximum BER of 10–7, they'd have to work out what combination of target SNRM and INP level would be expected to achieve that, while trying to minimize the bandwidth reduction (from the increased SNRM and FEC overheads) and latency increase (from interleaving). They'd probably have to do that with consideration to the typical noise characteristics found on their particular network.
Title: Re: William Grimsley's Line - After DLM Reset
Post by: kitz on April 30, 2016, 10:22:41 AM
@ ejs

Thanks for that info. 
I was aware of adjustable params for BER, but wasnt aware that on vdsl2 it was a constant. 

There is still something about coding gain that niggles, but I need to do further research to explain it properly..  and unfortunately I dont appear to have time to do any of that these days.   
I seem to be constantly chasing my tail to keep up with admin which is still backlogged despite me being sat here until gone 2am last night doing stuff no-ones sees, and I still havent caught up on PMs and emails. So its not really a good time for me to go reading white paper type stuff.  In a way its ironic that I never seem to get chance to do the stuff I love doing these days, because I get so tied up doing the more mundane things.