Kitz ADSL Broadband Information
adsl spacer  
Support this site
Home Broadband ISPs Tech Routers Wiki Forum
 
     
   Compare ISP   Rate your ISP
   Glossary   Glossary
 
Please login or register.

Login with username, password and session length
Advanced search  

News:

Pages: [1] 2 3 ... 8

Author Topic: Maths - hollow curve phenomenon detector - algorithm design  (Read 39667 times)

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Maths - hollow curve phenomenon detector - algorithm design
« on: January 19, 2022, 01:24:46 AM »

« Last Edit: January 21, 2022, 08:49:49 AM by Weaver »
Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #1 on: January 19, 2022, 03:41:13 PM »

My first (and currently only) suggestion is to restrict the domain of the X-axis values to be considered. I would use:

100 > X > 32
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #2 on: January 19, 2022, 09:21:23 PM »

« Last Edit: January 21, 2022, 09:44:14 PM by Weaver »
Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #3 on: January 19, 2022, 10:10:14 PM »

As 100 - 32 = 68, my next suggestion is to perform an initial pass looking at blocks of 4. That should minimise the distraction caused by a pilot tone, etc.

(Why blocks of 4? No real reason other than that 4 x 17 = 68 and 4 > 1.)

I feel the urge to type "first differential".
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #4 on: January 19, 2022, 10:51:41 PM »

Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #5 on: January 19, 2022, 11:21:32 PM »

Just differentiate the arithmetic mean and find the turning point(s) of the curve. If you have a local maximum, followed by a local minimum, followed by a local maximum then the hollow curve phenomenon has struck again.

Hmm . . . I think you will need to look at the second differential. (My memory of A-level pure mathematics, from 50+ years ago, has faded somewhat.)
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #6 on: January 20, 2022, 04:40:30 AM »

I understand the calculus rationale. However the pilot tone thing has a huge spike in both first and second derivatives.

l would rather not do differentiation; recte finite differences here, since the bits-per-bin data are discrete integer-valued (y). The reason is because having a loop with lots of subtractions in it will be slow, as Shortcuts is incredibly slow.

What were you saying before about four quarters? My most urgent need is to get rid of all spikes, pilot tone being the main one. Wobble of y +/- 1 is also a nuisance, some being mere quantisation noise.
Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #7 on: January 20, 2022, 03:16:33 PM »

I'm not too sure what I was thinking about, late yesterday.  :-[

At the moment, I can't see a clear forward path to a boolean answer to a query asking if a "hollow curve" is present.

Random thought. Suppose that the bit loading per sub-carrier index is "harvested", once, at the same time each 24 hour period. Now subtract that of dayn from that of dayn+1 to give the delta on dayn+1. What would that delta show when the "hollow curve phenomenon" first appears?
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #8 on: January 20, 2022, 08:55:57 PM »

« Last Edit: January 20, 2022, 09:04:36 PM by Weaver »
Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #9 on: January 20, 2022, 10:42:06 PM »

I was thinking about a crude spike detector that looks at x==60 for a dip down to y=2 (or maybe 3,4 for a bit of insurance) and then if it sees one at x==60 it walks sideways in increasing x+=2 to get away from the spike. Then y[x==60 or 62] now is compared against y[40] and y[85] as mentioned in my first post. Something like

        hollow = y[x==60 or 62] < y[40] && y[x==60 or 62] < y[85];

I am not that certain . . . but it certainly is worth testing.
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #10 on: January 21, 2022, 12:24:29 AM »

« Last Edit: January 21, 2022, 02:23:09 AM by Weaver »
Logged

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #11 on: January 21, 2022, 01:18:26 AM »

« Last Edit: January 21, 2022, 01:40:47 AM by Weaver »
Logged

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #12 on: January 21, 2022, 02:19:24 AM »

« Last Edit: February 11, 2022, 04:30:20 AM by Weaver »
Logged

jelv

  • Helpful
  • Kitizen
  • *
  • Posts: 2084
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #13 on: January 21, 2022, 08:16:38 AM »

A question: when writing posts in the forums, it does of course go crackers when I try to write certain things inside [ ]. How do I work around that?

Enclose the text in [nobbc]...[/nobbc] tags (which I had to do in this post so they would show - start a quote of this post to see how).
« Last Edit: January 21, 2022, 08:19:40 AM by jelv »
Logged
Broadband and Line rental: Zen Unlimited Fibre 2, Mobile: Vodaphone
Router: Fritz!Box 7530

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Maths - hollow curve phenomenon detector - algorithm design
« Reply #14 on: January 21, 2022, 06:46:48 PM »

Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.
Pages: [1] 2 3 ... 8