Kitz Forum

Announcements => Site & Forum Discussion => Topic started by: S13017 on February 03, 2019, 07:38:07 PM

Title: Maximum mumber of requests made today
Post by: S13017 on February 03, 2019, 07:38:07 PM
Hi is there any way to make more searches on the broadband checker on the site? thanks
Title: Re: Maximum mumber of requests made today
Post by: kitz on February 03, 2019, 11:03:16 PM
No sorry.   Someone abused it, BT Wholesale noticed and I had no access at all to any of their data, so it was down for a while to all.   
I had to jump through hoops, recode it and promise it wouldn't happen again by limiting the number of requests.   
Title: Re: Maximum mumber of requests made today
Post by: S13017 on February 04, 2019, 08:13:51 AM
Thanks thats appreciated, is there any other way i can find this sort of detailed info in larger amounts at all?

Many Thanks
Title: Re: Maximum mumber of requests made today
Post by: jelv on February 04, 2019, 09:26:55 AM
Is the SamKnows checker (https://availability.samknows.com/broadband/broadband_checker) limited?
Title: Re: Maximum mumber of requests made today
Post by: Ronski on February 04, 2019, 10:07:22 AM
Thanks thats appreciated, is there any other way i can find this sort of detailed info in larger amounts at all?

Many Thanks

You used to be able scrape the BT Wholesale checker but they wised up to that a few years ago and now black list the IP after to many requests. I don't know how many requests or how long the black list lasts.
Title: Re: Maximum mumber of requests made today
Post by: j0hn on February 04, 2019, 11:50:18 AM
Thanks thats appreciated, is there any other way i can find this sort of detailed info in larger amounts at all?

Many Thanks

For what purpose?
Title: Re: Maximum mumber of requests made today
Post by: kitz on February 04, 2019, 12:21:50 PM
Quote
You used to be able scrape the BT Wholesale checker but they wised up to that a few years ago and now black list the IP after to many requests.

They didn't used to care about any of the checkers, until it became evident that a few people were scraping.  They've since tightened up on a lot of things and made it so that you can't even now use an iframe around some of their pages.

All of those who do have access to their database (including ISPs) were told about 18/24m ago that they have to limit [external] requests and be alert to signs of abuse.  I know for a fact that BTw do monitor the amount of requests coming from various sources including any API requests.
Title: Re: Maximum mumber of requests made today
Post by: S13017 on February 04, 2019, 02:18:52 PM
For what purpose?


I have a company that can provide product solutions and want to make a list of areas to go for and samknows was good but the maps dont work , i stumbled upon this site but need to make searches per day for each area we are looking at.
Title: Re: Maximum mumber of requests made today
Post by: licquorice on February 04, 2019, 03:11:56 PM
Unbelievable!!!
Title: Re: Maximum mumber of requests made today
Post by: broadstairs on February 04, 2019, 04:40:11 PM
Sounds like this will end up in cold calling, hope they check TPS prior to doing any. Can understand why BT Wholesale would be upset.

Stuart
Title: Re: Maximum mumber of requests made today
Post by: S13017 on February 04, 2019, 05:30:19 PM
not at all Stuart, more so a staged event that the locals can be invited through local press and come and be part of and see the product range. im just looking to find the best areas to plan these first. no cold calling required :)
Title: Re: Maximum mumber of requests made today
Post by: broadstairs on February 04, 2019, 06:35:54 PM
not at all Stuart, more so a staged event that the locals can be invited through local press and come and be part of and see the product range. im just looking to find the best areas to plan these first. no cold calling required :)

Understand, however opinions here can be coloured by previous things which have been seen.

Stuart
Title: Re: Maximum mumber of requests made today
Post by: S13017 on February 04, 2019, 07:03:11 PM
Understand, however opinions here can be coloured by previous things which have been seen.

Stuart


Ah ok sorry , thanks for letting me know reasons why. im happy just to find the towns with slowest internet to assist, most of what is by doing research myself online and the checker facility just cements the research.
Title: Re: Maximum mumber of requests made today
Post by: j0hn on February 04, 2019, 07:25:12 PM

Ah ok sorry , thanks for letting me know reasons why. im happy just to find the towns with slowest internet to assist, most of what is by doing research myself online and the checker facility just cements the research.

Your trying to use a competitors database, that they deliberately don't want people harvesting data from, to use as an aid to targeting customers.

Surely you could see why some would question your motives.

It's exactly why I asked you why you wanted to do this, as I suspected it might be for this reason.

I'm not a fan, but it's your business  :)
Title: Re: Maximum mumber of requests made today
Post by: Ronski on February 04, 2019, 08:33:25 PM
If the OP just needs an idea of speeds for an area they could look here.

https://labs.thinkbroadband.com/local/index.php?tab=2&election=1#13/51.3199/1.2831/test/

It clearly relies on speed tests that people have carried, but could be a good indication of areas with slow broadband.
Title: Re: Maximum mumber of requests made today
Post by: j0hn on February 04, 2019, 08:46:54 PM
Don't Ofcom release this kind of data?