Kitz ADSL Broadband Information
adsl spacer  
Support this site
Home Broadband ISPs Tech Routers Wiki Forum
 
     
   Compare ISP   Rate your ISP
   Glossary   Glossary
 
Please login or register.

Login with username, password and session length
Advanced search  

News:

Author Topic: Exorcism; long tale of woe  (Read 2534 times)

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Exorcism; long tale of woe
« on: May 13, 2016, 07:26:25 PM »

[The story of how nearly half this week was wasted. Apologies for length of this post.]
---
The Weaver household has recently been cursed, touched by evil forces. Last week I received a new Siemens Gigaset N300 VoIP box from Andrews and Arnold, preconfigured for me by A & A. When I plugged the box into my LAN and logged into its web admin process, initially all seemed well. I told it to download the latest firmware update from the net, and the download started off. I then realised that the download was going to be very slow, because as a new, unknown device on my LAN, the N300 had been categorised as ‘pond life’; a guest IP was allocated to it, and its speed was strictly limited by a policy rule that applies to all visitors so that they are never allowed to hog the network. So I made the N300 into a recognised, full citizen, which changed its IPv4 address to something else. At that point the device seemingly died! I fiddled about with it but simply couldn't see it on the LAN at all, never mind even being able to ping it, and so next, in frustration, I tried the factory reset procedure on it. This seemed to be if no help at all, and the device was apparently semi-bricked in that there was an LED showing that the device was powered up but otherwise it was completely unresponsive. I then talked with AA on IRC briefly, to see if they could at least just sanity-check me or spot anything I had missed, but no joy. We were baffled. So we both agreed that the new N300 should go  straight back to AAISP. Bewildered. End of chapter one.

I ordered a new Firebrick FB2700 router from AA last Monday morning, as I had been having problems with one port on my current FB2500 device. Amazingly, after lightening my pocket by £900 inc VAT, the new FB2700 arrived _the next day_. In the Highlands (!), from the _South of England_. Very efficient. That day, Tuesday, my wife  was busy and wasn't available to help me with physical tasks, so apart from opening the box as if Santa had just visited me, installation would have to wait until the following day when my beloved would be free to help me out with plugging cables in and so forth. Came the next day and there was an uncanny repeat of the Siemens N300 box experience. I http-connected to the new Firebrick, successfully logged in to its web admin process and attempted to select a config file to http-upload into it. This failed, because IPv4 to the Internet wasn't working - since I had selected a bogus 10.0.0.0/8 address for myself so as to be able to talk to the Firebrick which defaulted to being at 10.0.0.1 - and I had forgotten that my backup of the config was living on the network file system provided by Apple's “iCloud” Internet-based storage service. So I changed my IPv4 address to something sensible, and attempted to set the new Firebrick's IPv4 address to something sensible too by letting it get DHCP-configured by the old Firebrick acting as DHCP server. At this point everything went pear-shaped. I simply could not see the new Firebrick on the LAN no matter how I tried, at an address expected of a DHCP client, nor at its default 10.0.0.1 address. I then tried factory-resetting it, out of desperation. This involved creating a loopback by connecting an Ethernet cable between two of the FB's ports in order to tell it to reset itself. Anyway it still appeared semi-bricked in that the LEDs on the front panel would flash as expected, showing the CPU was working, but I still simply couldn't see it or talk to it on the LAN. Sounds familiar?

After several hours of faffing about, I scanned the LAN and spotted an unknown device at a very unusual address - 192.268.1.1. I say ‘unusual’ because I haven't been using this particular RFC 1918 range at all. I thought to myself that this might be the new Firebrick which for some reason had been caused to adopt this unusual address because of the very-hard factory reset procedure. I then noticed that the mystery device couldn't be the new Firebrick because its MAC address was wrong. So in curiosity I tried http-connecting to the mystery device and got a webpage that was blank apart from a login prompt. After several minutes of password hacking, I successfully got in with "admin" / "admin" or some suchlike. Then to my horror, I saw a web page belonging to a DLink DSL-320B-Z1 modem/router. I struggled out of my bed, because my wife had gone to the local village and wasn't around to help, went to the upstairs office and found the evil DLink lurking on the desk. I realised that my dear wife had plugged it in to the main LAN switch for me some weeks earlier when I wanted to take a brief look at its config. But after I had finished, I had forgotten all about it and had never asked her to unplug the device for me, so it had been left sitting there still plugged into the LAN. The DLink can be a (crap, buggy) router as well as a modem, and as ill-luck would have it, it was acting as a _DHCP server_ and had been doing so for (?)weeks.

This, I suspected,  had been the cause of the chaos with the vanishing devices. At some point, acting as a DHCP client, a new device would get kidnapped by the evil rogue DHCP server and get pulled into the 192.168.0.0/16 range thus vanishing from sight. In the case of the Siemens N300, googling the issue brought up reports suggesting that the device could get bricked if a firmware download (or flash blowing) was interrupted, so this could be the answer to the first mystery death. In the case of the new Firebrick, I suspect I might have killed it by doing the factory reset procedure wrongly and asking my wife to pull the power at the wrong point, while it was perhaps still blowing its flash in order to reinstall the default config or the factory firmware image. The realisation about the suspected reason for the FB's death came after I had again talked with AA, we were once more baffled, and agreed to send the new FB back to AA for swap-out. I suggested to AA that an exorcism might be in order at Weaver Towers, as at that point the answer from rationality concerning the rogue DLink had not yet surfaced.

The moral: don't have rogue DHCP servers on your network.

I see that I can turn off the DHCP server function on the DLinks. They are supposed to be configured to just be in modem-only mode (‘bridge modes’), so it seems daft that a lot of these appropriate config changes aren't made as a matter of course, or even automatically. A lot of inappropriate garbage options are still left turned on when you set the device into modem-only mode.

So, the body count: Two brand new devices to go back to AA, just under a grand's worth of semi-bricked kit, to be packaged back up, ready for the next time we venture out to visit civilisation and post them off at Broadford Oifis a‘ Phuist. Ho hum.
Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Exorcism; long tale of woe
« Reply #1 on: May 13, 2016, 10:34:42 PM »

Hmm . . . :hmm:

I would be very surprised if there is anything significantly wrong with the FB2700, it probably just requires a factory re-load of the firmware. I'll guess that somewhere inside the case will be the appropriate connector. Hopefully the people at WF / AA will be able to sort things out for you.  :-\  (I have a WF1740 -- a FireBrick 105 -- in the grotto. No matter how I try, it refuses all attempts to upgrade its firmware.)

Also at The Cattery, every device connected to the LAN is assigned a static IPv4 address. So I always make a point of turning off any DHCP server that may be lurking around.

Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

kitz

  • Administrator
  • Senior Kitizen
  • *
  • Posts: 33884
  • Trinity: Most guys do.
    • http://www.kitz.co.uk
Re: Exorcism; long tale of woe
« Reply #2 on: May 13, 2016, 10:38:44 PM »

Ouch to both the pocket and time wasted.

Glad that you found the culprit..   damn annoying though :(
Logged
Please do not PM me with queries for broadband help as I may not be able to respond.
-----
How to get your router line stats :: ADSL Exchange Checker

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Exorcism; long tale of woe
« Reply #3 on: May 13, 2016, 11:51:30 PM »

No loss to pocket due to the curse of the rogue DLink, as the kit is brand new and under warranty. But annoying about the old Firebrick starting to misbehave on one port. (I might have posted on this subject a while back? Can't even remember.)
Logged

burakkucat

  • Respected
  • Senior Kitizen
  • *
  • Posts: 38300
  • Over the Rainbow Bridge
    • The ELRepo Project
Re: Exorcism; long tale of woe
« Reply #4 on: May 14, 2016, 12:30:22 AM »

Yes, in one of your earlier threads, when you were systematically swapping the three modems, the three PSUs and the three patch cables, in all permutations, there was an indication that something was "odd" with one port on the FireBrick.

Have you made any enquiries to see if WF / AA would overhaul and refurbish your current FireBrick?
Logged
:cat:  100% Linux and, previously, Unix. Co-founder of the ELRepo Project.

Please consider making a donation to support the running of this site.

Weaver

  • Senior Kitizen
  • ******
  • Posts: 11459
  • Retd s/w dev; A&A; 4x7km ADSL2 lines; Firebrick
Re: Exorcism; long tale of woe
« Reply #5 on: May 15, 2016, 01:45:41 AM »

That's a good idea. It might be a nightmare job finding the problem though.

Whatever the answer, I want to keep the (sickly) FB2500, as I need a backup device in case of yet another lightning surge, as I have to admit, I haven't found the energy to progress the WAN isolation ideas.
Logged

tickmike

  • Kitizen
  • ****
  • Posts: 3641
  • Yes Another Penguin !. :)
Re: Exorcism; long tale of woe
« Reply #6 on: May 17, 2016, 03:19:19 PM »

Done that  :) while setting up access point wireless settings a short distance from my WiFi connected laptop spent ages investigating why my laptop stopped steaming music only to find it had connected on to the access point WiFi signal being set up (because it was stronger), which was only wired up to a test computer and not the internet.  :-[
Logged
I have a set of 6 fixed IP's From  Eclipse  isp.BT ADSL2(G992.3) line>HG612 as a Modem, Bridge, WAN Not Bound to LAN1 or 2 + Also have FTTP (G.984) No One isp Fixed IP >Dual WAN pfSense (Hardware Firewall and routing).> Two WAN's, Ethernet LAN, DMZ LAN, Zyxel GS1100-24 Switch.

WWWombat

  • Kitizen
  • ****
  • Posts: 1674
Re: Exorcism; long tale of woe
« Reply #7 on: May 18, 2016, 06:10:54 PM »

I don't recall that I've had a rogue DHCP server before, but I've had the rogue WiFi.

If you want to make use of the nice shiny, UNUSED, 5GHz channels that are out of reach of "simple" consumer WiFi devices, you need to use the spectrum that requires DFS. This checks for nearby radar, and forces a channel change if needed.

This means a client can suddenly lose sight of the proper WiFi SSID, so falls back to something else - usually something terrible with almost no signal strength - and doesn't return when the decent SSID returns on a slightly different channel. Grr.
Logged
 

anything