21 Jan: Militzer&Oncley
Purpose: Entire station lost communication at about 1:30 today (while we were giving the tour of site5).
We've seen lots of reconnects in dyndns both since midnight last night and during the day yesterday.
Steps:
Cradlepoint WAN quick blinking/no USB or WLAN LED. Cycled power to cradlepoint. USB now on; WAN blinking; external connection via dyndns still not up, though www.dyndns does show request; am able to ssh in with IP address; data acquisition has been running.
See in messages that router_check ran, now access via isfs4.dyndns is working.
At Gordon's suggestion, did a bunch of tests of check_router script (which should have fixed this problem by itself). It has a long time-out of 3--5minutes, but did work as expected with the LAN cable unplugged. We next want to run a test by unplugging the 3G modem, but ran out of power on our laptop. We'll do this test tomorrow on the spare in the base.
P.S. The next day, we did this test on the spare, which worked exactly as expected. Thus, this failure at wvally4 is still a mystery.