Blog from May, 2013

Tower service visit

May 30, ~ 10:30 - 1:30 CDT

Gordon and Tom serviced the sensors and DSMs on the profile tower:

44m: Cleaned Licor

38m: Cleaned EC150

~36m: Cleaned K&Z 4-component net radiometer

32m: Cleaned Licor; grounded DSM; cleaned PAR; Tsfc @ -1.5 degC

26m: Cleaned Licor, PAR, and wetness sensor (splattered w/ bird crap)

20m: Licor and PAR cleaned; PAR covered in bird crap

14m: Grounded DSM and fixed usbdisk; cleaned PAR, KH2O (0.35V) and wetness sensor; no Tsfc

8m: Cleaned PAR, Licor, wetness sensor; typical splatter of bird crap

2m: Cleaned KH2O (0.35V)

There were questions about the PAR at 32 m (1036 W/m^2) and 14m (50 W/m^2), but these seem to fit into the profile of the other PAR's.

Cellular network

Gordon, May 29

The cradlepoint CBR400 router and the Verizon modems have been working, but have some issues.

On May 27 and 28, the router would go offline periodically, and not be pingable from the local network at address 192.168.0.5 (cbr400). From the web interface (http://cbr400), System Settings -> System Control -> Advanced, I turned off "Enable Watchdog Reboot" to see if that would help. The CBR400 stayed up all night. When we arrived at the trailer (9:20) it was pingable, but the web interface would not respond.

The 3G modem has been working fine. On the web interface for the CBR400, the signal strength is typically -75 dBm, with 4 bars.

The 4G modem does not always connect. The status page shows a signal level of -79 to -84 dBm, which I presume is acceptable.

The CBR400 sends log messages to the syslog on "flux". The 4G modem is known as "WAN:9d7c85c4". The logs show "carrier reject", and that it reverts back to 1XRTT (2G):

fgrep CBR /var/log/messages | fgrep 5c4

May 28 16:45:12 cbr400.isfs.ucar.edu (CBR400-afa) WAN:9d7c85c4: Connection Change : None -> EVDO, %
May 28 16:45:12 cbr400.isfs.ucar.edu (CBR400-afa) WAN:9d7c85c4: Connect Event: carrier reject
May 28 16:45:12 cbr400.isfs.ucar.edu (CBR400-afa) WAN:9d7c85c4.CPPM: state=connecting  result=carrier reject
May 28 16:45:19 cbr400.isfs.ucar.edu (CBR400-afa) WAN:9d7c85c4: Connect Event: carrier reject
May 28 16:45:19 cbr400.isfs.ucar.edu (CBR400-afa) WAN:9d7c85c4.CPPM: state=connecting  result=carrier reject
May 28 16:45:44 cbr400.isfs.ucar.edu (CBR400-afa) WAN:9d7c85c4: Connection Change : EVDO -> 1XRTT, %

I plan to contact Verizon and see if they can help from their end concerning the 4G modem.

Morning of May 29:
Upgraded firmware on CBR400 to version 4.3.0
Speed tests: http://www.dslreports.com/speedtest?flash=1

state

download

upload

latency

3G connected (EVDO), 4G disabled

413,444

380,309

121,107

4G connected (1xRTT), 3G disabled

58

127

485

Until we can get the 4G modem to do better than 1xRTT, we'll use the 3G and disable the 4G.

Here is the display of Status -> Internet Connections -> "Modem: Novatel Wireless CDMA" with an EVDO connection:

Here is the display of Status -> Internet Connections -> "Modem: Novatel Wireless 4G", in the disabled state:

May 30, Gordon
The cellular worked quite well yesterday, but not so hot today, frequent disconnects. I tried enabling the watchdog reset on the CBR but then disabled it again after several hours since it didn't help. The router_check.sh script on the "high" dsm is our own watchdog reset.

While on the tower, I checked the antenna cable connections at the modems, and the usb connections at the hug. All looked good.

TODO: look at the logs. Perhaps the signal levels were lower today? Contact verizon about 4G.

WIFI up

Gordon, May 28

AP24 is on a pipe at the NE corner of the base trailer.

eante (192.168.0.80) is mounted on a T-post at pond DSM (192.168.0.101)

Gary setup the etherants at the sodar and lidar.

eantf (192.168.0.81) is at the sodar (192.168.0.91)

eantg (192.168.0.82) is at the lidar (192.168.0.92). There is also a camera at the lidar (lidarcam=192.168.0.253).

All links OK.

To view the signal levels, point a browser to eante, f or g, login to admin, usual password about sonics.

To view the signal levels on the ap24, point a browser to ap24, admin, sonics. Click on "RegTable" link on the left-hand side, or you can ssh to it and view the registration table:

"int wire reg p" is shorthand for "interface wireless registration-table print" (or use TABS to expand commands):

ssh admin@ap24
admin@192.168.0.70's password:
...
[admin@Alico] > int wire reg p
 # INTERFACE     RADIO-NAME       MAC-ADDRESS       AP  SIGNAL... TX-RATE UPTIME
 0 wlan1-Int-Ant                  00:20:F6:05:24:7F no  -36dBm... 11Mbps  3h52m55s
 1 wlan1-Int-Ant                  00:20:F6:05:24:5A no  -32dBm... 11Mbps  2h4m56s
 2 wlan1-Int-Ant                  00:20:F6:05:1E:D5 no  -36dBm... 11Mbps  1h8m14s

Gordon, May 28

From candlewood this morning around 6:45 was able to ping isfs1.dyndns.org. Later, around 7:15 was not able to ping.

On arrival at base, could not ping tower DSMs. SDF was on, but no RXF on fiber transceiver.

At tower, 10:05 CDT

Battery terminals: 12.29V
Charge controller, "solar" input: 13.21
Charge controller, load: 0V
I believe the load disconnect LED was on

TRH fans were off

As I was probing the charge controller, the TRH fans started up. Perhaps the battery/controller/charged cooled a bit since the cooler lid was open?

Measured voltages again:
Battery terms: 12.69
Charger battery: 12.88
Charger solar: 13.07
Charger load: 12.84
DSM 12.16

By looking at the archive files on the DSMs, the system has been up and down this morning:

 

UTC

CDT

died

11:18

06:18

up

12:32

07:32

died

14:15

09:25

up

15:08

10:08

Left cooler lid open.

Fiber network up

The fiber network is up.

When the fiber was strung, we connected all 4 fibers, blue, green, brown and orange at each junction.

The first test was with the blue and green fibers, but the network would not come up. In the trailer, the SDF (signal detect fiber) would go green, but SDF at the tower was out.

Switched to brown and orange, and it is working now.

Base trailer: TX: orange, RX: brown
Tower: TX: brown, RX: orange

At each transceiver (media converter)

LED

color

Power

green

SDC (signal detect copper)

solid green

RXC (receive copper)

flashing green

SDF (signal detect fiber)

solid green

RXF (receive fiber)

flashing green

Switches (see BEACHON/Manitou logbook for info on these)

1

up

2

up

3

down

4

down

May 27.

Installed the soil sensors at site A (near the radiation stand) this morning.  Also buried a little more of the cables near the sensors at site B (near the rain gauge).

Heights of top of each bracket WRT tower base plate. Brackets at 13.92 and 43.86 meters had to be offset a bit due to section junctions or guy hardware.

Height (m)

2

8

13.92

20

26

32

38

43.86

Setup with Power

The whole tower is now dressed and running...kinda.  We have all tubes and instruments running (Gordon saw 100% coming in) then we shut it down due to power.  We just did a test with the batteries then we let the batteries charge off the transformer.  The TRAM Trailer does have the air conditioning working but no racks are set up yet so no power has been laid out.  Soil probe B is in w/ the tipping bucket and the radiation stand has been installed with no soils.  Fiber has been run but not hooked up.  

Kurt, Gordon and Tom will remain on site until start of project.

The radiation stand is within +/- 2 degrees of true E/W and has 4 Kipp & Zonen broadband radiometers (incoming and outgoing long and shortwave radiation), the SPN net radiometer, and a leaf wetness sensor.  Radiometer levels have their bubbles within the 'bullseyes'.

Setup TOWER Dressed

The whole tower has all instruments on it and the cables/tubes are dressed.  We have a couple of tubes that are low that need to be strung and the lower dsm to be hooked up and then we can have Gordon test all instruments while I am here.  We still do not have power to the tower but now that ACDs gear is loaded and the trailer is put into it's spot we can start hooking up transformers and run power to tower.  We can do testing off of batteries for today but we should have power going soon to the tower.  

Gordon and Tom have arrived and they found the tower.  

The inlet on the tubes are hanging just by the Licor mounting bolt.  It seems to be far enough away from sonic/licor and pressure port.  Tom will have the final say on location today.  

Things to do:

Soils/radiation stand (tom)

lower dam (chris)

tower power(kurt)

fiber (john/gordon)

pond & lidar communications (john)

Setup at SOAS

We have instrumented the tower!!!  We are all exhausted from todays setup.

We have all levels up except for the four component radiation and the canopy par wand.  These should be done tomorrow.

Trailer power is up and running.  The power to tower is not, but this is waiting on ACD due to where the trailer will reside.  

Things to do:

Four component on tower.

Par wand at canopy height.

ACD tubes installed.

soil probes installed.

power to tower.

ACD loaded.

Setup Log

We had a great day today.

We had a state forest servicer person get a rig to move our Base Trailer to the pole barn.  It is in place and set up.  WAHOO!!!!  This means no Black Warrior or Electrician needed.

The power cable has been drug through the woods and is in place.  No power yet (need breakers) but it's at least there and ready to hook up.

We also have dressed the High dsm levels and looks great.  

Soil and radiation spots have been picked but not installed.  Waiting on tower to be dressed while Ned is here.  

TRAM trailer has been moved to accommodate ACD.  We are having them directly transfer equipment or forklift rental.  I have been talking with Peter and Andrew on this transfer.

Things to do tomorrow:

Dress the rest of the levels on the tower.

Hook up power to trailer and site.

Communications to Pond and LIDAR.

Soils installation

Help ACD with equipment transfer.

GO TEAM!

Setup Update

May 22, 2013

At setup in Marion, AL.  We have re-plumed the tower using a plum-bob for the first three guy points.  Then we had line of site to the tower and used the theodolites for the remaining upper guy points.  The south, outer, guy anchor is fully tensioned and has moved an inch.  It has pulled towers the tower.  The ground is somewhat moist.  Since this anchor is in the tall grass, that seems to keep the ground more wet than the exposed ground near it.  There is still a puddle that is between the anchor and the bridge (going to tower).

The TRAM trailer is fixed.  It was the leaf spring on the right side.  This had broke, making the axle rest on the frame.  Since it was being driven and not seen, the axle then moved back and making the tire rub the wheel well, putting a gouge the tire on the tread near the outside.  The spring and brackets were all replaced and the trailer is now in position.  It is between the outer anchor and bridge.

Brackets are hung but no instruments.

Cable/fiber line has been flagged and it will be pulled the next day.  We have borrowed the AABC's front loader and it's suspending the spool of 1800' wire.  We will just take turns pulling cable through the woods.  It looks like we have long enough cable.

Ned has an area for the dark horse but has not committed to putting soils in yet.

Pond site is up and running.  No communication yet.  Forgot a bracket for the antenna.  

Base trailer will be moved to the pole barn once we find a trucker.  The gov't site is great but we are getting no responses from the power company.  The pole barn site was not used when the trailer was dropped due to moist ground.  It is dry now and looks great for a rig to drive on.