Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 5.3

...

Code Block
Jan 15 23:15:55 isfs6 rsyncd[854]: rsync: read errors mapping "PCAPS/raw_data/isfs6_20110113_000000.dat" (in data): Input/output error (5) 

The rsync also results in a bunch of these errors in /var/log/isfs/kernel:

Code Block

Jan 15 23:12:15 isfs6 kernel: attempt to access beyond end of device
Jan 15 23:12:15 isfs6 kernel: sda1: rw=0, want=78103088, limit=15825499

So that it doesn't get in the way of successive rsyncs, I moved it the file to isfs6:/media/usbdisk/projects/PCAPS/bad

data_stats on the rsync'd file reports many bad samples, with incorrect types, ids, length, times, etc.

I was able to clear our most of the junk with these commands on the file at EOL:

Code Block
sensor_extract -s 6,30 -s 6,100 -s 6,20 -s 6,50 -s 6,0x8000 -s 6,40 -s 6,80 -l 0 isfs6.dat isfs6_20110113_000000.dat 
nidsmerge -i isfs6.dat -o isfs6x.dat -s "2011 01 13 00:00"  -e "2011 01 13 12:00"
sensor_extract -s 6,30 -s 6,100 -s 6,20 -s 6,50 -s 6,0x8000 -s 6,40 -s 6,80 -l 0 isfs6xx.dat isfs6x.dat
bzip2 /scr/tmp/maclean/isfs6xx.dat -c > isfs6_20110113_000000.dat.bz2 

...