Setting up env for service node
error on ioctl 0x4008669a for '/scratch7/brkello/8-stripe/320/ior_test' (3): stripe already set
error: setstripe: create stripe file failed
lfs setstripe /scratch7/brkello/8-stripe/320/ior_test 2097152 0 8
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 21:31:53 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing write performance test.
Thu Jun  8 21:31:54 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     910.32     2097152    16384      0.413043   719.48     0.042744   0   

Max Write: 910.32 MiB/sec (954.54 MB/sec)

Run finished: Thu Jun  8 21:43:53 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 21:43:58 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing read performance test.
Thu Jun  8 21:43:59 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      455.70     2097152    16384      0.396027   1437.71    0.072761   0   

Max Read:  455.70 MiB/sec (477.84 MB/sec)

Run finished: Thu Jun  8 22:07:57 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/320/ior_test
	obdidx		 objid		objid		 group
	     0	          1814	        0x716	             0
	     1	          1948	        0x79c	             0
	     2	          1920	        0x780	             0
	     3	          1849	        0x739	             0
	     4	          1877	        0x755	             0
	     5	          1820	        0x71c	             0
	     6	          1843	        0x733	             0
	     7	          1799	        0x707	             0

lfs setstripe /scratch7/brkello/8-stripe/320/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 22:08:01 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing write performance test.
Thu Jun  8 22:08:02 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     924.47     2097152    16384      0.423213   708.45     0.042310   0   

Max Write: 924.47 MiB/sec (969.38 MB/sec)

Run finished: Thu Jun  8 22:19:50 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 22:19:55 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing read performance test.
Thu Jun  8 22:19:56 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      473.83     2097152    16384      0.388003   1382.69    0.073793   0   

Max Read:  473.83 MiB/sec (496.85 MB/sec)

Run finished: Thu Jun  8 22:42:58 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/320/ior_test
	obdidx		 objid		objid		 group
	     0	          1823	        0x71f	             0
	     1	          1957	        0x7a5	             0
	     2	          1929	        0x789	             0
	     3	          1858	        0x742	             0
	     4	          1886	        0x75e	             0
	     5	          1829	        0x725	             0
	     6	          1852	        0x73c	             0
	     7	          1808	        0x710	             0

lfs setstripe /scratch7/brkello/8-stripe/320/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 22:43:04 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing write performance test.
Thu Jun  8 22:43:05 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     897.54     2097152    16384      0.423009   729.72     0.042163   0   

Max Write: 897.54 MiB/sec (941.14 MB/sec)

Run finished: Thu Jun  8 22:55:15 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 22:55:19 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing read performance test.
Thu Jun  8 22:55:20 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      465.38     2097152    16384      0.397171   1407.77    0.076186   0   

Max Read:  465.38 MiB/sec (487.99 MB/sec)

Run finished: Thu Jun  8 23:18:48 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/320/ior_test
	obdidx		 objid		objid		 group
	     0	          1824	        0x720	             0
	     1	          1958	        0x7a6	             0
	     2	          1930	        0x78a	             0
	     3	          1859	        0x743	             0
	     4	          1887	        0x75f	             0
	     5	          1830	        0x726	             0
	     6	          1853	        0x73d	             0
	     7	          1809	        0x711	             0

lfs setstripe /scratch7/brkello/8-stripe/320/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 23:18:52 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing write performance test.
Thu Jun  8 23:18:53 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     893.39     2097152    16384      0.406283   733.13     0.043195   0   

Max Write: 893.39 MiB/sec (936.79 MB/sec)

Run finished: Thu Jun  8 23:31:06 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 23:31:12 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/320/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin02
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/320:
WARNING: Not using system("df /scratch7/brkello/8-stripe/320") call
Participating tasks: 320

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/320/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 320 (320 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 640 GiB

Commencing read performance test.
Thu Jun  8 23:31:13 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      462.44     2097152    16384      0.397157   1416.74    0.076110   0   

Max Read:  462.44 MiB/sec (484.90 MB/sec)

Run finished: Thu Jun  8 23:54:50 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/320/ior_test
	obdidx		 objid		objid		 group
	     0	          1825	        0x721	             0
	     1	          1959	        0x7a7	             0
	     2	          1931	        0x78b	             0
	     3	          1860	        0x744	             0
	     4	          1888	        0x760	             0
	     5	          1831	        0x727	             0
	     6	          1854	        0x73e	             0
	     7	          1810	        0x712	             0