Setting up env for service node
lfs setstripe /scratch7/brkello/8-stripe/401/ior_test 2097152 0 8
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 23:56:18 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing write performance test.
Thu Jun  8 23:56:19 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     862.35     2097152    16384      0.528763   951.76     0.055598   0   

Max Write: 862.35 MiB/sec (904.24 MB/sec)

Run finished: Fri Jun  9 00:12:11 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 00:12:16 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing read performance test.
Fri Jun  9 00:12:17 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      459.64     2097152    16384      0.494520   1786.20    0.096360   0   

Max Read:  459.64 MiB/sec (481.96 MB/sec)

Run finished: Fri Jun  9 00:42:03 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/401/ior_test
	obdidx		 objid		objid		 group
	     0	          1826	        0x722	             0
	     1	          1960	        0x7a8	             0
	     2	          1932	        0x78c	             0
	     3	          1861	        0x745	             0
	     4	          1889	        0x761	             0
	     5	          1832	        0x728	             0
	     6	          1855	        0x73f	             0
	     7	          1811	        0x713	             0

lfs setstripe /scratch7/brkello/8-stripe/401/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 00:42:09 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing write performance test.
Fri Jun  9 00:42:10 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     881.76     2097152    16384      0.534511   930.78     0.052405   0   

Max Write: 881.76 MiB/sec (924.60 MB/sec)

Run finished: Fri Jun  9 00:57:41 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 00:57:46 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing read performance test.
Fri Jun  9 00:57:47 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      455.45     2097152    16384      0.480444   1802.64    0.094888   0   

Max Read:  455.45 MiB/sec (477.57 MB/sec)

Run finished: Fri Jun  9 01:27:50 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/401/ior_test
	obdidx		 objid		objid		 group
	     0	          1827	        0x723	             0
	     1	          1961	        0x7a9	             0
	     2	          1933	        0x78d	             0
	     3	          1862	        0x746	             0
	     4	          1890	        0x762	             0
	     5	          1833	        0x729	             0
	     6	          1856	        0x740	             0
	     7	          1812	        0x714	             0

lfs setstripe /scratch7/brkello/8-stripe/401/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 01:27:55 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing write performance test.
Fri Jun  9 01:27:56 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     872.79     2097152    16384      0.530985   940.38     0.053681   0   

Max Write: 872.79 MiB/sec (915.18 MB/sec)

Run finished: Fri Jun  9 01:43:36 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 01:43:41 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing read performance test.
Fri Jun  9 01:43:42 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      455.49     2097152    16384      0.498947   1802.46    0.096672   0   

Max Read:  455.49 MiB/sec (477.61 MB/sec)

Run finished: Fri Jun  9 02:13:44 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/401/ior_test
	obdidx		 objid		objid		 group
	     0	          1828	        0x724	             0
	     1	          1962	        0x7aa	             0
	     2	          1934	        0x78e	             0
	     3	          1863	        0x747	             0
	     4	          1891	        0x763	             0
	     5	          1834	        0x72a	             0
	     6	          1857	        0x741	             0
	     7	          1813	        0x715	             0

lfs setstripe /scratch7/brkello/8-stripe/401/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 02:13:51 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing write performance test.
Fri Jun  9 02:13:52 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     868.67     2097152    16384      0.522770   944.86     0.055094   0   

Max Write: 868.67 MiB/sec (910.87 MB/sec)

Run finished: Fri Jun  9 02:29:37 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Fri Jun  9 02:29:42 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/401/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin03
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/401:
WARNING: Not using system("df /scratch7/brkello/8-stripe/401") call
Participating tasks: 401

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/401/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 401 (401 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 802 GiB

Commencing read performance test.
Fri Jun  9 02:29:43 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      456.02     2097152    16384      0.479194   1800.38    0.089302   0   

Max Read:  456.02 MiB/sec (478.18 MB/sec)

Run finished: Fri Jun  9 02:59:43 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/401/ior_test
	obdidx		 objid		objid		 group
	     0	          1829	        0x725	             0
	     1	          1963	        0x7ab	             0
	     2	          1935	        0x78f	             0
	     3	          1864	        0x748	             0
	     4	          1892	        0x764	             0
	     5	          1835	        0x72b	             0
	     6	          1858	        0x742	             0
	     7	          1814	        0x716	             0