Setting up env for service node
lfs setstripe /scratch7/brkello/8-stripe/241/ior_test 2097152 0 8
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 19:42:37 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing write performance test.
Thu Jun  8 19:42:38 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     912.46     2097152    16384      0.312561   540.59     0.031459   0   

Max Write: 912.46 MiB/sec (956.79 MB/sec)

Run finished: Thu Jun  8 19:51:38 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 19:51:43 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing read performance test.
Thu Jun  8 19:51:44 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      467.32     2097152    16384      0.301763   1055.84    0.055662   0   

Max Read:  467.32 MiB/sec (490.02 MB/sec)

Run finished: Thu Jun  8 20:09:20 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/241/ior_test
	obdidx		 objid		objid		 group
	     0	          1819	        0x71b	             0
	     1	          1953	        0x7a1	             0
	     2	          1925	        0x785	             0
	     3	          1854	        0x73e	             0
	     4	          1882	        0x75a	             0
	     5	          1825	        0x721	             0
	     6	          1848	        0x738	             0
	     7	          1804	        0x70c	             0

lfs setstripe /scratch7/brkello/8-stripe/241/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 20:09:24 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing write performance test.
Thu Jun  8 20:09:25 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     867.18     2097152    16384      0.311901   568.82     0.032585   0   

Max Write: 867.18 MiB/sec (909.31 MB/sec)

Run finished: Thu Jun  8 20:18:54 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 20:18:58 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing read performance test.
Thu Jun  8 20:18:58 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      476.39     2097152    16384      0.286348   1035.74    0.055005   0   

Max Read:  476.39 MiB/sec (499.53 MB/sec)

Run finished: Thu Jun  8 20:36:14 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/241/ior_test
	obdidx		 objid		objid		 group
	     0	          1820	        0x71c	             0
	     1	          1954	        0x7a2	             0
	     2	          1926	        0x786	             0
	     3	          1855	        0x73f	             0
	     4	          1883	        0x75b	             0
	     5	          1826	        0x722	             0
	     6	          1849	        0x739	             0
	     7	          1805	        0x70d	             0

lfs setstripe /scratch7/brkello/8-stripe/241/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 20:36:19 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing write performance test.
Thu Jun  8 20:36:20 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     851.48     2097152    16384      0.329104   579.30     0.032788   0   

Max Write: 851.48 MiB/sec (892.85 MB/sec)

Run finished: Thu Jun  8 20:45:59 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 20:46:03 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing read performance test.
Thu Jun  8 20:46:03 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      466.66     2097152    16384      0.297780   1057.33    0.056687   0   

Max Read:  466.66 MiB/sec (489.33 MB/sec)

Run finished: Thu Jun  8 21:03:41 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/241/ior_test
	obdidx		 objid		objid		 group
	     0	          1821	        0x71d	             0
	     1	          1955	        0x7a3	             0
	     2	          1927	        0x787	             0
	     3	          1856	        0x740	             0
	     4	          1884	        0x75c	             0
	     5	          1827	        0x723	             0
	     6	          1850	        0x73a	             0
	     7	          1806	        0x70e	             0

lfs setstripe /scratch7/brkello/8-stripe/241/ior_test 2097152 0 8
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 21:03:45 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -w -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing write performance test.
Thu Jun  8 21:03:46 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
write     898.65     2097152    16384      0.352812   548.86     0.032013   0   

Max Write: 898.65 MiB/sec (942.30 MB/sec)

Run finished: Thu Jun  8 21:12:55 2006
yod allocation delayed for Lustre recovery
IOR-2.8.10: MPI Coordinated Test of Parallel I/O

Run began: Thu Jun  8 21:12:58 2006
Command line used: /home/users/brkello/junetests/test5/IOR -g -E -v -a POSIX -C -i 1 -o /scratch7/brkello/8-stripe/241/ior_test -b 2048m -k -r -t 16m
Machine: catamount rslogin01
Maximum wall clock deviation: 0.00 sec
df /scratch7/brkello/8-stripe/241:
WARNING: Not using system("df /scratch7/brkello/8-stripe/241") call
Participating tasks: 241

Summary:
	api                = POSIX
	test filename      = /scratch7/brkello/8-stripe/241/ior_test
	access             = single-shared-file
	pattern            = segmented (1 segment)
	clients            = 241 (241 per node)
	repetitions        = 1
	xfersize           = 16 MiB
	blocksize          = 2 GiB
	aggregate filesize = 482 GiB

Commencing read performance test.
Thu Jun  8 21:12:58 2006

access    bw(MiB/s)  block(KiB) xfer(KiB)  open(s)    wr/rd(s)   close(s)   iter
------    ---------  ---------- ---------  --------   --------   --------   ----
read      469.37     2097152    16384      0.289479   1051.23    0.056984   0   

Max Read:  469.37 MiB/sec (492.17 MB/sec)

Run finished: Thu Jun  8 21:30:30 2006
OBDS:
0: ost00896_0_UUID ACTIVE
1: ost00896_1_UUID ACTIVE
2: ost00899_0_UUID ACTIVE
3: ost00899_1_UUID ACTIVE
4: ost00900_0_UUID ACTIVE
5: ost00900_1_UUID ACTIVE
6: ost00903_0_UUID ACTIVE
7: ost00903_1_UUID ACTIVE
8: ost00904_0_UUID ACTIVE
9: ost00904_1_UUID ACTIVE
10: ost00907_0_UUID ACTIVE
11: ost00907_1_UUID ACTIVE
12: ost00908_0_UUID ACTIVE
13: ost00908_1_UUID ACTIVE
14: ost00911_0_UUID ACTIVE
15: ost00911_1_UUID ACTIVE
16: ost00912_0_UUID ACTIVE
17: ost00912_1_UUID ACTIVE
18: ost00915_0_UUID ACTIVE
19: ost00915_1_UUID ACTIVE
20: ost00916_0_UUID ACTIVE
21: ost00916_1_UUID ACTIVE
22: ost00919_0_UUID ACTIVE
23: ost00919_1_UUID ACTIVE
24: ost00920_0_UUID ACTIVE
25: ost00920_1_UUID ACTIVE
26: ost00923_0_UUID ACTIVE
27: ost00923_1_UUID ACTIVE
28: ost00924_0_UUID ACTIVE
29: ost00924_1_UUID ACTIVE
30: ost00927_0_UUID ACTIVE
31: ost00927_1_UUID ACTIVE
32: ost00783_0_UUID ACTIVE
33: ost00783_1_UUID ACTIVE
34: ost00784_0_UUID ACTIVE
35: ost00784_1_UUID ACTIVE
36: ost00787_0_UUID ACTIVE
37: ost00787_1_UUID ACTIVE
38: ost00788_0_UUID ACTIVE
39: ost00788_1_UUID ACTIVE
40: ost00791_0_UUID ACTIVE
41: ost00791_1_UUID ACTIVE
42: ost00792_0_UUID ACTIVE
43: ost00792_1_UUID ACTIVE
44: ost00795_0_UUID ACTIVE
45: ost00795_1_UUID ACTIVE
46: ost00796_0_UUID ACTIVE
47: ost00796_1_UUID ACTIVE
48: ost00799_0_UUID ACTIVE
49: ost00799_1_UUID ACTIVE
50: ost00836_0_UUID ACTIVE
51: ost00836_1_UUID ACTIVE
52: ost00839_0_UUID ACTIVE
53: ost00839_1_UUID ACTIVE
54: ost00843_0_UUID ACTIVE
55: ost00843_1_UUID ACTIVE
/scratch7/brkello/8-stripe/241/ior_test
	obdidx		 objid		objid		 group
	     0	          1822	        0x71e	             0
	     1	          1956	        0x7a4	             0
	     2	          1928	        0x788	             0
	     3	          1857	        0x741	             0
	     4	          1885	        0x75d	             0
	     5	          1828	        0x724	             0
	     6	          1851	        0x73b	             0
	     7	          1807	        0x70f	             0