diff options
| -rw-r--r-- | utils/NightlyTest.gnuplot | 12 | ||||
| -rw-r--r-- | utils/NightlyTestTemplate.html | 58 |
2 files changed, 56 insertions, 14 deletions
diff --git a/utils/NightlyTest.gnuplot b/utils/NightlyTest.gnuplot index dd0911a..c4d0fa9 100644 --- a/utils/NightlyTest.gnuplot +++ b/utils/NightlyTest.gnuplot @@ -33,7 +33,7 @@ set nolabel set size .75,.75 set output "running_Olden_cbe_time.png" -set ylabel "CBE compiled execution time" +set ylabel "CBE compiled execution time (s)" plot "running_Olden_cbe_time.txt" u 1:2 t '' with lines, \ "running_Olden_cbe_time.txt" u 1:2 t "bh" with lines, \ "running_Olden_cbe_time.txt" u 1:3 t "bisort" with lines, \ @@ -66,7 +66,7 @@ plot "running_Olden_cbe_time.txt" u 1:2 t '' with lines, \ set size .75,.75 set output "running_Olden_jit_time.png" -set ylabel "JIT execution time" +set ylabel "JIT execution time (s)" plot "running_Olden_jit_time.txt" u 1:2 t '' with lines, \ "running_Olden_jit_time.txt" u 1:2 t "bh" with lines, \ "running_Olden_jit_time.txt" u 1:3 t "bisort" with lines, \ @@ -99,7 +99,7 @@ plot "running_Olden_jit_time.txt" u 1:2 t '' with lines, \ set size .75,.75 set output "running_Olden_llc_time.png" -set ylabel "LLC compiled execution time" +set ylabel "LLC compiled execution time (s)" plot "running_Olden_llc_time.txt" u 1:2 t '' with lines, \ "running_Olden_llc_time.txt" u 1:2 t "bh" with lines, \ "running_Olden_llc_time.txt" u 1:3 t "bisort" with lines, \ @@ -133,7 +133,7 @@ plot "running_Olden_llc_time.txt" u 1:2 t '' with lines, \ set size .75,.75 set output "running_Olden_opt_time.png" -set ylabel "Time to run the optimizer" +set ylabel "Time to run the optimizer (s)" plot "running_Olden_opt_time.txt" u 1:2 t '' with lines, \ "running_Olden_opt_time.txt" u 1:2 t "bh" with lines, \ "running_Olden_opt_time.txt" u 1:3 t "bisort" with lines, \ @@ -167,7 +167,7 @@ plot "running_Olden_opt_time.txt" u 1:2 t '' with lines, \ set size .75,.75 set output "running_Olden_machcode.png" -set ylabel "Program machine code size" +set ylabel "Program machine code size (bytes)" plot "running_Olden_machcode.txt" u 1:2 t '' with lines, \ "running_Olden_machcode.txt" u 1:2 t "bh" with lines, \ "running_Olden_machcode.txt" u 1:3 t "bisort" with lines, \ @@ -201,7 +201,7 @@ plot "running_Olden_machcode.txt" u 1:2 t '' with lines, \ set size .75,.75 set output "running_Olden_bytecode.png" -set ylabel "Program bytecode size" +set ylabel "Program bytecode size (bytes)" plot "running_Olden_bytecode.txt" u 1:2 t '' with lines, \ "running_Olden_bytecode.txt" u 1:2 t "bh" with lines, \ "running_Olden_bytecode.txt" u 1:3 t "bisort" with lines, \ diff --git a/utils/NightlyTestTemplate.html b/utils/NightlyTestTemplate.html index 80be981..9f96b44 100644 --- a/utils/NightlyTestTemplate.html +++ b/utils/NightlyTestTemplate.html @@ -110,14 +110,56 @@ <font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b> </td></tr></table></td></tr></table></center><p> -GNUplot <b>charts</b> showing a couple of things: -<ol> -<li>Compile Time -<li>Testing Time -<li>Time to run some programs, say all of Olden -<li>Time to compile something, say Olden. -<li>Size of bytecode files for Olden -</ol> + +Here are some charts showing how the LLVM optimizer and code generators are +changing over time. For now we use the Olden benchmark suite to measure this, +but eventually we will switch to using SPEC CPU2000. All programs are run with +"LARGE_PROBLEM_SIZE" enabled. Click on any of the charts to get a larger +version.<p> + +<h2>Compilation Measurements:</h2> + +<table border="0" align=center> +<tr> +<td width=50% align=center> +<a href="running_Olden_bytecode_large.png"><img width=480 height=360 border=0 src="running_Olden_bytecode.png"></a><br> +Size of LLVM bytecode files +</td> +<td width=50% align=center> +<a href="running_Olden_machcode_large.png"><img width=480 height=360 border=0 src="running_Olden_machcode.png"></a><br> +Size of native machine code for each program (generated by the JIT) +</td></tr> +<tr> +<td align=center> +<a href="running_Olden_opt_time_large.png"><img width=480 height=360 border=0 src="running_Olden_opt_time.png"></a><br> +Time to run the LLVM optimizer on each program +</td> +<td></td></tr> +</table> + +<h2>Program Execution Measurements:</h2> + +<table border="0" align=center> +<tr> +<td width=50% align=center> +<a href="running_Olden_cbe_time_large.png"><img width=480 height=360 border=0 src="running_Olden_cbe_time.png"></a><br> +Execution time for CBE generated executable +</td> +<td width=50% align=center> +<a href="running_Olden_llc_time_large.png"><img width=480 height=360 border=0 src="running_Olden_llc_time.png"></a><br> +Execution time for the LLC generated executable +</td></tr> + +<tr> +<td align=center> +<a href="running_Olden_jit_time_large.png"><img width=480 height=360 border=0 src="running_Olden_jit_time.png"></a><br> +Execution time for program in the JIT +</td> +<td></td></tr> +</table> + + + <br><br><center> <table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> |