auto import from //depot/cupcake/@135843

1 files changed, 671 insertions, 0 deletions

diff --git a/SunSpider/ChangeLog b/SunSpider/ChangeLog
new file mode 100644
index 0000000..a014a3a
--- /dev/null
+++ b/SunSpider/ChangeLog
@@ -0,0 +1,671 @@
+2008-10-30  Zoltan Horvath  <Horvath.Zoltan.6@stud.u-szeged.hu>
+
+        Fix a bug where when V8's or UBENCH's test suite list file is missing
+        the error message is suggesting that SunSpider's list file is missing.
+
+        Reviewed by Sam Weinig.
+
+        * sunspider:
+        (loadTestsList): Fix the error message to use the right list name.
+
+2008-10-07  David Hyatt  <hyatt@apple.com>
+
+        https://bugs.webkit.org/show_bug.cgi?id=18989
+
+        Remove global substitution from SunSpider regexp test, since only Firefox was honoring it and
+        we want all browsers to be doing the same thing on the test.
+
+        Reviewed by Maciej
+
+        * tests/regexp-dna.js:
+
+2008-09-09  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
+
+        Rubber-stamped by Maciej Stachowiak.
+
+        The bleeding edge branch of V8 now supports passing fileanmes after
+        '-f', so the SunSpider script should be changed to do this again.
+        This allows all 3 major JavaScript engines to be used with the
+        unmodified SunSpider script.
+
+        * sunspider:
+
+2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
+
+        Reviewed by Maciej Stachowiak.
+
+        Add a '--args' option to SunSpider, so that we can pass '-j' to TraceMonkey
+        and '--expose-gc' to V8. Also, rename the '--v8' option to '--v8-suite' and
+        correct the punctuation in its documentation.
+
+        * sunspider:
+
+2008-09-04  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
+
+        Reviewed by Oliver Hunt.
+
+        Bug 20616: Incorporate V8 benchmarks in testing
+        <https://bugs.webkit.org/show_bug.cgi?id=20616>
+
+        This is a first attempt at running the V8 benchmarks within SunSpider,
+        with the --v8 option. The number of iterations is fixed for each
+        benchmark, and was chosen to make each of the benchmarks run between
+        500 ms and 600 ms in V8 on my machine, a 2.16 GHz MacBook Pro.
+
+        * sunspider:
+        * tests/LIST-V8: Added.
+        * tests/v8-crypto.js: Added.
+        * tests/v8-deltablue.js: Added.
+        * tests/v8-earley-boyer.js: Added.
+        * tests/v8-raytrace.js: Added.
+        * tests/v8-richards.js: Added.
+
+2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
+
+        Not reviewed.
+
+        Remove a local change that was accidentally committed in r36034.
+
+        * resources/sunspider-standalone-driver.js:
+
+2008-09-02  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
+
+        Rubber-stamped by Oliver Hunt.
+
+        Make SunSpider work with JavaScript shells that don't take filenames
+        after a '-f' argument.
+
+        * sunspider:
+
+2008-06-07  Cameron Zwarich  <cwzwarich@uwaterloo.ca>
+
+        Reviewed by Timothy.
+
+        Remove the --squirrelfish option from SunSpider, as it is no longer needed.
+
+        * sunspider:
+        * tests/LIST-SQUIRRELFISH: Removed.
+
+2008-06-03  Alexey Proskuryakov  <ap@webkit.org>
+
+        Rubber-stamped by Mark Rowe.
+
+        Roll out r31215 - with Mac OS X 10.5.3, there is no need to pause update daemon any more.
+
+        * sunspider:
+
+2008-04-15  Maciej Stachowiak  <mjs@apple.com>
+
+        Rubber stamped by Oliver.
+        
+        - add newly working tests to squirrelfish list
+
+        * tests/LIST-SQUIRRELFISH: Add 3d-raytrace and string-unpack-code
+
+2008-04-14  Maciej Stachowiak  <mjs@apple.com>
+
+        Rubber stamped by Oliver.
+        
+        - move ubench tests properly.
+
+        * tests/ubench: Added.
+        * tests/ubench/function-closure.js: Added.
+        * tests/ubench/function-empty.js: Added.
+        * tests/ubench/function-missing-args.js: Added.
+        * tests/ubench/function-sum.js: Added.
+        * tests/ubench/loop-empty-resolve.js: Added.
+        * tests/ubench/loop-empty.js: Added.
+        * tests/ubench/loop-sum.js: Added.
+
+2008-04-14  Maciej Stachowiak  <mjs@apple.com>
+
+        Rubber stamped by Oliver.
+
+        * sunspider: Don't force --runs=1 in squirrelfish mode any more.
+
+2008-04-14  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+
+        - make --squirrelfish mode use the real harness, but a reduced set of tests
+
+        Also add a new ubench mode which runs the older squirrelfish microbenchmarks.
+
+        * sunspider:
+        * tests/LIST-SQUIRRELFISH:
+        * tests/LIST-UBENCH: Added.
+        * tests/squirrelfish: Moved to tests/ubench
+
+2008-04-14  Geoffrey Garen  <ggaren@apple.com>
+
+        Reviewed by Maciej Stachowiak.
+        
+        Removed an unused test.
+
+        * tests/squirrelfish/loop-resolve.js: Removed.
+
+2008-04-10  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+        
+        Add newly runnable tests to --squirrelfish mode.
+
+        * tests/LIST-SQUIRRELFISH:
+
+2008-04-06  Geoffrey Garen  <ggaren@apple.com>
+
+        Reviewed by Maciej Stachowiak.
+        
+        A little more love for --squirrelfish mode:
+        
+        Fixed a misplaced sort. Results properly sort now.
+        
+        Added a test list just for squirrelfish, and updated it to include
+        all currently passing SunSpider tests.
+        
+        Fixed the pruning regexp to match 3d-morph.js.
+
+        * sunspider:
+
+2008-03-26  Geoffrey Garen  <ggaren@apple.com>
+
+        Reviewed by Oliver Hunt.
+        
+        --squirrelfish mode: pared down tests for squirrelfish to chew on.
+
+        * sunspider:
+        * tests/LIST:
+        * tests/squirrelfish: Added.
+        * tests/squirrelfish/function-closure.js: Added.
+        * tests/squirrelfish/function-empty.js: Added.
+        * tests/squirrelfish/function-missing-args.js: Added.
+        * tests/squirrelfish/function-sum.js: Added.
+        * tests/squirrelfish/loop-empty-resolve.js: Added.
+        * tests/squirrelfish/loop-empty.js: Added.
+        * tests/squirrelfish/loop-resolve.js: Added.
+        * tests/squirrelfish/loop-sum.js: Added.
+
+2008-03-21  Alexey Proskuryakov  <ap@webkit.org>
+
+        Reviewed by Geoff.
+
+        * sunspider: Pause update daemon on Darwin to make results reliable
+        again (workaround for <rdar://problem/5811127>).
+
+2008-02-07  Eric Seidel  <eric@webkit.org>
+
+        Reviewed by Sam.
+
+        * sunspider: add an error message when ./tests/LIST is not found
+
+2007-12-29  Alp Toker  <alp@atoker.com>
+
+        Fix typo.
+
+        * hosted/sunspider.html:
+
+2007-12-29  Alp Toker  <alp@atoker.com>
+
+        Reviewed by Maciej.
+
+        Provide the current URL in the SunSpider results page. Useful for
+        copying benchmark results out of browsers without a location bar or
+        where the location bar can't handle long URLs.
+
+        * hosted/sunspider-results.html:
+
+2007-12-20  Eric Seidel  <eric@webkit.org>
+
+        Reviewed by mjs.
+
+        * sunspider: increase default number of runs for more accurate numbers
+
+2007-12-18  Mark Rowe  <mrowe@apple.com>
+
+        Fix typo.
+
+        * hosted/sunspider.html:
+
+2007-12-18  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Eric.
+        
+        - give an extra digit of precision for small differences.
+
+        * resources/sunspider-compare-results.js:
+
+2007-12-17  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Eric.
+        
+        - work around IE layout bugs
+
+        * hosted/sunspider.css:
+
+2007-12-17  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Mark.
+        
+        - fix compare feature
+
+        * hosted/sunspider-results.html:
+
+2007-12-17  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Mark.
+        
+        - Change the format of the output URL to be shorter, to meet IE constraints
+
+        * hosted/sunspider-driver.html:
+        * hosted/sunspider-results.html:
+
+2007-12-13  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+        
+        - Add some explanatory test and a dumb logo to SunSpider web hosted version
+
+        * hosted/sunspider-driver.html:
+        * hosted/sunspider-results.html:
+        * hosted/sunspider.css:
+        * hosted/sunspider.html:
+
+2007-12-13  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+        
+        - Make the web-hosted version of SunSpider look a little bit less drab.
+
+        * hosted/sunspider-driver.html:
+        * hosted/sunspider-results.html:
+        * hosted/sunspider.css: Added.
+        * hosted/sunspider.html:
+        * resources/TEMPLATE.html:
+
+2007-12-12  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Sam.
+        
+        - Change sunspider-compare-results output from showing "% faster" values to "x as fast" values.
+        
+        A sample of what new-style results would look like:
+        
+        TEST                   COMPARISON            FROM                 TO             DETAILS
+        ...
+        ** TOTAL **:           1.41x as fast     6613.6ms +/- 0.1%   4703.0ms +/- 0.1%     significant
+        ...
+            3bit-bits-in-byte: *1.36x as slow*     88.8ms +/- 0.6%    121.1ms +/- 0.6%     significant
+        
+        * resources/sunspider-compare-results.js:
+
+2007-11-14  Eric Seidel  <eric@webkit.org>
+
+        Reviewed by Sam.
+
+        * sunspider: add --shark-cache for L2 Cache Miss profiling
+
+2007-11-09  Alexey Proskuryakov  <ap@webkit.org>
+
+        Reviewed by Darin Adler.
+
+        http://bugs.webkit.org/show_bug.cgi?id=15925
+        SunSpider should check for Shark being installed
+
+        * sunspider: Explicitly test that shark command line tool is installed.
+
+2007-11-04  Darin Adler  <darin@apple.com>
+
+        * hosted/sunspider.html: Tweaked formatting a bit.
+
+2007-11-03  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+
+        - Add compare mode and a description of the benchmark to the hosted version.
+
+        * hosted/sunspider-results.html: Add compare mode - you can just paste in another results URL.
+        * hosted/sunspider.html: Added intro text.
+        * make-hosted: Copy new file.
+        * resources/sunspider-compare-results.js: Made more reusable by putting the implementation in
+        a function.
+        * resources/sunspider-standalone-compare.js: Added. Calls the function in the way standalone mode
+        expects.
+        * sunspider-compare-results: Use sunspider-standalone-compare.js.
+
+2007-11-02  Darin Adler  <darin@apple.com>
+
+        * sunspider: Changed "--base" to "--set-baseline".
+
+2007-11-02  Darin Adler  <darin@apple.com>
+
+        Reviewed by Maciej.
+
+        * sunspider: Added a "--base" option that records the current test as a baseline.
+        Moved the code to find the newest .mshark file into a function (since I needed to use
+        it in the other script and I prefer to copy/paste a function).
+
+        * sunspider-compare-results: Added logic to compare the baseline with the last
+        run when you don't pass any parameters.
+
+2007-10-29  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Eric.
+        
+        - Added list of ECMAScript3 features that SunSpider does not cover currently.
+
+        * UNCOVERED: Added.
+
+2007-10-29  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+        
+        - Give better error messages when sunspider-compare-results fails
+
+        * sunspider-compare-results:
+
+2007-10-29  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+        
+        - fix Date tests to work in command-line SpiderMonkey
+
+        * tests/date-format-tofte.js:
+        * tests/date-format-xparb.js:
+
+2007-10-29  Darin Adler  <darin@apple.com>
+
+        Reviewed by Maciej.
+
+        * sunspider: Added --shark20 option, to run Shark at its highest sample
+        resolution instead of its default.
+
+2007-10-28  Adam Roben  <aroben@apple.com>
+
+        Fix SunSpider on Windows
+
+        Reviewed by Eric.
+
+        * sunspider: Don't use colons in filenames.
+
+2007-10-28  Darin Adler  <darin@apple.com>
+
+        Reviewed by Adam.
+
+        * resources/sunspider-analyze-results.js: Tweak the output format a little.
+        Change so that when there's only one run we don't write out confidence
+        intervals at all rather than writing "NaN" over and over again.
+
+        * sunspider: Use the time and date as a suffix on the results file, that way
+        all the results are left behind in the tmp directory. This will make it easy
+        for us to add features that compare past results in the future. Also rename
+        the .mshark files using the same scheme.
+
+        * sunspider-compare-results: Relax the parsing rules so we can parse the
+        results file exactly as it's emitted from sunspider.
+
+2007-10-25  Adam Roben  <aroben@apple.com>
+
+        Strip carriage returns from results
+
+        Carriage returns were screwing up sunspider-compare-results on
+        Windows.
+
+        Rubberstamped by Oliver.
+
+        * sunspider:
+
+2007-10-24  Darin Adler  <darin@apple.com>
+
+        Reviewed by Eric.
+
+        * sunspider: Open the profile in shark after completing a run.
+        * sunspider-compare-results: Tiny perl tweaks.
+
+2007-10-23  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+
+        - Don't hardcode my path to testkjs
+        
+        * sunspider-compare-results:
+
+2007-10-23  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+        
+        - Add a compare script to compare results, and improve formatting of standard results a bit.
+
+        * resources/sunspider-analyze-results.js:
+        * resources/sunspider-compare-results.js: Added.
+        * sunspider-compare-results: Added.
+
+2007-10-23  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+
+        * resources/sunspider-analyze-results.js: Do the error range
+        properly, using the t-distribution instead of 1.96 (which was
+        based on the normal distribution).
+        
+        * sunspider: Print results in a way that will be friendlier to the
+        soon-to-come compare mode.
+
+2007-10-22  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Review.
+        
+        - add more tests (probably the final set for now)
+        
+        Already balanced. Added date, regexp, control flow, and a few
+        more string and object/array access tests.
+        
+        * tests/LIST:
+        * tests/access-fannkuch.js: Added.
+        * tests/access-nbody.js: Added.
+        * tests/controlflow-recursive.js: Added.
+        * tests/date-format-tofte.js: Added.
+        * tests/date-format-xparb.js: Added.
+        * tests/regexp-dna.js: Added.
+        * tests/string-validate-input.js: Added.
+
+2007-10-21  Eric Seidel  <eric@webkit.org>
+
+        Reviewed by mjs.
+
+        * sunspider: make --shark only sample from testkjs
+
+2007-10-21  Maciej Stachowiak  <mjs@apple.com>
+
+        Rubber stamped by Eric.
+        
+        - added crypto tests (already balanced)
+
+        * tests/LIST:
+        * tests/crypto-aes.js: Added.
+        * tests/crypto-md5.js: Added.
+        * tests/crypto-sha1.js: Added.
+
+2007-10-21  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Adam.
+        
+        - rebalance new tests
+        
+        Scaled the new tests so they take 400-600ms on a reasonably normal user setup:
+        
+        Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
+
+        This balances them with the existing tests.
+
+        * tests/access-binary-trees.js:
+        * tests/access-nsieve.js:
+        * tests/bitops-nsieve-bits.js:
+        * tests/math-partial-sums.js:
+        * tests/math-spectral-norm.js:
+        * tests/string-fasta.js:
+
+2007-10-20  Eric Seidel  <eric@webkit.org>
+
+        Reviewed by darin.
+        
+        Add improved argument handling to sunspider, including
+        --runs=<number>, --tests=<pattern, --shark, and --help
+        Also re-factor code into subroutines
+
+        * sunspider: improved argument handling
+
+2007-10-20  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Mark.
+
+        - Add more new tests, mostly from the computer language shootout. Not normalized yet.
+        
+        * TODO:
+        * tests/LIST:
+        * tests/access-binary-trees.js: Added.
+        * tests/access-nsieve.js: Added.
+        * tests/bitops-nsieve-bits.js: Added.
+        * tests/math-partial-sums.js: Added.
+        * tests/math-spectral-norm.js: Added.
+        * tests/string-fasta.js: Added.
+
+2007-10-20  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+
+        * TODO: Updated to note areas that are now well-covered.
+        
+        - Change the tests and the driver to avoid leaving large object
+        graphs hanging around, since that throws off the subsequent tests.
+        
+        * resources/sunspider-standalone-driver.js:
+        * tests/3d-cube.js:
+        * tests/3d-morph.js:
+        * tests/3d-raytrace.js:
+        * tests/bitops-bitwise-and.js:
+        * tests/string-base64.js:
+        * tests/string-tagcloud.js:
+
+2007-10-20  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Nikolas.
+        
+        - Rebalance test complexity.
+        
+        Scaled all the tests so they take 400-600ms on a reasonably normal user setup:
+        
+        Internet Explorer 7, Window XP, Dell Latitude D810 with a 2.13GHz Pentium M
+
+        However, for some tests, IE7 was a huge outlier compared to other
+        major browsers. For those tests, I used Firefox 2.0.0.8 on the
+        same OS and hardware as a normalization basis.
+        
+        * tests/3d-morph.js:
+        * tests/3d-raytrace.js:
+        * tests/bitops-3bit-bits-in-byte.js:
+        * tests/bitops-bits-in-byte.js:
+        * tests/bitops-bitwise-and.js:
+        * tests/math-cordic.js:
+        * tests/string-base64.js:
+        * tests/string-tagcloud.js:
+        * tests/string-unpack-code.js:
+
+2007-10-20  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+        
+        - Fix the browser-hosted driver to be compatible with Safari 2
+
+        * hosted/sunspider-driver.html:
+
+2007-10-20  Maciej Stachowiak  <mjs@apple.com>
+
+        Rubber stamped by Hyatt.
+        
+        - Add BSD license notice to cordic test, the original author said to do so.
+
+        * tests/math-cordic.js:
+
+2007-10-18  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Eric.
+        
+        - Support Windows and Windows browsers.
+
+        * hosted/sunspider-results.html: Display results correctly in IE.
+        * sunspider: tweaks to work on Windows, and with spaces in the path.
+
+2007-10-18  Maciej Stachowiak  <mjs@apple.com>
+
+        Rubber stamped by Oliver.
+
+        * tests/string-tagcloud.js: Remove stray print()
+
+2007-10-17  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Oliver.
+        
+        Add some string test cases.
+
+        * tests/string-base64.js: Added. Does base64 encoding and decoding.
+        * tests/string-tagcloud.js: Added. Parses a JSON string and
+        generates tagcloud HTML markup based on the data.        
+        * tests/string-unpack-code.js: Added. Unpack compressed versions of
+        four of the most popular JavaScript libraries.
+        * tests/LIST: Added the new tests.
+
+2007-10-16  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Anders.
+
+        * TODO: Updated with info on how to do the stats properly.
+
+        * hosted/sunspider-driver.html: Reduce timeout from 500 to 200 to
+        avoid overly slowing down the benchmark.
+
+        Added some 3D-related test cases.
+        
+        * tests/3d-cube.js: Added.
+        * tests/3d-morph.js: Added.
+        * tests/3d-raytrace.js: Added.
+        * tests/LIST:
+
+2007-10-14  Maciej Stachowiak  <mjs@apple.com>
+
+        Reviewed by Darin Adler.
+
+        - New JavaScript benchmark
+        http://bugs.webkit.org/show_bug.cgi?id=15515
+        
+        A start on a new JavaScript benchmark, with standalone and
+        browser-hosted drivers.
+        
+        The test content is still incomplete and the drivers could use
+        some more features but there is enough here to make a good start.
+        
+        The drivers compute a 95% confidence interval on the mean for the
+        whole test, each category, and each individual test to make it
+        easier to tell whether differences are statistically
+        significant. The confidence interval can be narrowed by running
+        the test more times.
+        
+        * TODO: Added. Remaining things that need to be done.
+        * sunspider: Added. Perl script that acts as the standalone test driver.
+        * resources/sunspider-standalone-driver.js: Added. JavaScript part
+        of standalone test driver.
+        * resources/sunspider-analyze-results.js: Added. JavaScript statistical
+        analysis code.
+        * resources/TEMPLATE.html: Added. Template for browser-hosted tests.
+        * make-hosted: Added. Script to generate browser-hosted tests.
+        * hosted/sunspider.html: Added. Start page for browser-hosted test.
+        * hosted/sunspider-driver.html: Added. Driver for browser-hosted tests.
+        * hosted/sunspider-results.html: Added. Results page for browser-hosted
+        tests.
+        * hosted/sunspider-record-result.js: Added. Helper file for browser-hosted
+        tests.
+        * tests/LIST: Added. List of tests to use.
+        * tests/bitops-3bit-bits-in-byte.js: Added. Some initial test content.
+        * tests/bitops-bits-in-byte.js: Added. Ditto.
+        * tests/bitops-bitwise-and.js: Added. Ditto.
+        * tests/math-cordic.js: Added. Ditto.
+