aboutsummaryrefslogtreecommitdiffstats
path: root/utils/lit
Commit message (Collapse)AuthorAgeFilesLines
* Update aosp/master LLVM for rebase to r235153Pirama Arumuga Nainar2015-05-181-4/+16
| | | | | Change-Id: I9bf53792f9fc30570e81a8d80d296c681d005ea7 (cherry picked from commit 0c7f116bb6950ef819323d855415b2f2b0aad987)
* Update aosp/master llvm for rebase to r233350Pirama Arumuga Nainar2015-04-091-13/+39
| | | | Change-Id: I07d935f8793ee8ec6b7da003f6483046594bca49
* Update aosp/master LLVM for rebase to r230699.Stephen Hines2015-03-236-16/+18
| | | | Change-Id: I2b5be30509658cb8266be782de0ab24f9099f9b9
* Pass LSAN_OPTIONS down so that it is possible to add suppressions.Rafael Espindola2015-01-081-1/+2
| | | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@224777 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 50c8c5686ec5fbae19d8ec72d46b228feb960862)
* Split executeShTest into two parts so that it can be better leveraged by libc++Eric Fiselier2015-01-081-13/+18
| | | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@224672 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 2bea59bd02fe2a448314dfba205cd748a66ac6b9)
* [LIT] Add JSONMetricValue type to wrap types supported by the json encoder.Eric Fiselier2015-01-081-0/+36
| | | | | | | | | | | | | | | | | | | | Summary: The following types can be encoded and decoded by the json library: `dict`, `list`, `tuple`, `str`, `unicode`, `int`, `long`, `float`, `bool`, `NoneType`. `JSONMetricValue` can be constructed with any of these types, and used as part of Test.Result. This patch also adds a toMetricValue function that converts a value into a MetricValue. Reviewers: ddunbar, EricWF Reviewed By: EricWF Subscribers: cfe-commits, llvm-commits Differential Revision: http://reviews.llvm.org/D6576 git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@224628 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 74430387cd6b1d0e3f89b604f747fa53fc3315b3)
* Now that we require a newer python, use the new exception syntax.Rafael Espindola2015-01-081-1/+1
| | | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@224130 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit fe6c7ee0f0e11a368d8c98db7e75d26c1c2b32e6)
* Require python 2.7.Rafael Espindola2015-01-081-2/+0
| | | | | | | | | | | | | | We were already requiring 2.5, which meant that people on old linux distros had to upgrade anyway. Requiring python 2.6 will make supporting 3.X easier as we can use the 3.X exception syntax. According to the discussion on llvmdev, there is not much value is requiring just 2.6, we may as well just require 2.7. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@224129 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 708bc15ff07dc2fcee3a66988bfc5bc15b80eb5f)
* [LIT] Add support for `UNSUPPORTED` tag to ↵Eric Fiselier2015-01-082-19/+29
| | | | | | | | | | | | | | | | | | | | | | `TestRunner.parseIntegratedTestScript` Summary: This patch gives me just enough to leverage the existing functionality in `TestRunner` for use in `libc++` and `libc++abi` . It does the following: * Adds the `UNSUPPORTED` tag to `TestRunner.parseIntegratedTestScript`. * Allows `parseIntegratedTestScript` to return an empty script if a script is not required by the caller. Reviewers: ddunbar, EricWF Reviewed By: EricWF Subscribers: cfe-commits, llvm-commits Differential Revision: http://reviews.llvm.org/D6589 git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223915 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit bd112609813171fad2eeb4ad5f7a9cd95fc78b2e)
* lit: Don't use python 2.6 featuresDavid Majnemer2015-01-081-1/+1
| | | | | | | LLVM supports python 2.5, this fixes a (somewhat) recent regression. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223626 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 726bd4160263609011b3a8168bde045203fd021b)
* Fix for xunit output to work around issue in Jenkins when tests are at the ↵Chris Matthews2015-01-081-1/+1
| | | | | | | root level git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223562 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit ab1837aef3d93a0bf2294aeaeb488c62e3d45535)
* Fix corner cases in lit xunit for paths with dotsChris Matthews2015-01-081-2/+9
| | | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223549 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 689f10d1b56f68fafd999debc86e0b58d2d5de80)
* Add a test-case for lit xunit outputChris Matthews2015-01-081-0/+10
| | | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223307 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 0baca9564c9df7b06645f71abdda0fe3090f46a6)
* Don't allow test-suite names with . in them in xml outputChris Matthews2015-01-082-6/+8
| | | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223305 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit 06a1a5f256cabe6d20cf745cd93b389815c988a9)
* Give lit a --xunit-xml-output option for saving results in xunit formatChris Matthews2015-01-082-7/+55
| | | | | | | | | --xunit-xml-output saves test results to disk in JUnit's xml format. This will allow Jenkins to report the details of a lit run. Based on a patch by David Chisnall. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@223163 91177308-0d34-0410-b5e6-96231b3b80d8 (cherry picked from commit dcedd15f58e7b76c2ee61c8030799c209104229b)
* Update aosp/master LLVM for rebase to r222494.Stephen Hines2014-12-029-34/+67
| | | | Change-Id: Ic787f5e0124df789bd26f3f24680f45e678eef2d
* Update LLVM for rebase to r212749.Stephen Hines2014-07-212-3/+20
| | | | | | | Includes a cherry-pick of: r212948 - fixes a small issue with atomic calls Change-Id: Ib97bd980b59f18142a69506400911a6009d9df18
* Update LLVM for 3.5 rebase (r209712).Stephen Hines2014-05-292-3/+3
| | | | Change-Id: I149556c940fb7dc92d075273c87ff584f400941f
* Update to LLVM 3.5a.Stephen Hines2014-04-248-14/+65
| | | | Change-Id: Ifadecab779f128e62e430c2b4f6ddd84953ed617
* lit: multiprocessing platform fix attemptAlp Toker2013-10-281-1/+2
| | | | | | | | | | The error raised by Python varies by platform(!), so let's just catch any exception and fall back. Thanks to Sylvestre Ledru for noticing this on a Debian / Python 2.7 system running code coverage. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193516 91177308-0d34-0410-b5e6-96231b3b80d8
* Clarify the comment about BSD versions in r193465Alp Toker2013-10-271-1/+2
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193508 91177308-0d34-0410-b5e6-96231b3b80d8
* self.path may be empty or otherwise miss the normal system directories,Joerg Sonnenberger2013-10-261-5/+1
| | | | | | | | so try PATH next. Assume it is sane enough to cover the usual system bash locations too, but the old list is not good enough for NetBSD. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193471 91177308-0d34-0410-b5e6-96231b3b80d8
* lit: Issue a note when multiprocessing fails to loadAlp Toker2013-10-261-0/+1
| | | | | | | | | | If multiprocessing was requested, detected as available and subsequently failed to initialize it's worth letting the user know about it before falling back to threads. This condition can arise in certain OpenBSD / FreeBSD Python versions. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193465 91177308-0d34-0410-b5e6-96231b3b80d8
* Fix a referenced before assignment in r193463Alp Toker2013-10-261-0/+1
| | | | | | Some versions of Python on the builders seem strict about this. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193464 91177308-0d34-0410-b5e6-96231b3b80d8
* lit: handle late multiprocessing errors gracefullyAlp Toker2013-10-262-8/+11
| | | | | | | | | This should be a better fix for lit multiprocessing failures, replacing the OpenBSD and FreeBSD workarounds in r193413 and r193457. Reference: http://bugs.python.org/issue3770 git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193463 91177308-0d34-0410-b5e6-96231b3b80d8
* Attempt to fix the FreeBSD build, disable multiprocessingAlp Toker2013-10-261-1/+2
| | | | | | | | | | Speculative quick fix based on clang-X86_64-freebsd output: File "/usr/local/lib/python2.6/multiprocessing/synchronize.py", line 33, in <module> " function, see issue 3770.") ImportError: This platform lacks a functioning sem_open implementation, therefore, the required synchronization primitives needed will not function, see issue 3770. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193457 91177308-0d34-0410-b5e6-96231b3b80d8
* Try to fix the openbsd bot.Rafael Espindola2013-10-251-1/+1
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193413 91177308-0d34-0410-b5e6-96231b3b80d8
* Actually switch the default to use multiprocessingRafael Espindola2013-10-231-1/+1
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193282 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Stop hacking the GIL check interval.Daniel Dunbar2013-10-231-6/+0
| | | | | | | - This was never a big win, and is irrelevant now that we commonly use multiprocessing based parallelism. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193280 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Use multiprocessing based parallelism by default, on Unix.Daniel Dunbar2013-10-231-3/+7
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@193279 91177308-0d34-0410-b5e6-96231b3b80d8
* Lit: LIT_PRESERVES_TMP should be aware of TMPDIR, too.NAKAMURA Takumi2013-10-171-2/+3
| | | | | | TMPDIR is preferred in Unix. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@192891 91177308-0d34-0410-b5e6-96231b3b80d8
* Lit: Introduce an environment variable, $LIT_PRESERVES_TMP, to preserve TMP ↵NAKAMURA Takumi2013-10-171-0/+9
| | | | | | | | (and TEMP). This is intended to check how many temporary files would be generated in automated builders. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@192887 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add an --output option, for writing results in a machine readable form.Daniel Dunbar2013-09-145-3/+96
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@190738 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add support for attach arbitrary metrics to test results.Daniel Dunbar2013-09-115-2/+119
| | | | | | | | | - This is a work-in-progress and all details are subject to change, but I am trying to build up support for allowing lit to be used as a driver for performance tests (or other tests which might want to record information beyond simple PASS/FAIL). git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@190535 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Allow config files to pass arbitrary values to child configs.Daniel Dunbar2013-09-034-12/+8
| | | | | | | - This aligns with how existing test suites end up wanting to use the local config files, conceptually it makes sense to consider them to be inherited. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189885 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] [tests] Add missing test input file.Daniel Dunbar2013-08-291-0/+6
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189561 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Fix internal shell's argv[0] handling.Daniel Dunbar2013-08-292-3/+5
| | | | | | | - At least on OS X, it is important for correct behavior of /bin/[ that argv[0] is passed as written, and not as the full executable path. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189559 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add support for multiprocessing, under --use-processes for now.Daniel Dunbar2013-08-293-39/+115
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189556 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Implement --max-time support by using provider cancel method.Daniel Dunbar2013-08-291-10/+16
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189555 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Refactor test execution logic into lit.run.Run.Daniel Dunbar2013-08-292-123/+158
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189554 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Put display lock inside the ThreadResultsConsumer.Daniel Dunbar2013-08-291-17/+9
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189553 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Factor out a results consumer interface for test execution.Daniel Dunbar2013-08-291-20/+44
| | | | | | - Also, change TestProvider interface to operate on test indices. git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189552 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Move top-level execute code into Run object.Daniel Dunbar2013-08-294-41/+49
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189551 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Factor out Run class to capture configuration + discovered tests.Daniel Dunbar2013-08-292-18/+29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189550 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Change lit.Test.ResultCode to be unique across pickling.Daniel Dunbar2013-08-291-0/+11
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189549 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Add a TODO.Daniel Dunbar2013-08-291-0/+29
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189546 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Update shtest format to return lit.Test.Result objects.Daniel Dunbar2013-08-291-40/+21
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189545 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Update LitTestCase to support lit.Test.Result.Daniel Dunbar2013-08-291-5/+13
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@189544 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Fix a couple lingering Py3 compat issues in ProgressBar.Daniel Dunbar2013-08-211-4/+12
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188951 91177308-0d34-0410-b5e6-96231b3b80d8
* [lit] Lift XFAIL handling to core infrastructure.Daniel Dunbar2013-08-213-36/+48
| | | | git-svn-id: https://llvm.org/svn/llvm-project/llvm/trunk@188949 91177308-0d34-0410-b5e6-96231b3b80d8