Commit Graph

72 Commits

Author SHA1 Message Date
Sergey Avseyev
411e602d13 Introduce pedantic mode for tester
Motivation
----------
External tools need to know whether or not any test in suite failed. For
example buildbot, or packaging tool would like to stop the execution and
mark it as failed if some tests does not pass.

Modification
------------
Add `--pedantic` switch to tester program which will force it to quit
with non-zero exit code if at least one failure detected. Also update
`tests()` proc in koch to inspect result from tester and propagate it to
user.

Result
------
Nothing has changed in default behaviour. But following invocations will
exit with non-zero code if there failed tests:

    ./koch tests --pedantic all
    ./tests/testament/tester --pedantic all
2015-05-25 22:37:30 +03:00
Simon Hafner
2bc1db7a30 run the C test too 2015-05-13 13:13:30 -05:00
Simon Hafner
9c4a74637d Merge branch 'devel' into jpoirier-realtimeGCTest 2015-05-13 12:06:05 -05:00
Araq
6725aa3634 fixes #2517 2015-04-25 23:16:59 +02:00
Adam Strzelecki
505836385c Tests: Optional error location column spec
This allows some test to specify error location column, to ensure compiler is
generating diagnostics pointing to exactly right place of an error.
2015-04-20 21:03:57 +02:00
Simon Hafner
c55f884b5c integrated realtimegc stuff into testament 2015-04-13 22:36:35 -05:00
def
64903e7050 Use ^ instead of - in slices 2015-03-28 00:38:15 +01:00
def
cb3c99fe1f Fix tests some more 2015-03-17 00:02:47 +01:00
Andreas Rumpf
b97207a74c Merge pull request #2307 from def-/test-fixes-2
Test fixes 2
2015-03-12 11:03:08 +01:00
Araq
f514be0772 fixes #2286 2015-03-12 01:45:15 +01:00
def
ac0f62084c Fix DLL tests on POSIX
Automatically add the lib directory to LD_LIBRARY_PATH temporarily
2015-03-10 15:35:36 +01:00
Araq
0032912d10 fixed the tester; more tests green 2015-03-10 12:32:48 +01:00
Simon Hafner
2b4dcc9f33 one result too much 2015-03-09 14:26:08 -05:00
Simon Hafner
8f8171a0c4 fixed tester back up 2015-03-09 11:30:40 -05:00
Andreas Rumpf
1a9f266e50 Merge pull request #2275 from reactormonk/better-tester-messages
better messages for nimout
2015-03-07 11:26:13 +01:00
Simon Hafner
df0afd8752 fixed a bug in nimble tests - disable for now 2015-03-06 12:59:36 -06:00
Simon Hafner
fb8c0280bd better messages for nimout 2015-03-05 16:15:28 -06:00
Araq
24ae0c387f some love for the testsuite; fixed regressions 2015-03-01 21:41:21 +01:00
Araq
335c19c869 tester reports ignored tests and supports 'nimout'; fixes #2211 2015-02-25 12:59:32 +01:00
Araq
0284e8d11c fixes #2070 2015-02-10 20:19:48 +01:00
def
c58573b34a Fix name of generated C file in tester
- Makes tests/ccgbugs/tmissingvolatile work again
2015-02-04 20:41:29 +01:00
def
1b91b3a2a5 Disable rodfiles tests for now 2015-02-04 20:10:57 +01:00
Dominik Picheta
d7023f2be4 Add missing tester.nim.cfg. 2015-01-28 18:29:21 +00:00
Dominik Picheta
6143393adb Move lib/pure/nodejs to compiler/nodejs. Ref #2017. 2015-01-28 14:58:31 +00:00
Andreas Rumpf
190cc01f24 Merge pull request #2017 from reactormonk/nodejs-binary
Algorithm to find the nodejs binary
2015-01-28 15:14:39 +01:00
Simon Hafner
2beaa7a2da find the nodejs binary
upstream calls it node, debian calls it nodejs. We gotta look for both
of them.
2015-01-27 13:02:17 -06:00
Andreas Rumpf
66040e58ec Merge pull request #1995 from def-/fix-idetools
Make caasdriver compile
2015-01-27 14:35:00 +01:00
Araq
efb5ec3e73 proper 'space in dir' test 2015-01-27 01:33:48 +01:00
def
d2ef99071c Make caasdriver compile 2015-01-20 14:21:49 +01:00
Guillaume Gelin
3119fe087d Happy new year! 2015-01-06 15:26:33 +01:00
Araq
7524610b31 fixes #1796 2015-01-05 02:27:24 +01:00
Araq
73dda8a81d fixes #1638 2014-12-17 21:52:01 +01:00
Dominik Picheta
0b229fae77 Fixes tester. 2014-09-10 00:17:29 +01:00
Araq
c6034277fc further adaptations 2014-08-29 09:12:12 +02:00
Araq
cd2c6128d1 renamed babelcmd to nimblecmd; config files are now nim.cfg; other renamings 2014-08-29 09:03:00 +02:00
Araq
0f4567d59e koch now uses nim.exe 2014-08-29 02:23:40 +02:00
Araq
6713ebcd98 tester compiles again 2014-08-29 01:12:18 +02:00
Araq
16b15f360a updated the tester 2014-08-29 00:57:21 +02:00
Araq
4ab56d6be0 some minor fixes 2014-08-14 22:22:04 +02:00
Araq
e94203ac21 tester should work again 2014-07-16 01:09:51 +02:00
Dominik Picheta
ebff5f1f28 Improve caasdriver output. 2014-06-16 23:36:11 +01:00
Andreas Rumpf
2ec1501c7a Merge pull request #1281 from Araq/new_spawn
New spawn
2014-06-16 23:03:17 +02:00
Dominik Picheta
1658a29ec6 Fixes #1263. 2014-06-15 12:57:05 +01:00
Varriount
370f06d557 Update categories.nim
Fixed the tester from crashing when the babel package file is invalid.
2014-06-14 22:32:37 -04:00
Araq
bea1761da1 tester works again 2014-05-30 17:04:39 +02:00
Araq
f12a0820e0 added 'sortoutput' option to make output deterministic for threading tests 2014-05-29 13:19:26 +02:00
Simon Hafner
dfeb573edb fixed paths because caasdriver is now in testament 2014-05-03 12:14:28 -05:00
Dominik Picheta
e80930247f Tester now ignores deprecation warnings. 2014-04-21 00:17:00 +01:00
Dominik Picheta
cf3b54fdcb Removes tthreadanalysis3 from threadTests spec. 2014-04-20 13:29:08 +01:00
Dominik Picheta
2fb5d62927 Tester now appreciates the test target. Modified 'cmd' in specs. 2014-04-16 21:28:19 +01:00