Commit Graph

78 Commits

Author SHA1 Message Date
Dominik Picheta
90fa64501f Implement .nimble-link files in the compiler and add tests for them. 2017-09-02 15:28:25 +01:00
Dominik Picheta
9b465a2361 Add readme to tests. Add fileDir option to testament & create nimble test. 2017-09-02 15:03:39 +01:00
Andreas Rumpf
686a9ae66a tester: better error message comparisons 2017-08-31 21:39:24 +02:00
Andreas Rumpf
4846e4e452 tester: make 'nimout' matching more robust against whitespace issues 2017-08-31 13:59:06 +02:00
zah
39aef12446 review and merge zahary's work (#5849)
* proper indentation for the generated JS code
* improved dead-code elimination for JavaScript
* test the JS dead-code elimination

A new test spec has been added - "maxcodesize". It specifies the
maximum size of the generated code in bytes.
2017-06-03 12:45:10 +02:00
Jacek Sieka
6bbf0fb64d compiler option for testament (#5713)
* compiler option for testament

* different spacing
2017-05-15 16:34:30 +02:00
Zahary Karadjov
fe48dd1cbe further improvements to the error messages produced by concepts 2017-03-24 16:59:47 +02:00
Zahary Karadjov
74a80988d9 proper error reporting for concepts and the introduction of the {.explain.} pragma 2017-03-24 16:59:47 +02:00
Andreas Rumpf
4ac6a26031 testament: be verbose when --pedantic fails 2017-02-03 10:29:08 +01:00
Araq
e236039d10 make tests on Windows green under --pedantic 2017-02-02 21:12:36 +01:00
Wh1teDuke
248b5c0468 Run Option: use now processSingleTest 2016-09-19 16:25:39 +02:00
Yuriy Glukhov
cafcf1308a Treat all failure codes from nodejs as 1 2016-08-27 20:25:36 +03:00
cheatfate
3291ccfe24 sets don't support empty arrays :) 2016-07-30 23:28:14 +03:00
cheatfate
70f80c98b9 Enable coroutines again. 2016-07-30 23:17:02 +03:00
cheatfate
85db7eb187 comments 2016-07-30 10:52:15 +03:00
cheatfate
0d2ff34d02 testament update to have list of disabled modules. 2016-07-30 02:07:05 +03:00
Andreas Rumpf
76c8d6164b added 'koch testinstall' command; more installer related bugfixes 2016-06-09 17:34:57 +02:00
Andreas Rumpf
9a747828fe Merge pull request #4049 from arnetheduck/tester-targets
tester: allow filtering tests by target
2016-04-07 13:34:01 +02:00
Dominik Picheta
082ba914bc Prevent tester from checking for output diffs for actionRunNoSpec. 2016-04-05 21:45:52 +01:00
Jacek Sieka
796f4e917c untaint command line option for parsing 2016-04-06 00:01:57 +08:00
Jacek Sieka
25abb7c2b6 tester: allow filtering tests by target 2016-04-05 20:51:13 +08:00
Adam Strzelecki
abb82554b7 compiler/msgs: Default to stderr for diagnostics
Previously we were defaulting to stdout for diagnostics, which could interfere
with scripts or `nim c -r' programs outputting their results to stdout,
possibly mixing their output with compiler messages.

This change makes now Nim to be inline with other compilers emitting
diagnostics to stderr. Also now --stdout option has proper meaning making all
diagnostics to be sent to stdout instead.

NOTE: Tester now calls compiler with --stdout.
2015-10-16 20:55:17 +02:00
Aman Gupta
e2dbf222e6 Merge remote-tracking branch 'origin/devel' into appveyor 2015-10-13 15:25:40 -07:00
Araq
8be9e46403 udpated the compiler and tester to use getOrDefault 2015-10-13 14:10:33 +02:00
Aman Gupta
a1750bd431 skip sdl/opengl/fsmonitor tests when unavailable 2015-10-08 10:58:52 -07:00
Aman Gupta
5bb0820596 show failure code 2015-10-08 10:58:37 -07:00
Aman Gupta
cadef43786 standardize on forward slashes for paths 2015-10-07 21:42:12 -07:00
Aman Gupta
f49cffeb19 framework is required 2015-10-07 18:28:57 -07:00
Aman Gupta
24ec975aa1 fix compile error 2015-10-07 18:15:59 -07:00
Aman Gupta
f0793a6d97 collect any output of appveyor command 2015-10-07 17:50:54 -07:00
Aman Gupta
582c5054a1 report duration to appveyor runner 2015-10-07 16:42:08 -07:00
Aman Gupta
3dfcaec25f use category as filename, and full filename in test name 2015-10-07 16:27:06 -07:00
Aman Gupta
6af9ac18f1 clean up whitespace on error msg 2015-10-07 16:25:03 -07:00
Aman Gupta
c34cbe690c tie into appveyor test results api 2015-10-07 16:06:51 -07:00
Aman Gupta
2240fd3f3f add tfile/tline assertions for template expansion file/line 2015-10-06 15:47:07 -07:00
Aman Gupta
6e7759734e show stderr w/ reExitcodesDiffer 2015-10-02 17:38:48 -07:00
Aman Gupta
b093c0abd0 show full compiler output with reNimcCrash 2015-09-30 19:32:09 -07:00
Aman Gupta
435fbbc943 allow testament/tester to run single file 2015-09-30 12:09:58 -07:00
Adam Strzelecki
e80465dacf tests: Trim .nim files trailing whitespace
via OSX: find . -name '*.nim' -exec sed -i '' -E 's/[[:space:]]+$//' {} +
2015-09-04 23:04:32 +02:00
Oscar Campbell
ee3d390b3f Revert from columnar layout. Remove temp-fix for 2857. 2015-06-10 19:52:26 +02:00
Oscar Campbell
0a810fd10f Treat unitest's default esc.seq. output as empty. 2015-06-04 22:53:39 +02:00
Oscar Campbell
071ccf3d02 Add "safety compilation". Improved, fixed messages
- node ext searcher also looks for "iojs" if no node(js?) found.
- koch ensures the local work dir compiler is freshly compiled before executing the tests.
- the tester can only run in the repo dir - now the compiler and libs used are also explicitly the local dirs - so no confusion from system wide pathing ("sufficiently sandboxed").
- fixed expectations in tmitems.nim test to match changes in json mod.
- re-layouted the columns / row printing slightly, making test fails pop out more, and everything "normal" layed back.
2015-06-04 07:33:27 +02:00
Sergey Avseyev
411e602d13 Introduce pedantic mode for tester
Motivation
----------
External tools need to know whether or not any test in suite failed. For
example buildbot, or packaging tool would like to stop the execution and
mark it as failed if some tests does not pass.

Modification
------------
Add `--pedantic` switch to tester program which will force it to quit
with non-zero exit code if at least one failure detected. Also update
`tests()` proc in koch to inspect result from tester and propagate it to
user.

Result
------
Nothing has changed in default behaviour. But following invocations will
exit with non-zero code if there failed tests:

    ./koch tests --pedantic all
    ./tests/testament/tester --pedantic all
2015-05-25 22:37:30 +03:00
Simon Hafner
2bc1db7a30 run the C test too 2015-05-13 13:13:30 -05:00
Simon Hafner
9c4a74637d Merge branch 'devel' into jpoirier-realtimeGCTest 2015-05-13 12:06:05 -05:00
Araq
6725aa3634 fixes #2517 2015-04-25 23:16:59 +02:00
Adam Strzelecki
505836385c Tests: Optional error location column spec
This allows some test to specify error location column, to ensure compiler is
generating diagnostics pointing to exactly right place of an error.
2015-04-20 21:03:57 +02:00
Simon Hafner
c55f884b5c integrated realtimegc stuff into testament 2015-04-13 22:36:35 -05:00
def
64903e7050 Use ^ instead of - in slices 2015-03-28 00:38:15 +01:00
def
cb3c99fe1f Fix tests some more 2015-03-17 00:02:47 +01:00