mirror of
https://github.com/nim-lang/Nim.git
synced 2025-12-30 01:44:37 +00:00
cf6dd57efe
* removed dead code * beginnings of a rodfile reader * IC: record global VM state changes and pragma state changes * IC: replay pragmas and VM state changes * implemented rod load file simuation for easier, extensive testing * critical bugfix * IC: stress test logic; should also help with recursive module dependencies; WIP * IC: loading from .rod files begins to work reliably * removed ugly hacks * yet another silly mistake
61 lines
2.2 KiB
ReStructuredText
61 lines
2.2 KiB
ReStructuredText
====================================
|
|
Incremental Recompilations
|
|
====================================
|
|
|
|
We split the Nim compiler into a frontend and a backend.
|
|
The frontend produces a set of `.rod` files. Every `.nim` module
|
|
produces its own `.rod` file.
|
|
|
|
- The IR must be a faithful representation of the AST in memory.
|
|
- The backend can do its own caching but doesn't have to.
|
|
- We know by comparing 'nim check compiler/nim' against 'nim c compiler/nim'
|
|
that 2/3 of the compiler's runtime is spent in the frontend. Hence we
|
|
implement IC for the frontend first and only later for the backend. The
|
|
backend will recompile everything until we implement its own caching
|
|
mechanisms.
|
|
|
|
Advantage of the "set of files" vs the previous global database:
|
|
- By construction, we either read from the `.rod` file or from the
|
|
`.nim` file, there can be no inconsistency. There can also be no
|
|
partial updates.
|
|
- No dependency to external packages (SQLite). SQLite simply is too
|
|
slow and the old way of serialization was too slow too. We use a
|
|
format designed for Nim and expect to base further tools on this
|
|
file format.
|
|
|
|
References to external modules must be (moduleId, symId) pairs.
|
|
The symbol IDs are module specific. This way no global ID increment
|
|
mechanism needs to be implemented that we could get wrong. ModuleIds
|
|
are rod-file specific too.
|
|
|
|
|
|
|
|
Global state
|
|
------------
|
|
|
|
There is no global state.
|
|
|
|
Rod File Format
|
|
---------------
|
|
|
|
It's a simple binary file format. `rodfiles.nim` contains some details.
|
|
|
|
|
|
Backend
|
|
-------
|
|
|
|
Nim programmers have to come to enjoy whole-program dead code elimination,
|
|
by default. Since this is a "whole program" optimization, it does break
|
|
modularity. However, thanks to the packed AST representation we can perform
|
|
this global analysis without having to unpack anything. This is basically
|
|
a mark&sweep GC algorithm:
|
|
|
|
- Start with the top level statements. Every symbol that is referenced
|
|
from a top level statement is not "dead" and needs to be compiled by
|
|
the backend.
|
|
- Every symbol referenced from a referenced symbol also has to be
|
|
compiled.
|
|
|
|
Caching logic: Only if the set of alive symbols is different from the
|
|
last run, the module has to be regenerated.
|