Current stable release: 1.2.6. See the changelog and release notes.
Supported native targets: Windows x64 (PE32+) and Linux x64 (ELF64).
MiniLang (.ml) is a small, dynamically typed language that compiles with the
self-hosted compiler produced by build.ps1 to native Windows x64 (PE32+) or
Linux x64 (ELF64) images. Windows is the default target;
--subsystem windows emits a Windows GUI image.
The compiler implementation is written entirely in MiniLang and rebuilds
itself with build.ps1. Release 1.2.6 includes ready-to-run Windows and
Linux binary packages; see binary installation. Generated
binaries remain outside Git. On a clean sibling checkout,
build.ps1 uses MiniLangCompilerPy/mlc_win64.py for the first bootstrap and
uses the resulting native compiler on subsequent self-host runs. This
compiler implementation and native self-host builds do not depend on Python.
Optional development-only Python scripts compare benchmark samples and verify
the embedded Linux runtime against the sibling reference compiler. See
Compiler parity and self-hosting for the exact bootstrap,
self-build and target-output guarantees.
Both compiler implementations and their documentation were developed with the assistance of generative AI.
- 1. Quickstart
- 2. Files & Running
- 3. Comments
- 4. Types & Literals
- 5. Variables & Assignments
- 6. Operators & Expressions
- 7. Arrays
- 8. Control Flow
- 9. Functions
- 10. struct
- 11. enum
- 12. Modules, namespace & import
- 13. Standard Library & Builtins
- 14. extern
- 15. Error handling:
error&try - 16. Syntax Reference (short)
- 17. Examples
- Native compiler status
- Compiler parity and self-hosting
Hello World
print "Hello MiniLang!"Variables and math
x = 10
y = 5
print x + yIf/then
age = 18
if age >= 18 then
print "ok"
else
print "nope"
end ifInline form also works:
if age >= 18 then print "ok" else print "nope" end ifProgram entry via main(args):
function main(args)
print "argc=" + len(args)
if len(args) > 0 then
print "first=" + args[0]
end if
return 0
end function- Source files use the extension:
.ml
.\build\mlc_win64.exe input.ml output.exe [options]
.\build\mlc_win64.exe input.ml output --target linux-x64 [options]
.\build\mlc_win64.exe -versionNotes:
- Flags can appear before or after the positional arguments.
windows-x64is the default and emits PE32+;linux-x64emits ELF64.build.ps1creates the native Windows compiler. On Linux,build.shcreates and verifies a native ELF compiler; either host can cross-compile both target formats.- A native Linux compiler marks both monolithic and
.mloELF outputs executable while retaining the caller'sumask; exact project-cache restores preserve that mode. A Windows-to-Linux cross-build cannot carry POSIX mode bits, so deployment from Windows still needschmod +x outputon Linux.
Common options:
Import / modules
-I <dir>/--import-path <dir>add an import search path (repeatable). The directory ofinput.mlis always an implicit import root.
Listings / diagnostics
--asmwrite a combined.asmlisting (default: off)--asm-out <path>override listing path (default: output basename +.asm)--asm-cols addr,opcodes,codechoose columns (default: all)- or
--asm-no-addr,--asm-no-opcodes,--asm-no-code
- or
--asm-datainclude.rdata/.data/.idatadumps (constants and imports)--asm-peinclude a PE32+ header + section table dump in the listing (Windows target only)--dump-labels <path>write a raw section/helper/label dump for parity debugging
Diagnostics
--keep-goingcontinue after the first error and report multiple diagnostics--max-errors <n>cap the number of diagnostics when using--keep-going(default: 20)
Conditional compilation
-DNAME[=VALUE]/--define NAME[=VALUE]override a typed source option; an omitted value meanstrue
Heap / GC tuning (native runtime)
--heap-reserve <size>reserve heap address space (e.g.256m)--heap-commit <size>initial committed heap bytes (e.g.16m)--heap-grow <size>minimum commit growth step when the heap needs to grow (e.g.1m)--heap-shrinkenable decommit after GC (trim-from-top). Default: off--heap-shrink-min <size>minimum committed heap when shrinking (default: initial commit)--gc-limit <size>bytes allocated between periodic GC runs (default: backend constant)--no-gc-periodicdisable periodic GC trigger (collect only on OOM)
Profiling / tracing
--profile-callsinstrument user functions with call counters; enablescallStats()--trace-callsprint each entered function name to stderr (runtime trace)
Output
--target windows-x64emits a PE32+ image (default)--target linux-x64emits an ELF64 image--subsystem console/cuiselects the default Windows console subsystem--subsystem windows/window/guiselects the Windows GUI subsystem; subsystem selection does not apply to Linux
Self-host build options
- Large import graphs automatically use the memory-bounded
.mloobject/link path; small programs keep the lower-overhead monolithic path --object-pipelineforce.mlomode;--no-object-pipelineforce monolithic mode (useful for parity and benchmark gates)- The canonical linker supports both Windows PE and Linux ELF. Section and
relocation streaming keep large links bounded, while monolithic and
.mlotarget files remain byte-identical. --profile-compilerprint wall-clock compiler/linker phase timings without changing target bytes--profile-compiler-batchesinclude setup, codegen, serialization and total time for every function-object batch, tagged with its module/type prefix; this implies--profile-compiler--profile-compiler-astinclude per-kind AST counts, maximum depth, interned symbol/file counts and compact-arena capacity/storage; this also implies--profile-compilerand does not alter generated target bytes
.\build\mlc_win64.exe -version and --version both print
MiniLang Compiler 1.2.6. .\build\mlc_win64.exe --help prints a short usage
summary.
Notes (current implementation):
- Targets Windows x64 (PE32+) and Linux x64 (ELF64); Windows remains the backward-compatible default.
- Heap parameters can be configured via
--heap-*flags (reserve/commit/grow/shrink). - If a top-level
function main(args)exists, the native entrypoint will call it after module initialization has completed. Imported module initializers and the entry file's top-level initialization run automatically beforemain.argsisargv[1..]as an array of strings. The returned int becomes the process exit code (void -> 0). - Both runtimes use one process-wide, thread-safe managed heap with per-thread
stacks and TLABs. Windows reserves/commits with
VirtualAlloc; Linux usesmmap,mprotectandmadvise. - Linux images without external native imports are static. A source containing
extern function ... from "lib.so..."gets a minimal dynamic ELF image using the x64 System V ABI and the glibc interpreter/lib64/ld-linux-x86-64.so.2. Each source extern is resolved through its declared library handle. The full UTF-8 library spelling is encoded into a collision-free slot key, so equal basenames, punctuation variants and equal symbols in different paths remain distinct. A missing module or symbol returns a catchable MiniLangerrorinstead of transferring control through a null loader slot. - Listing order is stable; PE header dumps are available only for Windows.
- The compiler uses the shared MiniLang frontend for parsing (tokenizer/parser).
Larger programs can keep their entry point, output path and compiler options in a TOML manifest and build it with one command:
.\build\mlc_win64.exe --project minilang.toml[project]
entry = "src/main.ml"
output = "build/app.exe"
include = ["src", "vendor"]
target = "windows-x64"
subsystem = "console"
object_pipeline = true
incremental = true
cache_dir = ".minilang-cache"
compiler_args = ["--heap-reserve", "1g"]
[defines]
FEATURE_TLS = true
SERVER_NAME = "example"
WORKER_LIMIT = 8All paths are relative to the manifest. The supported project fields are:
| Field | Meaning |
|---|---|
entry / input |
required entry .ml file |
output |
required native image path |
include / import_paths |
array of import roots |
target |
windows-x64 (default) or linux-x64 |
subsystem |
Windows only: console or windows (aliases accepted by the CLI) |
object_pipeline |
optional force switch: true selects .mlo, false selects monolithic; omit it for automatic selection |
incremental |
enable the exact-hit artifact cache (default true) |
cache_dir |
cache directory (default .minilang-cache) |
compiler_args |
array of additional compiler arguments |
The optional top-level [defines] table accepts booleans, integers and
strings. These values are passed to conditional compilation before any module
is parsed. Explicit -D arguments after --project take precedence. The
effective definitions and the manifest contents are included in the
incremental-cache fingerprint.
Unknown project fields and wrong field types are errors. Command-line
arguments after the manifest are appended; use --no-incremental to bypass
the cache for one build.
For manifests that must work with both compilers, use the conservative TOML
subset shown above: a [project] table, quoted strings, booleans, and
single-line arrays of quoted strings. Keep comments on their own lines. The
self-hosted compiler has a small purpose-built parser for this shared subset;
commas inside quoted array strings are preserved. The Python implementation
uses tomllib and therefore accepts full TOML.
The incremental cache is deliberately conservative. Its fingerprint covers the
manifest, effective compiler arguments, a content-based compiler executable
identity, every .ml source below the entry/include roots, and recursively
quoted imports which escape those roots. An exact hit verifies the
content-addressed cached executable before restoring it. POSIX modes are copied
with the artifact. When that final artifact is unavailable but a complete
fingerprint-matched .mlo set remains, the self-hosted compiler relinks those
objects without repeating parsing, analysis or code generation. The object
manifest records the sorted expected file set and is published last, so a
crashed or later-damaged population becomes a miss instead of feeding a partial
directory to the linker.
Broad root discovery does not descend into directory symlinks or Windows
junctions, matching the Python compiler and preventing cyclic traversal. A
quoted import that explicitly names a linked file is still followed and
fingerprinted. Object-set validation reuses one 1-MiB checksum buffer across
all MLOs instead of allocating one buffer per object.
Any relevant input change still performs a full build; this is exact whole-build
caching, not per-module dependency invalidation. Listing, label-dump and
self-frontcheck builds bypass the cache. Omit object_pipeline to let the
self-hosted compiler select by the recursively measured import graph, or set it
explicitly to force either pipeline. The same manifest works with the Python
compiler, which accepts both values but emits the equivalent monolithic image.
Final artifacts use per-process temporary names and are published before one
atomic state-pointer update, so interrupted or concurrent generations cannot
pair one input digest with another executable.
Conditional compilation is line-oriented and happens before tokenization and import resolution. It can therefore remove platform code, optional imports or entire declarations without changing source positions used by diagnostics.
#option TRACE_HTTP: bool = false
#option MAX_WORKERS: int = 8
#option PRODUCT: string = "server"
#const LARGE_POOL = MAX_WORKERS >= 16
#if TARGET_OS == "windows" and (TRACE_HTTP or LARGE_POOL)
import diagnostics.http_trace
#elif PRODUCT == "server"
import server.logging
#else
#error "unsupported product configuration"
#endif#option NAME: bool|int|string = expression declares a per-file typed option.
Its default is used unless a project/CLI definition with that name exists.
#const NAME = expression defines an immutable compile-time value for the
remainder of that file. Compile-time values are available only in directives;
they are not runtime variables and are not substituted into ordinary code.
The supported directives are #option, #const, #if, #elif, #else,
#endif and #error. Conditions must produce bool. Expressions support
bool/int/string literals, declared values, defined(NAME), not, and, or,
comparisons, integer arithmetic/bitwise/shift operations and string +.
Inactive branches are blanked before lexing, so their imports and syntax are
not processed. Directives may be nested.
The immutable target values are TARGET_OS, TARGET_ARCH, TARGET_ABI,
TARGET_FORMAT, POINTER_SIZE and MINILANG_VERSION. Windows selects
"windows", "x64", "win64", "pe", 8 and "1.2.6"; Linux selects
"linux", "x64", "sysv", "elf", 8 and "1.2.6". No
compiler-implementation value is exposed: the Python and self-hosted compilers
must select the same source for identical inputs.
Examples of CLI overrides:
.\build\mlc_win64.exe app.ml app.exe -DTRACE_HTTP -DMAX_WORKERS=32
.\build\mlc_win64.exe app.ml app.exe --define PRODUCT=desktopEach source file starts with the target values plus the same external
definitions, then evaluates its own #option defaults and #const values.
Declare every externally configurable name with #option; defined(NAME) is
useful for optional externally supplied flags. This is intentionally not a
textual macro system: directives cannot rewrite tokens or inspect which
compiler implementation is running.
There is a small auto-formatter written in MiniLang: tools/mlfmt.ml.
Compile it for Windows x64:
.\build\mlc_win64.exe .\tools\mlfmt.ml .\build\mlfmt.exe -I .Or build the native Linux x64 formatter:
.\build\mlc_win64.exe .\tools\mlfmt.ml .\build\mlfmt -I . --target linux-x64Format a single file:
.\build\mlfmt.exe src.ml --inplace
.\build\mlfmt.exe src.ml out.ml --indent 2 --max-blank 2Format a whole tree on Windows or Linux (recursive, in-place):
.\build\mlfmt.exe .Insert an Apache 2.0 header (only if missing):
.\build\mlfmt.exe . --apache "Authorname"
# or:
.\build\mlfmt.exe . --author "Authorname"Notes:
--max-blank -1allows unlimited blank lines.- The formatter understands the complete current language surface, including
typed/optional declarations, lambdas, interfaces,
match, eager and lazy iterators, async/static functions, conditional compilation, fine-grainedsynchronized(lock)blocks and bothloopfooter spellings. - Multi-character tokens such as
=>,?.,??and...remain atomic; declaration comments (///and//!) and block comments remain intact. - Directory formatting uses the portable standard-library filesystem API and deliberately skips junction and symbolic-link directories to avoid cycles.
- When
<path>is a directory,mlfmtformats all*.mlfiles recursively in-place (the optionaloutput.mlargument is only valid for single-file formatting). --apache/--authoruses the portable local clock on Windows and Linux.- The formatter is intentionally conservative (it does not change program semantics).
- The compiler suites verify canonical output, recompilation, runtime behavior, byte-idempotence, unchanged generated code and Windows/Linux formatter parity.
The repository does not contain a compiler executable. With
MiniLangCompilerPy checked out as a sibling, the first call automatically
creates the Python bootstrap. The second call rebuilds the compiler through
the MiniLang-only .mlo pipeline:
# Python bootstrap when build\mlc_win64.exe does not exist.
.\build.ps1
# Native self-host build using the compiler created above.
.\build.ps1On an x64 Linux host, the matching native bootstrap is:
./build.sh
# or select an explicit bootstrap/output
./build.sh --compiler ../MiniLangCompilerPy/mlc_win64.py --output build/mlc_linux_x64build.sh emits the compiler through the Linux .mlo linker, checks its
version, verifies byte-identical direct, .mlo and project-manifest ELF smoke
images (including parent-path normalization) and only then replaces the
requested output.
Useful variants:
# Build to build\mlc_win64.next.exe without replacing the current compiler.
.\build.ps1 -NoReplace
# Skip the post-build smoke test.
.\build.ps1 -SkipSmoke
# Use an explicit Python bootstrap and interpreter.
.\build.ps1 -Compiler ..\MiniLangCompilerPy\mlc_win64.py -Python py
# Use an explicit native bootstrap compiler and a custom output path.
.\build.ps1 -Compiler .\build\mlc_win64.exe -Output .\build\mlc_custom.exe
# Retain the generated .mlo object directory for linker investigation.
.\build.ps1 -KeepObjects
# Disable bootstrap memory-probe output at its source.
.\build.ps1 -NoBootstrapProbeNotes:
- When no
-Compileris supplied, the script prefers an existingbuild\mlc_win64.exe; otherwise it discovers the sibling Python compiler. - The script stages the self-host build in a short temporary directory and then
moves the finished executable into
build/. Object files are removed unless-KeepObjectsis passed. - Self-builds use the memory-bounded
.mloobject pipeline. The generated compiler reserves an 8 GiB virtual heap so very large monolithic target builds such as MiniQuake have headroom; only 512 MiB is initially committed and unused top pages may be trimmed after GC. - During large monolithic target builds, each bounded phase resolves only the
newly emitted
.textfixups. Unknown forward targets move to a deferred generation and are revisited once after helper emission, avoiding repeated rescans of an ever-growing patch set. Only section/data/IAT relocations then remain pending for PE assembly; generated executable bytes are unchanged. - Very large multi-module targets automatically select
--object-pipeline; it bounds the live assembler graph per fragment. A small coordinator starts the memory-heavy emitter, waits for it to exit, and only then links the retained objects, preventing emitter and linker heaps from overlapping. Canonical entry/function/support order, shared constant pools and exact section boundaries make the final PE byte-identical to the normal self-hosted and Python compiler outputs. Automated gates compare optimization-heavy and cross-module fixtures byte for byte. The current MiniQuake build completes all 495 function fragments, the support tail and the fresh-process link; its final PE is byte-identical to both monolithic compiler outputs. - Windows object-emission and fresh-link children are launched directly with
CreateProcessW, using exact CRT argument quoting. Paths ending in a backslash and values containing shell metacharacters therefore cross the process boundary unchanged. Large object streams explicitly root their output paths and runtime configuration across stride collections; plain self-builds no longer depend on diagnostic--mem-probeside effects. - Pass
--profile-compilerto the self-hosted compiler to print wall-clock timings for module loading, declaration planning, object emission and each linker phase. Large monolithic builds also report the text-label and deferred patch counts and whether direct section lookup was selected. The flag is diagnostic only and does not change target bytes. - Append-heavy compiler tables use capacity-backed internal vectors and are
frozen to ordinary arrays at established codegen boundaries. The object
writer isolates short-lived semantic batches while append-only data builders
and constant pools stay shared; completed assembler fragments are discarded.
The hot-path guard in
scripts/check_hotpath_concats.ps1prevents the main declaration/scope paths and nested-statement analysis worklists from regressing to growing-array concatenation. - Compiler-owned fixed-size arrays now use the runtime's native
array(size, fill)allocation instead of a bootstrap-era doubling/concatenation builder. Chunk tails containing realvoidvalues allocate their finalarray(size, void)directly, and parser/general builders copy chunk groups plus the active tail into one final array withoutgroups + [tail]. Short-lived merge inputs use a non-escaping variadic view, while 29 profile-selected concrete leaf helpers carry exact type contracts so the bounded automatic inliner can remove their hot direct-call overhead. A lazy iterator for the three-pass closure-layout set and asynchronous object emission were measured and rejected because they made full self-builds slower. The retained changes, rejected A/B results, hashes and memory data are recorded in the modern-constructs benchmark. - Function-object emission uses bounded batches of eight functions, or four for
the compiler backend's largest function groups. Per-function qualification
maps use generation-stamped clearing, so resetting a large open-addressing
table is O(1) while lookup order and emitted bytes remain deterministic.
Integer-flow collection, value-type collection and loop-hot-local discovery
share one deterministic statement traversal per function instead of walking
large function bodies three times. The inferred facts and emitted target
bytes remain unchanged. Their converged integer/type lattices remain compact
function-local hash indexes through emission, so repeated variable queries
are O(1) rather than linear in the number of inferred locals.
The paged writer appends little-endian 16-, 32- and 64-bit fields and UTF-8
strings without allocating temporary byte objects; MLO serialization uses
the direct U32 and string paths for its actual wire fields. MLO reads decode
U32 values at the cursor and reuse one reader-local result pair. The
assembler caches its active 64 KiB byte chunk, and compiler vectors use
nominal checks plus validated trusted accessors. Standard-library
Listgrowth and bulk conversion use nativecopyArray. Together these current backend hot paths reduce the same-window fixed-point build by about 9.5%; the implementation, rejected resolver experiment, hashes and measurements are in the backend hot-path benchmark.--profile-compilerreports aggregate batch setup, code generation and object serialization time.--profile-compiler-batchesadds one diagnostic line per batch with its module/type prefix and does not change target bytes. - Object emission remains deliberately serial. A background-writer prototype was measured on a complete self-build, exceeded six minutes and about 3.6 GiB working set, and was removed. Competing managed heaps and GC coordination cost more than the attempted codegen/serialization overlap saved; process-level parallelism should only return with isolated heaps and deterministic merge boundaries.
- Compiler-internal
.rdataand.datalabels use chunked, indexed builders; section relocation records are chunked as well. The parsed AST and active codegen graph remain explicit GC roots through canonical function emission, then their analysis state is released before the support-helper tail. The compiler uses a 3 GiB internal periodic-GC limit for large canonical builds; target--gc-limitvalues still configure only the generated executable. - The self-hosted tokenizer stores tokens in a typed structure-of-arrays arena instead of allocating one managed struct per token. Parser cursors are integer IDs, kinds use a byte column, source positions use packed 32-bit offsets, and token payloads use packed 32-bit IDs. Identifiers, keywords and operators are interned once per module; numbers and strings share the same text pool, while fixed punctuation and newline tokens need no stored text. The arena is sized from observed MiniLang token density and grows geometrically for compact or generated sources.
- Immutable literal/variable leaves and the high-frequency binary-expression
nodes use typed structure-of-arrays arenas with stable integer NodeIds.
Kinds, source offsets, source-file IDs, variable/operator symbol IDs and
binary child IDs are stored in compact columns; the remaining mutation-rich
statement/declaration nodes stay typed structs. One compilation-wide symbol
table deduplicates variable names and operators across all imported modules.
--profile-compiler-astreports the resulting per-kind population and arena footprint so further migrations can be selected from measured data. The 2026-08-30 arena report records the self-build, MiniQuake and MiniSQL correctness/time/memory results and the current limitation that backend state still dominates peak memory. - At the final frontend/backend ownership boundary, the compiler releases all compact AST columns and their intern tables in one operation. Path and module resolution caches are detached at the same boundary, then a full collection can reclaim the remaining frontend graph before support-tail emission or executable materialization. The arena is initialized lazily when another compilation starts in the same process.
- The canonical function stream no longer allocates a wrapper array for every function. A typed function-root arena stores kinds and names in columns and exposes stable integer node IDs to the object emitter. Once a non-inline function has been serialized, its body and analysis-only closure references are cleared; inline bodies remain available for later call-site expansion. Parsed-module program arrays and normalized source buffers are detached as soon as their nodes and line maps have entered the merged program, and the frontend module cache/order containers are released before code generation.
- Callable globals use a compact callable-only binding instead of the full mutable-variable record. Phase-local analysis maps opt into exact touched- slot tracking, so completed batches clear only live key/value references and do not scan their entire spare capacity. Reusable vector workspaces likewise clear stale reference slots before the next batch.
- The streaming linker first scans only section sizes, import metadata and
label-count hints. It then allocates each final target section exactly once,
reopens one object at a time and copies its payload directly to the final
offset; per-object section arrays and a later concatenation copy no longer
coexist. Unneeded object payloads are skipped during label and relocation
passes, and only a compact fallback cache is kept for uncommon relocation
targets. Global label maps are allocated once from counts collected during
the section pass; canonical
objm_N__maps are sharded and pre-sized from their dense object index. Local relocations address the current shard directly, while legacy names retain the general parser fallback. Label-index GC runs at bounded 128-object intervals, and--profile-compilerreports public/private label, shard and collection counts. During streamed relocation patching, the live section/label graph is held by an explicit compiler root; full collections are deferred until after that ownership boundary so diagnostics such as--mem-probecannot accidentally change linker correctness. The object emitter likewise roots its reusable fragment state, function-entry arena and accumulated builders across stride collections. Object clones preserve the synchronized-global set, keeping monitor emission byte-identical to the monolithic and Python pipelines. - Current object emission writes MLO v2 while retaining the length-prefixed
MLO1family magic. Same-fragmentrel32andrip32fields are resolved directly in the materialized text bytes and are not serialized as patches; only cross-fragment and cross-section targets retain their UTF-8 symbols. Consequently, local control-flow labels and relocations do not enter normal object/linker tables. The reader still accepts v1 and the earlier v2 numeric target encoding, so existing project caches and object directories remain linkable. A--dump-labelsdiagnostic build deliberately retains internal labels. - MLO serialization retains its 64 KiB paged builder but no longer flattens it into a second object-sized byte array before writing. Windows and Linux use a native short-write-safe file loop with one reusable bounded 1 MiB staging buffer. This avoids unbounded duplicate object bytes without regressing into one system call per page. The phase-release and MLO-streaming report records fixed-point, cross-compiler, Linux-host and memory measurements.
- The folding pass traverses the assembler's fixed-size patch groups directly. It materializes only the small outer group index and the unresolved cross-fragment records; it no longer creates a second flat array containing every local patch. On the current self-build this reduced mean object serialization from 21.296 to 17.224 seconds (19.12%) and sampled emitter peak working set from 3,316.6 to 3,286.5 MiB. The resulting 297-object Stage 2 and Stage 3 sets are individually byte-identical and link to the same 60,513,792-byte compiler image.
- The first v1-to-v2 pass reduced an exact 296-object compiler set from 213.30
to 151.20 MiB. Direct folding then reduced an exact current-source v2 set
from 158,603,878 bytes (151.26 MiB) to 107,016,076 bytes (102.06 MiB), another
32.53%. Three alternating relinks averaged 5.753 seconds for numeric v2 and
2.617 seconds for folded v2 (54.52% less, 2.20x throughput); average sampled
peak working set fell from 875.5 to 481.4 MiB (45.01%). Both sets emitted the
same 60,443,136-byte executable with SHA-256
101C11E9E17D19A58A01C8EABF5E6B4CB7971DC28FB3A66472C12BF8642D6A25. - Native bootstrap builds enable the compiler's
--mem-probemode by default and filter its noisy[mem]lines from the console. A clean Python bootstrap omits this self-host-only diagnostic flag automatically. - If the first compile produced object files but failed during the final link, the script retries the link from the existing
.mloobject directory.
.\output.exe [args...]Running tests:
.\scripts\run_tests.ps1
# optional: explicit compiler path
.\scripts\run_tests.ps1 -Compiler .\build\mlc_win64.exeNative Linux host-only behavior has a separate regression gate:
./scripts/run_native_linux_regressions.sh ./build/mlc_linux_x64It verifies executable mode bits, case-sensitive imports, distinct
Cache/cache paths in incremental projects and monolithic/.mlo identity.
Notes:
- The test runner compiles and executes the Windows PE suite and, when WSL is available, the Linux ELF/FFI/threading matrix. Native-Linux host behavior has the separate gate shown above.
- Windows images run natively on Windows; a non-Windows host needs Wine for the PE suite. Linux images run natively or through WSL.
- Full logs are written to
build/test-logs/; temporary test binaries are removed unless-KeepArtifactsis passed. -ShowCompilerProgresskeeps the compiler's[phase],[obj], and[link]progress lines visible on the console.-CompilerArgs ...appends additional compiler flags;-NoDefaultCompilerArgsdisables the script's default heap/GC flags.- The test script runs the compiler hot-path concatenation guard before it builds the MiniLang test harness.
- Latest complete run for this revision: 126/126 inner harness tests, plus all outer Windows/Linux, object-pipeline, FFI, GC and byte-identity gates.
For identical source files, include roots and compiler options, the normal monolithic path of this compiler and the Python reference compiler emit byte-identical Windows PE and Linux ELF files. A historical 25-program parity matrix covers the language/standard-library suites, GC stress, compiler-GC liveness, extern/native interop, global rebinding, native threads and managed thread pools. Current revisions rerun the documented fixed point plus focused Windows/Linux parity and object-pipeline gates.
The production self-build uses the MiniLang-only .mlo object pipeline. Its
canonical layout is covered by automated byte-identity gates against both the
normal self-hosted path and the Python bootstrap. Exact hashes, test counts,
boundaries and reproduction commands are recorded in
COMPILER_PARITY.md.
Current audited Windows fixed point (2026-09-01): the Python bootstrap produced
Stage 1 in 92.286 seconds; self-hosted Stages 2 and 3 took 187.630 and 188.809
seconds. All three are byte-identical 66,393,088-byte images with SHA-256
6000AAE0787F3A9B8C93B1206AEEE07D91B5F831ED11E0609A278BBD0212F780.
The complete inner harness passes 126/126 in 89.167 seconds; the full wrapper,
including every Windows/Linux, FFI, GC, object-pipeline and relink gate, passes
in 132.080 seconds. It also verifies the checked-in pthread blob layout.
Focused thread-lifecycle, Linux out double, exact-library-identity,
language-extension and standard-library builds are byte-identical across both
compilers and targets; the normal object-pipeline gates also pass. The current
standard-library images are 4,528,128-byte Windows PE and 4,493,296-byte Linux
ELF files.
The 8 GiB heap setting is virtual address-space reserve, not resident or
committed memory. Earlier backend A/B measurements remain in the
2026-09-01 report.
The measurements below preserve the chronology of earlier optimization passes; the audited fixed-point values above describe the current tree.
For the 1.1.0 acceptance pass, a 142-file snapshot of the then-current MiniQuake
worktree at commit 1036b1c3b551d00de777c67293d262a6cc5c2739 plus 18 dirty
entries was built through all three paths. Python took 67.528 seconds, the
self-hosted monolithic compiler took 2,024.375 seconds and the canonical
self-hosted .mlo build took 431.789 seconds. The .mlo run emitted 494
function fragments in 361.500 seconds, runtime helpers in 3.781 seconds and
linked in a fresh process in 42.375 seconds. All three builds produced the same
57,005,568-byte PE with SHA-256
3071B78B6F2C72B8C3036E5D62010831758F6EA3E7FFA3F6AF908BB9756003B3.
Retail Quake data passed a 120-frame runtime smoke and deterministic trace; a
1,000-frame E1M1 baseline measured about 1,404.5 headless frames/s and 166.8
rendered FPS. The object writer preserves the stream-wide inline budget across
fragments and filters local return/defer labels out of helper discovery.
The reviewed 1.1.0 source reached a binary fixed point at that time: Stage 2 and
Stage 3 are byte-identical 56,743,936-byte compiler images with SHA-256
E85E3A6EE515DC8605A10752DA953E0FBF92C5992CC354179CA7A471E11AFFEF.
The Python-built Stage 1 has the same size and SHA-256
5E84848F01D6147C1EE0D7BA47FE610DBF9093E05299AF2EF029B34B594B26D2;
Stage 2 and Stage 3 took 283.065 and 304.742 seconds. This fixed point includes
guarded specialization for fallible byte-buffer accesses, deterministic
16-byte user-function alignment across monolithic and .mlo builds, and a
dependency-driven type-flow worklist plus indexed package-aware integer flow.
The parity report therefore
distinguishes the bootstrap image, the measured self-hosted fixed point and
byte-identical target output explicitly.
The subsequent large-label throughput pass also converges at Stage 2. Its
Stage 2 and Stage 3 images are byte-identical 59,923,456-byte compilers with
SHA-256
FB6D921349BBE248A88726910CE72396651B2372179ADC36D7913FC7240ECF3D;
the stages completed in 357.656 and 258.750 seconds through the canonical
object pipeline. On clean MiniQuake commit
b5fe23f17bd5e861f22afd72b2e83aa4b73b9bd5, the optimized self-hosted
monolith completed in 874.519 seconds and .mlo in 351.937 seconds, compared
with the preceding 1,687.367- and 537.440-second measurements. Python,
self-hosted monolithic and .mlo builds all emitted the same 57,197,056-byte
PE with SHA-256
8E5D38689481FC7D0FC6CACD6FFD015EEBA3C2B875A9B19E0CC790A142970E63.
The subsequent linker-index pass reused the same retained 497-object MiniQuake directory for controlled A/B measurements. Link time fell from 58.891 seconds to 18.922-21.579 seconds (63.4-67.9%); label indexing fell from 44.407 seconds to 8.469-9.047 seconds. All runs retained the 57,197,056-byte size and SHA-256 above. A separate 656-object private-label layout also remains byte-identical to its baseline. See COMPILER_PARITY.md for the complete measurements and hashes.
The same source converges at the next self-host stage: Stage 2 and Stage 3 are
byte-identical 59,981,824-byte compiler images with SHA-256
86447CBFB07AF960EA970E3770927F5F6D0C780E61730303B194883F634E21DB.
The current serial object stream reuses one materialized semantic fragment
state across all function batches and resets only its assembler and
batch-local fields. It retains the historical per-batch binding-id origin, so
this is a compiler-memory/throughput optimization rather than a target-code
change. On the exact same self-host source, two old and two new object runs had
medians of 171.633 and 135.993 seconds (20.77% less); sampled private peak
memory fell from 3,240.3 to 3,191.5 MiB, and the instrumented heap high-water
fell by about 48 MiB. Stages 1, 2 and 3 are byte-identical 60,527,104-byte
images with SHA-256
E22718A62809CEED3919E723467A43E756237DA6B184B24246FC114D38B83810.
Every one of their 297 MLO files is also byte-identical. On clean MiniQuake
commit 59ac8cfc6c447c82b207100741512359f95e595c, the two-run object-emission
median fell from 239.610 to 215.477 seconds (10.07%) while all 497 MLO files
and the final 57,197,056-byte PE remained unchanged.
The current function-analysis pass also retains one compiler-local scratch
workspace across serial functions. Capacity-backed traversal/queue vectors and
epoch-cleared fact/dependency/promotion maps are reset in O(1); no compiler-only
field is added to generated CgState, so target layout is unchanged. In a
controlled same-configuration self-build comparison the median fell from
130.483 to 110.108 seconds (15.61%), while sampled process-tree private peak
fell by 32.3 MiB (5,363.0 to 5,330.8 MiB). A controlled MiniQuake build fell
from 283.945 to 224.695 seconds (20.87%) and emitted the same 57,197,056-byte
PE with SHA-256
9AF2B206162B7BD2E632379CA4F6D2598FDD390F8177EDA801668B9EA35C66C8.
Heap-shrink code generation is now synchronized as well. The self-hosted
backend emits the same post-GC decommit block and 4 MiB default threshold as
Python. Python bootstrap, self-hosted Stage 2 and Stage 3 are byte-identical
60,660,224-byte compiler images with SHA-256
344CE78BB6C03307A594FB4843642669083432AD2FF744772CE6086BA4A7629E.
Dedicated Windows and Linux tests verify that committed memory decreases
without crossing --heap-shrink-min; the complete ML harness remains 107/107
and all Windows/WSL host gates pass.
Serial object emission now selects its compiler-GC cadence from the prepared
function count. Streams of at most 2,048 functions collect completed fragment
graphs every 32 batches; larger applications retain the 64-batch cadence,
because their peak is dominated by the early live semantic graph and extra
collections only add work. Native compiler builds also start with 512 MiB
committed while retaining an 8 GiB reserve. On the same final self-host source,
the adaptive compiler reduced process-tree private peak from 3,551.6 to
2,281.8 MiB (35.75%), working-set peak from 3,179.8 to 1,928.8 MiB (39.34%) and
wall time from 145.527 to 133.109 seconds (8.53%). Python and self-hosted builds
are byte-identical 60,663,808-byte images with SHA-256
EFF138E771E6D2136D075E88863E6E3B0077481CEE6954A9794A0E48C931D370.
MiniQuake stays on the 64-batch path: its adjacent A/B changed from 259.279 to
258.089 seconds, private peak from 3,570.8 to 3,531.4 MiB, and retained the
exact 57,197,056-byte PE with SHA-256
9AF2B206162B7BD2E632379CA4F6D2598FDD390F8177EDA801668B9EA35C66C8.
Compiler-internal FastMap indexes now store slot generations in byte buffers
instead of tagged arrays and grow only after reaching 80% occupancy. This keeps
the language-visible map behavior and target bytes unchanged while reducing an
adjacent self-build's private peak from 1,944.2 to 1,823.9 MiB (6.19%), working
set from 1,904.3 to 1,792.1 MiB (5.89%) and object-emission time from 107.143
to 104.266 seconds (2.68%). Python Stage 1 and self-hosted Stages 2/3 converge
to the same 60,690,432-byte image with SHA-256
5E2518E16AC783F90F8E72E353338629088035D35A7870A15DEA283D7C605E20.
Frontend source normalization is now a single capacity-backed UTF-8 byte pass instead of allocating a managed string and array slot per source character. Native compiler builds also trim the waiting object-pipeline coordinator to a 16 MiB committed minimum after GC. The final self-build takes 88.776 seconds instead of 105.570 seconds and peaks at 1,841.1 instead of 1,972.3 MiB private commit. MiniQuake falls from 225.011 to 185.406 seconds and from 3,537.8 to 3,288.7 MiB private commit. Python and self-hosted Windows stages, every Stage 2/3 MLO object, Linux bootstrap/self-host stages and the current MiniQuake PE are byte-identical. The complete harness is 110/110 and all Windows/Linux gates pass; see the frontend-buffer report.
A MiniDoc-guided fixed-point call profile then exposed redundant lexical-frame
fallback scans and binding-generation invalidation of otherwise stable package
suffix searches. Complete scope indexes are now authoritative, while a
pool-size-aware suffix cache preserves lexical shadowing and invalidates on
symbol growth. Two same-source production self-builds improved from a
132.208-second median to 72.323 seconds (45.30% less); sampled private and
working-set peaks remained effectively unchanged. Python Stage 1 and
self-hosted Stages 2 and 3 are byte-identical 66,487,808-byte 1.2.2 images with
SHA-256
5C4AF305EAB1D825E6304A628FF43C9D1D1B9AE0100300B1DEBD4A4C4837E61A.
MiniDoc coverage remains 100% with zero strict warnings. See
the MiniDoc profile audit.
// this is a comment
print "hi" // comment at end of line/*
Multi-line comment
is ignored
*/
print "ok"/// documents the declaration immediately following it. MiniDoc reads these
comments from the original source while both compilers omit them from the
executable AST, so documentation has no runtime cost.
/// Loads a user by identifier.
/// @param id Stable user identifier.
/// @returns The matching user.
function loadUser(id as int) returns User
// ...
end functionUse //! for file-level documentation. /** ... */ and /*! ... */ are the
block forms for declaration and file documentation. MiniDoc also accepts a
legacy // or /* ... */ block directly before a declaration, but /// is
preferred because its intent is explicit. Supported structured tags include
@param, @returns, @error, @deprecated, @see, @since, @example,
@group, and @internal.
The repository contains ready-to-use MiniDoc configurations. With a sibling MiniDoc checkout, regenerate the compiler and standard-library API references:
..\MiniDoc\build\minidoc.exe --config .\minidoc.toml
..\MiniDoc\build\minidoc.exe --config .\minidoc-std.tomlGenerated HTML and Markdown are written below docs/api/compiler and
docs/api/std respectively. Both checked-in configurations disable generation
timestamps, so unchanged sources and revisions produce byte-identical trees on
independent runs.
MiniLang is newline-oriented, but supports a few "robust syntax" rules to make formatting easier:
- Newlines separate statements.
;can also separate statements (useful for single-line / inline code).
a = 1; b = 2; print a + bNewlines are allowed (and ignored) in common "continuation" positions:
-
After operators (and after unary operators):
x = 1 + 2 + 3 y = - 5 z = not false
-
Inside bracketed lists and calls (after
[/(, after commas, and before the closing]/)):a = [ 1, 2, 3, 4, 5, 6, ] print add( 1, 2, 3, )
-
Inside indexing (after
[and before]):v = a[ 0 ]
Trailing commas are allowed in array literals and call argument lists:
a = [1, 2, 3,]
print add(1, 2, 3,)MiniLang values:
- Int:
1,-42 - Hex int:
0xabc,-0x10 - Binary int:
0b10101,-0b10 - Float:
3.14,-0.5
a = 10
b = -3.5
h = 0xFF
m = 0b1010The frontend normalizes an unambiguous subtraction such as a-1 to a - 1
before tokenization. Spaces remain recommended for readability, but are not
required around - when its left side is an identifier, number, ) or ].
- Strings use double quotes:
"Text" - Common escapes are supported, e.g.
\n,\t,\",\\
s = "Hello\nWorld"
print struefalse
flag = true- Literals:
[1, 2, 3],["a", "b"] - Trailing commas are allowed:
[1, 2, 3,] - Multiline literals are allowed (see section 7).
arr = [1, 2, 3]bytes is a mutable raw byte buffer (values 0..255). You create it with bytes(...) (or legacy byteBuffer(...)).
- Indexing returns an
intbyte value. - Assignment
buf[i] = nexpectsnin0..255.
See 13.3 for details and file / encoding examples.
void is the "no value" literal.
You get void when a function ends without return, or explicitly via return void. It is a real runtime value, so it can be assigned:
function maybeGetName()
if input() == "" then
return void
end if
return "Nina"
end function
x = maybeGetName()
if x is void then
print "no name"
else
print x
end ifStrict void handling (runtime): using void in most operations produces a runtime error(...):
- calling it:
void()orx()whenxisvoid - member access:
void.field - indexing:
void[i]ora[void] - arithmetic / bitwise ops:
+ - * / % & | ^ ~ << >> - ordered comparisons:
< <= > >= - boolean ops:
and/or/not(if an operand isvoid) - as a condition in
if/while/loop ... while len(void)
For type checks, prefer:
x is void/x is not voidx is int,x is string, etc. (primitive type checks; sugar fortypeof(x) == "...")x is Thread/x is thread(the native thread category; both spellings are equivalent)x is Thing,x is Color, etc. (concrete struct/enum type checks; compares the internal type id)
Equality/inequality (==, !=) still works with void (e.g. void == void).
Note:
print void(and printing unsupported heap objects) raises a runtimeerror(...).
Older MiniLang versions treated void as an internal-only value that was not directly writable (e.g. assignment and printing were rejected). With strict void handling, void is writable, but using it as a real value in operations now fails loudly as described above.
name = "Max"
score = 100Variables do not need to be declared.
Use synchronized for a shared global binding:
synchronized counter = 0Synchronized variables may only be declared at top level or in a namespace.
Every read and write uses the runtime's process-wide recursive monitor. For an
assignment such as counter = counter + 1, the lock covers the complete
read/modify/write operation.
The binding may contain any MiniLang value, including strings, arrays, bytes, structs, functions and thread objects. The monitor protects access to the binding; it does not automatically protect later mutations of an object stored in it. Wrap compound object operations in a synchronized function or use a thread-safe collection.
Supported at top level, in namespaces, and inside functions.
const PI = 3.14159
const NAME = "MiniLang"Rules:
- A
constbinding can only be assigned once. - At top-level / in namespaces, the initializer must be
constexpr(compile-time evaluable). Typicalconstexprexpressions include literals, arithmetic/bitwise operations on constexpr values, references to otherconsts, and enum values. - Inside functions, the initializer may be any expression, but the name is still write-once.
Note: const makes the binding immutable (you can't reassign the name). It does not deep-freeze objects like arrays/bytes.
Allowed standalone statements are:
- assignments (e.g.
x = 1) - function calls (e.g.
foo(1,2)) print <expr>
Not allowed, for example:
1 + 2 // invalid: expressions alone are not statementsStatements can be separated by newlines or by ;.
| Operator | Meaning |
|---|---|
+ |
add / string concat / array concat / bytes concat |
- |
subtraction |
* |
multiplication |
/ |
division |
% |
modulo |
Important:
-,*,/,%work only with numbers (notbool).+is special:- number + number -> number
- array + array -> array concatenation
- bytes + bytes -> bytes concatenation
- otherwise -> string concatenation (both sides are converted to strings automatically)
Use str(value) when an explicit string conversion is clearer.
| Operator |
|---|
== |
!= |
> |
< |
>= |
<= |
is <type> |
is not <type> |
and,or(short-circuit)not(unary)
if not (x == 10) and true then
print "ok"
end if- shifts:
<<,>> - bitwise AND:
& - bitwise OR:
| - bitwise XOR:
^ - bitwise NOT:
~x
orand|^&==,!=,is>,<,>=,<=<<,>>+,-*,/,%- unary:
not,+x,-x,~x
Parentheses override precedence.
Newlines may appear after operators (see 3.1).
Structs may overload MiniLang's existing operator symbols. Declarations are
static functions: every operand is explicit, there is no implicit this, and
inline requests the same bounded expansion as an inline function.
struct Vector2
x as int,
y as int,
operator inline +(left as Vector2, right as Vector2) returns Vector2
return Vector2(left.x + right.x, left.y + right.y)
end operator
operator ==(left as Vector2, right as Vector2) returns bool
return left.x == right.x and left.y == right.y
end operator
end struct
sum = Vector2(1, 2) + Vector2(3, 4)
sum += Vector2(5, 6)The overloadable binary symbols are + - * / % == != < <= > >= & | ^ << >>.
The overloadable unary symbols are + - not ~. Multiple signatures may be
declared for one symbol, for example Vector2 + Vector2 and Vector2 + int.
Comparison overloads and unary not must return bool.
Resolution is compile-time-only and exact:
- every operand parameter and the result must have a required, non-optional
declared type, and the result cannot be
void; - the first operand must be the struct that contains the declaration;
- aliases such as
integerandintdenote the same type, but no implicit numeric, string or object conversion is attempted; - a missing exact signature or two matching canonical signatures is a compile error whenever the owning struct type is statically known;
- without an applicable struct declaration, the existing built-in operator
behavior is unchanged. Built-in unary
+valueis the numeric identity.
Variable compound assignments += -= *= /= %= &= |= ^= <<= >>= use the
corresponding binary overload and assign its result. Member and index compound
assignments are intentionally not accepted, so a side-effecting receiver or
index can never be evaluated twice implicitly. Write the read, operation and
assignment explicitly when needed.
and and or remain fixed short-circuit control-flow operators. Assignment,
is, is not, as, ?? and member/index access cannot be overloaded, and
programs cannot add new symbols or precedence levels. These limits keep parsing,
evaluation order and generated code deterministic across both compilers.
a = [1, 2, 3]
b = ["x", "y"]
c = array(4) // [void, void, void, void]
d = array(3, "hi") // ["hi", "hi", "hi"]array(size[, fill]) initializes a new array with size elements.
If fill is omitted, elements are initialized with void.
Invalid size (non-int, negative, or too large) returns a runtime error
(catchable via try(...)).
a = [
1, 2, 3,
4, 5, 6,
]arr = [10, 20, 30]
print arr[0] // 10Multiline indexing is allowed:
print arr[
2
] // 30Index must be an int (not bool).
Out of bounds indexing (or indexing a non-indexable value) raises a runtime error
that you can catch with try(...).
arr = [1, 2, 3]
arr[1] = 99
print arr // [1, 99, 3]Invalid index assignment (wrong target type, non-int index, out of bounds, invalid byte value)
raises a runtime error (catchable via try(...)).
x = [1,2]
y = [3,4]
z = x + y
print z // [1,2,3,4]Block form:
if <cond> then
...
else if <cond> then
...
else
...
end ifInline form (single-line / compact):
if <cond> then <stmt> end if
if <cond> then <stmt> else <stmt> end ifUse ; to put multiple statements on one line:
if x > 0 then a = 1; b = 2; print a + b end ifwhile <cond>
...
end whileBody executes at least once.
loop
...
while <cond>
end loopfor <var> = <start> to <end>
...
end forstartandendmust be int- runs automatically up or down (step +1 or -1)
Iterates over arrays, strings, or bytes.
for each <var> in <iterable>
...
end forJumps to the next loop iteration.
i = 0
while i < 5
i = i + 1
if i == 3 then
continue
end if
print i
end whileExits the current loop or a switch.
while true
print "once"
break
end whilebreak 2 breaks two nested levels (e.g. inner + outer loop).
while true
while true
print "stop"
break 2
end while
print "never reached"
end whileNote: break/continue should only be used inside matching constructs (loops, and switch for break).
switch <expr>
case <value>
...
end case
case <value1>, <value2>, <value3>
...
end case
case <start> to <end>
...
end case
case default
...
end case
end switchcase X, Y, Z= multiple valuescase A to B= range (mainly useful for ints)case default= fallback- When a case matches, its body runs and the switch is exited afterwards.
breakinside a case also exits the switch.
Robust syntax for value lists:
- Trailing commas are allowed before the case body:
case 1, 2, 3, - Value lists can span multiple lines:
switch x
case 1, 2, 3,
4, 5, 6
print "hit"
end case
end switchfunction <name>(a, b, c)
...
return <expr>
end function- parameters are names (identifiers)
returnis optional- without
return, the function returnsvoid return;is allowed and is equivalent toreturn- Robust syntax: a bare
returncan appear directly before a block terminator in inline forms, e.g.if cond then return end if
Example:
function add(a, b)
return a + b
end function
print add(2, 3)Multiline parameters are allowed (trailing comma optional):
function add3(
a,
b,
c,
)
return a + b + c
end functionMiniLang remains dynamically typed, but declarations may add runtime-checked
contracts. A failed parameter, return, annotated initializer or typed
struct-constructor field
contract produces error 1308 and propagates like every other MiniLang error;
wrap an operation in try(...) when the error is expected.
function sum(first as int, second as int = 0, rest...) returns int
total = first + second
for each value in rest
total = total + value
end for
return total
end function
maybeName as string? = void
print sum(second = 2, first = 1)
print sum(1, 2, 3, 4)The optional marker follows the type (Person?). void is accepted only by
an optional contract. Default and named arguments are available for directly
resolved MiniLang functions and methods; struct constructors accept field names.
A final name... parameter receives surplus positional arguments as an array.
Dynamic callable values intentionally do not accept named arguments because
their runtime representation has no parameter-name metadata.
Non-optional annotations also feed the optimizer after their entry guard has succeeded. Proven integer, float, boolean, string, array, bytes and concrete struct values can therefore use the same specialized machine-code paths as locally inferred values. A proven primitive return expression also omits its otherwise redundant return-contract check; entry guards remain the dynamic call boundary.
Expression lambdas use the existing closure implementation and may capture lexical variables:
factor = 4
multiply = function(value as int) returns int => value * factor
print multiply(3)Lambda calls are positional. Lambda parameters support type annotations, but
defaults and variadic tails are intentionally reserved for declared functions,
whose signatures the compiler can resolve at the call site. Small expression
lambdas and fully typed expression functions are automatically considered for
the same bounded inliner as explicit inline declarations; every function
still retains its normal callable body when the budget or eligibility check
requires a fallback.
Optional access and fallback expressions avoid manual void checks. ?.
short-circuits both field access and method calls, and ?? evaluates its right
side only when the left side is void:
label = user?.profile?.displayName ?? "anonymous"match provides deterministic value, list and inclusive-range matching. It is
the pattern-oriented spelling of switch; cases do not fall through and the
current version deliberately has no destructuring or guard clauses.
match status
case 0
print "idle"
end case
case 1 to 3
print "busy"
end case
case default
print "unknown"
end case
end matchIterator functions collect yielded values into an array with geometric buffer
growth. Prefixing the declaration with lazy instead returns a zero-argument
pull closure: each call produces one value and exhaustion returns void.
for each accepts both eager arrays and these pull closures, so a lazy iterator
does not materialize an intermediate collection. In both forms, returns T is
the yielded-value contract and explicit return statements are rejected.
Lazy state machines currently support yield in straight-line code, if,
while, do while, for and for each; yield inside match/switch or
synchronized, defer, and multi-level break are rejected at compile time.
iterator function numbers(limit as int) returns int
for i = 0 to limit
yield i
end for
end function
lazy iterator function largeNumbers(limit as int) returns int
for i = 0 to limit
yield i
end for
end functionFor a directly resolved variadic call, the compiler proves whether the tail can escape the callee. Read-only, call-scoped tails use an immutable stack array view; returned, captured, mutated or forwarded tails keep the normal managed heap array. This optimization does not change source semantics.
Interfaces are compile-time structural contracts. implements verifies every
required instance method and its complete parameter/variadic/optional/return
signature. Interfaces do not allocate runtime objects, provide default methods
or add a separate dynamic-dispatch mechanism.
interface Named
function name() returns string
end interface
struct Person implements Named
value as string
function name() returns string
return this.value
end function
end structAsync functions use one compiler-managed four-worker ThreadPool per program
and are available on Windows and Linux. Calling one submits a job and returns a
ThreadPoolJob immediately instead of creating a native thread per call.
await accepts pool jobs, ordinary Thread handles and non-thread values;
select accepts jobs and threads and returns the zero-based index of the first
completed item (-1 for an empty list). Async declarations are currently
limited to module or namespace scope; async struct methods and combined
async iterator declarations are rejected. Workers retain MiniLang's shared
GC heap and private-stack model. A retained async handle owns native
synchronization resources; call Dispose() after its result is no longer
needed, as with an explicitly submitted ThreadPoolJob.
async function fetch(id as int) returns string
return "item-" + id
end function
first = fetch(1)
second = fetch(id = 2)
winner = select(first, second)
print await first
print await secondInside a function, defer registers a function or method call for execution
when that function leaves:
function saveFile(path, data)
handle = openFile(path)
defer closeFile(handle)
writeFile(handle, data)
return true
end function- Deferred calls execute in reverse registration order (LIFO) on
return, normal fall-through and automaticerrorpropagation. - The callee/receiver and all arguments are captured when
deferis reached; later variable assignments do not change the queued call. - A
deferin a branch is registered only if that branch executes. - If a deferred call returns an
error, it becomes the pending function result; older deferred calls still run. - The current implementation accepts call expressions only and rejects
deferdirectly inside loops. Put one iteration in a helper function when per-item cleanup is needed.
You can mark top-level functions and struct methods as inline:
function inline clamp01(x)
if x < 0 then return 0 end if
if x > 1 then return 1 end if
return x
end functionFor an eligible direct call such as clamp01(v), the compiler expands the
callee body at the call site (no call/ret overhead). inline is a bounded
optimization request, not a guarantee. Small fully typed expression functions
and generated expression lambdas are also eligible automatically; explicit
inline remains useful for larger hand-selected bodies.
Current behavior / limits:
- Only supported for top-level functions and struct methods (
function inline ...). inlineandsynchronizedare mutually exclusive on the same function.- Only direct calls are inlined. Calls through a variable (e.g.
f = clamp01; f(v)) are not inlined. - Inline bodies must not capture variables (no closures / env hops / boxed captures).
- Bodies containing loops,
switch, nested functions, ordeferare not eligible and use the normal callable body instead. - Inline recursion / mutual recursion is rejected.
return <expr>returns from the inline call (the call yields the return value).- The inline expansion uses an isolated scope so it won't clobber caller locals.
- Eligibility is deliberately cost-bounded, and each callee has a 4096-byte native expansion budget. Later call sites fall back to its normal callable body instead of allowing unbounded code growth.
- Caller stack sizing includes the widest call inside every eligible inline body. Such a call is hidden from the caller's own AST, but still needs the same outgoing-argument and GC-rooted call-temp space after expansion.
- Every inline function retains a normal callable body. This deliberately trades a small amount of executable size for relocation safety across imported aliases, first-class callable values and late budget fallbacks.
print add(2, 3)Multiline call arguments are allowed (trailing comma optional):
print add3(
1,
2,
3,
)Thread(function[, logicalId]) creates a real native Windows/Linux thread object without
starting it. Its entry point must be a top-level, capture-free function with
zero or one parameter. A one-parameter worker receives the exact managed value
passed to Start(value):
synchronized jobsDone = 0
function worker(data)
global jobsDone
// allocations enter the process-wide managed heap
scratch = array(1024, data)
jobsDone = jobsDone + 1
return scratch
end function
t = Thread(worker, "request-worker-1")
print t.Status() // Created
print t.Start(42) // true
print t.Join() // true; waits indefinitely
print t.Status() // Completed
print t.Result() // the returned array
print t.Close() // closes the native thread handleThreads are a first-class runtime category. Both constructor-style and lowercase checks are accepted, including their negated forms:
print t is Thread // true
print t is thread // true
print t is not Thread // falseThread methods:
Start()orStart(value)atomically claims and starts a newly created thread once and returnsbool; concurrent calls on the same object can produce only one worker. Its argument count must match the entry function's zero/one arity.Stop()atomically requests cooperative cancellation and returns whether an alive thread changed toStopRequested, including the short startup-publication window.Join()waits indefinitely;Join(timeoutMs)waits at most the given number of milliseconds. Explicit timeouts must be integers in the portable range0..2147483647; invalid values produce a catchableerror. Both returntrueonly when the thread terminated. A Join racing Start waits for native-handle publication instead of failing early; concurrent joins on one object share a single native join operation safely.Status()returnsCreated,Running,StopRequested,Completed,Stopped, orFailed.IsAlive()is true forRunningandStopRequested.Id()returns the native thread id (0before a successful start).LogicalId()returns the user-defined logical id.SetLogicalId(value)can replace it while the thread is still inCreated; the constructor's optional second argument sets the initial value. Logical ids do not change the native operating-system thread id. The update and Start's state claim are atomic with respect to one another.Result()returns the worker's result (voiduntil it publishes one). Usetry(t.Result())when a failed worker returned anerrorvalue.Close()closes the native handle after termination. Concurrent calls are safe and exactly one can claim a live handle; cleanup also verifies that the native worker has fully exited before clearing its registered roots. AJointhat already acquired the handle remains valid whileClosewaits for it; later joins observe the close claim and returnfalse. Blocking cleanup is excluded from stop-the-world GC participation, preventing a terminal worker's TLAB-retirement safepoint from deadlocking with its closer. Status metadata remains valid until process exit. Stable control records are packed into thread-safe 64-KiB arenas rather than consuming one OS page each.
Worker helpers:
threadStopRequested()reports whether the current worker was asked to stop (and returnsfalseon the main thread).threadLogicalId()returns the logical id of the current worker (voidon the main thread).threadSleep(milliseconds)calls the native sleep primitive for an integer in0..2147483647; invalid values produce a catchableerrorinstead of being truncated by a target ABI.
Stop() is safe and cooperative: the compiler inserts cancellation checks at
statement boundaries. It never uses asynchronous thread termination. Long
native calls may finish before cancellation is observed, but a thread in a
blocking native call does not prevent another thread from collecting garbage.
All threads allocate into one process-wide, non-moving managed heap. Each OS thread owns only its native stack, a private GC root chain, temporary root slots and a 64 KiB thread-local allocation buffer (TLAB) carved from that shared heap. Objects up to 256 bytes including their GC header use a lock-free cursor fast path; larger objects, TLAB refills, heap growth and free-list access use the serialized central allocator. A TLAB is only an allocation reservation, never a private object heap, so references can be published between threads unchanged.
Collection is cooperative stop-the-world: generated function and loop safepoints park managed threads, while threads inside known native calls publish a stable root chain. The collector traces global roots and every registered thread context, retires all TLAB ownership, and then sweeps the ordinary shared heap block chain. A terminating worker returns its unused TLAB tail to the central free list.
When collections arrive back-to-back, a worker that observes the next request
while resuming reacquires the coordination monitor and republishes Parked
before waiting again. This keeps the collector's context scan and the worker's
wait state consistent even during sustained allocation churn at full hardware
thread concurrency.
Each thread context also retains its four most recent allocation results as handoff roots. This closes the short lifetime gap while nested object graphs are being assembled, before a precise stack or global root owns them. These slots are GC metadata; they are not a private managed heap.
Consequently, an object created by a worker remains valid after that worker
terminates whenever it is still reachable from a global, another live object,
a thread result or another registered root. heap_bytes_used(),
heap_bytes_committed() and heap_bytes_reserved() report the same global heap
from every thread. Thread.Close() releases the native handle and clears roots
owned by the thread object; it does not invalidate objects published elsewhere.
Use a synchronized function when a whole critical section must be serialized:
import std.threading as threading
function synchronized updateSharedState()
global jobsDone
jobsDone = jobsDone + 1
end function
guard = threading.Lock.new()
synchronized(guard)
// Only code using this guard is serialized.
updateOneSharedObject()
end synchronizedSynchronized variables and synchronized functions share the recursive
process-wide monitor for backward compatibility. synchronized(lock) instead
uses the supplied std.threading.Lock, evaluates that expression exactly once
and releases it on fall-through, return and propagated error exits. A failed
acquire propagates error 1101; break and continue cannot leave this block.
Independent locks allow unrelated critical sections to proceed concurrently.
Managed object identity is shared across threads; no copy is made when a reference is published. Concurrent writes to the same object, array slot or unsynchronized global are data races. Use the appropriate synchronized form or the primitives/collections in the next section to define the required critical section. Console and other process-wide I/O should also be serialized when multiple workers can use it.
For closed programs that never reference Thread, the compiler selects a
single-thread fast path. Generated hot code then omits cancellation and GC
safepoint polls, thread-local root/debug handoffs, managed/native transition
wrappers and allocator/world-lock traffic. Programs that can construct a
Thread retain the fully synchronized shared-heap runtime above; after all
workers have exited, uncontended allocation also bypasses the heap lock again.
This selection is automatic and does not change source semantics.
std.threading exposes native process-wide synchronization objects:
Lock.new()creates a native recursive mutex on either target. Methods areacquire(),tryAcquire(),acquireFor(timeoutMs),release(),isClosed()andclose().Acquire,TryAcquire,AcquireForandReleasealiases are also available.Semaphore.new(initialCount, maximumCount)providesacquire(),tryAcquire(),acquireFor(timeoutMs),release(),releaseMany(count),isClosed()andclose().Event.new(manualReset, initialState)provideswait(),tryWait(),waitFor(timeoutMs),set(),reset(),isClosed()andclose().
All timed waits accept integer milliseconds in 0..2147483647; invalid values
return false, and an ordinary timeout is also reported as false.
Semaphore.new uses the same upper bound for its maximum count. On Windows, a lock
acquired after WAIT_ABANDONED is treated as successfully acquired and must be
released.
The collection modules serialize access to managed backing arrays in the global heap:
std.ds.concurrent_list.ThreadSafeList:new,withCapacity,fromArray,add/push,addAll,get,set,insert,removeAt,pop,popOr,first,last,len/count,reserve,clear,toArray,close.std.ds.concurrent_hashmap.ThreadSafeHashMap:new,withCapacity,set,get,getOr,has,remove/delete,count/len,clear,keysArray,valuesArray,entriesArray,increment,close.increment(key, delta)is an atomic integer read/modify/write and initializes a missing key withdelta.
Collection values may be arbitrary MiniLang values, including nested arrays and
structs, and retain object identity instead of being deep-copied. Map keys may
be int, string or bytes; unsupported key types return false from
mutating methods. Snapshot methods return ordinary managed arrays. As with any
container, a lock protects the collection operation, not an unsynchronized
mutation later performed through an object reference returned by get().
import std.threading as threading
import std.ds.concurrent_list as concurrentList
import std.ds.concurrent_hashmap as concurrentMap
gate = threading.Semaphore.new(0, 1)
jobs = concurrentList.ThreadSafeList.new()
counts = concurrentMap.ThreadSafeHashMap.new()
function worker()
gate.acquire()
jobs.add("done") // same managed value is visible to all threads
counts.increment("done", 1) // atomic
end function
t = Thread(worker)
t.Start()
gate.release()
t.Join()
print jobs.get(0)
print counts.get("done")
t.Close()
// Only after all operations and waiters are finished:
jobs.close()
counts.close()
gate.close()Create shared objects before starting their users and keep their global
references alive. close() is a lifecycle operation, not a concurrent method:
call it only after all worker operations, lock holders and waiters have ended.
Because cancellation is cooperative, a worker blocked in a native wait can
observe Stop() only after that wait returns.
std.concurrent.thread_pool provides reusable GC-registered workers for
request-oriented workloads such as web servers. Jobs accept one managed data
value, retain its identity in the shared heap, and expose completion, failure
and cancellation without terminating the reusable worker:
import std.concurrent.thread_pool as threadPool
function handleRequest(request)
return "handled " + request
end function
pool = threadPool.ThreadPool.withQueueCapacity(8, 1024)
job = pool.Submit(handleRequest, "/status")
if typeof(job) == "void" then
// bounded queue is full or shutdown has begun: apply backpressure
return 503
end if
job.Wait()
print job.GetStatus() // Completed, Failed, or Cancelled
print job.GetResult()
job.Dispose()
pool.Shutdown() // graceful: drain accepted jobs
pool.AwaitTermination()
pool.Dispose()ThreadPool.new(workerCount)uses an unbounded queue.ThreadPool.withQueueCapacity(workerCount, capacity)bounds waiting jobs; capacity0is unbounded. Worker counts must be between 1 and 256.- Pending jobs use a geometrically growing circular buffer, keeping total queue growth linear even when producers temporarily outrun every worker.
Submit(function, data)returns aThreadPoolJob, orvoidafter shutdown or when a bounded queue is full.PendingCount(),WorkerCount()andIsShutdown()expose pool state.Shutdown()stops accepting work and drains the queue.ShutdownNow()cancels queued jobs; currently running callbacks finish cooperatively.AwaitTermination()/AwaitTerminationFor(timeoutMs)join all workers.Dispose()performs graceful shutdown if needed and closes native handles.- Jobs provide
Cancel,Wait,WaitFor,GetStatus,GetResult,IsDone,IsCancelledandDispose.
Pool workers receive stable logical ids such as thread-pool-0. Callbacks may
allocate, trigger GC and return arbitrary managed values. A Failed job stores
the callback's error; retrieve it with try(job.GetResult()). Pool disposal
and job disposal are lifecycle operations and must not race their active users.
std.concurrent.task layers Future values over an existing thread pool.
run(pool, callback, data) schedules a conventional callback;
runCancellable calls callback(data, token). Futures provide Wait,
WaitFor, IsDone, Cancel, Dispose plus lowercase status() and
result(). whenAll preserves input order, while whenAny and whenAnyFor
return the first completed index.
std.concurrent.cancellation provides CancellationTokenSource and its
read-only CancellationToken. Cancellation is idempotent and cooperative:
IsCancellationRequested, Wait/WaitFor and Check let running code observe
the request; Check returns error 1650. Cancelling a queued future removes
the job directly, whereas running work must inspect its token.
std.concurrent.channel.Channel.new(capacity) creates a bounded,
multi-producer/multi-consumer FIFO with backpressure. Send/Receive wait,
SendFor/ReceiveFor use millisecond timeouts and TrySend/TryReceive do not
block. A receive returns ChannelReceive(received, value), so a valid void
message remains distinguishable from a closed and drained channel. close()
seals the writer side; queued values remain readable. Call Dispose only after
blocked users have returned and the channel has drained.
import std.concurrent.channel as channels
import std.concurrent.task as tasks
import std.concurrent.thread_pool as threadPool
function work(value, token)
if token.IsCancellationRequested() then return token.Check() end if
return value * 2
end function
pool = threadPool.ThreadPool.withQueueCapacity(4, 128)
future = tasks.runCancellable(pool, work, 21)
future.Wait()
print future.result() // 42
future.Dispose()
channel = channels.Channel.new(64)
channel.Send("ready")
item = channel.Receive()
if item.received then print item.value end if
channel.close()
channel.Dispose()
pool.Shutdown()
pool.AwaitTermination()
pool.Dispose()Functions are first-class values. A function name evaluates to a pointer to that function and can be:
- assigned to a variable
- stored in arrays / structs
- passed to other functions
- called indirectly via
fn(...)
function add(a, b)
return a + b
end function
fn = add
print fn(2, 3) // 5Passing a function:
function apply(fn, a, b)
return fn(a, b)
end function
print apply(add, 2, 3) // 5Storing in an array (dispatch table):
function sub(a, b)
return a - b
end function
ops = [add, sub]
print ops[0](10, 4) // 14
print ops[1](10, 4) // 6Notes:
typeof(add)is"function".- Inline expansion applies only to direct calls (e.g.
add(1,2)), not to indirect calls likefn(1,2).
Direct and indirect calls are supported.
If a top-level function named main exists with exactly one parameter, it is treated as the program entrypoint:
function main(args)
// args is an array of strings (argv[1..], without the program path)
if len(args) > 0 then
print args[0]
end if
return 0
end functionRules:
mainmust be declared at top-level (not inside anamespace).- Signature must be
main(args)(exactly 1 parameter). argscontainsargv[1..](arguments after the executable name). Windows usesCommandLineToArgvWquoting; Linux consumes the kernel-providedargv.- If
mainreturns anint, it becomes the process exit code. If it returnsvoid(no return), the exit code is0. - The entrypoint call happens after module initialization has executed. Imported modules are initialized automatically before the entry file continues, and all module-init blocks run at most once.
function fact(n)
if n <= 1 then
return 1
else
return n * fact(n - 1)
end if
end function
print fact(5)- Lexical block scopes inside functions (variables are introduced on first assignment in the current block; shadowing is allowed).
- Functions are first-class values (you can store them in variables, pass them around, and call indirectly).
- Nested functions + closures are supported (captured vars are boxed and stored in an environment frame).
- Current limitation: shadowing of a captured name is rejected by the compiler.
- Reading a name that has never been assigned in any visible scope is a compile error ("undefined variable").
- Writing to a global from inside a function requires an explicit
globaldeclaration.- Unqualified names resolve to the active
package/namespacecontext of the file. - If the global does not exist yet (no prior top-level initialization), the compiler creates it automatically and initializes it to
void. - Globals are keyed by fully-qualified name, so
package Bar+Fuis different frompackage Bar2+Fu.
- Unqualified names resolve to the active
global inside functions:
package demo
function inc()
global counter
if typeof(counter) == "void" then counter = 0 end if
counter = counter + 1
end function
inc()
inc()
print counter // 2You can also declare a qualified global explicitly:
function setOther()
global other.pkg.counter
other.pkg.counter = 123
end functionRobust syntax: trailing commas are allowed in global declarations:
function f()
global counter, total,
counter = 1
end functionstruct Person
name
age
end struct
p = Person("Alice", 30)
print p.name
p.age = p.age + 1
print p.ageInline methods: You can also write function inline name(...) inside a
struct to request the same bounded direct-call expansion described in
9. Functions.
You can define instance methods and static methods inside a struct.
- Instance methods get an implicit first parameter
this(the instance). - Access fields via
this.field. - Call instance methods via
obj.method(...). - Call static methods via
StructName.method(...).
struct Box
value
function show()
print this.value
end function
static function make(v)
return Box(v)
end function
end struct
b = Box.make(123)
b.show()Notes:
- Struct constructors are calls:
Person(arg0, arg1, ...)(argument count must match the field count). - Field reads/writes are supported:
p.name,p.age = .... - Statically known constructor, method, and field mistakes are diagnosed during
compilation; dynamic invalid operations follow the runtime's normal
error/voidbehavior.
Ordinal enums currently support up to 65536 variants per enum and up to 65535 ordinal-enum types in one program.
Basic form:
enum Color
Red
Green
Blue
end enum
c = Color.Red
print cEnum variants can optionally have = <constexpr> values (ints, strings, etc.). If a variant has no explicit value, the native compiler will:
- auto-increment by
+1if the previous value is anint, otherwise - require an explicit value (compile error).
enum Http
Ok = 200
Created // 201
Accepted // 202
NotFound = 404
end enumThe native compiler supports compile-time composition:
namespacegroups declarations under a qualified name.importmerges other.mlfiles into the program before code generation.
namespace geom
function add(a, b)
return a + b
end function
struct Point
x
y
end struct
end namespaceHow to use it:
- Calls / constructors can be qualified:
geom.add(1,2),geom.Point(1,2). - In the native compiler, namespaces are not runtime objects; they are only used to qualify symbol names.
import "path/to/other.ml"Module-style form (syntactic sugar):
import foo.bar // resolves to "foo/bar.ml"Example with an include root:
.\build\mlc_win64.exe main.ml out.exe -I srcYou can add multiple search roots by repeating the flag. The compiler also always treats the directory of the entry file as an implicit import root.
# repeat -I / --import-path (recommended)
.\build\mlc_win64.exe main.ml out.exe -I src -I std -I vendorNotes:
-Iis repeatable. The current CLI does not split platform path lists likesrc;std;vendorautomatically.
Rules:
- Paths are resolved relative to the importing file's directory (absolute paths are also allowed).
- If the file is not found there, the compiler also searches the include roots in order: entry file directory (implicit) first, then the
-I/--import-pathdirectories (in the order provided). - If an import matches multiple files across the search paths, compilation fails with an ambiguous import error listing the matches.
- Diagnostics prefer short, stable paths (relative to the entry file directory) when possible.
- Imported modules remain declaration-oriented. At top-level (and inside
namespaceblocks) the supported forms are:package,import,namespacefunction,struct,enumextern function/extern struct- global
const(initializer must beconstexpr) - global assignments (runtime initializers are allowed)
- enum variants with explicit
= <value>must also beconstexpr
- Imported top-level global assignments are compiled as internal module initialization code. They run automatically before
main(args)and each module-init block runs at most once. - Side-effectful top-level statements other than global assignments are still rejected in imported modules (for example
print, top-levelif/while/for, or arbitrary expression statements). - Harmless import cycles are supported, and self-imports are ignored. Cycles that create unsafe cross-module initialization reads are diagnosed at runtime during module initialization.
import ... as <alias>is supported: it creates a compile-time alias for the imported module'spackagename, so you can write e.g.g.add()instead ofgeom.vec.add(). The imported file must declarepackage ....- Alias names must be valid identifiers and must not be reserved (
try,error). - If an imported file declares
package foo.bar, its location must match that package when resolved via a stable root (importing directory or-Iroot): the file should be found asfoo/bar.mlunder that root. Absolute-path imports and aliased explicit file imports (import "path/file.ml" as X) skip this location check, which is useful for code-behind files.
A file can declare its package name once at the very top:
package foo.barThis is used by the native compiler's import system (for import ... as <alias> and for verifying that a module's file path matches its declared package when resolved via an import root).
Notes:
packagemust be the first statement in the file (beforeimport,namespace,function, etc.).- It is compile-time only (no runtime effect).
Imported modules may contain top-level global assignments such as:
package demo
players = [void, void, void, void]
count = len(players)These assignments are compiled into internal module-init code. The compiler/runtime ensures that:
- imported modules initialize automatically before
main(args) - each module is initialized at most once
- self-imports are ignored
- simple cyclic imports are allowed
- unsafe cross-module reads during initialization are reported instead of silently using half-initialized state
Top-level const still stays compile-time only:
const Answer = 42MiniLang ships with a source-based standard library in std/. You import it the same way you import your own modules:
import std.string as s
import std.time as t
import std.fs as fsThe stdlib is compiled together with your program (there is no separate link
step). Its public modules work on both supported targets. std.fs, std.net,
std.time, std.threading and the shared-value helpers select Win32 or
glibc/POSIX implementations at compile time while keeping one MiniLang API.
Cryptography uses Windows CNG on Windows and OpenSSL 3 (libcrypto.so.3) on
Linux. TLS uses Schannel on Windows and OpenSSL 3 (libssl.so.3) on Linux.
Linux images that use only libc-backed modules need no dependency beyond the
normal x64 glibc runtime; importing std.crypto or std.tls additionally
requires the OpenSSL 3 runtime package.
The current library contains 47 source modules, byte-for-byte identical in both compiler repositories:
- Core:
std.core,std.assert,std.test,std.array,std.sort,std.math,std.random,std.fmt - Text and bytes:
std.string,std.string_builder,std.bytes,std.encoding.hex,std.encoding.base64 - System APIs:
std.platform,std.path,std.process,std.console,std.time,std.fs,std.io.file,std.net,std.uuidandstd.tls - Collections:
std.ds.list,std.ds.stack,std.ds.queue,std.ds.hashmap,std.ds.set - Concurrency:
std.threading,std.concurrent.thread_pool,std.concurrent.task,std.concurrent.cancellation,std.concurrent.channel,std.ds.concurrent_list,std.ds.concurrent_hashmap - Native primitives:
std.cpu,std.checksum.crc32c,std.checksum.crc32,std.crypto,std.crypto.aes_gcm,std.crypto._cng,std.crypto._openssl,std.tls._schannelandstd.tls._openssl(internal platform backends) - Compatibility helpers:
std.resultprovidesOptionandResult;std.concurrent.shared_valueprovides a legacy unmanaged snapshot codec;std._linux_fsis the internal POSIX filesystem backend.
std.io.file is the durable random-access API intended for databases and
servers: it provides positional reads/writes, truncation, flush, whole-file
advisory locks, atomic replacement and directory synchronization. std.tls
provides a built-in target-native Schannel/OpenSSL transport through
connect(socket, options) and accept(socket, options). The original
provider-neutral callback contract remains available for custom transports.
See Platform services for certificate references,
trust behavior, socket ownership and the native integration test.
Portable native sleep, socket and synchronization timeouts use the common
millisecond range 0..2147483647. std.time.sleep treats values outside that
range as a no-op; APIs returning a result reject them as documented.
New code should normally use native error(...) propagation with try(...)
instead of std.result.Result. Managed objects already share one process-wide
heap, so std.concurrent.shared_value is not needed for ordinary communication
between MiniLang threads.
Stdlib APIs that can fail (I/O, networking, parsing, ...) use MiniLang's native error(...) system. In practice this means a function either returns its normal value or an error value that automatically propagates unless you intercept it with try(...).
import std.fs as fs
w = try(fs.writeAllText("demo.txt", "hello\n"))
if typeof(w) == "error" then
print "write failed: " + w.message
end ifstd.test is the portable unit-test runtime. It is linked only into programs
which import it, so production executables have no test-framework overhead.
Assertions return MiniLang error values and therefore stop the current test
through normal error propagation while the runner catches the failure and
continues with the remaining cases.
Tests can be registered manually with test.Suite, or discovered without any
compiler extension. The mltest source tool reads explicit declaration
comments and generates a normal MiniLang entrypoint with explicit registrations:
package tests.math
import std.test as test
/// Verifies integer addition.
/// @testmethod addition
/// @category unit
/// @covers app.math.add
/// @timeout 1000
function additionWorks()
test.assertEqual(2 + 3, 5)
end functionDiscovery recognizes synchronous zero-argument top-level functions and
synchronous zero-argument static struct methods. The tagged declaration header
must keep its function name and parameter list on one line. Test source files
must declare a package. Supported metadata is
@testmethod, @beforeall, @afterall, @beforeeach, @aftereach,
@category, @covers, @timeout, and @skip. Tags remain ordinary
/// or /** ... */ documentation, so both compilers require no special
syntax or runtime reflection.
Run discovery, compilation, and execution on Windows:
.\scripts\run_mltest.ps1 -TestRoot .\tests\mltest_fixtureOn Linux:
bash ./scripts/run_mltest.sh tests/mltest_fixture --category unitThe generated executable accepts --filter TEXT, --category NAME,
--exclude-category NAME, --repeat N, --seed N, --fail-fast,
--list, and --quiet. Console output is the default; machine-readable
reports use --format json --output results.json or
--format junit --output results.xml. The exit code is 0 for a successful
run, 1 when any test failed, and 2 for invalid runner configuration. JSON and
JUnit reports retain discovered categories and coverage declarations. Listing
does not execute fixtures or test callbacks.
The assertion API includes assertTrue, assertFalse, assertEqual,
assertNotEqual, assertSame, assertNull, assertNotNull,
assertType, assertContains, assertApproxEqual, assertError,
assertErrorCode, and fail. Runs are deterministic and sequential;
--seed changes test order reproducibly. A positive @timeout executes that
case on a bounded test thread.
Length of arrays, strings, or bytes.
print len([1,2,3]) // 3
print len("abc") // 3
print len(bytes(4)) // 4Current runtime behavior: unsupported types return 0.
Creates an array with a fixed size and optional fill value.
a = array(5) // 5x void
b = array(5, 42) // 5x 42Invalid size (non-int, negative, or > 2147483647) returns a runtime error
(catchable via try(...)).
Reads one line from stdin.
name = input("Name: ")
print "Hello " + nameConverts string -> int/float (or returns numbers unchanged).
a = toNumber("123") // 123 (int)
b = toNumber("3.14") // 3.14 (float)
c = toNumber(10) // 10Current runtime behavior: invalid inputs return void.
Not allowed:
toNumber(true/false)toNumber(void)- non-parsable strings
Converts an int, float, or numeric string to a float. Invalid inputs return
void. Unlike toNumber, an integral input still produces a float.
print typeof(toFloat(2)) // "float"
print toFloat("3.5") // 3.5Converts a printable MiniLang value to a string. String concatenation uses the same conversion implicitly.
print str(123) // "123"
print str(true) // "true"Returns a string describing the type of x.
Type strings: int, float, bool, string, array, bytes, void,
function, enum, struct, error, thread, unknown.
print typeof(123) // "int"
print typeof("hi") // "string"
print typeof([1,2,3]) // "array"
// error values
err = error(2, "bad input")
print typeof(err) // "error"Returns a concrete type name for structs/enums.
- For struct instances (and struct constructor values), returns the struct name.
- For enum values, returns the enum name.
- For all other values, behaves like
typeof(x).
Note: typeof(x) intentionally stays coarse ("struct" / "enum") for backward compatibility.
struct Animal
name
end struct
enum Color
Red
end enum
a = Animal("Fay")
print typeof(a) // "struct"
print typeName(a) // "Animal"
print typeof(Color.Red) // "enum"
print typeName(Color.Red) // "Color"Constructs an error value (fields: .code and .message).
See Chapter 15 for full semantics (automatic propagation and try(...)).
Stops automatic error propagation for the given expression and returns either the normal value or the error value.
See Chapter 15 for full details.
File I/O is provided via the stdlib module std.fs (see "File I/O" below).
Creates a mutable bytes buffer.
-
bytes(size[, fill])andbyteBuffer(size[, fill])allocatesizebytes, filled withfill(default 0). -
bytes(...)supports additional forms:bytes()(empty),bytes(string)(UTF-8),bytes(array<int>), andbytes(bytes)(copy). -
byteBuffer(size)is a legacy alias (1 argument only). Usebytes(size[, fill])if you need a fill value.
buf = bytes(8)
print typeof(buf) // "bytes"
print len(buf) // 8
buf[0] = 255
print buf[0] // 255Decodes a byte buffer to a string.
- Expects a
bytesobject and decodes its complete payload as UTF-8. - If
encodingis provided it must be a string, but its content is currently ignored. Encodings other than UTF-8 are not implemented.
b = bytes(3)
b[0] = 65
b[1] = 66
b[2] = 67
print decode(b) // "ABC"
print decode(b, "utf-8") // "ABC"Decodes a bytes object as UTF-8, but stops at the first NUL byte (0x00).
Returns void on type errors.
Interprets a bytes object as UTF-16LE and stops at the first UTF-16 NUL (0x0000).
Returns void on type errors.
Typical use: converting wstr data coming from extern calls into a MiniLang string.
Encodes a bytes object as a lowercase hexadecimal string.
b = bytes(4)
b[0] = 0
b[1] = 17
b[2] = 170
b[3] = 255
print hex(b) // "0011aaff"Parses a hexadecimal string into a bytes object. Accepts an optional leading 0x / 0X prefix,
case-insensitive hex digits, and ignores common separators: spaces, tabs, newlines, _, -, :.
Current runtime behavior: invalid input returns void.
b = fromHex("00 11 aa ff")
print len(b) // 4
print hex(b) // "0011aaff"The stdlib module std.encoding.base64 provides Base64 encode/decode:
import std.encoding.base64 as b64
b = b64.fromBase64("SGVsbG8=") // bytes("Hello")
if typeof(b) == "bytes" then
print decode(b) // "Hello"
print b64.toBase64(b) // "SGVsbG8="
end ifNotes:
fromBase64(text)ignores whitespace and returnsbyteson success,voidon invalid input.toBase64(bytes)returns a string on success,voidon invalid args.
Returns a new bytes object containing a copy of length bytes starting at offset.
Rules:
offsetandlengthmust be integers.offsetmay be negative (like indexing):offset < 0meansoffset += len(bytes).- Bounds are strict (no clamping): requires
0 <= offset <= len(bytes)and0 <= lengthandoffset + length <= len(bytes). - On any type/bounds error, returns
void.
b = fromHex("00 11 22 33 44 55")
print hex(slice(b, 2, 3)) // "223344"
print hex(slice(b, -2, 2)) // "4455"Copies raw bytes from one bytes object into another.
Rules:
dstandsrcmust bebytes.dstOff,srcOff, andlenmust be non-negative integers.- The effective copy length is clamped to the remaining tail room of both buffers:
min(len, len(dst) - dstOff, len(src) - srcOff). - If an offset is already at or past the end of its buffer, or any argument is invalid, the call is a no-op and still returns
void. - Treat source/destination ranges as non-overlapping; overlap behavior is not guaranteed.
src = fromHex("00 11 22 33 44")
dst = bytes(5, 0)
copyBytes(dst, 1, src, 2, 3)
print hex(dst) // "0022334400"Copies tagged values between arrays in one native operation. The copy is shallow: strings, nested arrays, structs, and other managed objects remain the same shared objects.
Rules:
dstandsrcmust be arrays.dstOff,srcOff, andlenmust be non-negative integers.- The effective length is clamped to the remaining tail room of both arrays.
- Invalid arguments or offsets at/past an array end are a no-op.
- Treat source and destination ranges as non-overlapping; overlap behavior is not guaranteed.
src = [10, "twenty", true]
dst = array(5, 0)
copyArray(dst, 1, src, 0, len(src))
print dst // [0, 10, "twenty", true, 0]Fills a range inside a bytes object with a repeated byte value.
Rules:
dstmust bebytes.offandlenmust be non-negative integers.fillmust be an integer in the range0..255.- The effective fill length is clamped to the remaining tail room of
dst. - If
offis at/past the end, or any argument is invalid, the call is a no-op and still returnsvoid.
b = bytes(6, 0)
fillBytes(b, 2, 10, 0xAB)
print hex(b) // "0000abababab"The runtime also exposes the primitives used to implement std.string,
std.string_builder, std.bytes, and hash maps: stringHash, bytesHash,
stringSlice, stringIndexOf, stringLastIndexOf, stringStartsWith,
stringEndsWith, stringRepeat, the ASCII trim/case/reverse helpers,
stringEqualsIgnoreCaseAscii, stringJoin, bytesStartsWith, bytesEndsWith,
bytesIndexOf, bytesLastIndexOf, bytesCompare, and copyStringBytes.
Application code should normally prefer the checked wrappers in the
corresponding std.* modules.
The native runtime currently does not expose low-level file-handle builtins.
File I/O is provided by the standard library module std.fs, with convenience helpers like:
writeAllText,readAllText,readAllLines,appendAllTextwriteAllBytes,readAllBytesexists,delete,fileSize,copyFile,moveFile
Most functions that can fail return either their normal value or error(...).
A few APIs return plain bool (e.g. exists, delete).
Example:
import std.fs as fs
import std.string as s
p = "hello.txt"
chk = try(fs.writeAllText(p, "hello\nworld\n"))
if typeof(chk) != "error" then
r = try(fs.readAllText(p))
if typeof(r) != "error" and s.startsWith(r, "hello") then
print "ok"
end if
end ifThese builtins are intended for debugging and validating the generated runtime.
Returns the number of currently live heap blocks (objects that are not marked as free).
Returns the current bump pointer offset: heap_ptr - heap_base.
Note: after GC + optional shrink, heap_ptr may move backwards (trim-from-top).
Returns the currently committed heap bytes: heap_end - heap_base.
Returns the reserved heap address space: heap_reserve_end - heap_base.
Returns the total number of bytes in the free-list (sum of free blocks).
Returns the number of blocks currently in the free-list.
Runs the mark/sweep collector and returns void.
Sets the allocation threshold for the periodic GC trigger and returns
void.
- A positive integer enables periodic collection with that byte limit.
- Zero, a negative value, or a non-integer disables the periodic trigger.
- The allocation-failure/OOM retry collector remains enabled.
- The current periodic-allocation counter is reset when the limit changes.
- The calling thread's current TLAB is retired, so a new positive limit applies to its next allocation rather than its next buffer refill.
Notes (when does GC run?):
- The GC runs automatically when an allocation cannot be satisfied and the heap can't grow further; the runtime triggers a
fn_gc_collectonce and retries the allocation. - You can also trigger it manually via
gc_collect().
Notes:
- Small objects in threaded programs use 64 KiB TLABs; the whole refill is charged to periodic/young-allocation pressure once.
- The central allocator reuses freed blocks via a free-list and falls back to bump allocation.
- If the bump pointer would exceed the committed end, the runtime commits more pages (up to the reserved limit).
- If
--heap-shrinkis enabled, the runtime may decommit unused pages at the top of the heap after GC (trim-from-top).
When compiling with --profile-calls, the compiler instruments user functions with call counters.
At runtime you can query them via callStats().
stats = callStats()
if typeof(stats) == "array" then
for each s in stats
// each entry is a small struct-like record; print it to inspect fields
print s
end for
end ifNotes:
- Without
--profile-calls,callStats()is not meaningful (and may returnvoid). - Instrumentation adds overhead; use it for profiling/debugging, not for release benchmarking.
The native compiler generates Windows PE imports and library-specific,
runtime-resolved Linux ELF import slots from extern declarations.
Syntax:
extern function <Name>(<params...>) from "<library>" [symbol "<exportedName>"] [returns <type>]Parameter forms:
<type>(type-only)<name> as <type>(named, type-checked)out <type>/out <name> as <type>(experimental, see below)
Supported ABI types for direct-call inputs:
int/i64/u64/i32/u32doublebool(acceptsboolorintat the call site)ptr/pointer(accepts a native pointer value,int, orvoid;voidbecomesNULL)cstr/cstring(MiniLangstring->char*UTF-8;voidbecomesNULL)wstr/wstring(MiniLangstring->wchar_t*UTF-16LE;voidbecomesNULL)bytes/buffer/bytebuffer(MiniLangbytes-> pointer to its mutable payload;voidbecomesNULL)
Supported return types:
void/noneint/i64/u64/i32/u32ptr/pointerdoubleboolcstr(reads a NUL-terminatedchar*and converts to a MiniLangstring;NULL->void)wstr(reads a NUL-terminatedwchar_t*and converts to a MiniLangstring;NULL->void)
Notes:
- Arity mismatches are a compile error.
- Declarations that name the same physical library/symbol with incompatible integer/floating-point ABI classes are a compile error; compatible aliases are allowed.
- Type mismatches at runtime currently return
void(no exceptions yet). wstrarguments use a fixed temporary UTF-16 buffer. Very long strings may fail and returnvoid.- Windows imports are resolved by the PE loader, so a missing DLL or symbol
normally prevents startup. Linux preserves the exact
fromspelling, resolves it throughdlopen/dlsym, and returns a catchable MiniLang error when the library or symbol is unavailable. Lazy Linux resolution is claimed atomically, so concurrent first calls share one result; failed lookups are cached and a library opened for a missing symbol is closed immediately.
Example: MessageBox
extern function MessageBoxW(hwnd as ptr, text as wstr, caption as wstr, style as int)
from "user32.dll" symbol "MessageBoxW" returns int
MessageBoxW(void, "Hello from MiniLang!", "MiniLang", 0)Example: GetTickCount
extern function GetTickCount() from "kernel32.dll" returns u32
print GetTickCount()nativeBytesPtr(bytes) returns a native pointer to the payload of a MiniLang
bytes value. The result is represented as a MiniLang int so it can be passed
to ptr extern parameters or stored in native interop structures. For non-bytes
arguments it returns a null pointer value.
nativeRawValue(value) returns a MiniLang int containing the raw tagged
MiniLang value. nativeValueFromRaw(int) performs the inverse conversion.
These are low-level interop helpers for native APIs that store an opaque
application value and later return it unchanged.
nativeCallback(fn, "wndproc") returns a native Win64 callback pointer for a top-level MiniLang function.
The supported mode currently targets Win32 WNDPROC callbacks:
extern function CallWindowProcW(prev as ptr, hwnd as ptr, msg as u32, wParam as ptr, lParam as ptr) from "user32.dll" symbol "CallWindowProcW" returns ptr
function myWndProc(hwnd, msg, wParam, lParam)
return msg
end function
cb = nativeCallback(myWndProc, "wndproc")
print CallWindowProcW(cb, 0, 1024, 0, 0)Rules:
- The first argument must be a top-level MiniLang function.
"wndproc"callbacks must accept exactly four parameters:hwnd,msg,wParam,lParam.- The callback return value is converted back to native
LRESULT;intandboolare supported, other values return0.
The frontend also accepts extern struct declarations to describe an ABI layout:
extern struct POINT
x as i32
y as i32
end structLayouts use Win64 C-style sequential placement, natural field alignment and a
maximum alignment of eight bytes. Supported fields are i8/u8, i16/u16,
i32/u32, i64/u64, int, bool (Win32 BOOL) and ptr/pointer. Structs returned
through an implicit out parameter are copied into a normal GC-managed
MiniLang struct, so they remain valid after the native call returns. Automatic
managed-field marshaling currently supports int/i64/u64, i32/u32,
bool, and ptr; for layouts containing i8/u8 or i16/u16, pass
an explicit bytes buffer and decode those fields in MiniLang.
You can mark trailing parameters as out:
extern function GetCursorPos(out p as POINT) from "user32.dll" returns boolRules:
outparameters must appear at the end of the parameter list (so they can be implicitly handled at call sites).- A direct call may omit all trailing
outarguments. Storage is allocated in the current thread's stack frame and is therefore thread-safe and valid for the duration of the native call. - One omitted
outvalue becomes the call result. Multiple omitted values are returned as a MiniLang array in declaration order. - If such a call has native return type
bool, a false result becomes a catchable MiniLangerror; otherwise the native status/result is discarded in favor of the marshaled out value(s). - Full-arity calls remain accepted for backward compatibility. Automatic out allocation/marshaling is enabled by omission at a direct call site; indirect extern function values retain their declared full arity.
MiniLang uses error values for lightweight error handling (no exception mechanism).
An error is a normal value with:
.code(int).message(string)
Use the builtin error(code, message):
return error(2, "bad input")You can also construct and return errors from within helper functions and stdlib code.
If a function call evaluates to an error value, the caller will automatically return that error immediately (as if an implicit return <that error> happened).
This continues up the call stack until the error is handled or it reaches top-level.
function parseInt(s)
// ... on failure:
return error(100, "not a number")
end function
function loadConfig(path)
// If parseInt(...) returns an error, loadConfig(...) returns it automatically.
port = parseInt("oops")
return port
end function
// If unhandled, an error that reaches top-level terminates the program.
loadConfig("cfg.txt")Some builtins intentionally return void to indicate failure/absence, e.g.:
fromHex(str)slice(bytes, off, len)decode(bytes, encoding)
If you prefer strict behavior, use the stdlib wrappers that return error(...) instead:
std.encoding.hex.decodeOrError(s)std.bytes.fromHexOrError(s)std.bytes.subOrError(b, off, len)std.bytes.decodeUtf8OrError(b)
Use try(expr) to stop the automatic propagation and get back either the normal value or the error value.
try(...) is a special form (its argument is evaluated lazily so it can intercept the propagation).
e = try(loadConfig("cfg.txt"))
if typeof(e) == "error" then
print "config error: " + e.message
else
print "config ok, port=" + e
end ifTypical pattern:
- call with
try(...) - check
typeof(x) == "error" - handle / recover, or re-
return xto propagate manually
The toolchain reports errors with:
- filename
- line/column (when available)
- the relevant source line
- a
^marker (when available)
ParseError(syntax / parsing)
CompileError(code generation / backend validation)
Example (schematic):
ParseError: unexpected token
at main.ml:3:10
x = 5 / ?
^
#option NAME: bool|int|string = <compile-expression>#const NAME = <compile-expression>#if <bool-expression>/#elif/#else/#endif#error <string-expression>- CLI override:
-DNAME[=VALUE]or--define NAME[=VALUE]
Statements are separated by newlines or ;.
print <expr>const <ident> = <expr>(top-level/namespace requiresconstexpr)synchronized <ident> = <expr>(top-level/namespace shared binding)<lvalue> = <expr><ident> = ...<expr>.<field> = ...<expr>[<index>] = ...(multiline indexing allowed)
- compound variable assignment:
x += value,x -= value,x *= value,x /= value,x %= value,x &= value,x |= value,x ^= value,x <<= value, orx >>= value function name(a,b) ... end function(multiline params allowed, trailing comma optional)function name(a as int, b as string? = void, rest...) returns int ... end functionasync function name(...) ... end function/[lazy] iterator function name(...) ... end functioninterface Name ... end interface;struct Name implements Interface ... end structoperator [inline] <symbol>(typed operands) returns <type> ... end operator(inside a struct)function synchronized name(a,b) ... end function(process-wide recursive monitor)- optional entrypoint:
function main(args) ... end function return/return <expr>/return;(and barereturndirectly beforeend/else/casein inline blocks)defer <call-expression>(inside functions; LIFO cleanup on every function exit)global x, y, z(inside functions; trailing comma optional; names may be qualified likefoo.bar.x)if <expr> then ... end if(block or inline)while <expr> ... end whileloop ... while <expr> end loop(legacy:loop ... end loop while <expr>)for i = <expr> to <expr> ... end forfor each x in <expr> ... end forbreak/break <int>continueswitch <expr> ... end switchmatch <expr> ... end match(value/list/range/default cases)struct Name ... end struct(optional legacyareafter the name)enum Name ... end enum(optional legacyareafter the name; native supports optional= <constexpr>values)namespace Name ... end namespace(top-level or nested in namespaces; imported modules remain declaration-oriented, but top-level global assignments are allowed; native compiler)package foo.bar(top-level only; must be the first statement; native compiler)import "relative/or/absolute/path.ml" [as <alias>](top-level only; native compiler)import foo.bar [as <alias>](module-style import; resolves tofoo/bar.ml; native compiler)extern struct Name ... end struct(native compiler; experimental)extern function Name(...) from "dll" ...
- literals: number, string,
true/false,[ ... ](multiline + trailing comma allowed) - variable:
name - call:
f(a,b)orf(second = 2, first = 1)(multiline args + trailing comma allowed) - lambda:
function(x as int) returns int => x + 1 - optional access/fallback:
value?.member,value?.method(),left ?? fallback - async wait:
await handle; first completion:select(handle1, handle2) - native thread:
Thread(topLevelFunction); methodsStart,Stop,Join,Status,IsAlive,Id,Close - index:
arr[i] - member:
obj.field - unary:
+x,-x,not x,~x - binary:
+ - * / % == != > < >= <= and or - bitwise:
<< >> & | ^
Newlines are allowed after operators/unary operators and in common "list" positions (see 3.1).
for i = 1 to 30
if i % 15 == 0 then
print "FizzBuzz"
else if i % 3 == 0 then
print "Fizz"
else if i % 5 == 0 then
print "Buzz"
else
print i
end if
end forfunction sum(arr)
total = 0
for each x in arr
total = total + x
end for
return total
end function
nums = [1,2,3,4]
print sum(nums)struct User
name
role
end struct
u = User("Nina", "Admin")
switch u.role
case "Admin"
print u.name + " is admin"
end case
case default
print u.name + " is user"
end case
end switchenum Role
Admin
Guest
end enum
r = Role.Admin
print rThe native x64 backend generates deterministic Windows PE32+ images (console by default, optionally GUI) and deterministic Linux ELF64 images. The language runtime, global GC heap, TLAB allocator, native threads and synchronization are implemented on both targets.
What works:
- core types: int, float, bool, string, array, bytes, void
- control flow:
if/else,while,loop ... while ... end loop,for ... to,for each ... in,switch/case,break/break n,continue - LIFO deferred cleanup with
defer, including return/fall-through/error exits - bounded source-level
inlinefunctions with callable fallback bodies - first-class functions: user functions and many builtins are values; direct and indirect calls are supported
- gradual runtime-checked type contracts, optional values/access, default/named/variadic calls and expression lambdas
- value/range
match, eager/lazyiterator function/yield, structural compile-time interfaces and pooledasync/await/select - real native threads on Win32 and Linux with cooperative cancellation, data/result handoff,
native and logical ids, status/join APIs, private stacks, a process-wide
thread-safe GC heap, synchronized globals/functions, fine-grained
synchronized(lock)blocks and managed thread pools; Linux workers use pthread creation/join so libc TLS, malloc, synchronization and native providers remain valid on every worker - futures/tasks with cooperative cancellation, ordered/all-or-first completion helpers and bounded multi-producer/multi-consumer channels
- nested functions + closures (captured vars are boxed and stored in an environment frame)
main(args)entrypoint (argv[1..] asarray<string>,return int-> process exit code)globaldeclarations inside functions (required for accessing globals from a function; resolves to package/namespace-qualified globals; missing globals are auto-created asvoid)struct(constructors + field read/write)enum(values likeColor.Red, comparisons, printing,switch)namespaceblocks (compile-time name qualification)package+import(compile-time multi-file merge; imported modules support runtime-initialized globals, self-import ignore, and harmless import cycles)const(write-once bindings; top-level/namespace consts are evaluated at compile time)enumexplicit values (constexpr) + auto-increment for missing int valuesextern functionvia the PE import table (IAT) on Windows or ELF dynamic imports on Linux, ABI-layoutextern structand omitted trailingoutparameters; native Win64 callback pointers remain Windows-specific- TOML project manifests with conservative exact-hit artifact caching
- typed conditional compilation with CLI/project definitions and target values
- builtins / special forms:
len,input,toNumber,toFloat,str,typeof,typeName,error,try,array,bytes/byteBuffer,decode,decodeZ,decode16Z,hex,fromHex,slice,copyBytes,copyArray,fillBytes, native string/bytes helpers,Threadand its worker helpers,nativeBytesPtr,nativeRawValue,nativeValueFromRaw,nativeCallback, plus debug helpers:heap_count,heap_bytes_used,heap_bytes_committed,heap_bytes_reserved,heap_free_bytes,heap_free_blocks,gc_collect,gc_set_limit,callStats
Debugging / listings:
--asmwrites a combined.asmlisting--asm-peprepends a PE header + section table dump for Windows targets--asm-dataappends.rdata/.data/.idatadumps (useful to inspect constants and imports)
Heap sizing flags:
--heap-reserve <size>: reserved address space--heap-commit <size>: initial committed bytes--heap-grow <size>: minimum commit growth step--heap-shrink: enable decommit after GC (trim-from-top)--heap-shrink-min <size>: minimum committed heap when shrinking
Optimizations (always-on, conservative):
- Constant pooling: identical
.rdataconstants are stored once and referenced by multiple sites. - Bounded inlining with safe fallback bodies: eligible direct calls expand up to 4096 generated native bytes per callee; every function retains a normal callable body so imported aliases, data references and later calls remain valid.
- Local representation type flow: locals whose complete write set proves a
stable
int,float/number,bool, string, array, bytes or concrete struct representation bypass the corresponding dynamic dispatch. This includes direct tagged integer operations, numeric-only float arithmetic, bool conditions, fixed-offset struct fields and type-specialized indexing. Parameters, captured/boxed, synchronized, global or otherwise ambiguous values retain the generic checked path. Fallible division, modulo, shifts and byte-buffer construction receive facts only when their runtime validity is statically proven. - Known-receiver method devirtualization: a method call on a local whose
concrete struct type is proven becomes a direct call. Eligible
inlinemethods can then expand at the call site; ambiguous receivers retain the checked polymorphic inline-cache path. - Hot primitive register homes: up to two uniquely named
int/boollocals written inside loops are mirrored in nonvolatile XMM6/XMM7 registers. Their stack slots remain canonical for diagnostics and interop, and the full 128-bit caller register values are preserved according to the Win64 ABI. - Constant integer strength reduction: tagged additions/subtractions use immediates, constant multiplication uses zero/identity/negation/shift or immediate multiply forms, positive power-of-two modulo uses a mask, and constant shifts avoid the CL setup. Dynamic or otherwise unproven cases retain the generic checked code paths. Compile-time integer evaluation wraps after every operation to the signed 61-bit payload and masks nonnegative x64 shift counts exactly like generated code.
- Loop specialization and bounds-check elimination: small constant
forloops can be unrolled; larger constant-bound loops avoid dynamic end/direction state. For a fixed-length local array or bytes value, an inclusive range proven inside0..len(value)-1loads the container base once and removes the per-iteration target, index-tag and bounds checks. Negative or unproven indices retain normalization and full bounds validation. - GC-root liveness and prologues: expression roots are unpublished as soon as their lifetime ends, call spills are sized to actual arity, and tiny root frames use straight-line initialization.
- Thread-local allocation buffers: small managed objects use a lock-free per-thread cursor inside 64 KiB ranges of the shared heap. Refill, retirement, large objects and collection remain serialized and preserve one global object identity space.
- Branch/peephole optimization: resolved backward edges use x64 short branches when in range, jumps to the immediately following label disappear, and adjacent conditional/unconditional branch pairs become one inverted conditional branch when the first target is the fallthrough. Labels and intervening instructions prevent unsafe folding.
- Compact x64 encodings: accumulator-immediate opcodes, implicit-one shifts and safe 32-bit AND masks reduce actual machine-code size without packing the executable or removing runtime checks. Both native targets use the same encoding rules; defined arithmetic flags and full register results are preserved. See the size experiment.
- Helper pruning: only referenced
fn_*runtime helpers are emitted.
GC flags:
--gc-limit <size>overrides the periodic GC threshold (default:1min the current backend).--no-gc-periodicdisables periodic GC triggering (GC runs only on allocation failure / OOM path).
The standard library includes reusable CRC-32C/CRC-32, platform-native
cryptography, and CPU-dispatched byte/string search. Public wrappers live in
std.checksum.*, std.crypto, std.crypto.aes_gcm, and std.cpu;
checksum helpers and their lookup tables are emitted only when referenced,
while search accelerates the existing first-class string/bytes builtins.
CRC-32C uses SSE4.2 when available and a bit-identical software fallback. Search uses AVX2, SSE2, or scalar candidate scans while preserving byte-indexed string semantics. Cryptography is backed by Windows CNG or Linux OpenSSL 3 and includes AES-256-GCM, SHA-256/384, HMAC, HKDF, X25519, system CSPRNG, constant-time byte comparison, and best-effort secure erasure.
See the native primitives guide for API details,
polynomials, dispatch controls, and security assumptions. Focused tests live in
tests/checksum_runtime.ml, tests/crypto_cng.ml, and
tests/simd_search.ml; reproducible measurements live in benchmarks/.