source | all versions | oilshell.org

Oil 0.8.pre9

This is the home page for version 0.8.pre9 of Oil, a Unix shell. To use it,

1. Download a source tarball.
2. Build and install it, as described in INSTALL.

These steps take 30 to 60 seconds on most machines. After that, you can assemble an oshrc file, which is described in the manual.

Test results, metrics, and benchmarks are shown below.

Download

Note: oil-native is a preview release, not a working shell.

What's New

• Details are in the raw git change log. Not all changes affect the release tarball.
• I sometimes write a release announcement with a high-level description of changes.

Documentation

Oil has three major sources of docs:

• The Doc Overview links to all other docs, including the Manual and Oil Language Reference. It's work in progress. Up-to-date docs include:
  • INSTALL
  • OSH User Manual
  • Known Differences Between OSH and Other Shells
  • Egg Expressions (Oil Regexes)
  • JSON Support
  • Simple Word Evaluation
  • Quirks
  • Notes on OSH Architecture
• Online Help (incomplete). This document underlies the help builtin. It links to sections in the Help page.
• Github Wiki for oilshell/oil
  • The Oil Deployments wiki page has other ways of getting Oil. These versions may not be up-to-date.

Tests

Main Test Suites

• Spec Tests
  • Oil Language Features
  • OSH Survey. Test OSH with existing shells, and compare their behavior.
    • OSH in C++. Measuring the progress of Oil's C++ translation.
• Wild Tests. Parse and translate thousands of shell scripts with OSH.
• Unit Tests. Python unit test results.

Other Suites

• Gold Tests. Compare OSH against bash (using implicit assertions, no golden output.)
• osh2oil Tests. Test the conversion of OSH to Oil.
• parse-errors. A list of all parse errors.
  • parse-errors-oil-native. With the native binary.
• runtime-errors. A list of shell runtime errors.
• oil-runtime-errors. Oil language runtime errors.
• arena. Testing an invariant for the parser.
• osh-usage. Misc tests of the osh binary.
• oshc-deps. Tests for a subcommand in progress.
• opyc. Tests for the opyc tool.
• Smoosh test suite (from mgree/smoosh):
  • smoosh
  • smoosh-hang
• How many processes does Oil start compared to other shells?
  • syscall/by-code
  • syscall/by-input

Manual Tests

• [ ] Test build and install on OS X

Benchmarks

• OSH Parser Performance. How fast does OSH parse compared to other shells?
• OSH Runtime. How fast does OSH run shell scripts?
• OSH Compute Performance. How fast does it run small programs without I/O?
• Virtual Memory Baseline. How much memory do shells use at startup?
• OVM Build. How long does it take for end users to build Oil? How big is the resulting binary?

Metrics

• Lines of source, counted in different ways:
  • osh-cloc. OSH and common libraries, as measured by the cloc tool.
  • src. The whole Oil repo organized by type of source file.
  • oil-cpp. The C++ code in the oil-native tarball.
  • OPy. How much code is in the OPy toolchain?
• Lines of dependencies:
  • pydeps. Oil code plus the Python standard library.
  • nativedeps. Oil code plus a slice of CPython.
• Bytecode Metrics
  • overview - Compare OPy vs. CPython.
  • oil-with-opy - Oil compiled with OPy.
  • oil-with-cpython - Oil compiled with CPython (for comparison).
  • src-bin-ratio-with-opy - How big is the compiled output?
• OVM / CPython
  • overview - An analysis of GCC's compilation of OVM (a subset of CPython). Bloaty provides the underlying data.
  • cpython-defs/overview - We try to ship as little of CPython as possible, and this is what's left.
• oil-native. The future of Oil is pure native code.
  • overview - Binary code size reported by Bloaty.

Source Code

These files may help you understand how Oil is implemented, i.e. with domain-specific languages and code generation.

• _devbuild/gen/id.h. A list of language elements, used in the lexer and in multiple parsers and evaluators.
• The regex-based lexer uses two stages of code generation:
  • frontend/lexer_def.py
  • _devbuild/tmp/osh-lex.re2c.h
  • _devbuild/gen/osh-lex.h
• frontend/syntax.asdl. The syntax tree for OSH and Oil.
• oil_lang/grammar.pgen2. The expression grammar for Oil. In contrast, the OSH parsers are hand-written.

Also see the oilshell/oil repository.

OPy Tests

The OPy compiler is used to compile Oil to bytecode, but isn't itself part of the release.

• build-oil-repo
• test-gold
• regtest-compile
• regtest-verify-golden

Tree-shaking:

• Symbols in Oil
• Symbols in OPy