Find a file
Gavin Hayes a80eea78fe Squashed commit of the following:
commit d9e0429dec42bf786aa73a66c259c275be5a8de9
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:59 2022 -0400

    Revert "Don't relocate file descriptor memory"

    This reverts commit 3265324e00.

commit 22ce7f16eeb326408208fabee57eace63371352c
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:58 2022 -0400

    Revert "Make some minor touchups for nightlies"

    This reverts commit e9272f03fb.

commit 8ef0057111e955fa18f2cce77b36046fa96fdcd5
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:57 2022 -0400

    Revert "Tidy up the threading implementation"

    This reverts commit 155b378a39.

commit 7e99e6e08b14003df21d42bedf473219417d3610
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:56 2022 -0400

    Revert "Bare metal VGA: minor improvements (#608)"

    This reverts commit bae7367774.

commit cd184ff7fe4f8539a3928e8f2b8703e699c199e4
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:55 2022 -0400

    Revert "Rewrite recursive mutex code"

    This reverts commit cfcf5918bc.

commit 4aa26c44ee200ffbcb591b3145876095fa235bd3
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:54 2022 -0400

    Revert "Clean up the TLS code"

    This reverts commit 333768440c.

commit f8c989127c7b8821e2183858c321fcd54fc45ffe
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:52 2022 -0400

    Revert "Remove stdio lock macros from amalgamation"

    This reverts commit cdb2284f0d.

commit d10cd5c40f576a2dde8448338d2e9b3d88e160f8
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:50 2022 -0400

    Revert "Import nsync"

    This reverts commit 5dff63a31c.

commit 2a49d50c29f518367e0a51cb7a0a2b4b0a1679f0
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:49 2022 -0400

    Revert "Fix the build"

    This reverts commit 3de35e196c.

commit c258d09ee5a7f48cd3d0d71667aba6fa7ab0e9ee
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:49 2022 -0400

    Revert "Use *NSYNC for POSIX threads locking APIs"

    This reverts commit b5cb71ab84.

commit 43bf84f09737bf87d79c7650dde52e030556056d
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:48 2022 -0400

    Revert "Add *NSYNC mu_test"

    This reverts commit 9b89a7c51d.

commit 94a0e96d666f7cf2dd4af03b42516956908f4ad7
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:47 2022 -0400

    Revert "Don't pushpop in long mode without stack (#611)"

    This reverts commit 569c031934.

commit 55f9f15c8659f6956ac4c9e0334b7884f5ff1c01
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:46 2022 -0400

    Revert "Update redbean doc to correct return values (#610)"

    This reverts commit 55ddf73484.

commit 30865675f4c750d1fec64df9b7bf98e6132787a9
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:45 2022 -0400

    Revert "Left-align stub arguments to dd (fixes #374) (#598)"

    This reverts commit 0305194d98.

commit 01e8de146f8de3abb1fe8cf2c6e7054a68be411e
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:43 2022 -0400

    Revert "Add Vista branch to GitHub workflows"

    This reverts commit c03359c637.

commit 66966f8ae2d020e7c3e8f1ed20eddd9b155f9ac4
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:43 2022 -0400

    Revert "[WIP] Get bare metal working outside of an emulator (#609)"

    This reverts commit 116bda997e.

commit 9ab0952c35086ac6c3c1dc186ae9ff1f90d8d76c
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:41 2022 -0400

    Revert "Bare metal VGA: implement "status report" escape codes (#613)"

    This reverts commit c4eb701d56.

commit 86f6a61d16e2c896939f536119ba328c7220f1eb
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:38 2022 -0400

    Revert "Fix the build"

    This reverts commit 790c661317.

commit 92b09acf939fdd3c10a81d5dd212f76351f05451
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:37 2022 -0400

    Revert "Fix bug with sendfile() on XNU"

    This reverts commit 827f25f054.

commit 3a5b536995cf8c48fffd371097aae9dfbeeebb44
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:36 2022 -0400

    Revert "Fix preadv() and pwritev()"

    This reverts commit 050062bcbb.

commit 854ec3631f54d087797a67c8e86b7d2655bc1317
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:35 2022 -0400

    Revert "Fix POSIX advisory locks on Windows"

    This reverts commit a5fa90a21f.

commit 5cc1a788126b5b2b54656e0f4244a56596b59978
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:35 2022 -0400

    Revert "Fix F_DUPFD_CLOEXEC on some systems"

    This reverts commit c64e7eaf7c.

commit 0264d3b34dcf80b0d34d6f4ef100a0f8545047e0
Author: Gavin Hayes <gavin@computoid.com>
Date:   Wed Sep 21 22:41:33 2022 -0400

    Revert "Add README description for new vista branch"

    This reverts commit 30140812f0.
2022-09-21 22:43:07 -04:00
.github Squashed commit of the following: 2022-09-21 22:43:07 -04:00
.vscode Remove testonly keyword 2022-09-05 08:41:43 -07:00
ape Squashed commit of the following: 2022-09-21 22:43:07 -04:00
build Introduce MODE=fastbuild for 28% speedup 2022-09-09 08:59:59 -07:00
dsp Make SIG_DFL / SIG_IGN C++ compatible 2022-09-05 08:49:26 -07:00
examples Squashed commit of the following: 2022-09-21 22:43:07 -04:00
libc Squashed commit of the following: 2022-09-21 22:43:07 -04:00
net Release redbean 2.0.18 2022-09-04 06:57:59 -07:00
test Squashed commit of the following: 2022-09-21 22:43:07 -04:00
third_party Squashed commit of the following: 2022-09-21 22:43:07 -04:00
tool Squashed commit of the following: 2022-09-21 22:43:07 -04:00
usr/share Make improvements 2022-04-29 00:42:47 -07:00
.clang-format Add x86_64-linux-gnu emulator 2020-08-25 04:43:42 -07:00
.gitattributes Perform build and magnum tuning 2021-08-10 10:26:13 -07:00
.gitignore Reduce GNU Make latency 17% for cosmo 2022-08-19 15:29:24 -07:00
CONTRIBUTING.md Add CONTRIBUTING.md 2021-04-11 00:55:53 -07:00
LICENSE Add title to the LICENSE file 2021-02-27 13:25:59 -08:00
Makefile Squashed commit of the following: 2022-09-21 22:43:07 -04:00
README.md Squashed commit of the following: 2022-09-21 22:43:07 -04:00

Cosmopolitan Honeybadger

build

Cosmopolitan

Cosmopolitan Libc makes C a build-once run-anywhere language, like Java, except it doesn't need an interpreter or virtual machine. Instead, it reconfigures stock GCC and Clang to output a POSIX-approved polyglot format that runs natively on Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best possible performance and the tiniest footprint imaginable.

Background

For an introduction to this project, please read the αcτµαlly pδrταblε εxεcµταblε blog post and cosmopolitan libc website. We also have API documentation.

Getting Started

If you're doing your development work on Linux or BSD then you need just five files to get started. Here's what you do on Linux:

wget https://justine.lol/cosmopolitan/cosmopolitan-amalgamation-2.0.1.zip
unzip cosmopolitan-amalgamation-2.0.1.zip
printf 'main() { printf("hello world\\n"); }\n' >hello.c
gcc -g -Os -static -nostdlib -nostdinc -fno-pie -no-pie -mno-red-zone \
  -fno-omit-frame-pointer -pg -mnop-mcount -mno-tls-direct-seg-refs \
  -o hello.com.dbg hello.c -fuse-ld=bfd -Wl,-T,ape.lds -Wl,--gc-sections \
  -include cosmopolitan.h crt.o ape-no-modify-self.o cosmopolitan.a
objcopy -S -O binary hello.com.dbg hello.com

You now have a portable program.

./hello.com
bash -c './hello.com'  # zsh/fish workaround (we patched them in 2021)

If ./hello.com executed on Linux throws an error about not finding an interpreter, it should be fixed by running the following command (although note that it may not survive a system restart):

sudo sh -c "echo ':APE:M::MZqFpD::/bin/sh:' >/proc/sys/fs/binfmt_misc/register"

If the same command produces puzzling errors on WSL or WINE when using Redbean 2.x, they may be fixed by disabling binfmt_misc:

sudo sh -c 'echo -1 >/proc/sys/fs/binfmt_misc/status'

Since we used the ape-no-modify-self.o bootloader (rather than ape.o) your executable will not modify itself when it's run. What it'll instead do, is extract a 4kb program to ${TMPDIR:-${HOME:-.}} that maps your program into memory without needing to copy it. It's possible to install the APE loader systemwide as follows.

# System-Wide APE Install
# for Linux, Darwin, and BSDs
# 1. Copies APE Loader to /usr/bin/ape
# 2. Registers w/ binfmt_misc too if Linux
ape/apeinstall.sh

# System-Wide APE Uninstall
# for Linux, Darwin, and BSDs
ape/apeuninstall.sh

It's also possible to convert APE binaries into the system-local format by using the --assimilate flag. Please note that if binfmt_misc is in play, you'll need to unregister it temporarily before doing this, since the assimilate feature is part of the shell script header.

$ file hello.com
hello.com: DOS/MBR boot sector
./hello.com --assimilate
$ file hello.com
hello.com: ELF 64-bit LSB executable

Now that you're up and running with Cosmopolitan Libc and APE, here's some of the most important troubleshooting tools APE offers that you should know, in case you encounter any issues:

./hello.com --strace   # log system calls to stderr
./hello.com --ftrace   # log function calls to stderr

Do you love tiny binaries? If so, you may not be happy with Cosmo adding heavyweight features like tracing to your binaries by default. In that case, you may want to consider using our build system:

make -j8 MODE=tiny

Which will cause programs such as hello.com and life.com to shrink from 60kb in size to about 16kb. There's also a prebuilt amalgamation online https://justine.lol/cosmopolitan/cosmopolitan-tiny.zip hosted on our download page https://justine.lol/cosmopolitan/download.html.

MacOS

If you're developing on MacOS you can install the GNU compiler collection for x86_64-elf via homebrew:

brew install x86_64-elf-gcc

Then in the above scripts just replace gcc and objcopy with x86_64-elf-gcc and x86_64-elf-objcopy to compile your APE binary.

Windows

If you're developing on Windows then you need to download an x86_64-pc-linux-gnu toolchain beforehand. See the Compiling on Windows tutorial. It's needed because the ELF object format is what makes universal binaries possible.

Cosmopolitan officially only builds on Linux. However, one highly experimental (and currently broken) thing you could try, is building the entire cosmo repository from source using the cross9 toolchain.

mkdir -p o/third_party
rm -rf o/third_party/gcc
wget https://justine.lol/linux-compiler-on-windows/cross9.zip
unzip cross9.zip
mv cross9 o/third_party/gcc
build/bootstrap/make.com

Source Builds

Cosmopolitan can be compiled from source on any Linux distro. First, you need to download or clone the repository.

wget https://justine.lol/cosmopolitan/cosmopolitan.tar.gz
tar xf cosmopolitan.tar.gz  # see releases page
cd cosmopolitan

This will build the entire repository and run all the tests:

build/bootstrap/make.com -j16
o//examples/hello.com
find o -name \*.com | xargs ls -rShal | less

If you get an error running make.com then it's probably because you have WINE installed to binfmt_misc. You can fix that by installing the the APE loader as an interpreter. It'll improve build performance too!

ape/apeinstall.sh

Since the Cosmopolitan repository is very large, you might only want to build a particular thing. Cosmopolitan's build config does a good job at having minimal deterministic builds. For example, if you wanted to build only hello.com then you could do that as follows:

build/bootstrap/make.com -j16 o//examples/hello.com

Sometimes it's desirable to build a subset of targets, without having to list out each individual one. You can do that by asking make to build a directory name. For example, if you wanted to build only the targets and subtargets of the chibicc package including its tests, you would say:

build/bootstrap/make.com -j16 o//third_party/chibicc
o//third_party/chibicc/chibicc.com --help

Cosmopolitan provides a variety of build modes. For example, if you want really tiny binaries (as small as 12kb in size) then you'd say:

build/bootstrap/make.com -j16 MODE=tiny

Here's some other build modes you can try:

build/bootstrap/make.com -j16 MODE=dbg       # asan + ubsan + debug
build/bootstrap/make.com -j16 MODE=asan      # production memory safety
build/bootstrap/make.com -j16 MODE=opt       # -march=native optimizations
build/bootstrap/make.com -j16 MODE=rel       # traditional release binaries
build/bootstrap/make.com -j16 MODE=optlinux  # optimal linux-only performance
build/bootstrap/make.com -j16 MODE=tinylinux # tiniest linux-only 4kb binaries

For further details, see //build/config.mk.

GDB

Here's the recommended ~/.gdbinit config:

set host-charset UTF-8
set target-charset UTF-8
set target-wide-charset UTF-8
set osabi none
set complaints 0
set confirm off
set history save on
set history filename ~/.gdb_history
define asm
  layout asm
  layout reg
end
define src
  layout src
  layout reg
end
src

You normally run the .com.dbg file under gdb. If you need to debug the .com file itself, then you can load the debug symbols independently as

gdb foo.com -ex 'add-symbol-file foo.com.dbg 0x401000'

Support Vector

Platform Min Version Circa
AMD K8 Venus 2005
Intel Core 2006
Windows Vista 2006
Linux 2.6.18 2007
Mac OS X 15.6 2018
FreeBSD 13 2020
OpenBSD 6.4 2018
NetBSD 9.2 2021

Special Thanks

Funding for this project is crowdsourced using GitHub Sponsors and Patreon. Your support is what makes this project possible. Thank you! We'd also like to give special thanks to the following individuals:

For publicly sponsoring our work at the highest tier.