2021-02-04 11:30:47 +00:00
|
|
|
|
![Cosmopolitan Honeybadger](usr/share/img/honeybadger.png)
|
|
|
|
|
|
2022-06-23 20:22:28 +00:00
|
|
|
|
[![build](https://github.com/jart/cosmopolitan/actions/workflows/build.yml/badge.svg)](https://github.com/jart/cosmopolitan/actions/workflows/build.yml)
|
2020-06-15 14:18:57 +00:00
|
|
|
|
# Cosmopolitan
|
|
|
|
|
|
2021-01-29 00:19:10 +00:00
|
|
|
|
[Cosmopolitan Libc](https://justine.lol/cosmopolitan/index.html) makes C
|
|
|
|
|
a build-once run-anywhere language, like Java, except it doesn't need an
|
2021-02-08 17:19:00 +00:00
|
|
|
|
interpreter or virtual machine. Instead, it reconfigures stock GCC and
|
|
|
|
|
Clang to output a POSIX-approved polyglot format that runs natively on
|
|
|
|
|
Linux + Mac + Windows + FreeBSD + OpenBSD + NetBSD + BIOS with the best
|
|
|
|
|
possible performance and the tiniest footprint imaginable.
|
2021-01-29 00:19:10 +00:00
|
|
|
|
|
|
|
|
|
## Background
|
|
|
|
|
|
|
|
|
|
For an introduction to this project, please read the [αcτµαlly pδrταblε
|
|
|
|
|
εxεcµταblε](https://justine.lol/ape.html) blog post and [cosmopolitan
|
|
|
|
|
libc](https://justine.lol/cosmopolitan/index.html) website. We also have
|
|
|
|
|
[API documentation](https://justine.lol/cosmopolitan/documentation.html).
|
|
|
|
|
|
|
|
|
|
## Getting Started
|
|
|
|
|
|
2021-02-08 17:19:00 +00:00
|
|
|
|
If you're doing your development work on Linux or BSD then you need just
|
2021-03-04 15:54:41 +00:00
|
|
|
|
five files to get started. Here's what you do on Linux:
|
2021-01-29 00:19:10 +00:00
|
|
|
|
|
|
|
|
|
```sh
|
2022-08-22 01:59:20 +00:00
|
|
|
|
wget https://justine.lol/cosmopolitan/cosmopolitan-amalgamation-2.0.1.zip
|
|
|
|
|
unzip cosmopolitan-amalgamation-2.0.1.zip
|
2021-02-19 00:32:31 +00:00
|
|
|
|
printf 'main() { printf("hello world\\n"); }\n' >hello.c
|
2021-03-04 14:13:32 +00:00
|
|
|
|
gcc -g -Os -static -nostdlib -nostdinc -fno-pie -no-pie -mno-red-zone \
|
2022-09-13 11:14:20 +00:00
|
|
|
|
-fno-omit-frame-pointer -pg -mnop-mcount -mno-tls-direct-seg-refs -gdwarf-4 \
|
2022-08-19 01:22:16 +00:00
|
|
|
|
-o hello.com.dbg hello.c -fuse-ld=bfd -Wl,-T,ape.lds -Wl,--gc-sections \
|
2022-05-24 17:19:39 +00:00
|
|
|
|
-include cosmopolitan.h crt.o ape-no-modify-self.o cosmopolitan.a
|
2021-02-08 17:19:00 +00:00
|
|
|
|
objcopy -S -O binary hello.com.dbg hello.com
|
2021-03-04 15:54:41 +00:00
|
|
|
|
```
|
|
|
|
|
|
2022-05-24 17:19:39 +00:00
|
|
|
|
You now have a portable program.
|
2021-03-04 15:54:41 +00:00
|
|
|
|
|
|
|
|
|
```sh
|
2021-02-08 17:19:00 +00:00
|
|
|
|
./hello.com
|
2022-05-24 17:19:39 +00:00
|
|
|
|
bash -c './hello.com' # zsh/fish workaround (we patched them in 2021)
|
2021-02-08 17:19:00 +00:00
|
|
|
|
```
|
|
|
|
|
|
2022-09-04 07:09:24 +00:00
|
|
|
|
If `./hello.com` executed on Linux throws an error about not finding an
|
|
|
|
|
interpreter, it should be fixed by running the following command (although
|
|
|
|
|
note that it may not survive a system restart):
|
|
|
|
|
|
|
|
|
|
```sh
|
|
|
|
|
sudo sh -c "echo ':APE:M::MZqFpD::/bin/sh:' >/proc/sys/fs/binfmt_misc/register"
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
If the same command produces puzzling errors on WSL or WINE when using
|
|
|
|
|
Redbean 2.x, they may be fixed by disabling binfmt_misc:
|
|
|
|
|
|
|
|
|
|
```sh
|
|
|
|
|
sudo sh -c 'echo -1 >/proc/sys/fs/binfmt_misc/status'
|
|
|
|
|
```
|
|
|
|
|
|
2022-05-24 17:19:39 +00:00
|
|
|
|
Since we used the `ape-no-modify-self.o` bootloader (rather than
|
|
|
|
|
`ape.o`) your executable will not modify itself when it's run. What
|
2022-06-26 01:17:31 +00:00
|
|
|
|
it'll instead do, is extract a 4kb program to `${TMPDIR:-${HOME:-.}}`
|
|
|
|
|
that maps your program into memory without needing to copy it. It's
|
|
|
|
|
possible to install the APE loader systemwide as follows.
|
2022-05-24 17:19:39 +00:00
|
|
|
|
|
|
|
|
|
```sh
|
2022-07-10 21:13:45 +00:00
|
|
|
|
# System-Wide APE Install
|
|
|
|
|
# for Linux, Darwin, and BSDs
|
|
|
|
|
# 1. Copies APE Loader to /usr/bin/ape
|
|
|
|
|
# 2. Registers w/ binfmt_misc too if Linux
|
2022-05-24 17:19:39 +00:00
|
|
|
|
ape/apeinstall.sh
|
|
|
|
|
|
2022-07-10 21:13:45 +00:00
|
|
|
|
# System-Wide APE Uninstall
|
|
|
|
|
# for Linux, Darwin, and BSDs
|
|
|
|
|
ape/apeuninstall.sh
|
2022-05-24 17:19:39 +00:00
|
|
|
|
```
|
|
|
|
|
|
2022-07-10 21:13:45 +00:00
|
|
|
|
It's also possible to convert APE binaries into the system-local format
|
2022-07-16 17:56:10 +00:00
|
|
|
|
by using the `--assimilate` flag. Please note that if binfmt_misc is in
|
2022-07-10 21:13:45 +00:00
|
|
|
|
play, you'll need to unregister it temporarily before doing this, since
|
|
|
|
|
the assimilate feature is part of the shell script header.
|
2022-05-24 17:19:39 +00:00
|
|
|
|
|
|
|
|
|
```sh
|
2022-05-25 18:31:08 +00:00
|
|
|
|
$ file hello.com
|
|
|
|
|
hello.com: DOS/MBR boot sector
|
2022-05-24 17:19:39 +00:00
|
|
|
|
./hello.com --assimilate
|
2022-05-25 18:31:08 +00:00
|
|
|
|
$ file hello.com
|
|
|
|
|
hello.com: ELF 64-bit LSB executable
|
2022-05-24 17:19:39 +00:00
|
|
|
|
```
|
|
|
|
|
|
2022-07-10 21:13:45 +00:00
|
|
|
|
Now that you're up and running with Cosmopolitan Libc and APE, here's
|
|
|
|
|
some of the most important troubleshooting tools APE offers that you
|
|
|
|
|
should know, in case you encounter any issues:
|
2022-05-24 17:19:39 +00:00
|
|
|
|
|
|
|
|
|
```sh
|
2022-05-25 18:31:08 +00:00
|
|
|
|
./hello.com --strace # log system calls to stderr
|
|
|
|
|
./hello.com --ftrace # log function calls to stderr
|
2022-05-24 17:19:39 +00:00
|
|
|
|
```
|
|
|
|
|
|
2022-07-10 21:13:45 +00:00
|
|
|
|
Do you love tiny binaries? If so, you may not be happy with Cosmo adding
|
|
|
|
|
heavyweight features like tracing to your binaries by default. In that
|
|
|
|
|
case, you may want to consider using our build system:
|
|
|
|
|
|
|
|
|
|
```sh
|
2022-09-13 11:14:20 +00:00
|
|
|
|
make m=tiny
|
2022-07-10 21:13:45 +00:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Which will cause programs such as `hello.com` and `life.com` to shrink
|
|
|
|
|
from 60kb in size to about 16kb. There's also a prebuilt amalgamation
|
|
|
|
|
online <https://justine.lol/cosmopolitan/cosmopolitan-tiny.zip> hosted
|
|
|
|
|
on our download page <https://justine.lol/cosmopolitan/download.html>.
|
2021-03-04 15:54:41 +00:00
|
|
|
|
|
2021-05-07 14:52:32 +00:00
|
|
|
|
### MacOS
|
|
|
|
|
|
|
|
|
|
If you're developing on MacOS you can install the GNU compiler
|
|
|
|
|
collection for x86_64-elf via homebrew:
|
|
|
|
|
|
|
|
|
|
```sh
|
|
|
|
|
brew install x86_64-elf-gcc
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Then in the above scripts just replace `gcc` and `objcopy` with
|
|
|
|
|
`x86_64-elf-gcc` and `x86_64-elf-objcopy` to compile your APE binary.
|
|
|
|
|
|
|
|
|
|
### Windows
|
|
|
|
|
|
|
|
|
|
If you're developing on Windows then you need to download an
|
2021-02-08 17:19:00 +00:00
|
|
|
|
x86_64-pc-linux-gnu toolchain beforehand. See the [Compiling on
|
|
|
|
|
Windows](https://justine.lol/cosmopolitan/windows-compiling.html)
|
|
|
|
|
tutorial. It's needed because the ELF object format is what makes
|
|
|
|
|
universal binaries possible.
|
|
|
|
|
|
2022-05-25 18:31:08 +00:00
|
|
|
|
Cosmopolitan officially only builds on Linux. However, one highly
|
|
|
|
|
experimental (and currently broken) thing you could try, is building the
|
|
|
|
|
entire cosmo repository from source using the cross9 toolchain.
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
mkdir -p o/third_party
|
|
|
|
|
rm -rf o/third_party/gcc
|
|
|
|
|
wget https://justine.lol/linux-compiler-on-windows/cross9.zip
|
|
|
|
|
unzip cross9.zip
|
|
|
|
|
mv cross9 o/third_party/gcc
|
|
|
|
|
build/bootstrap/make.com
|
|
|
|
|
```
|
|
|
|
|
|
2021-05-07 14:52:32 +00:00
|
|
|
|
## Source Builds
|
|
|
|
|
|
2022-05-25 18:31:08 +00:00
|
|
|
|
Cosmopolitan can be compiled from source on any Linux distro. First, you
|
|
|
|
|
need to download or clone the repository.
|
2021-02-08 17:19:00 +00:00
|
|
|
|
|
|
|
|
|
```sh
|
2022-04-06 20:07:51 +00:00
|
|
|
|
wget https://justine.lol/cosmopolitan/cosmopolitan.tar.gz
|
|
|
|
|
tar xf cosmopolitan.tar.gz # see releases page
|
2021-03-29 10:15:30 +00:00
|
|
|
|
cd cosmopolitan
|
2022-05-25 18:31:08 +00:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
This will build the entire repository and run all the tests:
|
|
|
|
|
|
|
|
|
|
```sh
|
2022-09-13 11:14:20 +00:00
|
|
|
|
build/bootstrap/make.com
|
2021-01-29 00:19:10 +00:00
|
|
|
|
o//examples/hello.com
|
2021-02-07 14:11:44 +00:00
|
|
|
|
find o -name \*.com | xargs ls -rShal | less
|
2021-01-29 00:19:10 +00:00
|
|
|
|
```
|
2021-03-01 00:40:36 +00:00
|
|
|
|
|
2022-05-25 18:31:08 +00:00
|
|
|
|
If you get an error running make.com then it's probably because you have
|
|
|
|
|
WINE installed to `binfmt_misc`. You can fix that by installing the the
|
|
|
|
|
APE loader as an interpreter. It'll improve build performance too!
|
|
|
|
|
|
|
|
|
|
```sh
|
|
|
|
|
ape/apeinstall.sh
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Since the Cosmopolitan repository is very large, you might only want to
|
|
|
|
|
build a particular thing. Cosmopolitan's build config does a good job at
|
|
|
|
|
having minimal deterministic builds. For example, if you wanted to build
|
|
|
|
|
only hello.com then you could do that as follows:
|
|
|
|
|
|
|
|
|
|
```sh
|
2022-09-13 11:14:20 +00:00
|
|
|
|
build/bootstrap/make.com o//examples/hello.com
|
2022-05-25 18:31:08 +00:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Sometimes it's desirable to build a subset of targets, without having to
|
|
|
|
|
list out each individual one. You can do that by asking make to build a
|
|
|
|
|
directory name. For example, if you wanted to build only the targets and
|
|
|
|
|
subtargets of the chibicc package including its tests, you would say:
|
|
|
|
|
|
|
|
|
|
```sh
|
2022-09-13 11:14:20 +00:00
|
|
|
|
build/bootstrap/make.com o//third_party/chibicc
|
2022-05-25 18:31:08 +00:00
|
|
|
|
o//third_party/chibicc/chibicc.com --help
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Cosmopolitan provides a variety of build modes. For example, if you want
|
|
|
|
|
really tiny binaries (as small as 12kb in size) then you'd say:
|
|
|
|
|
|
|
|
|
|
```sh
|
2022-09-13 11:14:20 +00:00
|
|
|
|
build/bootstrap/make.com m=tiny
|
2022-05-25 18:31:08 +00:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
Here's some other build modes you can try:
|
|
|
|
|
|
|
|
|
|
```sh
|
2022-09-13 11:14:20 +00:00
|
|
|
|
build/bootstrap/make.com m=dbg # asan + ubsan + debug
|
|
|
|
|
build/bootstrap/make.com m=asan # production memory safety
|
|
|
|
|
build/bootstrap/make.com m=opt # -march=native optimizations
|
|
|
|
|
build/bootstrap/make.com m=rel # traditional release binaries
|
|
|
|
|
build/bootstrap/make.com m=optlinux # optimal linux-only performance
|
|
|
|
|
build/bootstrap/make.com m=fastbuild # build 28% faster w/o debugging
|
|
|
|
|
build/bootstrap/make.com m=tinylinux # tiniest linux-only 4kb binaries
|
2022-05-25 18:31:08 +00:00
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
For further details, see [//build/config.mk](build/config.mk).
|
|
|
|
|
|
2022-04-17 19:25:10 +00:00
|
|
|
|
## GDB
|
|
|
|
|
|
|
|
|
|
Here's the recommended `~/.gdbinit` config:
|
|
|
|
|
|
2022-09-04 05:19:55 +00:00
|
|
|
|
```gdb
|
2022-04-17 19:25:10 +00:00
|
|
|
|
set host-charset UTF-8
|
|
|
|
|
set target-charset UTF-8
|
|
|
|
|
set target-wide-charset UTF-8
|
|
|
|
|
set osabi none
|
|
|
|
|
set complaints 0
|
|
|
|
|
set confirm off
|
|
|
|
|
set history save on
|
|
|
|
|
set history filename ~/.gdb_history
|
|
|
|
|
define asm
|
|
|
|
|
layout asm
|
|
|
|
|
layout reg
|
|
|
|
|
end
|
|
|
|
|
define src
|
|
|
|
|
layout src
|
|
|
|
|
layout reg
|
|
|
|
|
end
|
|
|
|
|
src
|
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
You normally run the `.com.dbg` file under gdb. If you need to debug the
|
|
|
|
|
`.com` file itself, then you can load the debug symbols independently as
|
|
|
|
|
|
|
|
|
|
```
|
|
|
|
|
gdb foo.com -ex 'add-symbol-file foo.com.dbg 0x401000'
|
|
|
|
|
```
|
|
|
|
|
|
2021-03-01 00:40:36 +00:00
|
|
|
|
## Support Vector
|
|
|
|
|
|
2021-03-04 14:13:32 +00:00
|
|
|
|
| Platform | Min Version | Circa |
|
|
|
|
|
| :--- | ---: | ---: |
|
|
|
|
|
| AMD | K8 Venus | 2005 |
|
|
|
|
|
| Intel | Core | 2006 |
|
2022-07-19 23:05:19 +00:00
|
|
|
|
| Linux | 2.6.18 | 2007 |
|
2022-09-15 10:49:34 +00:00
|
|
|
|
| Windows | 8 | 2012 |
|
2022-07-19 23:05:19 +00:00
|
|
|
|
| Mac OS X | 15.6 | 2018 |
|
2021-03-04 14:13:32 +00:00
|
|
|
|
| OpenBSD | 6.4 | 2018 |
|
2022-09-15 10:49:34 +00:00
|
|
|
|
| FreeBSD | 13 | 2020 |
|
2022-06-11 16:27:14 +00:00
|
|
|
|
| NetBSD | 9.2 | 2021 |
|
2022-06-22 11:35:43 +00:00
|
|
|
|
|
|
|
|
|
## Special Thanks
|
|
|
|
|
|
|
|
|
|
Funding for this project is crowdsourced using
|
|
|
|
|
[GitHub Sponsors](https://github.com/sponsors/jart) and
|
|
|
|
|
[Patreon](https://www.patreon.com/jart). Your support is what makes this
|
|
|
|
|
project possible. Thank you! We'd also like to give special thanks to
|
|
|
|
|
the following individuals:
|
|
|
|
|
|
|
|
|
|
- [Joe Drumgoole](https://github.com/jdrumgoole)
|
|
|
|
|
|
|
|
|
|
For publicly sponsoring our work at the highest tier.
|