cosmopolitan/libc
Justine Tunney 00611e9b06 Improve ZIP filesystem and change its prefix
The ZIP filesystem has a breaking change. You now need to use /zip/ to
open() / opendir() / etc. assets within the ZIP structure of your APE
binary, instead of the previous convention of using zip: or zip! URIs.
This is needed because Python likes to use absolute paths, and having
ZIP paths encoded like URIs simply broke too many things.

Many more system calls have been updated to be able to operate on ZIP
files and file descriptors. In particular fcntl() and ioctl() since
Python would do things like ask if a ZIP file is a terminal and get
confused when the old implementation mistakenly said yes, because the
fastest way to guarantee native file descriptors is to dup(2). This
change also improves the async signal safety of zipos and ensures it
doesn't maintain any open file descriptors beyond that which the user
has opened.

This change makes a lot of progress towards adding magic numbers that
are specific to platforms other than Linux. The philosophy here is that,
if you use an operating system like FreeBSD, then you should be able to
take advantage of FreeBSD exclusive features, even if we don't polyfill
them on other platforms. For example, you can now open() a file with the
O_VERIFY flag. If your program runs on other platforms, then Cosmo will
automatically set O_VERIFY to zero. This lets you safely use it without
the need for #ifdef or ifstatements which detract from readability.

One of the blindspots of the ASAN memory hardening we use to offer Rust
like assurances has always been that memory passed to the kernel via
system calls (e.g. writev) can't be checked automatically since the
kernel wasn't built with MODE=asan. This change makes more progress
ensuring that each system call will verify the soundness of memory
before it's passed to the kernel. The code for doing these checks is
fast, particularly for buffers, where it can verify 64 bytes a cycle.

- Correct O_LOOP definition on NT
- Introduce program_executable_name
- Add ASAN guards to more system calls
- Improve termios compatibility with BSDs
- Fix bug in Windows auxiliary value encoding
- Add BSD and XNU specific errnos and open flags
- Add check to ensure build doesn't talk to internet
2021-08-22 01:11:53 -07:00
..
alg Make major improvements to redbean and libraries 2021-04-18 12:34:15 -07:00
bits Improve isystem includes and magic numbers 2021-08-14 23:36:36 -07:00
calls Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
crt Remove more nonstandard stuff from cosmopolitan.h 2021-03-01 00:18:23 -08:00
dns Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
elf Get codebase completely working with LLVM 2021-02-09 02:57:32 -08:00
fmt Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
integral Remove undefined behaviors 2021-05-16 11:16:28 -07:00
intrin Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
isystem Improve Libc by making Python work even better 2021-08-18 22:16:23 -07:00
linux Improve documentation 2020-12-27 07:02:35 -08:00
log Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
mem Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
nexgen32e Fix regression in _gclongjmp() 2021-08-19 09:34:24 -07:00
nt Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
ohmyplus Fix link order in cosmopolitan.a 2021-01-16 12:05:41 -08:00
rand Improve linenoise and get it working on Windows 2021-08-15 14:34:05 -07:00
runtime Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
sock Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
stdio Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
str Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
stubs Remove undefined behaviors 2021-05-16 11:16:28 -07:00
sysv Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
testlib Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
time Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
tinymath Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
unicode Fix issues with stdio needed for Lua 2021-03-06 19:04:26 -08:00
x Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
zipos Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
assert.h Define assert as an expression 2021-04-01 19:42:02 -07:00
complex.h Make improvements 2020-12-01 03:43:40 -08:00
dce.h Make redbean StoreAsset() work better 2021-05-14 05:44:37 -07:00
disclaimer.inc Improve Libc by making Python work even better 2021-08-18 22:16:23 -07:00
dos.h Mold the redbean binary to minimize page faults 2021-05-03 12:14:13 -07:00
errno.h Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
inttypes.h Initial import 2020-06-15 07:18:57 -07:00
libc.mk Make more functions friendly to Address Sanitizer 2021-02-02 03:45:31 -08:00
limits.h Remove nonstandard defines from limits.h (#115) 2021-03-08 17:34:44 -08:00
literal.h Initial import 2020-06-15 07:18:57 -07:00
mach.h Perform some minor fixups 2021-03-16 22:19:51 -07:00
macho.internal.h Get Cosmopolitan into releasable state 2020-11-25 08:19:00 -08:00
macros-cpp.internal.inc Get codebase completely working with LLVM 2021-02-09 02:57:32 -08:00
macros.internal.h Make redbean StoreAsset() work better 2021-05-14 05:44:37 -07:00
macros.internal.inc Improve signal handling and math 2021-02-25 18:33:33 -08:00
math.h Improve ZIP filesystem and change its prefix 2021-08-22 01:11:53 -07:00
notice.inc Improve Libc by making Python work even better 2021-08-18 22:16:23 -07:00
notice.internal.h Add epoll and do more release readiness changes 2020-11-28 12:01:51 -08:00
paths.h Initial import 2020-06-15 07:18:57 -07:00
README.md Add x86_64-linux-gnu emulator 2020-08-25 04:43:42 -07:00
zip.h Refactor out some duplicated code 2021-08-14 06:17:56 -07:00

SYNOPSIS

Cosmopolitan Standard Library.

OVERVIEW

This directory defines static archives defining functions, like printf(), mmap(), win32, etc. Please note that the Cosmopolitan build configuration doesn't link any C/C++ library dependencies by default, so you still have the flexibility to choose the one provided by your system. If you'd prefer Cosmopolitan, just add $(LIBC) and $(CRT) to your linker arguments.

Your library is compromised of many bite-sized static archives. We use the checkdeps tool to guarantee that the contents of the archives are organized in a logical way that's easy to use with or without our makefile infrastructure, since there's no cyclic dependencies.

The Cosmopolitan Library exports only the most stable canonical system calls for all supported operating systems, regardless of which platform is used for compilation. We polyfill many of the APIs, e.g. read(), write() so they work consistently everywhere while other apis, e.g. CreateWindowEx(), might only work on one platform, in which case they become no-op functions on others.

Cosmopolitan polyfill wrappers will usually use the dollar sign naming convention, so they may be bypassed when necessary. This same convention is used when multiple implementations of string library and other performance-critical function are provided to allow Cosmopolitan to go fast on both old and newer computers.

We take an approach to configuration that relies heavily on the compiler's dead code elimination pass (libc/dce.h). Most of the code is written so that, for example, folks not wanting support for OpenBSD can flip a bit in SUPPORT_VECTOR and that code will be omitted from the build. The same is true for builds that are tuned using -march=native which effectively asks the library to not include runtime support hooks for x86 processors older than what you use.

Please note that, unlike Cygwin or MinGW, Cosmopolitan does not achieve broad support by bolting on a POSIX emulation layer. We do nothing more than (in most cases) stateless API translations that get you 90% of the way there in a fast lightweight manner. We therefore can't address some of the subtle differences, such as the nuances of absolute paths on Windows. Our approach could be compared to something more along the lines of, "the Russians just used a pencil to write in space", versus spending millions researching a pen like NASA.