vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
from http://github.com/ggerganov/llama.cpp.git
414 commits 380 branches 3056 tags 365 MiB
Find a file
ajasibley b45efa3239 Updated nix.shell 
Added install and setup for Cosmonic and its dependencies for Apple Silicon Macs and and Nvidia Jetsons.
2023-05-23 22:20:17 +00:00
ggreganov-llama.cpp fiat nexus ▦ 2023-04-20 22:38:56 +00:00
llama.cpp fiat nexus ▦ 2023-04-20 22:38:56 +00:00
myapp Added openssl to nix for cosmonic. 2023-05-18 00:07:39 +00:00
src fiat nexus ▦ 2023-04-20 22:38:56 +00:00
Cargo.lock fiat nexus ▦ 2023-04-20 22:38:56 +00:00
Cargo.toml fiat nexus ▦ 2023-04-20 22:38:56 +00:00
cosmo-overlay.nix Updated shell nix to install cosmo if not already installed. Added README and cleaned up repo. 2023-05-18 12:36:09 +00:00
README.md Update README.md 2023-05-18 12:39:44 +00:00
shell.nix Updated nix.shell 2023-05-23 22:20:17 +00:00
vespa-cli-overlay.nix Updated comments. 2023-05-17 21:19:50 +00:00

README.md

Start Vespa with Docker

docker run -it --platform=linux/amd64 --detach --name vespa --hostname vespa-container \ --publish 8080:8080 --publish 19071:19071 \ vespaengine/vespa

If you have issues starting cosmonic:

rustup default stable rustup target add wasm32-unknown-unknown

Cosmonic fails to launch server on macOS due to incorrect OpenSSL version

Cosmonic is unable to properly launch a server on macOS systems because the default OpenSSL version provided by the operating system is LibreSSL, which is incompatible with Cosmonic's requirements. The Cosmonic documentation suggests installing OpenSSL 1.1 using Homebrew (brew install openssl@1.1), which resolves the issue for installations managed by Homebrew. However, when attempting to use Nix to install the same package, the issue persists.

It is assumed that this problem occurs because Homebrew installs OpenSSL 1.1 as a "keg-only" package, avoiding symlinking it to avoid conflicts with macOS's LibreSSL dependencies. As a result, Cosmonic may be hard-coded to look for the OpenSSL installation in the Homebrew-specific directory, causing it to miss the Nix installation.

Steps to reproduce:

  1. Use macOS with the default LibreSSL version installed.
  2. Try to launch a Cosmonic server.
  3. Observe the server failing to start due to the incorrect OpenSSL version.
  4. Install OpenSSL 1.1 using Nix.
  5. Attempt to launch the Cosmonic server again.
  6. Observe the server still failing to start, even with the correct OpenSSL version installed via Nix.

Expected behavior:

Cosmonic should be able to detect and utilize the correct OpenSSL version installed via Nix, similar to how it works with Homebrew installations.

System information:

  • macOS version: (please provide your macOS version)
  • Cosmonic version: (please provide your Cosmonic version)
  • Nix version: (please provide your Nix version)

Possible solution:

Update Cosmonic to search for OpenSSL installations in common Nix paths, or provide a configuration option to specify the location of the OpenSSL installation.