From 000c4681e4b32a8662c4b333912e14541d59a97d Mon Sep 17 00:00:00 2001 From: pudepiedj Date: Wed, 4 Oct 2023 12:38:50 +0100 Subject: [PATCH] More LLM questions --- prompts/LLM-questions.txt | 11 ++++++++--- 1 file changed, 8 insertions(+), 3 deletions(-) diff --git a/prompts/LLM-questions.txt b/prompts/LLM-questions.txt index 79fa98855..36a2533bf 100644 --- a/prompts/LLM-questions.txt +++ b/prompts/LLM-questions.txt @@ -8,7 +8,7 @@ In the context of LLMs, what is decoding? In the context of LLMs, what is encoding? In the context of LLMs, what is tokenizing? In the context of LLMs, what is an embedding? -In the context of LLMs, what is an quantization? +In the context of LLMs, what is quantization? In the context of LLMs, what is a tensor? In the context of LLMs, what is a sparse tensor? In the context of LLMs, what is a vector? @@ -25,7 +25,7 @@ In the context of neural nets, what is cross-entropy? In the context of neural nets, what is over-fitting? In the context of neural nets, what is under-fitting? What is the difference between an interpreted computer language and a compiled computer language? -What is a debugger? +In the context of software development, what is a debugger? When processing using a GPU, what is off-loading? When processing using a GPU, what is a batch? When processing using a GPU, what is a block? @@ -36,4 +36,9 @@ When processing using a GPU, what is a cache? When processing using a GPU, what is unified memory? When processing using a GPU, what is VRAM? When processing using a GPU, what is a kernel? -When processing using a GPU, what is "metal"? \ No newline at end of file +When processing using a GPU, what is "metal"? +In the context of LLMs, what are "Zero-Shot", "One-Shot" and "Few-Shot" learning models? +In the context of LLMs, what is the "Transformer-model" architecture? +In the context of LLMs, what is "Multi-Head Attention"? +In the context of LLMs, what is "Self-Attention"? +In the context of transformer-model architectures, how do attention mechanisms use masks? \ No newline at end of file