Llama-3.1-8B-Instruct-FastDraft-150M-int8-ov is now available on Ollama
Llama-3.1-8B-Instruct-FastDraft-150M-int8-ov is now available through local Ollama runtime. 8K context window listed. Meta Llama 3: The most capable openly available LLM to date
View source