Penguin-VL-8B

Penguin-VL-8B is a open-weight tencent llm model with a 32,768 token context window.

Running this yourself: desktop gpu should be enough.