glm-4-9b-chat

ZCode now has 1 million users. As a thank-you to our community, we’ve reset usage limits for all GLM Coding Plan users. We’re also rolling out an update that helps turn long-horizon capabilities into

ZCode now has 1 million users. As a thank-you to our community, we’ve reset usage limits for all GLM Coding Plan users. We’re also rolling out an update that helps turn long-horizon capabilities into completed work: - More intelligence in real engineering workflows - 98% cache https://t.co/QT03v4lJVm

Overview - Z.AI DEVELOPER DOCUMENT home page

As models, contexts, and workloads grow, hidden assumptions in inference infrastructure can surface as output anomalies. Reliability requires more than throughput, latency, and availability. It also r

As models, contexts, and workloads grow, hidden assumptions in inference infrastructure can surface as output anomalies. Reliability requires more than throughput, latency, and availability. It also requires preserving the correctness of model state behind every generation.

After fixing correctness issues, we turned to the next bottleneck: Prefill throughput and GPU memory pressure in long-context Coding Agent serving. To address this, we introduced LayerSplit, a layer-w

After fixing correctness issues, we turned to the next bottleneck: Prefill throughput and GPU memory pressure in long-context Coding Agent serving. To address this, we introduced LayerSplit, a layer-wise KV Cache storage scheme. Instead of duplicating all layers on every GPU, https://t.co/OGptVovbtf

Fantastic to see GLM being applied to such fresh, dynamic scenarios.