Search results

Compilation failed

Status: Open.

#285 In antirez/ds4;

· kekekekekeshi opened on May 29, 2026

cuda prefill failed on NVIDIA A100-SXM4-80GB during both inference and bench

Status: Open.

#284 In antirez/ds4;

· RedHeartSecretMan opened on May 29, 2026

Support for 2 GX10s cluster with 128GB each - support tensor parallelism

Status: Open.

#262 In antirez/ds4;

· rmunad opened on May 26, 2026

download_model.sh pro-imatrix --> error 400

Status: Open.

#249 In antirez/ds4;

· ivanfioravanti opened on May 25, 2026

ds4 / DGX Spark / MTP and Performance Improvements

cuda

speed

Status: Open.

#244 In antirez/ds4;

· TrevorS opened on May 25, 2026

ds4-agent: separate runtime asset root from workspace cwd

Status: Open.

#240 In antirez/ds4;

· dbader opened on May 24, 2026

support for vulkan backend

Status: Open.

#237 In antirez/ds4;

· khimaros opened on May 24, 2026

Supporting Q2 Q4 mixed model download & how to evaluate perf between it & Q2

Status: Open.

#226 In antirez/ds4;

· Flux159 opened on May 22, 2026

Shared Library Support

Status: Open.

#217 In antirez/ds4;

· neomantra opened on May 21, 2026

Return deepseek-chat in GET models

Status: Open.

#216 In antirez/ds4;

· 2xbass opened on May 21, 2026

Add support for structured outputs

Status: Open.

#210 In antirez/ds4;

· pminervini opened on May 20, 2026

Roadmap question: multi-session / concurrent multi-user inference support

ideas-to-explore

Status: Open.

#209 In antirez/ds4;

· AndreaSuriano96 opened on May 20, 2026