All issues

Search results

SDPA fallback: sliding window doesn't reduce memory (full mask built regardless of window size)

Status: Open.

#825 In karpathy/nanochat;

· Qwertyemma opened on Aug 9, 2026

FA3 loader reports success on Blackwell (sm_120) then dies at first kernel launch

Status: Open.

#820 In karpathy/nanochat;

· carey-bunks opened on Aug 2, 2026

chat_rl: the sampled assistant_end token is masked out, so stopping is never reinforced

potential_bugNeeds investigation/confirmation whether or not it's a bugNeeds investigation/confirmation whether or not it's a bug

Status: Open.

#810 In karpathy/nanochat;

· devYRPauli opened on Jul 20, 2026

Add support for OpenCL (e.g., for the integrated AMD GPU)?

Status: Open.

#804 In karpathy/nanochat;

· virex-84 opened on Jul 10, 2026

TODO: hash for d34 model

docsImprovements or additions to documentationImprovements or additions to documentation

Status: Open.

#791 In karpathy/nanochat;

· svlandeg opened on Jun 26, 2026

Token smearing does not correctly handle chunked prefill / chunk inference (first token of a chunk misses its cross-chunk predecessor

potential_bugNeeds investigation/confirmation whether or not it's a bugNeeds investigation/confirmation whether or not it's a bug

Status: Open.

#756 In karpathy/nanochat;

· Libertax-coder opened on May 25, 2026

Flash Attention module has some improvements for better performance and error handling

Status: Open.

#752 In karpathy/nanochat;

· eeea2222 opened on May 15, 2026

Use Official PyTorch FA3 Builds

Status: Open.

#737 In karpathy/nanochat;

· varunneal opened on Apr 29, 2026

RTX 3050TI Not detecting m.get_device()

Status: Open.

#698 In karpathy/nanochat;

· the15thwiseone opened on Apr 12, 2026

[Bug] scripts/chat_sft.py produces loss: nan from step 00001 on small device-batch-size (≤8) due to fully-masked micro-batches

code robustness

Status: Open.

#590 In karpathy/nanochat;

· suraj-self opened on Mar 5, 2026

chat_cli.py: RuntimeError (1x0 matmul) when conversation history exceeds sequence_len

code robustness

Status: Open.

#581 In karpathy/nanochat;

· suraj-self opened on Mar 1, 2026

ZeroDivisionError in scaling law math when --target-param-data-ratio is set to 0

code robustness

Status: Open.

#578 In karpathy/nanochat;

· suraj-self opened on Feb 28, 2026