AI Dev Impact Lab JA
← Topics ranking · 2026-08
GITHUB TOPIC

#attention-sinks

GitHub repositories that have self-applied the topic "attention-sinks" — a creator-tagged metadata that surfaces how AI projects describe themselves.

1
tagged repos
1
top 1 stars
1
with tool sigs
1
shown

REPOS Repos for #attention-sinks (top 1 by stars)

atandra2000/GPT-OSS-Lite

Faithful from-scratch PyTorch reproduction of OpenAI's GPT-OSS architecture (sliding/full attention alternation, learned attention sinks, YaRN 128K, top-2-of-8 MoE), scaled to Chinchilla-optimal 502M total / 247M active training on a single A100 80GB

Python ★ 1 AI 90 1 sig

RELATED Other topics · full topics ranking →

#claude-code

1,564

#ai-agents

1,160

#llm

1,071

#claude

943

#python

806

#ai

741

#developer-tools

728

#mcp

727

#codex

521

Aggregated by case-insensitive match against topics_json of each repo's latest content snapshot. methodology