AI Dev Reads
AI engineering posts picked from company and developer tech blogs such as Toss, LINE, Anthropic and OpenAI, each with a short summary. Tap to read the original.
Last searched Oct 19, 7:44 PM KST
Anthropic EngineeringAdded Oct 19
Redesigning source control for always-on agents (Anthropic)
As daily merges grew from about 2,500 in May to over 30,000 by September, Anthropic replaced git for its monorepo with Scion, an in-house system that keeps commits, merges and history on the server and fetches only needed files. It uses about 200x less CPU and memory than the old git mirrors and checkouts dropped from minutes to seconds. Anthropic says it isn't a general-purpose git replacement.
Infra & servingAgents
토스 테크Added Oct 19
Building an AI platform so service teams can focus on product (Toss)
Toss's AI platform team pulled model integration, permissions, usage tracking and incident response out of individual service teams into one platform: a request portal, a model gateway, an MCP gateway for internal tools, input guardrails, Langfuse tracing and a CLI, applied by data tier (L1–L4) and SLA tier.
Infra & servingCase studies
Squeezing every CPU cycle and building a Milvus sizing rule (Toss)
Toss Securities' data infra team tuned Milvus for vector search: HNSW_SQ8 hit 316 QPS at recall@10 0.954 while cutting per-replica memory from about 335GB to 114GB, and pinning CPU and memory to the same NUMA node added 41% more QPS. They turned the measurements into a rule for how many servers to provision.
Infra & servingCase studies