01 自动性能优化Automated performance engineering

把 GPU 的空转
变成吞吐量
Turn idle GPU
into throughput

提交一个仓库,几十分钟后拿回改好的代码和一个经过验证的加速比。训练衡量每步墙钟时间,推理衡量单位时间吞吐。 Submit a repo. Get back a mergeable diff and a verified speedup — measured as per-step wall clock for training, throughput for inference.

先报价再执行 · 未达到承诺加速比全额退回 credits Quoted before it runs · Credits refunded in full if the target speedup is missed

端到端加速比End-to-end speedup 1.00×
基线Baseline418 ms/step
优化后Optimised259 ms/step
train.py:142  数据加载等待dataloader stall34%1.42×
train.py:88  每步同步per-step sync9%1.09×
engine.py:57  启动开销startup overhead6%已回滚rolled back
本次扣费 3.66 credits · 未达标不扣 This run: 3.66 credits · nothing charged if it misses 查看 diffView diff
中位端到端加速比Median end-to-end speedup
跑通的真实开源项目Real OSS projects run
通过双门禁的比例Passed both gates
中位单次耗时Median wall clock per run

02 工作原理How it works

诊断是核心,验证是底线Diagnosis is the product. Verification is the floor.

修复手段本身是公开知识,就那十几种。门槛在两端:给定一份性能数据,判断该用哪一种、预期能拿到多少;以及事后证明改动既变快了,也没有改坏。 The fixes themselves are public knowledge — there are maybe fifteen of them. The hard parts are at either end: reading a profile and knowing which one applies and what it's worth, then proving afterwards that the change made it faster without breaking anything.

01 采集 / Collect 跑基线,记录性能数据 · profile the baseline 02  诊断 / Diagnose 定位瓶颈,估算收益 · rank by payoff 03  修改 / Modify 按诊断逐项执行 · agent applies each 04  验证 / Verify 双门禁,不过则回滚 · gated or reverted
01

采集Collect

复现环境、跑通基线、记录 CPU 与 CUDA 两条时间轴。不猜,只测。Reproduce the environment, run the baseline, record both the CPU and CUDA timelines. No guessing — only measurement.

02

诊断Diagnose

由确定性代码完成,不交给模型判断。输出瓶颈类型、源码位置、每项的预期收益上界。Done in deterministic code, not left to the model. Emits bottleneck class, source location, and an upper bound on the payoff of each.

03

修改Modify

agent 只拿到结论并执行,一次改一处,改完立刻过门禁。默认不碰数值精度。The agent receives conclusions only and executes them, one change at a time, each gated immediately. Numerical precision is never touched by default.

04

验证Verify

测量条件锁死,报告分布而不是单值。任一门禁失败,整个改动回滚并写进报告。Measurement conditions frozen; we report a distribution, not a single number. Either gate failing rolls the change back and writes up why.

03 双门禁Two gates

变快了,而且没改坏Faster — and provably not broken

候选改动 Candidate change 速度门 / Speed gate 快在诊断指出的那一处 · gain lands where predicted 质量门 / Quality gate 输出与轨迹一致 · outputs and trajectory unchanged 全过则保留 both pass → keep 任一失败回滚 either fails → roll back 进入下一处 / next 写入报告 / logged

速度门Speed gate

确认改动真的带来提升,并且提升来自诊断指出的那一处。快了但瓶颈没变,通常是噪声而不是成果。测量条件完全锁死,报告分布而不是单值。Confirms the change actually helped, and that the gain came from the place the diagnosis pointed at. Faster with the bottleneck unmoved is usually noise, not a result. Conditions are frozen and we report a distribution, never a single number.

质量门Quality gate

确认行为没有改变:输出一致、训练轨迹一致、资源占用不上升、结果可复现。任何一项不通过,整个改动回滚,并把原因写进报告。Confirms behaviour is unchanged: identical outputs, identical training trajectory, no rise in resource usage, reproducible results. Any failure rolls the whole change back and the reason goes in the report.

门禁的工程量必须大于优化本身。用户不会自己验证,出一次事故的代价远大于多拿几个点的加速。这也是最难被复制的部分——手段可以照抄,验证闭环需要时间和运行量才能磨出来。The gates must be more engineering than the optimisations are. Users won't verify for themselves, and one incident costs far more than a few extra points of speedup. It's also the hardest part to copy: the techniques are public, but the verification loop only comes from time and volume.

04 相关项目The landscape

所有人都在算子层,
没人在系统层
Everyone is at the kernel layer.
Nobody is at the systems layer.

维度Dimension 现有工具Existing tools AutoOptm
输入Input一个 nn.Module 的单次 forwardA single forward pass of one nn.Module整个仓库,含依赖、数据、启动脚本The whole repo — deps, data, launch scripts
输出Outputkernel 文件A kernel file可直接合并的 diffA mergeable diff
Profile只看 GPU kernelGPU kernels onlyCPU 与 CUDA 时间轴一起看CPU and CUDA timelines together
优化目标Objective单算子的 GPU 时间GPU time of one operator端到端墙钟或吞吐End-to-end wall clock or throughput
算子覆盖Operator coverageLLM 类算子,无卷积LLM operators; no convolution不限,因为不碰算子Unbounded — we don't touch operators

Amdahl 定律在它们那里只算 GPU kernel 时间。一个 GPU 利用率只有 40% 的训练循环,把所有算子优化到理论峰值,端到端也快不了多少。而这正是绝大多数真实开源项目的状态。For them, Amdahl's law only counts GPU kernel time. Take a training loop running at 40% GPU utilisation, optimise every operator to theoretical peak, and end-to-end barely moves. That 40% is the state of most real open-source projects.

05 定价Pricing

按实际消耗计费
先报价,后扣费
Metered on what it actually costs
Quoted first, charged after

每次优化真实消耗 GPU 分钟和 token,所以按量计费而不是固定月费。系统先给出预期加速比和 credit 报价,你确认后才开跑——达不到承诺,credits 全额退回账户。Every run burns real GPU minutes and real tokens, so it's metered, not a flat subscription. You get a projected speedup and a credit quote before anything runs. Miss the target and the credits go straight back to your balance.

Free
$0
5 credits / mo
  • 仅公开仓库Public repos only
  • 结果公开上榜Results published to the leaderboard
  • 无私有仓库 / 无优先队列No private repos, no priority queue
按量充值Top-up
$20 +
20 credits · $1.00 / credit
  • credits 永不过期Credits never expire
  • 私有仓库,结果不公开Private repos, results kept private
  • 按原价购买,无倍率List price — no multiplier
Pro 2× credits
$99 / mo
198 credits · $0.50 / credit
  • 同样的钱拿双倍 creditsDouble the credits per dollar
  • 私有仓库 · 优先队列 · 并发 4Private repos · priority queue · 4 concurrent
  • CI 集成(跑在你自己的 runner 上)CI integration on your own runners
Team
$499 / mo
998 credits · $0.50 / credit
  • 并发 16 · SSO · 审计日志16 concurrent · SSO · audit log
  • BYOC:跑在你自己的云账号BYOC — runs in your own cloud account
  • 数据默认不留存Zero retention by default

订阅赠送的 credits 按月清零;充值的 credits 永不过期。完整费率表见定价页 Subscription credits reset monthly; topped-up credits never expire. Full rate card on the pricing page.

先看它在你的仓库上能拿到多少Find out what it gets on your repo

诊断阶段免费。看到加速比和报价之后,你再决定要不要付。Diagnosis is free. You decide whether to pay once you've seen the speedup and the quote.