SWE-bench

community

https://swe-bench.com

AI & ML interests

None defined yet.

Recent Activity

john-b-yang authored a paper 12 days ago

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?

john-b-yang authored a paper 12 days ago

OpenThoughts: Data Recipes for Reasoning Models

john-b-yang authored a paper 12 days ago

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

View all activity

SWE-bench 's datasets 17

SWE-bench/SWE-prime

Viewer • Updated Apr 13 • 1.36k • 106

SWE-bench/SWE-smith-cpp

Viewer • Updated Mar 9 • 5.12k • 211

SWE-bench/SWE-smith-ts

Viewer • Updated Feb 28 • 5.03k • 497

SWE-bench/SWE-bench_Verified

Benchmark • Updated Feb 27 • 500 • 68.9k • 88

SWE-bench/SWE-smith-java

Viewer • Updated Feb 12 • 7.47k • 1.18k

SWE-bench/SWE-smith-rs

Viewer • Updated Feb 6 • 5.31k • 320 • 2

SWE-bench/SWE-smith-js

Viewer • Updated Jan 20 • 6.07k • 775

SWE-bench/SWE-smith-py

Viewer • Updated Dec 18, 2025 • 50.9k • 3.44k • 5

SWE-bench/SWE-smith-go

Viewer • Updated Dec 18, 2025 • 8.21k • 1.85k

SWE-bench/SWE-smith-php

Viewer • Updated Dec 18, 2025 • 1 • 89

SWE-bench/SWE-smith

Viewer • Updated Dec 14, 2025 • 59.1k • 20k • 52

SWE-bench/SWE-bench_Not_Verified

Viewer • Updated Sep 16, 2025 • 1.79k • 39

SWE-bench/SWE-bench_Multilingual

Viewer • Updated Aug 26, 2025 • 300 • 491k • 12

SWE-bench/SWE-smith-trajectories

Viewer • Updated Jul 19, 2025 • 76k • 3.74k • 60

SWE-bench/SWE-bench_Multimodal

Viewer • Updated Apr 29, 2025 • 612 • 4.88k • 10

SWE-bench/SWE-bench_Lite

Viewer • Updated Apr 29, 2025 • 323 • 32.5k • 15

SWE-bench/SWE-bench

Viewer • Updated Apr 29, 2025 • 21.5k • 8.07k • 30