TestSuiteBench eth-sri/tsb-mutants Updated 2 days ago • 177 eth-sri/tsb-reference_tests Updated 2 days ago • 246 eth-sri/tsb-reference_impl Updated 2 days ago • 236
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 210 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 112 zai-org/humaneval-x Updated Oct 25, 2022 • 4.03k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 24 • 1
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 37 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 50
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 60 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 222 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 2.01k eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 43 • 2
TestSuiteBench eth-sri/tsb-mutants Updated 2 days ago • 177 eth-sri/tsb-reference_tests Updated 2 days ago • 246 eth-sri/tsb-reference_impl Updated 2 days ago • 236
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 37 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 50
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 210 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 112 zai-org/humaneval-x Updated Oct 25, 2022 • 4.03k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 24 • 1
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 60 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 222 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 2.01k eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 43 • 2
