Tasks
SotA
Datasets
Papers
Methods
Submit
About
Datasets
/
COD
COD
Benchmarks
16k
/
S-Measure
16k
/
Weighted F-Measure
16k
/
MAE
2D Classification
/
S-Measure
2D Classification
/
Weighted F-Measure
2D Classification
/
MAE
2D Object Detection
/
S-Measure
2D Object Detection
/
Weighted F-Measure
2D Object Detection
/
MAE
3D
/
S-Measure
3D
/
Weighted F-Measure
3D
/
MAE
Camouflaged Object Segmentation
/
S-Measure
Camouflaged Object Segmentation
/
Weighted F-Measure
Camouflaged Object Segmentation
/
MAE
Object Detection
/
S-Measure
Object Detection
/
Weighted F-Measure
Object Detection
/
MAE
Object Segmentation
/
S-Measure
Object Segmentation
/
Weighted F-Measure
Object Segmentation
/
MAE
Related Benchmarks
COD10K
/
16k
/
E_{\phi}
COD10K
/
16k
/
F_{\beta}
COD10K
/
16k
/
MAE
COD10K
/
16k
/
S_{\alpha}
COD10K
/
2D Classification
/
E_{\phi}
COD10K
/
2D Classification
/
F_{\beta}
COD10K
/
2D Classification
/
MAE
COD10K
/
2D Classification
/
S_{\alpha}
COD10K
/
2D Object Detection
/
E_{\phi}
COD10K
/
2D Object Detection
/
F_{\beta}
COD10K
/
2D Object Detection
/
MAE
COD10K
/
2D Object Detection
/
S_{\alpha}
COD10K
/
3D
/
E_{\phi}
COD10K
/
3D
/
F_{\beta}
COD10K
/
3D
/
MAE
COD10K
/
3D
/
S_{\alpha}
COD10K
/
Camouflaged Object Segmentation
/
E_{\phi}
COD10K
/
Camouflaged Object Segmentation
/
F_{\beta}
COD10K
/
Camouflaged Object Segmentation
/
MAE
COD10K
/
Camouflaged Object Segmentation
/
S_{\alpha}
COD10K
/
Object Detection
/
E_{\phi}
COD10K
/
Object Detection
/
F_{\beta}
COD10K
/
Object Detection
/
MAE
COD10K
/
Object Detection
/
S_{\alpha}
COD10K
/
Object Segmentation
/
E_{\phi}
COD10K
/
Object Segmentation
/
F_{\beta}
COD10K
/
Object Segmentation
/
MAE
COD10K
/
Object Segmentation
/
S_{\alpha}
CODAH
/
Common Sense Reasoning
/
Accuracy
CODAH
/
Question Answering
/
Accuracy
CODE-15%
/
ECG Patient Identification
/
Accuracy
CODE-15%
/
Electrocardiography (ECG)
/
Accuracy
CODE-15%
/
Medical waveform analysis
/
Accuracy
CoDEx Large
/
Link Prediction
/
Hits@1
CoDEx Large
/
Link Prediction
/
Hits@10
CoDEx Large
/
Link Prediction
/
Hits@3
CoDEx Large
/
Link Prediction
/
MRR
CoDEx Medium
/
Link Prediction
/
Hits@1
CoDEx Medium
/
Link Prediction
/
Hits@10
CoDEx Medium
/
Link Prediction
/
Hits@3
CoDEx Medium
/
Link Prediction
/
MRR
CoDEx Small
/
Link Prediction
/
Hits@1
CoDEx Small
/
Link Prediction
/
Hits@10
CoDEx Small
/
Link Prediction
/
Hits@3
CoDEx Small
/
Link Prediction
/
MRR
CoDesc
/
Code Search
/
Test MRR
CoDesc
/
Source Code Summarization
/
BLEU-4
Code-Switching English-Spanish NER
/
Named Entity Recognition (NER)
/
F1
CodeContests
/
Code Generation
/
Test Set pass@1
CodeContests
/
Code Generation
/
Test Set pass@5
CodeContests
/
Code Generation
/
Val Set pass@1
CodeContests
/
Code Generation
/
Val Set pass@5
CodeSearchNet
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet
/
Code Search
/
Go
CodeSearchNet
/
Code Search
/
JS
CodeSearchNet
/
Code Search
/
Java
CodeSearchNet
/
Code Search
/
Overall
CodeSearchNet
/
Code Search
/
PHP
CodeSearchNet
/
Code Search
/
Python
CodeSearchNet
/
Code Search
/
Ruby
CodeSearchNet
/
Source Code Summarization
/
F1
CodeSearchNet
/
Text Generation
/
Smoothed BLEU-4
CodeSearchNet - Go
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet - Go
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet - Go
/
Text Generation
/
Smoothed BLEU-4
CodeSearchNet - Java
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet - Java
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet - Java
/
Text Generation
/
Smoothed BLEU-4
CodeSearchNet - JavaScript
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet - JavaScript
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet - JavaScript
/
Text Generation
/
Smoothed BLEU-4
CodeSearchNet - Php
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet - Php
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet - Php
/
Text Generation
/
Smoothed BLEU-4
CodeSearchNet - Python
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet - Python
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet - Python
/
Source Code Summarization
/
BLEU-4
CodeSearchNet - Python
/
Source Code Summarization
/
METEOR
CodeSearchNet - Python
/
Text Generation
/
Smoothed BLEU-4
CodeSearchNet - Ruby
/
Code Documentation Generation
/
Smoothed BLEU-4
CodeSearchNet - Ruby
/
Code Generation
/
Smoothed BLEU-4
CodeSearchNet - Ruby
/
Code Search
/
MRR
CodeSearchNet - Ruby
/
Text Generation
/
Smoothed BLEU-4
CodeXGLUE - AdvTest
/
Code Search
/
MRR
CodeXGLUE - Bugs2Fix
/
Code Repair
/
Accuracy (medium)
CodeXGLUE - Bugs2Fix
/
Code Repair
/
Accuracy (small)
CodeXGLUE - Bugs2Fix
/
Code Repair
/
BLEU (medium)
CodeXGLUE - Bugs2Fix
/
Code Repair
/
BLEU (small)
CodeXGLUE - Bugs2Fix
/
Code Repair
/
CodeBLEU (medium)
CodeXGLUE - Bugs2Fix
/
Code Repair
/
CodeBLEU (small)
CodeXGLUE - CONCODE
/
Text-to-Code Generation
/
BLEU
CodeXGLUE - CONCODE
/
Text-to-Code Generation
/
CodeBLEU
CodeXGLUE - CONCODE
/
Text-to-Code Generation
/
EM
CodeXGLUE - CT-all
/
Cloze Test
/
Go
CodeXGLUE - CT-all
/
Cloze Test
/
JS
CodeXGLUE - CT-all
/
Cloze Test
/
Java
CodeXGLUE - CT-all
/
Cloze Test
/
PHP
CodeXGLUE - CT-all
/
Cloze Test
/
Python
CodeXGLUE - CT-all
/
Cloze Test
/
Ruby
CodeXGLUE - CT-maxmin
/
Cloze Test
/
Go
CodeXGLUE - CT-maxmin
/
Cloze Test
/
JS
CodeXGLUE - CT-maxmin
/
Cloze Test
/
Java
CodeXGLUE - CT-maxmin
/
Cloze Test
/
PHP
CodeXGLUE - CT-maxmin
/
Cloze Test
/
Python
CodeXGLUE - CT-maxmin
/
Cloze Test
/
Ruby
CodeXGLUE - CodeSearchNet
/
Code Generation
/
Java/BLEU
CodeXGLUE - CodeSearchNet
/
Code Generation
/
Java/CodeBLEU
CodeXGLUE - CodeSearchNet
/
Code Generation
/
Java/EM
CodeXGLUE - CodeSearchNet
/
Code Generation
/
Python/BLEU
CodeXGLUE - CodeSearchNet
/
Code Generation
/
Python/CodeBLEU
CodeXGLUE - CodeSearchNet
/
Code Generation
/
Python/EM
CodeXGLUE - CodeTrans
/
Code Generation
/
Accuracy (C#→Java)
CodeXGLUE - CodeTrans
/
Code Generation
/
Accuracy (Java→C#)
CodeXGLUE - CodeTrans
/
Code Generation
/
BLEU (C#→Java)
CodeXGLUE - CodeTrans
/
Code Generation
/
BLEU (Java→C#)
CodeXGLUE - CodeTrans
/
Code Generation
/
CodeBLEU (C#→Java)
CodeXGLUE - CodeTrans
/
Code Generation
/
CodeBLEU (Java→C#)
CodeXGLUE - Github Java Corpus
/
Code Completion
/
Accuracy (token-level)
CodeXGLUE - Github Java Corpus
/
Code Completion
/
EM (line-level)
CodeXGLUE - Github Java Corpus
/
Code Completion
/
Edit Sim (line-level)
CodeXGLUE - PY150
/
Code Completion
/
Accuracy (token-level)
CodeXGLUE - PY150
/
Code Completion
/
EM (line-level)
CodeXGLUE - PY150
/
Code Completion
/
Edit Sim (line-level)
CodeXGLUE - WebQueryTest
/
Code Search
/
Accuracy
CodeXGLUE - WebQueryTest
/
Code Search
/
F1