Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/SMN

SMN

Reported on 19 benchmarks across 1 task · 1 paper · 19 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing19 results

Conversational Response SelectiononDouban
MAP· 2016-12-06
0.529
best: 0.651 (SEMSOL(W/o utterances))
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononDouban
MRR· 2016-12-06
0.569
best: 0.688 (Uni-Enc+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononDouban
P@1· 2016-12-06
0.397
best: 0.518 (Uni-Enc+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononDouban
R10@1· 2016-12-06
0.233
best: 0.33 (SEMSOL)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononDouban
R10@2· 2016-12-06
0.396
best: 0.557 (Uni-Enc+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononDouban
R10@5· 2016-12-06
0.724
best: 0.877 (SEMSOL(W/o utterances))
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononRRS
MAP· 2016-12-06
0.487
best: 0.702 (BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononRRS
MRR· 2016-12-06
0.501
best: 0.715 (SA-BERT+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononRRS
P@1· 2016-12-06
0.309
best: 0.555 (SA-BERT+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononRRS
R10@1· 2016-12-06
0.281
best: 0.497 (SA-BERT+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononRRS
R10@2· 2016-12-06
0.442
best: 0.708 (BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononRRS
R10@5· 2016-12-06
0.723
best: 0.931 (SA-BERT+BERT-FP)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononUbuntu Dialogue (v1, Ranking)
R10@1· 2016-12-06
0.726
best: 0.918 (Dial-MAE)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononUbuntu Dialogue (v1, Ranking)
R10@2· 2016-12-06
0.822
best: 0.965 (BERT-FP+EDHNS)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononUbuntu Dialogue (v1, Ranking)
R10@5· 2016-12-06
0.96
best: 0.994 (BERT-FP+EDHNS)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononUbuntu Dialogue (v1, Ranking)
R2@1· 2016-12-06
0.926
best: 0.975 (BERT-SL)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononE-commerce
R10@1· 2016-12-06
0.453
best: 0.957 (BERT-FP+EDHNS)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononE-commerce
R10@2· 2016-12-06
0.654
best: 0.986 (BERT-FP+EDHNS)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627
Conversational Response SelectiononE-commerce
R10@5· 2016-12-06
0.886
best: 0.997 (BERT-FP+EDHNS)
SOTA
Sequential Matching Network: A New Architecture for Multi-turn Response Selection in Retrieval-based Chatbots arXiv:1612.01627