TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/InstructDS

InstructDS

Reported on 9 benchmarks across 3 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Knowledge Base7 results

  • Text SummarizationonSAMSum
    ROUGE-1· 2023-10-17
    55.3
    best: 59.1 (OmniVec2)
    SOTA
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Text SummarizationonSAMSum
    ROUGE-2· 2023-10-17
    31.3
    best: 34.1 (OmniVec2)
    SOTA
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Text SummarizationonDialogSum
    Rouge1· 2023-10-17
    47.8
    SOTA
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Text SummarizationonDialogSum
    Rouge2· 2023-10-17
    22.2
    SOTA
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Text SummarizationonSAMSum
    BertScoreF1· 2023-10-17
    55.5
    best: 71.92 (SICK)
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Text SummarizationonSAMSum
    ROUGE-L· 2023-10-17
    46.7
    best: 63.7 (OmniVec2)
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Text SummarizationonDialogSum
    RougeL· 2023-10-17
    39.4
    best: 41.4 (OmniVec2)
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981

Natural Language Processing2 results

  • Reading ComprehensiononDREAM
    Accuracy· 2023-10-17
    65.9
    best: 69.2 (ASA + RoBERTa)
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981
  • Visual Question Answering (VQA)onDREAM
    Accuracy· 2023-10-17
    65.9
    best: 69.2 (ASA + RoBERTa)
    Instructive Dialogue Summarization with Query AggregationsarXiv:2310.10981