TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/GAL 6.7B

GAL 6.7B

Reported on 24 benchmarks across 5 tasks · 1 paper · 4 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical15 results

  • Protein Structure PredictiononCASPSeq
    Validation perplexity· 2022-11-16
    17.29
    best: 17.26 (GAL 120B)
    SOTA
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Protein Structure PredictiononUniProtSeq
    Validation perplexity· 2022-11-16
    11.58
    best: 5.54 (GAL 120B)
    SOTA
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Protein Structure PredictiononPaenSeq
    Validation perplexity· 2022-11-16
    7.76
    best: 3.14 (GAL 120B)
    SOTA
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Protein Structure PredictiononCASPSimSeq
    Validation perplexity· 2022-11-16
    16.35
    best: 12.77 (GAL 120B)
    SOTA
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Protein Function PredictiononUniProtSeq
    ROUGE-L· 2022-11-16
    0.111
    best: 0.252 (GAL 120B)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Protein Function PredictiononCASPSimSeq
    ROUGE-L· 2022-11-16
    0.109
    best: 0.252 (GAL 120B)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Protein Function PredictiononPaenSeq
    ROUGE-L· 2022-11-16
    0.137
    best: 0.272 (GAL 120B)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic Descriptiononclintox
    Molecules (M)· 2022-11-16
    2
    best: 77 (ChemBERTa-2 (MTR-77M))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic Descriptiononclintox
    ROC-AUC· 2022-11-16
    78.4
    best: 99.2 (Deep-CBN)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic DescriptiononMoleculeNet
    AUC· 2022-11-16
    0.64
    best: 0.77 (Uni-Mol)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic DescriptiononBBBP
    ROC-AUC· 2022-11-16
    53.5
    best: 96.4 (DumplingGNN)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic DescriptiononHIV dataset
    AUC· 2022-11-16
    0.722
    best: 0.81 (DVMP)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic DescriptiononSIDER
    ROC-AUC· 2022-11-16
    55.9
    best: 91.11 (BioAct-Het)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic DescriptiononTox21
    ROC-AUC· 2022-11-16
    63.9
    best: 92.4 (Deep-CBN)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Atomistic DescriptiononBACE
    ROC-AUC· 2022-11-16
    58.4
    best: 88.4 (MolXPT)
    Galactica: A Large Language Model for SciencearXiv:2211.09085

Methodology8 results

  • Molecular Property Predictiononclintox
    Molecules (M)· 2022-11-16
    2
    best: 77 (ChemBERTa-2 (MTR-77M))
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property Predictiononclintox
    ROC-AUC· 2022-11-16
    78.4
    best: 99.2 (Deep-CBN)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property PredictiononMoleculeNet
    AUC· 2022-11-16
    0.64
    best: 0.77 (Uni-Mol)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property PredictiononBBBP
    ROC-AUC· 2022-11-16
    53.5
    best: 96.4 (DumplingGNN)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property PredictiononHIV dataset
    AUC· 2022-11-16
    0.722
    best: 0.81 (DVMP)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property PredictiononSIDER
    ROC-AUC· 2022-11-16
    55.9
    best: 91.11 (BioAct-Het)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property PredictiononTox21
    ROC-AUC· 2022-11-16
    63.9
    best: 92.4 (Deep-CBN)
    Galactica: A Large Language Model for SciencearXiv:2211.09085
  • Molecular Property PredictiononBACE
    ROC-AUC· 2022-11-16
    58.4
    best: 88.4 (MolXPT)
    Galactica: A Large Language Model for SciencearXiv:2211.09085

Natural Language Processing1 result

  • Question AnsweringonTruthfulQA
    MC1· 2022-11-16
    0.19
    best: 0.59 (GPT-4 (RLHF))
    Galactica: A Large Language Model for SciencearXiv:2211.09085