lm-evaluation-harness

A framework for few-shot evaluation of autoregressive language models.

Stars

97

Forks

31

Language

Python

Last Updated

May 28, 2024

Similar Repos
Repo Language Stars Description Updated At
Python 4 A framework for few-shot evaluation of autoregressive language models. Nov 21, 2021
Python 315 A framework for few-shot evaluation of autoregressive language models. Aug 10, 2022
Python 10 A framework for few-shot evaluation of autoregressive language models. Jan 28, 2023
None 8 A framework for few-shot evaluation of autoregressive language models. Apr 18, 2023
Python 2 A framework for few-shot evaluation of autoregressive language models. Mar 07, 2023
Python 2 A framework for few-shot evaluation of autoregressive language models. Jun 12, 2023
Python 5 A framework for few-shot evaluation of autoregressive language models. Jun 16, 2023
Python 47 A framework for the evaluation of autoregressive code generation language models. Dec 01, 2022
Python 27 Zero-shot text classification package using autoregressive language models May 03, 2023
None 11491 GPT-3: Language Models are Few-Shot Learners Aug 12, 2022
None 2 GPT-3: Language Models are Few-Shot Learners Mar 24, 2021
Python 40 Language Models of Code are Few-Shot Commonsense Learners Apr 21, 2023
Python 26 [EMNLP 2022] Continual Training of Language Models for Few-Shot Learning Feb 14, 2023
Python 46 PERFECT: Prompt-free and Efficient Few-shot Learning with Language Models Aug 24, 2022
Python 3 A Few-shot Framework for Research Sep 02, 2021
Python 39 Pytorch code for Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners Aug 17, 2022
Python 133 Search Engines with Autoregressive Language models Aug 08, 2022
Python 142 Prototype Mixture Models for Few-shot Semantic Segmentation May 07, 2022
Python 10 few-shot models for short-term traffic prediction Apr 13, 2023
Python 16 Let ChatGPT (Large Language Models) Serve As Data Annotator and Zero-shot/few-shot Information Extractor. May 23, 2023
Python 2 Attempt at implementing few shot diffusion models Apr 04, 2023
Python 47 A set of utilities for running few-shot prompting experiments on large-language models Apr 21, 2023
Python 122 Code for the paper "True Few-Shot Learning in Language Models" (https://arxiv.org/abs/2105.11447) Oct 05, 2022
Python 8 The code and data used for "Large Language Models are few(1)-shot Table Reasoners" Mar 21, 2023
Jupyter Notebook 14 Code for: "Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models" Sep 22, 2022
Python 60 [ICLR 2023] Code for our paper "Selective Annotation Makes Language Models Better Few-Shot Learners" Apr 17, 2023
Python 5 Self-training Pretrained Language Models for Zero- and Few-shot Multi-dialectal Arabic Sequence Labeling Jun 05, 2022
Python 2 My implementation of Few-Shot Diffusion Models paper Feb 22, 2023
Python 47 The source code of "Language Models are Few-shot Multilingual Learners" (MRL @ EMNLP 2021) Apr 20, 2023
Python 169 Few-shot Natural Language Generation for Task-Oriented Dialog Aug 08, 2022
None 12 Evaluation of Portuguese Language Models May 04, 2023
Python 65 Code for the ICLR2022 paper "Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners" Oct 17, 2022
Python 67 LightningFSL: Pytorch-Lightning implementations of Few-Shot Learning models. Jul 02, 2022
Python 2 Official Implementation of "ProtSi: Prototypical Siamese Network for Few Shot Subjective Answer Evaluation" Mar 07, 2024
Python 68 Evaluation suite for large-scale language models. Jul 07, 2022
Python 571 ACL'2021: LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723 Oct 17, 2022
Python 153 SSL-FEW-SHOT Jun 07, 2022
Python 152 Few shot learning Feb 22, 2023
Python 2 MMLU evaluation for language models served with EasyLM Apr 12, 2023
Python 31 Source for the ACL 2021 Findings paper "Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models" Aug 09, 2022
Python 11 Source for the ACL 2021 Findings paper "Few-shot Knowledge Graph-to-Text Generation with Pretrained Language Models" May 04, 2023
Python 9 A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis Aug 04, 2022
Python 16 Shaping Visual Representations with Language for Few-shot Classification, ACL 2020 Aug 22, 2022
None 2 Few-shot Reranking for Multi-hop QA via Language Model Prompting Apr 03, 2023
Python 8 Repo for "Analyzing Commonsense Emergence in Few-shot Knowledge Models" (AKBC 2021) Jul 31, 2022
Python 2 A zero-shot chatbot library for large language models Mar 07, 2023
Python 18 Few shot learning for cancer Jun 17, 2022
TeX 875 Collection for Few-shot Learning May 17, 2023
TeX 2 Collection for Few-shot Learning Jul 14, 2021
Python 36 Code to reproduce experiments in the paper "Constrained Language Models Yield Few-Shot Semantic Parsers" (EMNLP … Jul 29, 2022