CL_SLU

"An Investigation of the Combination of Rehearsal and Knowledge Distillation in Continual Learning for Spoken Language Understanding", accepted at INTERSPEECH …

Stars

6

Forks

0

Language

Python

Last Updated

Oct 15, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 2 CoReD Continual Learning with feature-based representation learning and knowledge distillation Jun 01, 2023
Python 12 Continual Learning Benchmark for Spoken Keyword Spotting Mar 17, 2023
Python 4 Class Similarity Weighted Knowledge Distillation for Continual Semantic Segmentation Sep 02, 2022
Python 12 Online Coreset Selection for Rehearsal-based Continual Learning, ICLR 2022 May 03, 2023
Python 59 [ICLR 2022] Towards Continual Knowledge Learning of Language Models Sep 01, 2022
Python 128 Learning to Prompt (L2P) for Continual Learning @ CVPR22 and DualPrompt: Complementary Prompting for Rehearsal-free … Aug 09, 2022
Python 8 Official implementation of "On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning" Mar 31, 2023
Python 20 PyTorch code for the CVPR'23 paper: "CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning" May 04, 2023
Python 16 Pytorch Implementation of DualPrompt: Complementary Prompting for Rehearsal-free Continual Learning @ ECCV22 Nov 30, 2022
Python 4 Rethinking end-to-end evaluation for spoken language understanding Jul 08, 2022
Python 3 Serial Contrastive Knowledge Distillation for Continual Few-shot Relation Extraction, Findings of ACL 2023 May 13, 2023
Python 55 Knowledge Distillation for Multi-task Learning (ECCV20 Workshops) Apr 24, 2023
Python 54 Progressive Prompts: Continual Learning for Language Models Apr 27, 2023
Jupyter Notebook 621 LUKE -- Language Understanding with Knowledge-based Embeddings Apr 11, 2023
Python 3 Distill on the Go: Online knowledge distillation in self-supervised learning Apr 08, 2022
Jupyter Notebook 10 Offical Code for Paper "Exploring Inter-Channel Correlation for Diversity-preserved Knowledge Distillation" Jun 06, 2022
C++ 12 The Continual Learning App Apr 23, 2023
Python 2 Learning with Knowledge Distillation for Fine Grained Image Classification Nov 15, 2023
Python 1227 A PyTorch-based knowledge distillation toolkit for natural language processing Sep 12, 2022
Python 3 A PyTorch-based knowledge distillation toolkit for natural language processing Apr 12, 2022
Python 8 A continual learning framework for natural language processing. Apr 13, 2023
Python 49 Exploring large language models for knowledge graph completion Jan 12, 2024
Python 3 Repo for ACL2023 paper "Towards Understanding and Improving Knowledge Distillation for Neural Machine Translation". May 15, 2023
Python 1444 A PyTorch implementation for exploring deep and shallow knowledge distillation (KD) experiments with flexibility Sep 01, 2022
Python 2 Effectiveness of Text, Acoustic, and Lattice-based representations in Spoken Language Understanding tasks Jul 01, 2023
Python 9 This is the repository for implementation of 'Knowledge Distillation for Multi-task Learning' Jan 06, 2023
Python 11 Code for the EMNLP2020 long paper "Lifelong Language Knowledge Distillation" https://arxiv.org/abs/2010.02123 Feb 23, 2023
Python 3 Codes and Checkpoints of the Interspeech paper "Sentence Embedder Guided Utterance Encoder (SEGUE) for Spoken … Jun 08, 2023
Python 15 The Continual Learning in Multimodality Benchmark Sep 15, 2022
Python 38 An Extensible Continual Learning Framework Focused on Language Models (LMs) Apr 26, 2023
None 46 Must-read Papers on Large Language Model (LLM) Continual Learning Jan 17, 2024
Swift 29 Simple app to help understanding the spoken text in islamic prayers. Nov 17, 2022
Python 16 This setup allows to train end-to-end neural models for spoken language understanding (SLU). Apr 26, 2023
Python 34 Pytorch Implementation of "Sequential Dialogue Context Modeling for Spoken Language Understanding( https://arxiv.org/abs/1705.03455 )" Mar 27, 2023
Python 413 A Pytorch Knowledge Distillation library for benchmarking and extending works in the domains of Knowledge … Aug 30, 2022
Jsonnet 2 incremental symbol learning for natural language understanding Jul 25, 2022
Java 50 Use Watson Natural Language Understanding and Watson Knowledge Studio to fingerprint personal data from unstructured … Jul 11, 2022
Python 8 KDSS is the framework for knowledge distillation from LLMs Oct 25, 2023
Python 29 Spoken Language Identification on Common Voice and AudioSet using Deep Learning May 12, 2023
Python 26 [EMNLP 2022] Continual Training of Language Models for Few-Shot Learning Feb 14, 2023
Python 50 Pytorch version of VidLanKD: Improving Language Understanding viaVideo-Distilled Knowledge Transfer Jun 28, 2022
Python 21 Code for ECML/PKDD 2020 Paper --- Continual Learning with Knowledge Transfer for Sentiment Classification Apr 17, 2023
Python 48 [ICCV'21] CKDN: Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessment Aug 09, 2022
Python 16 Preventing Zero-Shot Transfer Degradation in Continual Learning of Vision-Language Models May 08, 2023
Python 7 Official repository for "Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models" Mar 20, 2022
Jupyter Notebook 3 A repo illustrating the basics of Continual Learning. Aug 14, 2022
Jupyter Notebook 2 Experiments with knowledge distillation for course project of Machine learning course (CS771A) at IITK. Dec 22, 2020
Python 73 Code for ACL 2022 paper "BERT Learns to Teach: Knowledge Distillation with Meta Learning". May 24, 2023
Python 2 Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECMLPKDD 2022) Nov 09, 2023
Python 31 Code for EMNLP 2021 main conference paper "Dynamic Knowledge Distillation for Pre-trained Language Models" Feb 23, 2023