Self-Supervised-Embedding-Fusion-Transformer

The code for our IEEE ACCESS (2020) paper Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion.

Stars

81

Forks

20

Language

Python

Last Updated

Oct 09, 2023

Similar Repos
Repo Language Stars Description Updated At
Python 86 The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to … Aug 21, 2022
Jupyter Notebook 3 Multimodal Emotion Recognition. See article : https://medium.com/@mustapha-ajeghrir/multimodal-emotion-recognition-456e4a73f9e8 May 07, 2022
Python 7 Implementation of the paper "Multimodal Transformer With Learnable Frontend and Self Attention for Emotion Recognition" … Jun 28, 2022
Jupyter Notebook 198 TensorFlow implementation of "Multimodal Speech Emotion Recognition using Audio and Text," IEEE SLT-18 May 19, 2023
Python 4 A generalized self-supervised training paradigm for unimodal and multimodal alignment and fusion. May 16, 2023
Python 41 [IEEE TIP 2022] Official implementation of MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer Dec 12, 2023
Python 5 Self-supervised place recognition by exploring temporal and feature neighborhoods Apr 06, 2023
Python 11 SiT: Self-supervised vision Transformer Jun 10, 2022
Python 2 Self-supervised vIsion Transformer (SiT) Aug 13, 2022
Python 8 Repository for reproducing result in journal "Self-supervised learning for Speech Emotion Recognition" May 30, 2023
None 10 Multimodal Emotion Recognition in Conversation Challenge（ CCAC 2023） Apr 28, 2023
Python 31 Source code for ICASSP 2022 paper "MM-DFN: Multimodal Dynamic Fusion Network For Emotion Recognition in … Apr 12, 2023
Python 19 Cross Attentional AV Fusion for Dimensional Emotion Recognition May 21, 2023
MATLAB 5 This is MATLAB code implementing our paper in IEEE Access 2020 Dec 19, 2022
Python 28 Multimodal Semi-Supervised Learning for Text Recognition (SemiMTR) Sep 01, 2022
Jupyter Notebook 104 Look-into-Object: Self-supervised Structure Modeling for Object Recognition (CVPR 2020) Aug 13, 2022
Jupyter Notebook 25 Emotion Recognition ToolKit (ERTK): tools for emotion recognition. Dataset processing, feature extraction, experiments, May 04, 2023
None 4 [IEEE T-IP 2020] Deep Image-to-Video Adaptation and Fusion Networks for Action Recognition Apr 23, 2023
Python 15 [IEEE RAL 2022] IMFNet: Interpretable Multimodal Fusion for Point Cloud Registration May 23, 2023
Python 89 Official PyTorch implementation of our AAAI22 paper: TransMEF: A Transformer-Based Multi-Exposure Image Fusion Framework via … Jun 02, 2022
Jupyter Notebook 88 A multimodal approach on emotion recognition using audio and text. May 09, 2023
Python 19 Official PyTorch implementation of paper Leveraging Unimodal Self Supervised Learning for Multimodal Audio-Visual Speech Recognition Jun 24, 2022
Jupyter Notebook 6 Implementation of Thesis: Multimodal Emotion Recognition using Deep Learning Techniques: A novel system for real-world … May 02, 2022
None 71 A curated list of self-supervised multimodal learning resources. May 03, 2023
Jupyter Notebook 20 Pytorch implementation of Multimodal Fusion Transformer for Remote Sensing Image Classification. Aug 11, 2022
Python 11 Multimodal Fusion via Teacher-Student Network for Indoor Action Recognition Aug 23, 2022
None 4 This repo contains multimodal dataset with their features for multimodal sentiment analysis and emotion recognition Apr 13, 2021
Python 5 [IEEE RAL 2022] GMF: General Multimodal Fusion Framework for Correspondence Outlier Rejection May 29, 2023
Jupyter Notebook 2 This repository is for speech emotion recognition for MELD: A Multimodal Multi-Party Dataset for Emotion … Jun 22, 2022
Jupyter Notebook 5 Emotion recognition methods through facial expression, speeches, audios, and multimodal data Aug 12, 2022
None 2 MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation Apr 10, 2022
Python 621 MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation Apr 21, 2023
Python 2 Code for Multimodal Cross Attention Network for Audio Visual Emotion Recognition Nov 01, 2022
Jupyter Notebook 80 Official PyTorch Implementation of Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations May 03, 2023
Jupyter Notebook 15 Official implementation of the paper "GANSER: A Self-supervised Data Augmentation Framework for EEG-based Emotion Recognition" Jun 14, 2022
Python 2 Multiple Object Feature Fusion for weakly supervised deep learning Apr 16, 2022
Python 13 Hybrid CNN-Transformer Feature Fusion for Single Image Deraining Apr 18, 2023
Python 4 Attention-based Multimodal Image Feature Fusion Module for Transmission Line Detection Jun 11, 2022
Python 8 This is an implentation of paper GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition May 22, 2022
Python 2 Efficient Multimodal Transformer with Dual-Level Feature Restoration for Robust Multimodal Sentiment Analysis (TAC 2023) May 16, 2023
Python 27 Self-supervised monocular depth estimation with a vision transformer Aug 17, 2022
Python 194 Self-Supervised Extrinsic Calibration using 3D Spatial Transformer Networks May 15, 2023
Python 63 Augmentation adversarial training for self-supervised speaker recognition Jul 31, 2022
Python 17 Code for "Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion"(ECCV2022) Apr 24, 2023
Python 6 Self-Supervised Feature Extraction for 3D Axon Segmentation Jan 06, 2022
Python 10 Transformer-based model for Speech Emotion Recognition(SER) - implemented by Pytorch May 29, 2023
Python 3 The code for our paper Hierarchical Interactive Multimodal Transformer for Aspect-Based Multimodal Sentiment Analysis Apr 17, 2023
Python 4 Featurization of image and question, Feature fusion, Answer generation for Multimodal System Jan 10, 2023
Python 8 [ICASSP 2020] Speech Emotion Recognition with Dual-Sequence LSTM Architecture Mar 02, 2023
Python 96 Self-Supervised Pre-Training for Transformer-Based Person Re-Identification Jun 21, 2022