gradient-descent-variants

My implementation of Batch, Stochastic & Mini-Batch Gradient Descent Algorithm using Python

Stars

18

Forks

21

Language

Jupyter Notebook

Last Updated

Aug 08, 2023

Similar Repos
Repo Language Stars Description Updated At
Go 3 Example of mini-batch SGD (mini-batch stochastic gradient descent) in Go Dec 29, 2022
Python 27 Python implementation of stochastic sub-gradient descent algorithm for SVM from scratch Jun 13, 2022
Jupyter Notebook 3 Gradient Descent Algorithm Implementation using NumPy Oct 15, 2021
C++ 25 Stochastic Gradient Descent SVM classifier Dec 22, 2022
Python 2 Averaged Stochastic Gradient Descent Classifiers Apr 02, 2017
Python 13 Weighted multiple-instance learning algorithm based on stochastic gradient descent Apr 02, 2023
Python 6 Estimating ARMA model parameters using stochastic gradient descent Jan 13, 2021
Jupyter Notebook 10 Simple python implementation of stochastic gradient descent for neural networks through backpropagation. Feb 20, 2023
C++ 2 Stochastic gradient descent library in C++ Sep 09, 2021
Jupyter Notebook 54 An IPython notebook showing the basics of implementing gradient descent and stochastic gradient descent in … Apr 26, 2023
JavaScript 2 Incrementally perform binary classification using stochastic gradient descent (SGD). Jan 11, 2022
Java 2 Hadoop Streaming for Logistic Regression using Stochastic Gradient Descent Aug 20, 2021
Python 5 TensorFlow implementation of "SGDR: Stochastic Gradient Descent with Warm Restarts" Apr 25, 2023
Jupyter Notebook 2 Gradient Descent: Concept & Manual Python Implementation Mar 23, 2024
Python 4 Fluctuation-dissipation relations for stochastic gradient descent Feb 06, 2022
JavaScript 2 Online regression via stochastic gradient descent (SGD). Nov 22, 2021
C++ 22 Asynchronous Stochastic Gradient Descent with Delay Compensation Feb 17, 2022
Python 2 An implementation of MaxEnt, with Mini-batch Stochastic Gradient approach to get the optimized parameters. Aug 22, 2019
Jupyter Notebook 3 A linear regression implementation using gradient descent with python Mar 30, 2023
C 2 Scalable large-margin distance metric learning using stochastic gradient descent Sep 03, 2020
Python 2 Parallelization of k-means clustering and Stochastic Gradient Descent using MPI Mar 19, 2022
Jupyter Notebook 2 The two-spiral Problem solved using the Stochastic Gradient Descent optimiser. Aug 12, 2022
Jupyter Notebook 2 How to use linear regression with 3 ways (Least squares, Batch and Stochastic gradient descent) Mar 17, 2021
Jupyter Notebook 2 A neural network implementation in Python, using gradient descent and backpropagation implementation May 31, 2023
Matlab 15 MATLAB implementation of Gradient Descent algorithm for Multivariate Linear Regression Apr 18, 2022
C++ 69 CUDA Matrix Factorization Library with Stochastic Gradient Descent (SGD) Mar 25, 2023
Jupyter Notebook 2 TF2 implementation of Learning to learn by gradient descent by gradient descent Jul 28, 2022
Python 22 JAX implementation of Learning to learn by gradient descent by gradient descent Mar 08, 2023
Julia 4 Replicated Stochastic Gradient Descent on Commitee machines with binary weights Jul 28, 2020
Python 20 A python implementation of Dueling Bandit Gradient Descent (DBGD) Apr 23, 2023
Python 25 This repository contains implementation of stochastic gradient descent, SGD with momentum, Adagrad, RMSprop, Adam, Adamax … Apr 19, 2023
Python 4 Python Recommender System with SVD using gradient descent Jun 07, 2019
Python 295 A PyTorch implementation of Learning to learn by gradient descent by gradient descent Aug 16, 2022
Python 2 Linear regression using gradient descent Nov 06, 2020
Python 3 implementation of the 'stochastic quartet descent MDS' Jun 20, 2022
Jupyter Notebook 7 Tensorflow 2.0 Keras implementation of "Learning to learn by gradient descent by gradient descent" Apr 27, 2023
Python 5 Gradient descent using pure python without numpy or scipy Aug 03, 2022
Python 36 Training vision models with full-batch gradient descent and regularization Apr 25, 2023
Python 4 BIRTSGD is an implementation of Beta3-irt using gradient descent. Jun 14, 2022
Python 5 Stochastic Meta Descent Dec 07, 2020
Jupyter Notebook 50 Linear model training using stochastic gradient descent (SGD) on PYNQ with full to low precision. May 28, 2022
Python 2 Implementing standard econometric models using Stochastic Gradient Descent and Perceptrons instead of MLE and GMM. Oct 14, 2023
Jupyter Notebook 31 PyTorch implementation of Stein Variational Gradient Descent Apr 20, 2023
Jupyter Notebook 3 Linear classifiers (Logistic Regression, GDA), Stochastic Gradient Descent, L1 L2 Regularization, SVM Mar 10, 2023
Python 4 This is a python implementation of Accelerated Proximal Gradient Descent method. Jan 03, 2022
Jupyter Notebook 3 An implementation of the algorithm proposed in 'A PAC-Bayesian Analysis of Randomized Learning with Application … Sep 15, 2019
Python 32 Convex optimizers for LASSO, including subgradient, project gradient, proximal gradient, smooth method, lagrangian method and … Apr 18, 2023
Python 8 Recurrent Stochastic Value Gradient implementation with TensorFlow Nov 29, 2021
Python 42 Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent Mar 28, 2022
C++ 3 A simple implementation of the gradient descent method. Jan 13, 2022