Faster Training of Large Language Models with Parallelization
Implementing Faster Training of Large Language Models with Parallelization. Learn about key parallelism techniques for GPUs and TPUs to accelerate training.
Tag Archives: PyTorch
Optimizers explained for training Neural Networks
Overview Training a Deep Learning model (or any machine learning model in fact) is all about bringing the model predictions (model output) close to the real output(Ground truth) for a given set of input-output pairs. Once the model’s results are close to the real results our job is done. To understand how close model predictions are with respect… Read More »
Deep Learning with PyTorch: First Neural Network
Deep Learning is part of the Machine Learning family that deals with creating the Artificial Neural Network (ANN) based models. ANNs are used for both supervised as well as unsupervised learning tasks. Deep Learning is extensively used in tasks like-object detection, language translations, speech recognition, face detection, and recognition..etc. Let’s create our First Neural Network with PyTorch- In… Read More »
Deep Learning with PyTorch: Introduction
Overview PyTorch is a deep learning framework developed by Facebook’s AI Research lab(FAIR) about four years ago (in 2016). This PyTorch framework was designed to make our machine learning and deep learning project journey super fast and smooth. Pytorch is written in Python, C++, and CUDA and is supported across Linux, macOS, and Windows platforms. It also has… Read More »