Archives
A curated repository for my study notes, insights, and write-ups
ML Fundamentals
Interview Preparation
ML Fundamentals
Core concepts behind generalization, regularization, normalization, and dropout
Optimization & Training
Interview Preparation
Optimization & Training
Backpropagation, optimizers, activations, and initialization
Classification & Information Theory
Interview Preparation
Classification & Information Theory
SVM, logits and softmax, entropy, cross-entropy, and KL divergence
Linear Algebra & Decomposition
Interview Preparation
Linear Algebra & Decomposition
Vector-space basics, norms, eigen/SVD decompositions, LoRA, and PCA
Probability & Bayesian Inference
Interview Preparation
Probability & Bayesian Inference
Bayes' theorem, MLE/MAP, and the canonical distributions used in ML
Optimization Theory
Interview Preparation
Optimization Theory
Convexity, Lipschitz smoothness, and constrained optimization via Lagrangian duality
Regression
Interview Preparation
Regression
Linear and logistic regression with a probabilistic interpretation
CNN & ResNet
Interview Preparation
CNN & ResNet
Convolutional layers, parameter-efficient variants, and residual learning for deep networks
Sequence Models
Interview Preparation
Sequence Models
From RNNs to Transformers and ViT, with attention mechanisms, positional encodings, and complexity
AutoEncoder · VAE · GAN
Interview Preparation
AutoEncoder · VAE · GAN
AutoEncoders, VAEs, GANs, and generative model evaluation metrics
Diffusion · Flow Matching · SDE Score
Interview Preparation
Diffusion · Flow Matching · SDE Score
Denoising diffusion, classifier-free guidance, flow matching, SDE-based score models, and DiT
Conditioning & Distillation
Interview Preparation
Conditioning & Distillation
Knowledge distillation and conditioning adapters for pretrained diffusion models
3D Neural Rendering
Interview Preparation
3D Neural Rendering
NeRF, neural tangent kernels, InstantNGP, and 3D Gaussian Splatting for novel-view synthesis