# PyTorch Tutorials

> PyTorch Tutorials documentation.

## Docs

- [ONNX Live Tutorial](https://docs.pytorch.org/tutorials/advanced/ONNXLive.md)
- [TorchRL objectives: Coding a DDPG loss](https://docs.pytorch.org/tutorials/advanced/coding_ddpg.md)
- [Autograd in C++ Frontend](https://docs.pytorch.org/tutorials/advanced/cpp_autograd.md)
- [Custom C++ and CUDA Operators](https://docs.pytorch.org/tutorials/advanced/cpp_custom_ops.md)
- [Custom SYCL Operators](https://docs.pytorch.org/tutorials/advanced/cpp_custom_ops_sycl.md)
- [<no title>](https://docs.pytorch.org/tutorials/advanced/cpp_export.md)
- [Using the PyTorch C++ Frontend](https://docs.pytorch.org/tutorials/advanced/cpp_frontend.md)
- [Supporting Custom C++ Classes in torch.compile/torch.export](https://docs.pytorch.org/tutorials/advanced/custom_class_pt2.md)
- [Extending PyTorch with Custom C++ Classes](https://docs.pytorch.org/tutorials/advanced/custom_classes.md)
- [PyTorch Custom Operators](https://docs.pytorch.org/tutorials/advanced/custom_ops_landing_page.md)
- [Training Transformer models using Distributed Data Parallel and Pipeline Parallelism](https://docs.pytorch.org/tutorials/advanced/ddp_pipeline.md)
- [Registering a Dispatched Operator in C++](https://docs.pytorch.org/tutorials/advanced/dispatcher.md)
- [Extending dispatcher for a new backend in C++](https://docs.pytorch.org/tutorials/advanced/extend_dispatcher.md)
- [Distributed Training with Uneven Inputs Using the Join Context Manager](https://docs.pytorch.org/tutorials/advanced/generic_join.md)
- [Neural Transfer Using PyTorch](https://docs.pytorch.org/tutorials/advanced/neural_style_tutorial.md)
- [Creating Extensions Using NumPy and SciPy](https://docs.pytorch.org/tutorials/advanced/numpy_extensions_tutorial.md)
- [Pendulum: Writing your environment and transforms with TorchRL](https://docs.pytorch.org/tutorials/advanced/pendulum.md)
- [Facilitating New Backend Integration by PrivateUse1](https://docs.pytorch.org/tutorials/advanced/privateuseone.md)
- [Custom Python Operators](https://docs.pytorch.org/tutorials/advanced/python_custom_ops.md)
- [Combining Distributed DataParallel with Distributed RPC Framework](https://docs.pytorch.org/tutorials/advanced/rpc_ddp_tutorial.md)
- [(beta) Accelerating BERT with semi-structured (2:4) sparsity](https://docs.pytorch.org/tutorials/advanced/semi_structured_sparse.md)
- [Computation times](https://docs.pytorch.org/tutorials/advanced/sg_execution_times.md)
- [Exploring TorchRec sharding](https://docs.pytorch.org/tutorials/advanced/sharding.md)
- [<no title>](https://docs.pytorch.org/tutorials/advanced/torch-script-parallelism.md)
- [<no title>](https://docs.pytorch.org/tutorials/advanced/torch_script_custom_ops.md)
- [Semi-Supervised Learning using USB built upon PyTorch](https://docs.pytorch.org/tutorials/advanced/usb_semisup_learn.md)
- [Audio Data Augmentation](https://docs.pytorch.org/tutorials/beginner/audio_data_augmentation_tutorial.md)
- [Audio Datasets](https://docs.pytorch.org/tutorials/beginner/audio_datasets_tutorial.md)
- [Audio Feature Augmentation](https://docs.pytorch.org/tutorials/beginner/audio_feature_augmentation_tutorial.md)
- [Audio Feature Extractions](https://docs.pytorch.org/tutorials/beginner/audio_feature_extractions_tutorial.md)
- [Audio Resampling](https://docs.pytorch.org/tutorials/beginner/audio_resampling_tutorial.md)
- [Automatic Differentiation with torch.autograd](https://docs.pytorch.org/tutorials/beginner/basics/autogradqs_tutorial.md)
- [Build the Neural Network](https://docs.pytorch.org/tutorials/beginner/basics/buildmodel_tutorial.md)
- [Datasets & DataLoaders](https://docs.pytorch.org/tutorials/beginner/basics/data_tutorial.md)
- [Learn the Basics](https://docs.pytorch.org/tutorials/beginner/basics/index.md)
- [Learn the Basics](https://docs.pytorch.org/tutorials/beginner/basics/intro.md)
- [Optimizing Model Parameters](https://docs.pytorch.org/tutorials/beginner/basics/optimization_tutorial.md)
- [Quickstart](https://docs.pytorch.org/tutorials/beginner/basics/quickstart_tutorial.md)
- [Save and Load the Model](https://docs.pytorch.org/tutorials/beginner/basics/saveloadrun_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/basics/sg_execution_times.md)
- [Tensors](https://docs.pytorch.org/tutorials/beginner/basics/tensorqs_tutorial.md)
- [Transforms](https://docs.pytorch.org/tutorials/beginner/basics/transforms_tutorial.md)
- [Fast Transformer Inference with Better Transformer](https://docs.pytorch.org/tutorials/beginner/bettertransformer_tutorial.md)
- [A Gentle Introduction to torch.autograd](https://docs.pytorch.org/tutorials/beginner/blitz/autograd_tutorial.md)
- [Training a Classifier](https://docs.pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.md)
- [Optional: Data Parallelism](https://docs.pytorch.org/tutorials/beginner/blitz/data_parallel_tutorial.md)
- [Deep Learning with PyTorch: A 60 Minute Blitz](https://docs.pytorch.org/tutorials/beginner/blitz/index.md)
- [Neural Networks](https://docs.pytorch.org/tutorials/beginner/blitz/neural_networks_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/blitz/sg_execution_times.md)
- [Tensors](https://docs.pytorch.org/tutorials/beginner/blitz/tensor_tutorial.md)
- [Chatbot Tutorial](https://docs.pytorch.org/tutorials/beginner/chatbot_tutorial.md)
- [Running Tutorials in Google Colab](https://docs.pytorch.org/tutorials/beginner/colab.md)
- [Writing Custom Datasets, DataLoaders and Transforms](https://docs.pytorch.org/tutorials/beginner/data_loading_tutorial.md)
- [DCGAN Tutorial](https://docs.pytorch.org/tutorials/beginner/dcgan_faces_tutorial.md)
- [Fault-tolerant Distributed Training with torchrun](https://docs.pytorch.org/tutorials/beginner/ddp_series_fault_tolerance.md)
- [Distributed Data Parallel in PyTorch - Video Tutorials](https://docs.pytorch.org/tutorials/beginner/ddp_series_intro.md)
- [Multi GPU training with DDP](https://docs.pytorch.org/tutorials/beginner/ddp_series_multigpu.md)
- [What is Distributed Data Parallel (DDP)](https://docs.pytorch.org/tutorials/beginner/ddp_series_theory.md)
- [Deep Learning with PyTorch: A 60 Minute Blitz](https://docs.pytorch.org/tutorials/beginner/deep_learning_60min_blitz.md)
- [Image Segmentation DeepLabV3 on Android](https://docs.pytorch.org/tutorials/beginner/deeplabv3_on_android.md)
- [Image Segmentation DeepLabV3 on iOS](https://docs.pytorch.org/tutorials/beginner/deeplabv3_on_ios.md)
- [PyTorch Distributed Overview](https://docs.pytorch.org/tutorials/beginner/dist_overview.md)
- [Distributed training at scale with PyTorch and Ray Train](https://docs.pytorch.org/tutorials/beginner/distributed_training_with_ray_tutorial.md)
- [<no title>](https://docs.pytorch.org/tutorials/beginner/examples_autograd/index.md)
- [PyTorch: Tensors and autograd](https://docs.pytorch.org/tutorials/beginner/examples_autograd/polynomial_autograd.md)
- [PyTorch: Defining New autograd Functions](https://docs.pytorch.org/tutorials/beginner/examples_autograd/polynomial_custom_function.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/examples_autograd/sg_execution_times.md)
- [PyTorch: Control Flow + Weight Sharing](https://docs.pytorch.org/tutorials/beginner/examples_nn/dynamic_net.md)
- [<no title>](https://docs.pytorch.org/tutorials/beginner/examples_nn/index.md)
- [PyTorch: Custom nn Modules](https://docs.pytorch.org/tutorials/beginner/examples_nn/polynomial_module.md)
- [PyTorch: nn](https://docs.pytorch.org/tutorials/beginner/examples_nn/polynomial_nn.md)
- [PyTorch: optim](https://docs.pytorch.org/tutorials/beginner/examples_nn/polynomial_optim.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/examples_nn/sg_execution_times.md)
- [<no title>](https://docs.pytorch.org/tutorials/beginner/examples_tensor/index.md)
- [Warm-up: numpy](https://docs.pytorch.org/tutorials/beginner/examples_tensor/polynomial_numpy.md)
- [PyTorch: Tensors](https://docs.pytorch.org/tutorials/beginner/examples_tensor/polynomial_tensor.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/examples_tensor/sg_execution_times.md)
- [Adversarial Example Generation](https://docs.pytorch.org/tutorials/beginner/fgsm_tutorial.md)
- [Finetuning Torchvision Models](https://docs.pytorch.org/tutorials/beginner/finetuning_torchvision_models_tutorial.md)
- [Autograd](https://docs.pytorch.org/tutorials/beginner/former_torchies/autograd_tutorial_old.md)
- [nn Package](https://docs.pytorch.org/tutorials/beginner/former_torchies/nnft_tutorial.md)
- [Multi-GPU Examples](https://docs.pytorch.org/tutorials/beginner/former_torchies/parallelism_tutorial.md)
- [Tensors](https://docs.pytorch.org/tutorials/beginner/former_torchies/tensor_tutorial_old.md)
- [PyTorch for Former Torch Users](https://docs.pytorch.org/tutorials/beginner/former_torchies_tutorial.md)
- [Introduction to Holistic Trace Analysis](https://docs.pytorch.org/tutorials/beginner/hta_intro_tutorial.md)
- [Trace Diff using Holistic Trace Analysis](https://docs.pytorch.org/tutorials/beginner/hta_trace_diff_tutorial.md)
- [Hyperparameter tuning using Ray Tune](https://docs.pytorch.org/tutorials/beginner/hyperparameter_tuning_tutorial.md)
- [Introduction to PyTorch - YouTube Series](https://docs.pytorch.org/tutorials/beginner/introyt.md)
- [The Fundamentals of Autograd](https://docs.pytorch.org/tutorials/beginner/introyt/autogradyt_tutorial.md)
- [Model Understanding with Captum](https://docs.pytorch.org/tutorials/beginner/introyt/captumyt.md)
- [Introduction to PyTorch on YouTube](https://docs.pytorch.org/tutorials/beginner/introyt/index.md)
- [Introduction to PyTorch](https://docs.pytorch.org/tutorials/beginner/introyt/introyt1_tutorial.md)
- [Introduction to PyTorch - YouTube Series](https://docs.pytorch.org/tutorials/beginner/introyt/introyt_index.md)
- [Building Models with PyTorch](https://docs.pytorch.org/tutorials/beginner/introyt/modelsyt_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/introyt/sg_execution_times.md)
- [PyTorch TensorBoard Support](https://docs.pytorch.org/tutorials/beginner/introyt/tensorboardyt_tutorial.md)
- [Introduction to PyTorch Tensors](https://docs.pytorch.org/tutorials/beginner/introyt/tensors_deeper_tutorial.md)
- [Training with PyTorch](https://docs.pytorch.org/tutorials/beginner/introyt/trainingyt.md)
- [Knowledge Distillation Tutorial](https://docs.pytorch.org/tutorials/beginner/knowledge_distillation_tutorial.md)
- [Mosaic: Memory Profiling for PyTorch](https://docs.pytorch.org/tutorials/beginner/mosaic_memory_profiling_tutorial.md)
- [Advanced: Making Dynamic Decisions and the Bi-LSTM CRF](https://docs.pytorch.org/tutorials/beginner/nlp/advanced_tutorial.md)
- [Deep Learning with PyTorch](https://docs.pytorch.org/tutorials/beginner/nlp/deep_learning_tutorial.md)
- [Deep Learning for NLP with Pytorch](https://docs.pytorch.org/tutorials/beginner/nlp/index.md)
- [Introduction to PyTorch](https://docs.pytorch.org/tutorials/beginner/nlp/pytorch_tutorial.md)
- [Sequence Models and Long Short-Term Memory Networks](https://docs.pytorch.org/tutorials/beginner/nlp/sequence_models_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/nlp/sg_execution_times.md)
- [Word Embeddings: Encoding Lexical Semantics](https://docs.pytorch.org/tutorials/beginner/nlp/word_embeddings_tutorial.md)
- [What is torch.nn really?](https://docs.pytorch.org/tutorials/beginner/nn_tutorial.md)
- [Export a model with control flow to ONNX](https://docs.pytorch.org/tutorials/beginner/onnx/export_control_flow_model_to_onnx_tutorial.md)
- [Export a PyTorch model to ONNX](https://docs.pytorch.org/tutorials/beginner/onnx/export_simple_model_to_onnx_tutorial.md)
- [ONNX](https://docs.pytorch.org/tutorials/beginner/onnx/index.md)
- [Introduction to ONNX](https://docs.pytorch.org/tutorials/beginner/onnx/intro_onnx.md)
- [Extending the ONNX Exporter Operator Support](https://docs.pytorch.org/tutorials/beginner/onnx/onnx_registry_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/onnx/sg_execution_times.md)
- [Profiling your PyTorch Module](https://docs.pytorch.org/tutorials/beginner/profiler.md)
- [Learning PyTorch with Examples](https://docs.pytorch.org/tutorials/beginner/pytorch_with_examples.md)
- [Saving and Loading Models](https://docs.pytorch.org/tutorials/beginner/saving_loading_models.md)
- [Serve PyTorch models at scale with Ray Serve](https://docs.pytorch.org/tutorials/beginner/serving_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/beginner/sg_execution_times.md)
- [T5-Base Model for Summarization, Sentiment Classification, and Translation](https://docs.pytorch.org/tutorials/beginner/t5_tutoria.md)
- [Template Tutorial](https://docs.pytorch.org/tutorials/beginner/template_tutorial.md)
- [Text classification with the torchtext library](https://docs.pytorch.org/tutorials/beginner/text_sentiment_ngrams_tutorial.md)
- [Preprocess custom text dataset using torchtext](https://docs.pytorch.org/tutorials/beginner/torchtext_custom_dataset_tutorial.md)
- [Transfer Learning for Computer Vision Tutorial](https://docs.pytorch.org/tutorials/beginner/transfer_learning_tutorial.md)
- [Language Modeling with nn.Transformer and torchtext](https://docs.pytorch.org/tutorials/beginner/transformer_tutorial.md)
- [Language Translation with nn.Transformer and torchtext](https://docs.pytorch.org/tutorials/beginner/translation_transformer.md)
- [Understanding requires_grad, retain_grad, Leaf, and Non-leaf Tensors](https://docs.pytorch.org/tutorials/beginner/understanding_leaf_vs_nonleaf_tutorial.md)
- [Compilers](https://docs.pytorch.org/tutorials/compilers_index.md)
- [Deep Dive](https://docs.pytorch.org/tutorials/deep-dive.md)
- [Distributed](https://docs.pytorch.org/tutorials/distributed.md)
- [Domains](https://docs.pytorch.org/tutorials/domains.md)
- [Ecosystem](https://docs.pytorch.org/tutorials/ecosystem.md)
- [Extension](https://docs.pytorch.org/tutorials/extension.md)
- [Welcome to PyTorch Tutorials](https://docs.pytorch.org/tutorials/index.md)
- [Getting Started with Fully Sharded Data Parallel(FSDP)](https://docs.pytorch.org/tutorials/intermediate/FSDP1_tutorial.md)
- [Advanced Model Training with Fully Sharded Data Parallel (FSDP)](https://docs.pytorch.org/tutorials/intermediate/FSDP_advanced_tutorial.md)
- [Getting Started with Fully Sharded Data Parallel (FSDP2)](https://docs.pytorch.org/tutorials/intermediate/FSDP_tutorial.md)
- [Introduction to Libuv TCPStore Backend](https://docs.pytorch.org/tutorials/intermediate/TCPStore_libuv_backend.md)
- [Large Scale Transformer model training with Tensor Parallel (TP)](https://docs.pytorch.org/tutorials/intermediate/TP_tutorial.md)
- [Hooks for autograd saved tensors](https://docs.pytorch.org/tutorials/intermediate/autograd_saved_tensors_hooks_tutorial.md)
- [Multi-Objective NAS with Ax](https://docs.pytorch.org/tutorials/intermediate/ax_multiobjective_nas_tutorial.md)
- [NLP From Scratch: Classifying Names with a Character-Level RNN](https://docs.pytorch.org/tutorials/intermediate/char_rnn_classification_tutorial.md)
- [NLP From Scratch: Generating Names with a Character-Level RNN](https://docs.pytorch.org/tutorials/intermediate/char_rnn_generation_tutorial.md)
- [Compiled Autograd: Capturing a larger backward graph for torch.compile](https://docs.pytorch.org/tutorials/intermediate/compiled_autograd_tutorial.md)
- [Fusing Convolution and Batch Norm using Custom Function](https://docs.pytorch.org/tutorials/intermediate/custom_function_conv_bn_tutorial.md)
- [Double Backward with Custom Functions](https://docs.pytorch.org/tutorials/intermediate/custom_function_double_backward_tutorial.md)
- [Training “real-world” models with DDP](https://docs.pytorch.org/tutorials/intermediate/ddp_series_minGPT.md)
- [Multinode Training](https://docs.pytorch.org/tutorials/intermediate/ddp_series_multinode.md)
- [Getting Started with Distributed Data Parallel](https://docs.pytorch.org/tutorials/intermediate/ddp_tutorial.md)
- [Debugging Hangs with Flight Recorder Using TorchComms and Debug Server](https://docs.pytorch.org/tutorials/intermediate/debug_hangs_with_flight_recorder.md)
- [Distributed Pipeline Parallelism Using RPC](https://docs.pytorch.org/tutorials/intermediate/dist_pipeline_parallel_tutorial.md)
- [Writing Distributed Applications with PyTorch](https://docs.pytorch.org/tutorials/intermediate/dist_tuto.md)
- [Recurrent DQN: Training recurrent policies](https://docs.pytorch.org/tutorials/intermediate/dqn_with_rnn_tutorial.md)
- [Model ensembling](https://docs.pytorch.org/tutorials/intermediate/ensembling.md)
- [Forced Alignment with Wav2Vec2](https://docs.pytorch.org/tutorials/intermediate/forced_alignment_with_torchaudio_tutorial.md)
- [Forward-mode Automatic Differentiation (Beta)](https://docs.pytorch.org/tutorials/intermediate/forward_ad_usage.md)
- [(beta) Building a Simple CPU Performance Profiler with FX](https://docs.pytorch.org/tutorials/intermediate/fx_profiling_tutorial.md)
- [Inductor CPU backend debugging and profiling](https://docs.pytorch.org/tutorials/intermediate/inductor_debug_cpu.md)
- [Data Loading Optimization in PyTorch](https://docs.pytorch.org/tutorials/intermediate/intermediate_data_loading_tutorial.md)
- [Jacobians, Hessians, hvp, vhp, and more: composing function transforms](https://docs.pytorch.org/tutorials/intermediate/jacobians_hessians.md)
- [Train a Mario-playing RL Agent](https://docs.pytorch.org/tutorials/intermediate/mario_rl_tutorial.md)
- [Channels Last Memory Format in PyTorch](https://docs.pytorch.org/tutorials/intermediate/memory_format_tutorial.md)
- [<no title>](https://docs.pytorch.org/tutorials/intermediate/mnist_train_nas.md)
- [Single-Machine Model Parallel Best Practices](https://docs.pytorch.org/tutorials/intermediate/model_parallel_tutorial.md)
- [Interactive Distributed Applications with Monarch](https://docs.pytorch.org/tutorials/intermediate/monarch_distributed_tutorial.md)
- [Neural Tangent Kernels](https://docs.pytorch.org/tutorials/intermediate/neural_tangent_kernels.md)
- [NLP from Scratch](https://docs.pytorch.org/tutorials/intermediate/nlp_from_scratch_index.md)
- [Getting Started - Accelerate Your Scripts with nvFuser](https://docs.pytorch.org/tutorials/intermediate/nvfuser_intro_tutorial.md)
- [How to save memory by fusing the optimizer step into the backward pass](https://docs.pytorch.org/tutorials/intermediate/optimizer_step_in_backward_tutorial.md)
- [Parametrizations Tutorial](https://docs.pytorch.org/tutorials/intermediate/parametrizations.md)
- [Per-sample-gradients](https://docs.pytorch.org/tutorials/intermediate/per_sample_grads.md)
- [A guide on good usage of non_blocking and pin_memory() in PyTorch](https://docs.pytorch.org/tutorials/intermediate/pinmem_nonblock.md)
- [Training Transformer models using Pipeline Parallelism](https://docs.pytorch.org/tutorials/intermediate/pipeline_tutorial.md)
- [Introduction to Distributed Pipeline Parallelism](https://docs.pytorch.org/tutorials/intermediate/pipelining_tutorial.md)
- [Customize Process Group Backends Using Cpp Extensions](https://docs.pytorch.org/tutorials/intermediate/process_group_cpp_extension_tutorial.md)
- [Pruning Tutorial](https://docs.pytorch.org/tutorials/intermediate/pruning_tutorial.md)
- [Real Time Inference on Raspberry Pi 4 and 5 (40 fps!)](https://docs.pytorch.org/tutorials/intermediate/realtime_rpi.md)
- [Reinforcement Learning (PPO) with TorchRL Tutorial](https://docs.pytorch.org/tutorials/intermediate/reinforcement_ppo.md)
- [Reinforcement Learning (DQN) Tutorial](https://docs.pytorch.org/tutorials/intermediate/reinforcement_q_learning.md)
- [Implementing Batch RPC Processing Using Asynchronous Executions](https://docs.pytorch.org/tutorials/intermediate/rpc_async_execution.md)
- [Implementing a Parameter Server Using Distributed RPC Framework](https://docs.pytorch.org/tutorials/intermediate/rpc_param_server_tutorial.md)
- [Getting Started with Distributed RPC Framework](https://docs.pytorch.org/tutorials/intermediate/rpc_tutorial.md)
- [(Beta) Implementing High-Performance Transformers with Scaled Dot Product Attention (SDPA)](https://docs.pytorch.org/tutorials/intermediate/scaled_dot_product_attention_tutorial.md)
- [NLP From Scratch: Translation with a Sequence to Sequence Network and Attention](https://docs.pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.md)
- [Computation times](https://docs.pytorch.org/tutorials/intermediate/sg_execution_times.md)
- [Spatial Transformer Networks Tutorial](https://docs.pytorch.org/tutorials/intermediate/spatial_transformer_tutorial.md)
- [Speech Recognition with Wav2Vec2](https://docs.pytorch.org/tutorials/intermediate/speech_recognition_pipeline_tutorial.md)
- [Visualizing Models, Data, and Training with TensorBoard](https://docs.pytorch.org/tutorials/intermediate/tensorboard_tutorial.md)
- [Text-to-speech with Tacotron2](https://docs.pytorch.org/tutorials/intermediate/text_to_speech_with_torchaudio.md)
- [Building a Convolution/Batch Norm fuser with torch.compile](https://docs.pytorch.org/tutorials/intermediate/torch_compile_conv_bn_fuser.md)
- [torch.compile End-to-End Tutorial](https://docs.pytorch.org/tutorials/intermediate/torch_compile_full_example.md)
- [Introduction to torch.compile](https://docs.pytorch.org/tutorials/intermediate/torch_compile_tutorial.md)
- [torch.export Tutorial](https://docs.pytorch.org/tutorials/intermediate/torch_export_tutorial.md)
- [Introduction to TorchRec](https://docs.pytorch.org/tutorials/intermediate/torchrec_intro_tutorial.md)
- [Introduction to TorchRec](https://docs.pytorch.org/tutorials/intermediate/torchrec_tutorial.md)
- [TorchVision Object Detection Finetuning Tutorial](https://docs.pytorch.org/tutorials/intermediate/torchvision_tutorial.md)
- [Accelerating PyTorch Transformers by replacing nn.Transformer with Nested Tensors and torch.compile()](https://docs.pytorch.org/tutorials/intermediate/transformer_building_blocks.md)
- [Using Variable Length Attention in PyTorch](https://docs.pytorch.org/tutorials/intermediate/variable_length_attention_tutorial.md)
- [Visualizing Gradients](https://docs.pytorch.org/tutorials/intermediate/visualizing_gradients_tutorial.md)
- [Intro](https://docs.pytorch.org/tutorials/intro.md)
- [Making Native Android Application that uses PyTorch prebuilt libraries](https://docs.pytorch.org/tutorials/recipes/android_native_app_with_custom_op.md)
- [(beta) Compiling the optimizer with torch.compile](https://docs.pytorch.org/tutorials/recipes/compiling_optimizer.md)
- [(beta) Running the compiled optimizer with an LR Scheduler](https://docs.pytorch.org/tutorials/recipes/compiling_optimizer_lr_scheduler.md)
- [DebugMode: Recording Dispatched Operations and Numerical Debugging](https://docs.pytorch.org/tutorials/recipes/debug_mode_tutorial.md)
- [Asynchronous Saving with Distributed Checkpoint (DCP)](https://docs.pytorch.org/tutorials/recipes/distributed_async_checkpoint_recipe.md)
- [Getting Started with Distributed Checkpoint (DCP)](https://docs.pytorch.org/tutorials/recipes/distributed_checkpoint_recipe.md)
- [Getting Started with CommDebugMode](https://docs.pytorch.org/tutorials/recipes/distributed_comm_debug_mode.md)
- [Getting Started with DeviceMesh](https://docs.pytorch.org/tutorials/recipes/distributed_device_mesh.md)
- [<no title>](https://docs.pytorch.org/tutorials/recipes/distributed_optim_torchscript.md)
- [Profiling PyTorch RPC-Based Workloads](https://docs.pytorch.org/tutorials/recipes/distributed_rpc_profiling.md)
- [Explicit horizontal fusion with foreach_map and torch.compile](https://docs.pytorch.org/tutorials/recipes/foreach_map.md)
- [Ease-of-use quantization for PyTorch with Intel® Neural Compressor](https://docs.pytorch.org/tutorials/recipes/intel_neural_compressor_for_pytorch.md)
- [Loading data in PyTorch](https://docs.pytorch.org/tutorials/recipes/loading_data_recipe.md)
- [(beta) Efficient mobile interpreter in Android and iOS](https://docs.pytorch.org/tutorials/recipes/mobile_interpreter.md)
- [Pytorch Mobile Performance Recipes](https://docs.pytorch.org/tutorials/recipes/mobile_perf.md)
- [Model Preparation for Android Recipe](https://docs.pytorch.org/tutorials/recipes/model_preparation_android.md)
- [Model Preparation for iOS Recipe](https://docs.pytorch.org/tutorials/recipes/model_preparation_ios.md)
- [Profiling PyTorch workloads with The Instrumentation and Tracing Technology (ITT) API](https://docs.pytorch.org/tutorials/recipes/profile_with_itt.md)
- [Summary of PyTorch Mobile Recipes](https://docs.pytorch.org/tutorials/recipes/ptmobile_recipes_summary.md)
- [Model Interpretability using Captum](https://docs.pytorch.org/tutorials/recipes/recipes/Captum_Recipe.md)
- [Automatic Mixed Precision](https://docs.pytorch.org/tutorials/recipes/recipes/amp_recipe.md)
- [SyntaxError](https://docs.pytorch.org/tutorials/recipes/recipes/benchmark.md)
- [Changing default device](https://docs.pytorch.org/tutorials/recipes/recipes/changing_default_device.md)
- [Defining a Neural Network in PyTorch](https://docs.pytorch.org/tutorials/recipes/recipes/defining_a_neural_network.md)
- [PyTorch Recipes](https://docs.pytorch.org/tutorials/recipes/recipes/index.md)
- [Tips for Loading an nn.Module from a Checkpoint](https://docs.pytorch.org/tutorials/recipes/recipes/module_load_state_dict_tips.md)
- [PyTorch Profiler](https://docs.pytorch.org/tutorials/recipes/recipes/profiler_recipe.md)
- [Reasoning about Shapes in PyTorch](https://docs.pytorch.org/tutorials/recipes/recipes/reasoning_about_shapes.md)
- [Save Load Across Devices](https://docs.pytorch.org/tutorials/recipes/recipes/save_load_across_devices.md)
- [Saving And Loading A General Checkpoint](https://docs.pytorch.org/tutorials/recipes/recipes/saving_and_loading_a_general_checkpoint.md)
- [Saving And Loading Models For Inference](https://docs.pytorch.org/tutorials/recipes/recipes/saving_and_loading_models_for_inference.md)
- [Saving Multiple Models In One File](https://docs.pytorch.org/tutorials/recipes/recipes/saving_multiple_models_in_one_file.md)
- [Computation times](https://docs.pytorch.org/tutorials/recipes/recipes/sg_execution_times.md)
- [Extension points in nn.Module for load_state_dict and tensor subclasses](https://docs.pytorch.org/tutorials/recipes/recipes/swap_tensors.md)
- [How to use TensorBoard with PyTorch](https://docs.pytorch.org/tutorials/recipes/recipes/tensorboard_with_pytorch.md)
- [Timer quick start](https://docs.pytorch.org/tutorials/recipes/recipes/timer_quick_start.md)
- [Performance Tuning Guide](https://docs.pytorch.org/tutorials/recipes/recipes/tuning_guide.md)
- [Warmstarting model using parameters from a different model in PyTorch](https://docs.pytorch.org/tutorials/recipes/recipes/warmstarting_model_using_parameters_from_a_different_model.md)
- [What is a state_dict in PyTorch](https://docs.pytorch.org/tutorials/recipes/recipes/what_is_state_dict.md)
- [Zeroing out gradients in PyTorch](https://docs.pytorch.org/tutorials/recipes/recipes/zeroing_out_gradients.md)
- [Reducing AoT cold start compilation time with regional compilation](https://docs.pytorch.org/tutorials/recipes/regional_aot.md)
- [Reducing torch.compile cold start compilation time with regional compilation](https://docs.pytorch.org/tutorials/recipes/regional_compilation.md)
- [Script and Optimize for Mobile Recipe](https://docs.pytorch.org/tutorials/recipes/script_optimized.md)
- [Computation times](https://docs.pytorch.org/tutorials/recipes/sg_execution_times.md)
- [Compile Time Caching Configuration](https://docs.pytorch.org/tutorials/recipes/torch_compile_caching_configuration_tutorial.md)
- [Compile Time Caching in torch.compile](https://docs.pytorch.org/tutorials/recipes/torch_compile_caching_tutorial.md)
- [(beta) Utilizing Torch Function modes with torch.compile](https://docs.pytorch.org/tutorials/recipes/torch_compile_torch_function_modes.md)
- [Using User-Defined Triton Kernels with torch.compile](https://docs.pytorch.org/tutorials/recipes/torch_compile_user_defined_triton_kernel_tutorial.md)
- [Dynamic Compilation Control with torch.compiler.set_stance](https://docs.pytorch.org/tutorials/recipes/torch_compiler_set_stance_tutorial.md)
- [torch.export AOTInductor Tutorial for Python runtime (Beta)](https://docs.pytorch.org/tutorials/recipes/torch_export_aoti_python.md)
- [Demonstration of torch.export flow, common challenges and the solutions to address them](https://docs.pytorch.org/tutorials/recipes/torch_export_challenges_solutions.md)
- [(beta) Using TORCH_LOGS python API with torch.compile](https://docs.pytorch.org/tutorials/recipes/torch_logs.md)
- [<no title>](https://docs.pytorch.org/tutorials/recipes/torchscript_inference.md)
- [Optimizing CPU Performance on Intel® Xeon® with run_cpu Script](https://docs.pytorch.org/tutorials/recipes/xeon_run_cpu.md)
- [Shard Optimizer States with ZeroRedundancyOptimizer](https://docs.pytorch.org/tutorials/recipes/zero_redundancy_optimizer.md)
- [Recipes](https://docs.pytorch.org/tutorials/recipes_index.md)
- [Computation times](https://docs.pytorch.org/tutorials/sg_execution_times.md)
- [Introduction to Context Parallel](https://docs.pytorch.org/tutorials/unstable/context_parallel.md)
- [Profiling PyTorch RPC-Based Workloads](https://docs.pytorch.org/tutorials/unstable/distributed_rpc_profiling.md)
- [Flight Recorder for Debugging Stuck Jobs](https://docs.pytorch.org/tutorials/unstable/flight_recorder_tutorial.md)
- [(prototype) Accelerating torch.save and torch.load with GPUDirect Storage](https://docs.pytorch.org/tutorials/unstable/gpu_direct_storage.md)
- [(prototype) GPU Quantization with TorchAO](https://docs.pytorch.org/tutorials/unstable/gpu_quantization_torchao_tutorial.md)
- [TorchInductor C++ Wrapper Tutorial](https://docs.pytorch.org/tutorials/unstable/inductor_cpp_wrapper_tutorial.md)
- [How to use torch.compile on Windows CPU/XPU](https://docs.pytorch.org/tutorials/unstable/inductor_windows.md)
- [<no title>](https://docs.pytorch.org/tutorials/unstable/inductor_windows_cpu.md)
- [(Prototype) Convert Mobilenetv2 to Core ML](https://docs.pytorch.org/tutorials/unstable/ios_coreml_workflow.md)
- [(Prototype) Use iOS GPU in PyTorch](https://docs.pytorch.org/tutorials/unstable/ios_gpu_workflow.md)
- [(Prototype) Introduce lite interpreter workflow in Android and iOS](https://docs.pytorch.org/tutorials/unstable/lite_interpreter.md)
- [Efficiently writing “sparse” semantics for Adagrad with MaskedTensor](https://docs.pytorch.org/tutorials/unstable/maskedtensor_adagrad.md)
- [MaskedTensor Advanced Semantics](https://docs.pytorch.org/tutorials/unstable/maskedtensor_advanced_semantics.md)
- [MaskedTensor Overview](https://docs.pytorch.org/tutorials/unstable/maskedtensor_overview.md)
- [MaskedTensor Sparsity](https://docs.pytorch.org/tutorials/unstable/maskedtensor_sparsity.md)
- [Using Max-Autotune Compilation on CPU for Better Performance](https://docs.pytorch.org/tutorials/unstable/max_autotune_on_CPU_tutorial.md)
- [Getting Started with Nested Tensors](https://docs.pytorch.org/tutorials/unstable/nestedtensor.md)
- [(Beta) Convert MobileNetV2 to NNAPI](https://docs.pytorch.org/tutorials/unstable/nnapi_mobilenetv2.md)
- [PyTorch 2 Export Quantization for OpenVINO torch.compile Backend](https://docs.pytorch.org/tutorials/unstable/openvino_quantizer.md)
- [Autoloading Out-of-Tree Extension](https://docs.pytorch.org/tutorials/unstable/python_extension_autoload.md)
- [Computation times](https://docs.pytorch.org/tutorials/unstable/sg_execution_times.md)
- [(prototype) Tracing-based Selective Build Mobile Interpreter in Android and iOS](https://docs.pytorch.org/tutorials/unstable/tracing_based_selective_build.md)
- [torch.vmap](https://docs.pytorch.org/tutorials/unstable/vmap_recipe.md)
- [Unstable](https://docs.pytorch.org/tutorials/unstable_index.md)