nn.Xxx nn.functional.xxx nn.Conv2d nn.functional.conv2d nn.Dropout nn.functional.dropout dropout.

tocrch.nn torch.nn nnautograd nn.Parameter nn.Linear&nn.conv2d nn.functional nn.Module nn.Sequential.

  1. nn.Embedding(10, 5) 10 5 .

Understanding the Context

Linear+SoftmaxSoftmaxnn.Transformer nn.Transformernn.TransformerEncodernn.TransformerDecoder .

pytorchnn.embedding pytorchnn.embeddingword2vec (skip-gram cbow) 28 .

() .

Pytorchnn.CrossEntropyLoss ()weight label0-30123lossweight weight .

Key Insights

Pytorch nn.AdaptiveAvgPool2d (output_size) ? : nn.AdaptiveAvgPo

nn.Module .

pytorchtorch.nn.Parameter [] [] .