| | --- |
| | license: cc-by-nc-nd-4.0 |
| | tags: |
| | - Image |
| | - Captionning |
| | - RESNET-152 |
| | - LSTM |
| | --- |
| | |
| | ## Introduction |
| |
|
| | This model is defined as proposed in the book "mastering pytorch". |
| | It is based on CNN-encoder and a LSTM-decoder. |
| |
|
| | The CNN-encoder is based on a pretrained RESNET-152. The last layer of the resnet is replaced by a vector embedding layer of 256 elements. |
| | The LSTM-decoder use an input of 256, a hidden layer of 512, and uses the vocabulary size. |
| |
|
| | The model has been trained as a pure learning exercise, and so the model performances remain relatively mean. |
| |
|
| | ## Training procedure |
| |
|
| | For the sake of the exercise, the model has been trained for only 5 epochs. |
| |
|
| | It has been trained on the COCO dataset. |