Note
This project is stopped due to lack of computational resources. However, I will continue the project in the future with more computational resources.
This repository serves as a practical review of deep learning and machine learning concepts. To make the learning process more engaging, the project focuses on a specific topic in deep learning: positional encoding. To archive that, this project will build the BERT model from scratch and evaluate the positional encoding in the BERT model. The implementation will be done using the PyTorch framework.