Code_Up_Repository

• A repository documenting efforts to study coding:
• Striving to boldly apply the latest libraries, techniques, and technologies for coding practice.
• Primarily utilizing PyTorch Lightning and Huggingface.

Planned Tasks

• Implementing model architectures from scratch, covering the entire process from training to inference.
• Constructing architectures using pre-trained models.

To be Implemented

• Transformers Architecture (Completed - Model)
  • PyTorch
  • Paper
• BERT
  • PyTorch, PyTorch Ligthning
  • self_making
    • 직접 Huggingface의 Bert 코드와 아래 레퍼런스의 'BERT code 이해'를 보고 짠 소스코드
  • pretrained
    • Huggingface의 Pretrained model을 가져와 Classification을 하는 코드
  • Reference
    • Huggingface BERT
    • BERT code 이해
• GPT
• Llama 2
  • 1. KoAlpaca Tuning Example
  • Llama2 : Open Foundation and Fine-Tuned Chat Models
  • Paper