Benchmarking gemma2-9b Efficiency Across Fine-Tuning Techniques

Contents

• Benchmarking gemma2-9b Efficiency Across Fine-Tuning Techniques
  • Contents
    • Experiments list
  • Inspiration

Experiments list

• document full chart and finesetup and inference setup on local
• Model architecture:
  • Gemma2-9b LLMs from scratch for small dataset
  • alternative for Collators used in model its have some limitations

Inspiration

• The dataset to explore Competition
• I took this repository from tascj/kaggle-lmsys-chatbot-arena-post, to explore some functionality.