Instruction finetuning
1. Instruction dataset gathered at https://huggingface.co/collections/mesolitica/malaysian-synthetic-dataset-656c2673fe7fe0b1e9e25fe2
2. Notebook to prepare dataset at https://github.com/mesolitica/malaysian-dataset/blob/master/llm-instruction/combine-malay-no-alignment-multitasks-partial-ultrachat-v2.ipynb
3. Prepared data pushed to https://huggingface.co/datasets/malaysia-ai/mosaic-chat-instructions-partial-ultrachat-v2
Created on December 10|Last edited on December 13
Comment
MaLLaM 5B
1
MaLLaM 1.1B
1
MaLLaM 3B
1
Mistral 7B
6
TinyLlama 1.1B
1
Add a comment