Red Pajama 2: The Public Dataset With a Whopping 30 Trillion Tokens

Together, the developer, claims it is the largest public dataset specifically for language model pre-training

RedPajama training progress at 440 billion tokens

ChatGPT / Generative AI recent news, page 3 of 19

Total Licensing Spring 24 by Total Licensing - Issuu

ChatGPT / Generative AI recent news, page 5 of 21

RedPajama Reproducing LLaMA🦙 Dataset on 1.2 Trillion Tokens, by Angelina Yang

RedPajama's Giant 30T Token Dataset Shows that Data is the Next Frontier in LLMs

RedPajama, a project to create leading open-source models, starts by reproducing LLaMA training dataset of over 1.2 trillion tokens

Data science recent news

cerebras/SlimPajama-627B · Datasets at Hugging Face

RedPajama Reproducing LLaMA🦙 Dataset on 1.2 Trillion Tokens, by Angelina Yang

ChatGPT / Generative AI recent news, page 3 of 19

RedPajama Reproducing LLaMA🦙 Dataset on 1.2 Trillion Tokens, by Angelina Yang

Language models recent news, page 7 of 25

2311.17035] Scalable Extraction of Training Data from (Production) Language Models

2311.17035] Scalable Extraction of Training Data from (Production) Language Models