exo/lm-dataset-preparer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
5 Commits 1 Branch 0 Tags
efb520fc072ce0d557c0c59ba08c806648aa3d65
Commit Graph

5 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
extio-de
efb520fc07 New generator: Jsonl QA style contextual prompts; 
JsonL: Add sliding windows;
Streamed jsonl output;
Memory optimization: Buffered, blocking task creation;
 2024-10-29 23:51:41 +01:00
extio-de
4b93ed97be Fix splitParagraphs; Improved prompts; 2024-10-29 21:00:23 +01:00
extio-de
030bc5bee1 Improved rewriting; 2024-10-27 09:54:34 +01:00
extio-de
78a814a64e Readme 2024-10-20 22:01:19 +02:00
extio-de
59dc27a8ef initial commit 2024-10-20 21:04:32 +02:00