exo/lm-dataset-preparer
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
6 Commits 1 Branch 0 Tags
dca4aa0a29306181398034a34466b1ed539244c6
Commit Graph

5 Commits

Author SHA1 Message Date
extio-de
dca4aa0a29 Refactoring; Readme; 2024-10-30 00:21:18 +01:00
extio-de
efb520fc07 New generator: Jsonl QA style contextual prompts; 
JsonL: Add sliding windows;
Streamed jsonl output;
Memory optimization: Buffered, blocking task creation;
 2024-10-29 23:51:41 +01:00
extio-de
4b93ed97be Fix splitParagraphs; Improved prompts; 2024-10-29 21:00:23 +01:00
extio-de
030bc5bee1 Improved rewriting; 2024-10-27 09:54:34 +01:00
extio-de
59dc27a8ef initial commit 2024-10-20 21:04:32 +02:00