extio-de
|
1c94b97b92
|
DatasetTool marker interface;
|
2024-12-18 20:42:12 +01:00 |
|
extio-de
|
54ebdb2e51
|
New tool: Text2Jsonl2HistoryInstructCompletion;
|
2024-12-18 20:07:07 +01:00 |
|
extio-de
|
75c2109d6d
|
Switch dataset preparer to lmlib;
|
2024-12-18 20:05:03 +01:00 |
|
extio-de
|
fb34561bd5
|
Client: Collect and show more statistics; MergeJsonl: Shuffle merged json; Rewrite: Fix progress indicator;
|
2024-12-10 18:11:48 +01:00 |
|
extio-de
|
6648ce43ef
|
Updated description;
|
2024-12-02 23:15:44 +01:00 |
|
extio-de
|
f0872fb7ee
|
createCharacterNameMapping: Changed log level;
|
2024-12-02 11:36:03 +01:00 |
|
extio-de
|
57f7ec2e48
|
Text2Jsonl2WithContextualPrompts: Prompt improved; Name mapping requires at least 5 characters (otherwise we may replace random syllables);
|
2024-12-01 22:50:53 +01:00 |
|
extio-de
|
b027c2a892
|
Text2Jsonl2WithContextualPrompts: Rename persons; Prompt conversation contexts;
|
2024-12-01 18:32:36 +01:00 |
|
extio-de
|
dda9400cc1
|
Text2Jsonl2WithContextualPrompts: Overlap chunks;
|
2024-11-16 10:54:06 +01:00 |
|
extio-de
|
70822207dd
|
splitParagraphs: Split by the closest occurence to chunk_norm instead of chunk_min;
|
2024-11-16 10:52:28 +01:00 |
|
extio-de
|
82f969d666
|
Fix paragraphToContextualPrompt response post-processing;
|
2024-11-03 22:53:35 +01:00 |
|
extio-de
|
cb8ac57580
|
Improved prompt for Text2Jsonl2WithContextualPrompts;
|
2024-11-03 20:37:22 +01:00 |
|
extio-de
|
509f36238d
|
Fix MixtralPromptStrategy; Refactoring;
|
2024-11-02 12:24:28 +01:00 |
|
extio-de
|
1813ab8928
|
Client refactoring; MergeJsonl tool;
|
2024-11-01 19:41:03 +01:00 |
|
extio-de
|
94a20bd4ed
|
Merge pull request #1 from stephan-birkl/patch-1
Update Client.java
|
2024-11-01 19:18:35 +01:00 |
|
stephan-birkl
|
3b6a0ee74a
|
Update Client.java
|
2024-11-01 17:43:40 +01:00 |
|
extio-de
|
e40e648557
|
splitParagraphs
|
2024-11-01 15:48:28 +01:00 |
|
extio-de
|
14bd1c1915
|
splitParagraphs
|
2024-11-01 15:31:24 +01:00 |
|
extio-de
|
65e50e1dcc
|
Sliding contexts for contextual prompts;
|
2024-11-01 15:08:26 +01:00 |
|
extio-de
|
7232387134
|
Switched remaining tools to streaming output;
Generate contextual prompt datasets as single files per input;
Added Alpaca prompt template;
Generate multiple contextual prompt lengths;
|
2024-11-01 13:43:59 +01:00 |
|
extio-de
|
2087405c64
|
Readme;
|
2024-10-30 00:22:54 +01:00 |
|
extio-de
|
dca4aa0a29
|
Refactoring; Readme;
|
2024-10-30 00:21:18 +01:00 |
|
extio-de
|
efb520fc07
|
New generator: Jsonl QA style contextual prompts;
JsonL: Add sliding windows;
Streamed jsonl output;
Memory optimization: Buffered, blocking task creation;
|
2024-10-29 23:51:41 +01:00 |
|
extio-de
|
4b93ed97be
|
Fix splitParagraphs; Improved prompts;
|
2024-10-29 21:00:23 +01:00 |
|
extio-de
|
030bc5bee1
|
Improved rewriting;
|
2024-10-27 09:54:34 +01:00 |
|
extio-de
|
78a814a64e
|
Readme
|
2024-10-20 22:01:19 +02:00 |
|
extio-de
|
59dc27a8ef
|
initial commit
|
2024-10-20 21:04:32 +02:00 |
|