extio-de
|
685c740c5c
|
New tool: Create; New tool: Contextual instructions; Rewrite: Configure cnt for both impr and enh; Task Execution: Reimplemented task queuing approach; Fixes;
|
2024-12-26 21:49:51 +01:00 |
|
extio-de
|
dc5a4f3e25
|
Improve contextual prompt instruction;
|
2024-12-20 00:43:16 +01:00 |
|
extio-de
|
d44fd53323
|
Configurable model categories;
|
2024-12-20 00:14:02 +01:00 |
|
extio-de
|
74eaa5c72b
|
Tool pipelines;
|
2024-12-19 19:20:45 +01:00 |
|
extio-de
|
bfb4e8be3b
|
Text2Jsonl2HistoryInstructCompletion: Improved llm prompt; Utils: normalizeModelResponse(), streamOut();
|
2024-12-19 14:04:01 +01:00 |
|
extio-de
|
56b7dcb265
|
MergeJsonl tools accepts multiple directories;
|
2024-12-18 20:48:58 +01:00 |
|
extio-de
|
1c94b97b92
|
DatasetTool marker interface;
|
2024-12-18 20:42:12 +01:00 |
|
extio-de
|
54ebdb2e51
|
New tool: Text2Jsonl2HistoryInstructCompletion;
|
2024-12-18 20:07:07 +01:00 |
|
extio-de
|
75c2109d6d
|
Switch dataset preparer to lmlib;
|
2024-12-18 20:05:03 +01:00 |
|
extio-de
|
fb34561bd5
|
Client: Collect and show more statistics; MergeJsonl: Shuffle merged json; Rewrite: Fix progress indicator;
|
2024-12-10 18:11:48 +01:00 |
|
extio-de
|
f0872fb7ee
|
createCharacterNameMapping: Changed log level;
|
2024-12-02 11:36:03 +01:00 |
|
extio-de
|
57f7ec2e48
|
Text2Jsonl2WithContextualPrompts: Prompt improved; Name mapping requires at least 5 characters (otherwise we may replace random syllables);
|
2024-12-01 22:50:53 +01:00 |
|
extio-de
|
b027c2a892
|
Text2Jsonl2WithContextualPrompts: Rename persons; Prompt conversation contexts;
|
2024-12-01 18:32:36 +01:00 |
|
extio-de
|
dda9400cc1
|
Text2Jsonl2WithContextualPrompts: Overlap chunks;
|
2024-11-16 10:54:06 +01:00 |
|
extio-de
|
70822207dd
|
splitParagraphs: Split by the closest occurence to chunk_norm instead of chunk_min;
|
2024-11-16 10:52:28 +01:00 |
|
extio-de
|
82f969d666
|
Fix paragraphToContextualPrompt response post-processing;
|
2024-11-03 22:53:35 +01:00 |
|
extio-de
|
cb8ac57580
|
Improved prompt for Text2Jsonl2WithContextualPrompts;
|
2024-11-03 20:37:22 +01:00 |
|
extio-de
|
509f36238d
|
Fix MixtralPromptStrategy; Refactoring;
|
2024-11-02 12:24:28 +01:00 |
|
extio-de
|
1813ab8928
|
Client refactoring; MergeJsonl tool;
|
2024-11-01 19:41:03 +01:00 |
|
stephan-birkl
|
3b6a0ee74a
|
Update Client.java
|
2024-11-01 17:43:40 +01:00 |
|
extio-de
|
e40e648557
|
splitParagraphs
|
2024-11-01 15:48:28 +01:00 |
|
extio-de
|
14bd1c1915
|
splitParagraphs
|
2024-11-01 15:31:24 +01:00 |
|
extio-de
|
65e50e1dcc
|
Sliding contexts for contextual prompts;
|
2024-11-01 15:08:26 +01:00 |
|
extio-de
|
7232387134
|
Switched remaining tools to streaming output;
Generate contextual prompt datasets as single files per input;
Added Alpaca prompt template;
Generate multiple contextual prompt lengths;
|
2024-11-01 13:43:59 +01:00 |
|
extio-de
|
dca4aa0a29
|
Refactoring; Readme;
|
2024-10-30 00:21:18 +01:00 |
|
extio-de
|
efb520fc07
|
New generator: Jsonl QA style contextual prompts;
JsonL: Add sliding windows;
Streamed jsonl output;
Memory optimization: Buffered, blocking task creation;
|
2024-10-29 23:51:41 +01:00 |
|
extio-de
|
4b93ed97be
|
Fix splitParagraphs; Improved prompts;
|
2024-10-29 21:00:23 +01:00 |
|
extio-de
|
030bc5bee1
|
Improved rewriting;
|
2024-10-27 09:54:34 +01:00 |
|
extio-de
|
59dc27a8ef
|
initial commit
|
2024-10-20 21:04:32 +02:00 |
|