Batched loading and chunking of text datasets;

This commit is contained in:
extio-de
2025-02-09 16:17:27 +01:00
parent f253fde344
commit cb52446985
4 changed files with 24 additions and 10 deletions

View File

@@ -1,2 +1,4 @@
{ "text": "When you look down at your feet, you always see green stones on the ground." }
{ "text": "When you glance downwards, you always notice green pebbles scattered about." }
{ "text": "In the stillness of the night, I'd lie awake thinking about the secrets hidden within the ancient texts written on green stone tablets." }
{ "text": "It's said that the location of a long-lost city lies hidden beneath a vast expanse of green rocks stretching as far as the eye can see." }