Files
lm-launcher/README.md

1.5 KiB
Raw Blame History

lm-launcher

A small Swing GUI for managing local GGUF models and launching apps with model-dependent command-line placeholders.

What it does

  • scans a configured models directory for .gguf files
  • stores per-model settings in models.json
  • stores app launch definitions in apps.json
  • launches apps with placeholders resolved from the selected model

Model settings

Each model can store:

  • context length
  • max context length
  • threads
  • GPU layers
  • prompt template
  • temperature
  • top-p
  • top-k
  • min-p

The main window also provides sliders for quickly adjusting launch-time values for:

  • context length
  • threads
  • GPU layers
  • temperature
  • top-p
  • top-k
  • min-p

App placeholders

Use these tokens in app arguments:

  • MODEL
  • CONTEXT_SIZE
  • THREADS
  • GPU_LAYERS
  • TEMP
  • TOP_P
  • TOP_K
  • MIN_P

Example:

-m MODEL -c CONTEXT_SIZE -t THREADS -ngl GPU_LAYERS --temp TEMP --top-p TOP_P --top-k TOP_K --min-p MIN_P

Files

  • lm-launcher.properties – launcher configuration
  • models.json – saved model settings
  • apps.json – saved app definitions
  • run.sh – starts the packaged launcher jar

Run

./run.sh

To build from source with the bundled Jackson jars:

javac -cp jackson-annotations-2.17.2.jar:jackson-core-2.17.2.jar:jackson-databind-2.17.2.jar -d /tmp/lm-launcher-build $(find src -name '*.java' | sort)
java -cp /tmp/lm-launcher-build:jackson-annotations-2.17.2.jar:jackson-core-2.17.2.jar:jackson-databind-2.17.2.jar de.extio.lm_launcher.Main