How to paste in multiple lines?

[jlebon]

I'm sure I'm missing something obvious here, but... how do I actually pass multiple lines to the prompt? I tried with \ or doing a block copy and paste, but ramalama just passes the line to the model immediately after the first line. This makes it impossible to pass e.g. a block of code.

[ericcurtin]

Hmmmm good point... You can do this kinda thing in RamaLama:

cat some_code.txt | ramalama run smollm:135m "Review my code"

A lot of this command prompt logic is gonna change soon in:

#1158

Which will change the prompt from using linenoise.cpp to https://docs.python.org/3/library/cmd.html

But I think python's cmd default is to treat a new line like an Enter... Likely we can change this default behaviour in python's cmd, we've changed it's default behaviour for a few things already, it's the RamaLamaShell class:

ramalama/libexec/ramalama/ramalama-client-core

Line 82 in e1f8fb8

class RamaLamaShell(cmd.Cmd):

Another thing that can be done is OpenWebUI or AnythingLLM can be connected to ramalama serve but we should get this working the CLI prompt too, like you say...

[ericcurtin]

I dug into python's cmd library which is generally based on readline, multi-line support isn't impossible, but tricky, there's assumptions that Enter and newline are the same.

[ericcurtin]

FWIW, I'd be interested in seeing an implementation of what you describe in any language @jlebon be in C/C++/golang/python3 etc. Just a simple shell like standalone thing that behaves how you describe.

[ericcurtin]

Probably don't recommend C/C++ actually went that route, it's either 2000+ lines of code or use readline library, both have issues