Show HN: TUI-use: Let AI agents control interactive terminal programs

wolttam

This is kind of fun, something I've been thinking about over the last couple days. This is one area that makes me feel like our current LLM approach is just not quite general enough. Yes, developers and power users love the command-line, because it is the most efficient way to accomplish many tasks. But it's rarely (never?) our only tool. We often reach for TUIs and GUIs. It's why approaches like this get me excited: https://si.inc/posts/fdm1/

mccoyb

Something something medical researcher reinvents calculus. In 2026: frontend web developer reinvents tmux. Guys, please do us the service of pre-filtering your crack token dreams by investigating the tool stack which is already available in the terminal ... or at least give us the courtesy of explaining why your vibecoded Greenspun's 10th something is a significant leg up on what already exists, and perhaps has existed for many years, (and is therefore, in the training set, and is therefore, probably going to work perfectly out of the box).

wild_egg

I've had my agents using tmux for these use cases for a couple years now. What does TUI-use offer on top?

petcat

Maybe I'll use this to feed prompts into an interactive Claude session so I can use my max subscription instead of having to pay for API credits when using claude -p

mikkupikku

Are they any good at nethack?

8note

hehe, i made something similar for feedback loop on claude hooks. claude can open another claude instance in the testing folder, and check to see if the hooks fire properly

halfwhey

That’s neat I was working on a skill for this exact purpose: https://github.com/halfwhey/skills/tree/master/plugins/tmux Two use cases I use this for is debugging with GDB/PDB and giving me walkthroughs on how to use TUIs

flux3125

Finally Claude Code can now control Claude Code

alfonsodev

I could make agents use delve (a go lang debugger) interactively, and it worked quite well specially when models weren't as good as they are now, they could choose where to put the breakpoint and inspect variables, I found that was the only way to unlock some situations when they insisted in that "it must be working", and it wasn't, I found that giving them the empirical tools to check for themselves was the only way to unstuck them. Another use was for them to read the logs out of your development web server ( typical npm run dev, go run .) I could do this with tmux send-keys and tmux capture-pane, you just need to organise the session, panes and windows and tell the agent where is what. That was my first agent to tool communication experience, and it was cool. After that I experimented with a agent to agent communication, and I would prompt to claude "after you finish ask @alex to review your code". In the CLAUDE.md file i'd explain that to talk to @alex you need to send the message using tmux send-keys to his tmux session, and to codex I'd say "when you received a review request from @claudia do .. such and such, and when you finish write her back the result of it" I added one more agent to coordinate a todo list, and send next tasks. After that I got a bit carried away and wrote some code to organise things in matrix chat rooms, (because the mobile app just works with your server) and I was fascinated that they seem to be collaborating quite well (to some extend), but it didn't scale. I abandoned the "project" because after all I found agents were getting better and better and implementing internal todo tasks, subagents ...etc plus some other tmux orchestrations tools appeared every other day. I got fatigued of some many new ai things coming up, that and the end, I went back to just use iTerm, split panes, and manually coordinate things. Tabs for projects, panes for agents, no more than 2 agents per project ( max 3 for a side non conflicting task ) I think that is also what cognitively does not tire me. My project name was cool though, tamex, as in tame tmux agents :) And to comment on the submission, I think the idea has potential, I might give it a try, the key is to have low friction and require low cognitive load from the end user. I think that's why skills after all are the thing that is going to stick the most.

ofabioroma

Does it work with any TUI?

ofabioroma

Does it work on any TUI?

6thbit

I thought Codex at least already can handle interactive sessions of programs, e.g. GDB.

kristopolous

My version works on small local models and uses tmux under the hood. No installation is necessary. Simply tell your agent to run uvx agent-cli-helper and that's it. The verbiage and flow is optimized through test harnesses to maximize effectiveness for agentic use. https://github.com/day50-dev/acli (Sorry: my marketing and and pitch skills are trash)

zmmmmm

So if I'm understanding right, Claude Code can use Claude Code now?

dchuk

I’ve used something similar a bit and it worked very well: https://github.com/pproenca/agent-tui