martosaur

martosaur

Handwave is a thin wrapper around InstructorLite that makes it simpler to use vague handwaving in your apps.

It comes with 3 built-in providers (Handwave.OpenAI, Handwave.Claude and Handwave.Gemini) and behaviour to define your own.

Here’s its whole API surface:

  1. Use llm_if when you can’t come up with a regular if:
import Handwave.OpenAI

llm_if user_email, "looks suspicious?" do
  {:error, :blocked}
else
  create_user(user_email)
end
  1. Use llm_rewrite when you just need that term() -> 🧠🪄✨ -> string function:
iex> llm_rewrite(
          %Req.Response{status: 401, body: "session token expired"},
          "Tell user what to do without technical details"
        )
"Your session has expired. Please log in again to continue."
  1. Use llm_route when you want LLM to just figure out what to do:
import Handwave.OpenAI

@impl Oban.Worker
def process(job) do
  # do things
catch
  kind, error ->
    formatted = Exception.format(kind, error, __STACKTRACE__)
    
    formatted
    |> llm_route([:snooze, :cancel, :error], "Snooze if it makes sense to try later, cancel if it's a lost cause, otherwise just error")
    |> case do
      :snooze -> {:snooze, 60}
      :cancel -> {:cancel, error}
      _ -> {:error, formatted}
    end
end

Have fun.

https://github.com/martosaur/handwave

Showing Posts 1 to 3

FlyingNoodle

FlyingNoodle

llm_if user_email, "looks suspicious?" do

llm_if ← this is a joke right? Are we really at that point?

DaAnalyst

DaAnalyst

I actually like this, specially the llm_rewrite.

llm_if could be useful for non- too-deterministic cases, such as branching in video games.

martosaur

martosaur OP

That were exactly my thoughts that led me to making this package, but ultimately, I came to realization that this is a useful library (that’s why I released it). Structured outputs for LLMs enable embedding small bits of intelligence in conventional application code and at this point I can’t help but admit that sometimes this is useful. Admittedly, examples in the readme are silly, because they have to be small and because I chose a playful tone for the library as a way to cope with new reality. But in real life I use this type of stuff to determine, for example, if user wants to do a “broad” search or “focused” one and trigger different search pipeline based on perceived intent.

I agree that this can be an absolutely cursed way to do things in the wrong hands. I’m not too worried though as it seems like nobody it writing code by hand these days and Claude won’t use this library.

— All posts loaded —

Where Next? Top

Trending in Announcing Top

woylie
Flop is an Elixir library that applies filtering, ordering and pagination parameters to your Ecto queries. offset-based pagination with...
New
MRdotB
I needed to reuse React components from my Chrome extension in my Phoenix/LiveView backend. I noticed that for Svelte/Vue, there are live...
New
marciok
Hi there! We created Gust: A task orchestrator inspired by Airflow. For those who have never heard about Aiflow, it’s a Python-based wor...
New
fuelen
Hi all! I want to present a small library which provides a mix task for generating an Entity-Relationship Diagram for Ecto schemas. You...
New
anuaralfetahe
Hello Published a new library - ProcessHub! ProcessHub is a library designed to manage process distribution within the Elixir cluster. ...
New
jimsynz
Beam Bots (or just BB for short) is a framework for building fault-tolerant robotics applications in Elixir using familiar OTP patterns. ...
New
Dmk
Xamal is a deployment tool for Elixir apps that deploys native releases to bare metal servers over SSH. It’s a port of GitHub - basecamp/...
New

Other Trending Topics Top

mudasobwa
I am happy to introduce the very α version of the new programming language compiled to BEAM. Welcome Cure. It has literally three kille...
New
AstonJ
This showed up on my feed.. anyone heard of it? Just hype? Ox Alpha is a reasoning model designed for coding, sustained ag...
New
sergio
It’s not that it’s vocabulary is too advanced. It’s something worse. I get lost trying to follow even a paragraph written by Claude. It’...
New
webofbits
With AI doing more of the implementation work, I’ve been wondering how much coding I should deliberately keep doing myself. My main conc...
#ai
New
sorenone
Today we’re releasing Oban for Python. Not an Oban client in Python. Not a pythonx wrapper embedded in Elixir. Nope, it’s a fully operati...
New
akoutmos
@hugobarauna, Dr. Dimitrios Koutmos (my brother) and I (Alex Koutmos) have been hard at work on writing a book on how you can use Elixir ...
New

We're in Beta

About us Mission Statement

Options

Thread Display Mode




Thread Preview

Skip Thread Previews