14 Likes
Nice!
Can you point to API docs for āsearch.hexdocs.pmā?
I donāt know if they exist yet 
1 Like
Thank you Zach.
This is very interesting to me.
I am trying getting up to speed with AI assistance software development.
I installed ollama on my Mac mini M4 pro and would like to use it.
Could you give me some pointers on how to proceed best?
Cheers from Chrichton
1 Like
As a point of feedback, starting with (emphasis mine):
We have a new paradigm available to us in software engineering, whether we like it or not.
is tremendously off-putting. Yeah, just shove it down our throats because whether we like it not it is happening.
Personally, I find most of the LLM efforts going on in the industry right now to be borderline abominations, if only due to the resource consumption and the often misleading rhetoric around purported benefits. But I also know that people will do as they will do, and donāt feel there is much point in crusading against it in places like this.
But if your hope is to broach the topic and find a place for it here despite a lack of general consensus on the benefits and costs, maybe donāt start with what amounts to ultimatums such as āwhether we like it or notā, as if we are without agency (excuse the pun?) and technology is something that happens to us rather than due to us, that those who disagree must acquiesce and jump on your hype trains, or at the very least not impede them because, again, thereās no real choice.
Having to write that in response to a post that opines about how open source is about taking back the power and leveling playingfields should not be lost ā¦
1 Like
Personally I think you skipped an important part of that sentence. What I said was āavailable to usā. As an open source maintainer, I cannot stop people from using LLMs. So I have a vested interested in improving their usage of it.
Before the introduction of usage rules, I would get questions and issues daily about LLM hallucinations. Now, this happens far less often. Iāll update the introduction today to make it more clear. My point is not that we must use LLMs, but that they are now in use by many. OSS maintainers know that more than anyone 
11 Likes
Local models are not very good right now AFAIK. I canāt advise much on how to use them as Iāve not really done it myself. I have another article on my substack about my general workflow.
@zachdaniel can you please share a link to that article? As for local LLM I see that maybe some industries will force it later either due to security or compliance issues plus cost as an example Banking in case it will make use of AI channel to serve customer, think of Ash AI prompts instead of regular chat banking
1 Like
I like >90% of what I read from you but in this case Iām with @aseigo; the words āwhether we like it or notā are aggressive and off-putting.
A bit less thorny framing would be: āThese tools are a fact of life and are heavily usedā or some such.
Iām comfortable with the framing. AI tools are a part of the industry. I canāt say that they are a net good. But pretending that they donāt exist, or deciding not to be exposed to them just isnāt an option at this point, at least for a large portion of software engineers. āWether we like it or notā is in fact exactly the point Iām trying to make.
9 Likes
