ConnorRigby

ConnorRigby

Nerves Core Team

Disclist - A Discord bot to scrape Craigslist

I spend a lot of time browsing Craigslist. Possibly too much. But I find the reason I spend so much time looking is because it’s really tricky to filter out good stuff from spam and nonsense. I also can’t easily get notifications of good stuff in real time so I miss out on things often. So in normal software developer fashion, I over-engineered myself a solution. I’ve been interested in scraping Craigslist since i was a kid, but they sort of frown upon it. I found that Elixir’s pattern matching makes searching HTML really easy to work with.

Anyway here’s the source. I didn’t really built it with the intent of anyone besides me using it, but it certainly is possible to add it to other servers.

Here’s a screenshot of how it looks.

I can’t say this was a great idea, but it’s been pretty useful for at least the last couple days i’ve had it running.

Most Liked

Matt

Matt

Such a true statement. I love this solution! Such a great job :+1:

Wow, you brought back a lot of memories from the mid 90s when I was in high school. I made quite a few programs to scrape web sites. I liked to pull data and consolidate it from news sources, and computer programming sources. You are right, quite a few sites were not happy with frequent queries to their servers.

ConnorRigby

ConnorRigby

Nerves Core Team

Just learned about Discord’s “Rich embed” and i very much believe this user interface is better than Craigslist’s official one.

Where Next?

Popular in Discussions Top

Jayshua
I recently came across the javascript library htmx. It reminded me a lot of liveview so I thought the community here might be interested....
New
Nvim
Elixir appears to be a superior language to Python. I don’t see any advantage of Python over Elixir. Are there any?
New
AlexMcConnell
The reason that Rails is as popular as it is is because it’s very easy for relatively inexperienced developers to get a lot of work done....
588 19675 166
New
ejpcmac
I have discovered Nix last month and I am currently on my way to migrating to it—both on macOS at home and the full NixOS distrubution at...
New
boundedvariable
I am going through the kafka architecture. All the features what the kafka is providing are already in Erlang. I would like hear your opi...
New
cblavier
Hey there, It’s been more than a year since we started using LiveView as our main UI library and building a whole library of UI componen...
New
tomekowal
Hey guys! I want to create a toy project that shows a chart of temperature over time and updates every 5 seconds. I feel LiveView is per...
New
wmnnd
The Go vs Elixir thread got me thinking: Would it be too hard to implement a simple mechanism for creating Go-style static app binaries f...
New
AstonJ
Seen any cool LiveView demos, sample apps or examples? Please post them here! :003:
New
sergio
Kind of like when jquery came out, it was super necessary. Existing drag and drop libraries have a bunch of baggage to support old browse...
New

Other popular topics Top

sen
Hi All, I set a environment variables in dev.exs , like below code. when i start server, how can i set the ${enable} value? thanks. d...
New
Harrisonl
We have an ECS cluster with 4 services, where each task joins a single cluster, via discovery ECS discovery service. Currently when I de...
New
shahryarjb
Hello, I have map which I want to convert it to string like this: the map: %{last_name: "tavakkoli", name: "shahryar"} the string I ne...
New
Fl4m3Ph03n1x
About me? ( if you have nothing better to do than reading about some random guy in the internet :stuck_out_tongue: ) Hello all, this is ...
New
stefanluptak
Hello everybody, usually, I use a 29" ultra-wide monitor for VSCode which can easily accomodate explorer (files panel) + file with code ...
New
nsuchy
Hi. I’ve noticed that Windows Powershell has it’s own IEX command and you cannot access Elixir’s IEX due to the conflict. This isn’t a cr...
New
klo
Got a question about when to concat vs. prepending items to list then reversing to achieve appending. So i know lists boil down to [1 | ...
New
openscript
Hello! Sorry for this astonishing simple question, but I’m really stuck. I try to set up the intellij-elixir plugin, but I don’t know ho...
New
AstonJ
Seen any cool LiveView demos, sample apps or examples? Please post them here! :003:
New
vegabook
I’m brand new to Phoenix and I have stripped one of the demo applications to the bone. I just want to get an svg up on the screen. Here i...
New

We're in Beta

About us Mission Statement