I have tested a normal one, and it works fine.
Do you think the streaming one could be any performance impact?
ijunaidfarooq
hubertlepicki
So the intent behind creating streaming one is that I have to send multipart requests that contain files, and these files can be many megabytes in size. If I do N of these requests at the same time, I could easily end up exhausting my memory quota.
So, the intent was not to make it more performant, but make it not crash production server.
I actually have no idea how the streaming performance versus non-streaming compares. It’d be good test to do.
3
ijunaidfarooq
Okay I have phoenix dashboard working.
I am going to be in production with without streaming in the end of the day again.
then can you tell me what place is to look for in Phoenix dashboard?
with HTTPoison and Hackney its like this,
I can show you both, with stream and without stream. by tomorrow.
I have a use case of sending 800 * 2 something requests, per second or per 5 minutes and per 10 minutes.
0
LostKobrakai
You more likely want to look at the charts in observer, which show you memory usage over time, since memory should be cleaned up after the file contents will no longer be needed.
0
hubertlepicki
But you will see the memory usage here in the “Binary” section as well, and in fact you probably already see if you are making a lot of these requests and/or take long time to send.
0
ijunaidfarooq
Hi,
as in hackney it supports to send a file such
HTTPoison.post(url, {:file, file_path}, headers)
Can we send a file in mint or finch?
I have tried multipart of tesla for this but it add content type multipart. where as my headers are octet/stream.
0
hubertlepicki
Which thing do you want to do, because you can do both:
a) send a multipart request with form data and/or more than one file in it. This is as if you submitted a form on the web site - you need Tesla.Multipart + Finch for that
b) send a single file, as octet-stream - you need just Finch on it’s own for that
?
0
ijunaidfarooq
Yeah I sorted. I just did File.read! and put it on body.
it was like binary data of curl request. and I sent the binary with octet stream, it worked like a charm, I was just trying to difficult way first. and It costed me 3 hours , I should have tried simple one first.
0
achempion
It looks kind of dangerous to read all the content into the memory. If you have large files (it looks like it is because you’ve mentioned uploading via file streaming) it could consume much memory.
All the cases you’ve described supported by HTTPoison but for some reason you don’t want to use it. Can’t really understand why.
0
ijunaidfarooq
there is a long details above for not using HTTPoison and hackney and many around over internet
I want to use Finch.
and I just read the file content and send it as a body in finch.
0