<turbo-stream action="append" target="posts_list"><template>    <div class="postbit" id="133929" data-post-id="133929">
  <section>
    <div class="post-wrap">


					<div class="post-header">
		        <div class="user-avatar">
		          <img alt="wanton7" src="https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/wanton7/120/14151_2.png" width="120" height="120" />
		        </div>
					
						<div class="user-details">
		          <div class="user-name">
		            <h3>
                  wanton7
                  </h3>
		          </div>
						
						</div>
					
					</div>

	        <div class="thread-main">
	            <div class="post-body" data-turbo="false">
								<p>Nice I accidentally deleted my reply and forum says “You’ve performed this action too many times. Please wait 23 hours before trying again.” when I try to undelete. I’m pretty sure I haven’t undeleted anything before and post will deleted 24 hours <img src="https://forum.elixirforum.com/images/emoji/apple/slight_smile.png?v=15" title=":slight_smile:" class="emoji" alt=":slight_smile:" loading="lazy" width="20" height="20"></p>
<p>Here are those links again<br>
<a href="https://github.com/elixir-plug/plug_cowboy/issues/10" class="onebox" target="_blank" rel="noopener nofollow ugc">https://github.com/elixir-plug/plug_cowboy/issues/10</a><br>
<a href="https://github.com/ninenines/cowboy/issues/1376" class="onebox" target="_blank" rel="noopener nofollow ugc">https://github.com/ninenines/cowboy/issues/1376</a></p> 
	            </div>

	            <div class="base-line">
	                <div class="thread-counters">
	                    <span class="thread-count count-likes js-likers-trigger" title="Likes" data-post-id="133929" data-batch-url="/posts/batch_likers">
                        2
                      </span>
                      <!-- <span class="thread-count js-solved-indicator" title="Marked as solution"></span> -->
	                </div>
	                <div class="go-to-post">
	                  <a title="Go to post" alt="Go to post" href="https://forum.elixirforum.com/t/very-high-memory-usage-when-streaming-file-with-phoenix/23455/13">Post #12</a>
	                </div>
	            </div>
              <div id="likers-container-133929" 
                   class="likers-container"
                   data-first-post="false"
                   data-batch-url="/posts/batch_likers">
                   <div class="likers-placeholder" 
                     data-likers-post-id="133929"
                     data-batch-url="/posts/batch_likers">
                  <div class="post-likers"></div>
                </div>
              </div>
	        </div>
			

    </div>

    <div class="triangle-top-right type-solved cat-solved" title="Marked as solution"></div>
  </section>
</div>
    <div class="postbit" id="133941" data-post-id="133941">
  <section>
    <div class="post-wrap">


					<div class="post-header">
		        <div class="user-avatar">
		          <img alt="no_one" src="https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/no_one/120/15941_2.png" width="120" height="120" />
		        </div>
					
						<div class="user-details">
		          <div class="user-name">
		            <h3>
                  no_one
                    <span class="op-star" title="Thread Starter">
                      <img alt="OP" class="op-star-icon" src="/assets/thread-icons/thread-icon-thread-starter-df91e872.png" />
                    </span>
                  </h3>
		          </div>
						
						</div>
					
					</div>

	        <div class="thread-main">
	            <div class="post-body" data-turbo="false">
								<p>I’ve implemented this like in linked issue and now it works.</p> 
	            </div>

	            <div class="base-line">
	                <div class="thread-counters">
	                    <span class="thread-count count-likes js-likers-trigger" title="Likes" data-post-id="133941" data-batch-url="/posts/batch_likers">
                        2
                      </span>
                      <!-- <span class="thread-count js-solved-indicator" title="Marked as solution"></span> -->
	                </div>
	                <div class="go-to-post">
	                  <a title="Go to post" alt="Go to post" href="https://forum.elixirforum.com/t/very-high-memory-usage-when-streaming-file-with-phoenix/23455/14">Post #13</a>
	                </div>
	            </div>
              <div id="likers-container-133941" 
                   class="likers-container"
                   data-first-post="false"
                   data-batch-url="/posts/batch_likers">
                   <div class="likers-placeholder" 
                     data-likers-post-id="133941"
                     data-batch-url="/posts/batch_likers">
                  <div class="post-likers"></div>
                </div>
              </div>
	        </div>
			

    </div>

    <div class="triangle-top-right type-standard-post cat-standard-post" title="Post #13"></div>
  </section>
</div>
    <div class="postbit" id="133947" data-post-id="133947">
  <section>
    <div class="post-wrap">


					<div class="post-header">
		        <div class="user-avatar">
		          <img alt="wanton7" src="https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/wanton7/120/14151_2.png" width="120" height="120" />
		        </div>
					
						<div class="user-details">
		          <div class="user-name">
		            <h3>
                  wanton7
                  </h3>
		          </div>
						
						</div>
					
					</div>

	        <div class="thread-main">
	            <div class="post-body" data-turbo="false">
								<p>I think that’s temporary solution because if you have multiple streaming connections that mailbox might be filling from all of them and checking mailbox size might not be a very good solution. Hopefully this gets fixed in Cowboy 2.7. I read that Cowboy 1.x isn’t effected because chunk is synchronous function in 1.x. Maybe you could also try downgrading to 1.x in the meantime, if that’s possible with Phoenix.</p> 
	            </div>

	            <div class="base-line">
	                <div class="thread-counters">
	                    <span class="thread-count count-likes js-likers-trigger" title="Likes" data-post-id="133947" data-batch-url="/posts/batch_likers">
                        1
                      </span>
                      <!-- <span class="thread-count js-solved-indicator" title="Marked as solution"></span> -->
	                </div>
	                <div class="go-to-post">
	                  <a title="Go to post" alt="Go to post" href="https://forum.elixirforum.com/t/very-high-memory-usage-when-streaming-file-with-phoenix/23455/15">Post #14</a>
	                </div>
	            </div>
              <div id="likers-container-133947" 
                   class="likers-container"
                   data-first-post="false"
                   data-batch-url="/posts/batch_likers">
                   <div class="likers-placeholder" 
                     data-likers-post-id="133947"
                     data-batch-url="/posts/batch_likers">
                  <div class="post-likers"></div>
                </div>
              </div>
	        </div>
			

    </div>

    <div class="triangle-top-right type-standard-post cat-standard-post" title="Post #14"></div>
  </section>
</div>
    <div class="postbit" id="134083" data-post-id="134083">
  <section>
    <div class="post-wrap">


					<div class="post-header">
		        <div class="user-avatar">
		          <img alt="benwilson512" src="https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/benwilson512/120/1457_2.png" width="120" height="120" />
		        </div>
					
						<div class="user-details">
		          <div class="user-name">
		            <h3>
                  benwilson512
                  </h3>
		          </div>
						
			          <div class="user-title">
									<span>Author of Craft GraphQL APIs in Elixir with Absinthe</span>
			          </div>
						</div>
					
					</div>

	        <div class="thread-main">
	            <div class="post-body" data-turbo="false">
								<p>Once people start with streams it’s common to think they need to keep using a stream. The code should be:</p>
<pre data-code-wrap="elixir"><code class="lang-elixir">    url
    |&gt; HttpStream.stream()
    |&gt; Enum.reduce(conn, fn n, conn -.
      chunk(conn, n) 
    end)
</code></pre>
<p>This ensures that the controller action returns a conn, and it returns specifically the <code>conn</code> that has sent all the chunks, which is what you want. It also avoids accumulating all the data in memory.</p>
<p>HttpStream still needs to be implemented in a way that doesn’t overload the process with messages though.</p> 
	            </div>

	            <div class="base-line">
	                <div class="thread-counters">
	                    <span class="thread-count count-likes js-likers-trigger" title="Likes" data-post-id="134083" data-batch-url="/posts/batch_likers">
                        1
                      </span>
                      <!-- <span class="thread-count js-solved-indicator" title="Marked as solution"></span> -->
	                </div>
	                <div class="go-to-post">
	                  <a title="Go to post" alt="Go to post" href="https://forum.elixirforum.com/t/very-high-memory-usage-when-streaming-file-with-phoenix/23455/16">Post #15</a>
	                </div>
	            </div>
              <div id="likers-container-134083" 
                   class="likers-container"
                   data-first-post="false"
                   data-batch-url="/posts/batch_likers">
                   <div class="likers-placeholder" 
                     data-likers-post-id="134083"
                     data-batch-url="/posts/batch_likers">
                  <div class="post-likers"></div>
                </div>
              </div>
	        </div>
			

    </div>

    <div class="triangle-top-right type-standard-post cat-standard-post" title="Post #15"></div>
  </section>
</div>
    <div class="postbit" id="134095" data-post-id="134095">
  <section>
    <div class="post-wrap">


					<div class="post-header">
		        <div class="user-avatar">
		          <img alt="wanton7" src="https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/wanton7/120/14151_2.png" width="120" height="120" />
		        </div>
					
						<div class="user-details">
		          <div class="user-name">
		            <h3>
                  wanton7
                  </h3>
		          </div>
						
						</div>
					
					</div>

	        <div class="thread-main">
	            <div class="post-body" data-turbo="false">
								<p>It seems that you didn’t read this thread before replying. Problem doesn’t have anything to do with that code, there is a bug in Cowboy 2.x that is causing this. Look at my earlier post with links. Calling <code>chunk</code> pushed messages to <code>cowboy_clear:connection_process</code>’s mailbox and returns. That means there is no back pressure like in Cowboy 1.x where call to <code>chunk</code> was a synchronous. Mailbox keeps filling up because file chunks are coming in fast <code>cowboy_clear:connection_process</code> process gets slow and huge amount memory is allocated.</p>
<p>If you want to try it yourself <a class="mention" href="/u/no_one" rel="nofollow">@no_one</a> provided code in Github in some posts back.</p>
<blockquote>
<p>Also are you sure it’s ok to use <code>Enum.reduce</code> with streams? I’m pretty sure that will load whole file in to memory because it will create intermediate list as you can see in examples here <a href="https://hexdocs.pm/elixir/Stream.html" class="inline-onebox" rel="noopener nofollow ugc">Stream — Elixir v1.20.2</a></p>
</blockquote>
<p>Edited: I think I was wrong and using <code>Enum.reduce</code> doesn’t cause any intermediate list to be created because it returns a single value so it’s probably OK in that code.</p> 
	            </div>

	            <div class="base-line">
	                <div class="thread-counters">
	                    <span class="thread-count count-likes js-likers-trigger" title="Likes" data-post-id="134095" data-batch-url="/posts/batch_likers">
                        1
                      </span>
                      <!-- <span class="thread-count js-solved-indicator" title="Marked as solution"></span> -->
	                </div>
	                <div class="go-to-post">
	                  <a title="Go to post" alt="Go to post" href="https://forum.elixirforum.com/t/very-high-memory-usage-when-streaming-file-with-phoenix/23455/17">Post #16</a>
	                </div>
	            </div>
              <div id="likers-container-134095" 
                   class="likers-container"
                   data-first-post="false"
                   data-batch-url="/posts/batch_likers">
                   <div class="likers-placeholder" 
                     data-likers-post-id="134095"
                     data-batch-url="/posts/batch_likers">
                  <div class="post-likers"></div>
                </div>
              </div>
	        </div>
			

    </div>

    <div class="triangle-top-right type-standard-post cat-standard-post" title="Post #16"></div>
  </section>
</div>
    <div class="postbit" id="134296" data-post-id="134296">
  <section>
    <div class="post-wrap">


					<div class="post-header">
		        <div class="user-avatar">
		          <img alt="wanton7" src="https://forum.elixirforum.com/user_avatar/forum.elixirforum.com/wanton7/120/14151_2.png" width="120" height="120" />
		        </div>
					
						<div class="user-details">
		          <div class="user-name">
		            <h3>
                  wanton7
                  </h3>
		          </div>
						
						</div>
					
					</div>

	        <div class="thread-main">
	            <div class="post-body" data-turbo="false">
								<p>Tried your code and downgraded <code>{:plug_cowboy, "~&gt; 2.0"}</code> to <code>{:plug_cowboy, "~&gt; 1.0"}</code> in deps and it seems to fix this problem and memory doesn’t increase anymore.</p> 
	            </div>

	            <div class="base-line">
	                <div class="thread-counters">
	                    <span class="thread-count count-likes js-likers-trigger" title="Likes" data-post-id="134296" data-batch-url="/posts/batch_likers">
                        2
                      </span>
                      <!-- <span class="thread-count js-solved-indicator" title="Marked as solution"></span> -->
	                </div>
	                <div class="go-to-post">
	                  <a title="Go to post" alt="Go to post" href="https://forum.elixirforum.com/t/very-high-memory-usage-when-streaming-file-with-phoenix/23455/18">Post #17</a>
	                </div>
	            </div>
              <div id="likers-container-134296" 
                   class="likers-container"
                   data-first-post="false"
                   data-batch-url="/posts/batch_likers">
                   <div class="likers-placeholder" 
                     data-likers-post-id="134296"
                     data-batch-url="/posts/batch_likers">
                  <div class="post-likers"></div>
                </div>
              </div>
	        </div>
			

    </div>

    <div class="triangle-top-right type-last-post cat-last-post" title="Last post!"></div>
  </section>
</div>
</template></turbo-stream><turbo-stream action="replace" target="load-more-container"><template><div id="load-more-container" class="load-more-container">
    <span class="all-loaded">— All posts loaded —</span>
</div></template></turbo-stream>