True true, I was thinking of in the style of {:active, :once} when I wrote that, like a TCP stream. ^.^
OvermindDL1
1
NobbZ
I’d use Stream.transform/3/4 to consume the file and implement the reducer as some kind of automaton which consumes the file and emits a stream of tokens, which is then transformed into its final form.
Constructing the automaton can get pretty tedious when it out grows a certain size…
2
NobbZ
A stream is not a binary, so you can’t.
That automaton changes its state depending on the current state and the next character of input. Whenever a certain state is reached (an acceptance state) a token is emitted depending on the previously accumulated characters and the current state. This is the very basic idea.
I’m to tired though to construct at least a minimal example. I do hope I will be able to do so during the weekend.
1