Maxximiliann
High Performance Iterations Over 10,000 Row Data Set
#python
import pandas as pd
import numpy as np
df = pd.DataFrame(np.random.rand(10000,5), columns=('A','B','C','D','E'))
%timeit df['E'] = np.where(df['E'].values < .5, 0, 1)
93.2 µs ± 527 ns per loop (mean ± std. dev. of 7 runs, 10000 loops each)
(Excerpted from: How to iterate over a Pandas DataFrame)
What Elixir libraries/functions can be used to achieve equal/better performance given the same data set?
Most Liked
kelvinst
Well, for numpy part, I would say that you could use nx, but I think for now it is still a early stage tool, so I would not expect the same result for a while.
For pandas though, I don’t think that there is a tool like that yet, but I would not be surprised if one gets released in 2 or 3 weeks 
Popular in Questions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Producing high quality Elixir screencasts since 2017.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking for Elixir devs who love to ship. Start your free account.
Practical resources that improve the lives of professional developers.
Producing high quality Elixir screencasts since 2017.
The deployment platform built for Elixir: PaaS ease, VPS control.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"