jackalcooper
Anybody using elixir/erlang to create dataset for machine learning?
Sometimes it is kind of frustrating to use mostly python based tools to create dataset. You got so many cores on machines for deep learning and it takes forever to create dataset if you can’t leverage them. For instance I have been running this dataset creation task for more than a day and it only utilize 400% cpu while there are 24 metal cpus on the server.
Most Liked
kokolegorille
More or less, You feed your neural network to produce a dataset.
Here are some open datasets
kokolegorille
I don’t think so, GAN is putting 2 neural networks working adversary…
One generates data, the other trying to detect if data is fake. It ends when neural checking network can not differentiate between generated data and real data.
BTW there is this very impressive video about GAN…
mythicalprogrammer
Sometimes it is kind of frustrating to use mostly python based tools to create dataset. You got so many cores on machines for deep learning and it takes forever to create dataset if you can’t leverage them.
I have no idea what this create dataset means at all. This is coming from a statistician/programmer that does sampling, collecting, cleaning, modeling, and web scraping.
Last Post!
kokolegorille
I am sorry but I don’t know…
I have been interested in DL since Google Alpha(Go, Master, Zero) was able to defeat top human players at the game of Go, and top dedicated computer programs at the game of Chess.
I have been using Python recently to see what could be done.
Most of Python libraries for DL are wrapper around C/C++, so I think it could be doable in Elixir too.
There is also tensorflex 
Popular in Discussions
Other popular topics
Latest on Elixir Forum
Sponsor Spotlight
Enabling companies to succeed by building software people love.
Categories:
Sub Categories:
Forums
Popular Tags
- #ecto
- #liveview
- #troubleshooting
- #learning-elixir
- #deployment
- #library
- #erlang
- #testing
- #genserver
- #mix
- #absinthe
- #remote-other
- #otp
- #plug
- #how-to-question
- #macros
- #postgres
- #channels
- #elixirconf
- #exunit
- #discussion
- #code-sync
- #javascript
- #podcasts
- #onsite
- #dialyzer
- #docker
- #authentication
- #umbrella
- #full-time-contract
- #podcasts-by-brainlid
- #ecto-query
- #elixir-ls
- #phoenix_html
- #iex
- #blog-post
- #graphql
- #genstage
- #ai
- #websockets
- #supervisor
- #elixirconf-us
- #advent-of-code
- #distillery
- #processes
- #forms
- #api
- #metaprogramming
- #security
- #hex
Our Sponsors
Build Elixir applications with speed and confidence.
Supporting innovation across the BEAM ecosystem.
We build reliable cloud platforms for business-critical systems.
Catch errors, track performance, monitor hosts and more.
Error tracking for Elixir devs who love to ship. Start your free account.
Practical resources that improve the lives of professional developers.
Producing high quality Elixir screencasts since 2017.
Enabling companies to succeed by building software people love.
The team behind Membrane, Popcorn, LiveDebugger. Available for hire.
Courses that'll move you from confusion to "Aha, now I get it!"