Don’t take me wrong, but why you are fetching them from github. I mean the repos are public, however what is the point of having all the random notebooks from github here, or I am missing something?
D4no0
hectorperez
Don’t take me wrong, but why you are fetching them from github. I mean the repos are public, however what is the point of having all the random notebooks from github here, or I am missing something?
Sometimes I find Notesclub handy to search notebooks that use a concrete function, hex package or a concept.
For example, if I want to learn metaprogramming, I search that. Then, I’d have a quick look to the results and open on Livebook one that looks good and I trust like the one by DockYard Academy on metaprogramming.
That way, I can change or try related new things on Livebook as I read along – compared to a book or online content which I have to copy-paste, etc. to try code, modify it, etc.
Does it make sense?
Anyway, if you or anyone else wants to share more about their views on Notesclub I’d love to hear them. Thanks!
0
D4no0
I understand that, however I find kind of intrusive to crawl on repositories and fetch files, even if they are open, but maybe my concern is unfounded.
0
hectorperez
I thought everyone would be okay with us indexing their notebooks as the repos are public. If you have a moment, I’d love to know more about your concern:
Is it ok for you that people use GitHub’s advanced search – or Google – to find livemd files? Otherwise, the easiest solution for all this – including Notesclub – is not to include notebooks in public repos. By the way, if you upload a notebook in a public repo on GitHub, Notesclub will fetch it. But, if you delete it from the default branch on GitHub, we’ll delete it on Notesclub too.
We could also implement a way to exclude certain users or repos from Notesclub so people can opt out. Do you think this would be enough? Or is including all by default still a concern for you?
Anyway, do you personally have notebooks in public repos you would prefer we didn’t include in Notesclub or is it a concern you think others might have? I’d like to confirm it is a concern to someone with public notebooks on GitHub before considering implementing a solution. Thanks @D4no0!
2
D4no0
Well this is not very encouraging.
I have nothing against fetching livebooks, as long as you respect privacy, a opt-out strategy would be nice.
On the other note, not all repositories are MIT/Apache2 and some of them have copyrighted content, so it would be nice if you respected licenses too.
0
smathy
Just to demonstrate that other voices exist, I have zero issues with what notesclub is doing with the public (ie published) information on GitHub, to the extent that I’m surprised the contrary opinion exists.
The choice of deleting when the author deletes from the default branch elevates you from beyond reproach to downright polite.
Just my 2¢
4
linusdm
Can you explain what’s not encouraging? The response of @hectorperez seemed to solicit your concerns, and is open to your criticism. I’d say the opposite is true: that response was very encouraging.
1
D4no0
I am against data mining, even how google search crawls over sites and extracts and correlates data is highly questionable, of course we take these things as norm now, another example is how copilot that is trained on open-source repositories, is a commercial product.
In this case it is clear that this project is not malicious by design, however I would appreciate if we could use other modern tools to find solutions to problems and not just fallback to these mining strategies.
0
hectorperez
Hi! We can now discover the most liked Livebook notebooks: notes.club/top
Do you find it useful? Would you like to see anything else on Notesclub? Maybe the most liked notebooks for each hex package?
0