Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Package manager servers on the meshnet #20

Open
pospi opened this issue May 18, 2019 · 13 comments
Open

Package manager servers on the meshnet #20

pospi opened this issue May 18, 2019 · 13 comments

Comments

@pospi
Copy link

pospi commented May 18, 2019

Idea

There are likely going to be a lot of development-centered activities at the camp- as such, it would be cool if people were able to provide mirrors for npmjs.org / crates.io etc so that we can share code more easily... or some other way to sync the necessary dependencies for collaboration. Just putting this out there to see if anyone has lightweight & easily replicable solutions ;)

Skillsets

Devops / server admin experince

@benhylau
Copy link
Member

I wonder if IPFS (debian mirror?) or open-registry.dev (npm?) may have solutions for this one. @victorb may know something about package mirrors on off-Internet local networks?

@victorb
Copy link

victorb commented May 23, 2019

Yeah, Open-Registry could easily be used for this (and we can also easily add more things than just npm [like debian]).

Basically, running one instance on the mesh of Open-Registry, with other participants using Bolivar (https://github.com/open-services/bolivar) would enable everyone to download and re-share packages that have been cached in the Open-Registry instance, even without internet connection.

@benhylau
Copy link
Member

Anyone interested in running this? We have a way to emulate the local network for testing https://github.com/dweb-camp-2019/meshnet/blob/master/testnet/README.md

@sbillig
Copy link

sbillig commented Jun 28, 2019

@pospi @benhylau

I started hacking together an ipfs-backed crates.io download api proxy/mirror a few weeks back, but sort of lost steam when I heard there would be a decent internet connection at the camp. I'll bring a copy of all of the crates (30-50GB? (still downloading)). Not sure if I'll continue with the api proxy; maybe I'll put them in an ipfs mfs and/or dat, and see how well that works with cargo-vendor or something. I'll ponder and poke at it a bit; definitely open to suggestions if you have any.

@benhylau
Copy link
Member

I definitely would like to unplug the entire / segments of this network at certain hours during Camp if others are interested!

@sbillig
Copy link

sbillig commented Jun 28, 2019

Sounds good to me! With 500 dweb/dwebcurious people in one place, it seems like a useful exercise to force us to make things work sans internet infrastructure.

@pospi
Copy link
Author

pospi commented Jun 30, 2019

oh, looks like previous comment has been deleted but https://www.npmjs.com/package/friendpm sounded like a great solution for nodejs code sharing. I think https://www.npmjs.com/package/airtar would also be a good one for people to have pre-installed.

@benhylau
Copy link
Member

oh, looks like previous comment has been deleted

Oh? Like an admin deleted or it didn't go in properly? I definitely didn't delete anything.

@pospi
Copy link
Author

pospi commented Jun 30, 2019 via email

@benhylau
Copy link
Member

Just making sure no one accidentally deleted things, lots of people on the org :)

My guess is friendpm would work only across same node on the mesh network as I see no bootstrap command, same reason all the other p2p apps won't auto-discover across subnets. Could still be useful!

@momack2
Copy link

momack2 commented Jul 5, 2019

Love this idea! @achingbrain created "npm-on-ipfs-in-a-box" - which would be great to make npm available on the local network. Maybe he can ship it to me and I can bring it?

@benhylau
Copy link
Member

benhylau commented Jul 6, 2019

Hey @momack2 having this on the network would be great, especially with an IPFS HTTP gateway on the local IP address.

@momack2
Copy link

momack2 commented Jul 16, 2019

Sadly we can't make shipping work in time, but definitely planning to cache some useful content on my local node before attending to make accessible on the network. =]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants