| KatolaZ | Centurion_Dan: there are no such reports | 06:34 |
|---|---|---|
| KatolaZ | we ougtha solve problems if they show up :) | 06:34 |
| KatolaZ | the ftpsync approach is so much more complicated that it's pointless to put more work on it at this point in time | 06:34 |
| KatolaZ | when we will have 50 mirrors all around the world, we might think again about it :) | 06:35 |
| detha | Centurion_Dan: even that approach is not 100% bullet-proof, but it is a lot better than 'just rsync' | 07:53 |
| detha | anyway, luxury problems. If only devuan /had/ public rsync access | 07:54 |
| golinux | Pad for this week's meet: https://pad.dyne.org/code/#/2/code/edit/SU4R6SxRIn7ZwJ29DZf6Iy33/ | 08:08 |
| KatolaZ | detha: we will put in place a mirror with public rsync access | 10:12 |
| detha | KatolaZ: that would be awesome, makes life so much easier for those that spin up VMs and containers from behind firewalls | 10:14 |
| KatolaZ | detha: I don't see the point, but still :) | 10:15 |
| KatolaZ | in the meanwhile, some of the mirrors already give rsync access | 10:15 |
| KatolaZ | https://pkgmaster.devuan.org/mirror_list.txt | 10:15 |
| detha | cool, thanks. (the point here is that the lab has no direct internet access, and can only see local mirrors) | 10:17 |
| KatolaZ | detha: just get a proper mirror with debmirror | 10:35 |
| detha | KatolaZ: one could. but that means more non-standard things (openbsd/centos/debian/routerOS all just use rsync) | 10:38 |
| KatolaZ | detha: I don't follow you | 10:50 |
| KatolaZ | debian uses http not rsync | 10:50 |
| KatolaZ | anyway, we will provide a public access rsync repo | 10:51 |
| KatolaZ | that would not be much useful anyway though, since you still need to get debian packages from debian | 10:51 |
| KatolaZ | and put in place the needed rewrite rules on the http server | 10:51 |
| detha | KatolaZ: debian provides rsync on a number of mirrors; and yes, our internal mirror server has those rules to rewrite to the local debian mirror | 11:04 |
| detha | the point is, those rules are on the 'inside', where security is lighter. Also, consistently using rsync for mirror updates makes QoS for mirror syncs on the network side possible. | 11:06 |
| KatolaZ | detha: just use one of the mirrors which provide rsync | 11:07 |
| KatolaZ | there are several | 11:07 |
| KatolaZ | and there will probably be one more on the devuan infra | 11:07 |
| detha | cool, last time I checked (about a year ago) I didn't find any | 11:07 |
| KatolaZ | detha: the mirror infra has changed A LOT in the last year or so :) | 11:08 |
| KatolaZ | the issue is that we have beel dealing with a lot of different things, and energy is limited | 11:08 |
| KatolaZ | I guess Devuan now has a fairly robust mirror infra | 11:08 |
| KatolaZ | which we lacked until the end of 2017 | 11:08 |
| KatolaZ | that's a good step forward | 11:09 |
| KatolaZ | obviously, there is always room for improvement ;) | 11:09 |
| detha | yup. no offense, but when devuan started to an outsider the whole mirror setup looked somewhat brittle | 11:10 |
| detha | but in the last half year or so, I haven't had any issues with the devuan things here | 11:11 |
| Centurion_Dan | KatolaZ: I'm working on testing debians ftpsync util at the moment - my rsync seems to be limited to ~200KB/s so I really notice the brokeness at times on my local mirror - because the sync is so slow. | 11:50 |
| Centurion_Dan | This ftpsync tool looks pretty well thought out with a push mode so updating downstream mirrors can be automaticly triggered, | 11:53 |
| KatolaZ | Centurion_Dan: that requires rsync access to the mirrors | 11:53 |
| KatolaZ | push access | 11:53 |
| Centurion_Dan | yup. I'll setup a secondary mirror here so I can have round robin for my mirror access ;-) | 11:54 |
| KatolaZ | oh ok :) | 11:54 |
| KatolaZ | makes sense :) | 11:54 |
| Centurion_Dan | the benefit is that as soon as mirror has completed a sync stage then it can push it's downstream mirrors to sync that stage as well - reducing the sync latency. | 11:57 |
| KatolaZ | yeah Centurion_Dan | 11:57 |
| KatolaZ | but you'd agree there is a bit much complication at this stage | 11:57 |
| KatolaZ | :) | 11:57 |
| Centurion_Dan | Once I've got the kinks worked out I'll write up documentation on setting it up. Although I'm already going to have to do a PR to fix it so it can use pre-defined ssh keys for the pull. | 11:58 |
| detha | Centurion_Dan: what about the old 'cp -rl mirror/* stage/; rsync ... stage; mv stage mirror' tricks ? | 13:05 |
| detha | that should work with rsync --exclude=dist; rsync | 13:06 |
| * rrq don't have working internet (still). +irc +pad -jitsi | 21:04 | |
| rrq | es | 21:05 |
| golinux | It's time folks! | 21:27 |
Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!