libera/#devuan/ Friday, 2021-04-16

trivaltohi all01:46
trivaltoquick question ... i have setup a local "lan" mirror by serving out the contents of the desktop iso via http ... it mostly works via netboot but it will not pull the ata-modules-xxx.udeb01:47
trivaltoas a result the preseed autoconfiguration will not complete "no ahci drivers"01:48
trivaltowhen I list an official mirror it all works well.01:48
trivaltoany ideas on how to fix the issue ??01:48
crashoverrideconfigure your local http server to reverse proxy files from the official mirror when not found, before serving a 404.01:49
trivaltothanks  crashoverride01:49
crashoverrideyou're very welcome.01:49
trivaltobut the packages are all there01:49
gnarfaceit's probably that the desktop iso are too out of date after one networked system update01:49
gnarfaceit's probably about versions01:49
gnarface(and security patches)01:49
crashoverridetrivalto: wait, it will not pull the package that are there?01:49
trivaltono all the missing .udebs are there but they live in the debian/pool01:50
crashoverrideah.01:50
trivaltono01:50
gnarfaceanyway what you want is a caching proxy for apt, that is the correct answer.  i would recommend apt-cacher-ng rather than something ad-hoc but ymmv.01:50
crashoverrideyeah this isn't an HTTP problem, but an apt problem.01:50
crashoverrideI'm sorry, I can't help you then :)01:50
crashoverridewhat gnarface said seems sensible tho.01:51
trivaltofair enough but this document https://pkgmaster.devuan.org/devuan_mirror_walkthrough.txt01:51
trivaltoseems to suggest it should be pretty easy to have a "local mirror"01:51
gnarfaceyea a full mirror is also an option but it's really overkill01:52
trivaltoit is just a matter of redirects for all the software that is already there01:52
trivaltothere is nothing that the installer is looking for that is not already in that iso01:52
gnarfacethat's what i'm not sure about though01:52
crashoverridegnarface: wouldn't an HTTP reverse proxy fix that, too, then?01:53
gnarfacethe packages may all be there by name but they might have too old of a package revision01:53
gnarfacecrashoverride: yes, the functional difference in most cases will just be about how much disk space you need01:53
trivaltook I will look closely at that01:53
crashoverridegnarface: fair enough.01:53
gnarfacetrivalto: examine this line: ii  libmjpegutils-2.1-0:amd64              1:2.1.0+debian-6                      amd64        MJPEG capture/editing/replay and MPEG encoding toolset (library)01:53
trivaltook so instead is there an easy way to rsync only a single relase ... say beowulf01:54
gnarfacetrivalto: actually examine just this part:  1:2.1.0+debian-601:54
trivaltofrom where the /var/log/syslog of the install ??01:54
trivaltoby the way, thanks to both of you guys, crashoverride  and gnarface for your help01:55
gnarfaceso the important part to know is that the part before the : is the debian package name major version, the part between the : and the + are the upstream version, and the part after the last "-" is the package build revision number < if there's a security fix this part may be the only part that actually iterates, but it can still cause dependency check fails01:55
crashoverrideI apparently didn't help much.01:55
crashoverridebut you're welcome.01:55
trivaltohey,  just replying and trying is very much appreciated01:55
gnarfacetrivalto: i think there would be a way to rsync or wget from the repos but you have to find the right paths, i don't know off the top of my head... it would be easier probably to apt-get --download-only or something like that01:56
gnarfacereally just running an apt proxy usually obviates all of this01:57
trivaltowould you guys think others would find this process useful ... I mean in a sysadmin multi server/desktop scenario this would be ideal ... without having to mess with mirrors01:57
fsmithredthat is the chimaera/ceres version of libmjpeg-2.1-001:58
gnarfacei think other people would find it useful but most of them also probably would be better off using a caching proxy...01:58
trivaltoso gnarface , apt-cacher-ng can work with an iso to make an apt proxy ??01:58
gnarfacetrivalto: it just works with whatever is in your sources.list, so yes, but the point would be you wouldn't have to01:58
trivaltoby proxy do you mean that it will just redirect to the actual mirrors on the net? because the whole point of what I am trying to do is keep 10 machines from going to the net and downloading the same software02:00
gnarfacetrivalto: also, the obsessive focus on the iso part of this is the harmful part, because if you were going to make a local mirror you'd be better off using reprepro or the like anyway, to make an actual mirror you can manually update an individual package in without having to re-create a whole custom install iso with updated packages just so you could use the novel emergency source repo feature02:00
gnarfacetrivalto: yea, that is exactly what the caching proxy would do; it would transparently only make one connection to the net for each package, then serve just that one package to an arbitrary amount of LAN peers02:00
trivaltook, obsessive might be a bit much, I was going for simplicity..02:01
gnarfacetrivalto: yes, i understand that, which is why i'm steering you away from stuff that is actually not the simplest approach02:01
trivaltook thanks02:01
trivaltobut I am still confused, does the proxy cache the packages locally (my lan) ??02:02
gnarfaceyea it uses some storage that it dynamically manages, but it has some configuration options02:02
trivaltook02:02
trivaltothat is great to know that is all I am looking for to save bandwidth ...02:02
gnarfaceif you needed this to work fully offline, like on an air-gapped LAN you'd need an actual mirror like reprepo (reprepro is the only one i've tried but i know there are a few others available)02:03
gnarfacebut even then you'd have to manage the packages on the repo manually02:03
trivaltook also good to know... I will give up on the iso/http route02:03
gnarfacei actually just had to set it up because the international cross-connects to the real mirrors aren't reliable to my country02:04
trivaltowow. great ... so kindred spirits... :)02:04
trivaltoare you using preseed/ansible ??02:05
gnarfacenah, but i have worked with preseeding a little02:05
gnarfacejust briefly really02:05
trivaltook02:05
gnarfaceso i'm familiar with the basic idea02:05
gnarfaceyou gotta load a package list but that package list has to have the right versions available02:06
gnarfaceso if that changes upstream, an iso would have to be updated to match it02:06
gnarfacecompletely doable but the iso creation is an unnecessary step that would have to be repeated02:06
trivaltoyeah, It has been really hard to figure out how the whole process actually works ... even the debina di-netboot-assistant lists and ISO as one of the things you can server over the lan02:06
trivaltobut when I actually tried it .. it did not work02:07
gnarfacei get the picture even they rarely use it anymore, it's kindof a vestigial feature02:07
trivaltobut that might be just my incompetence02:07
gnarfacewell i think the documentation might be a bit stale and incomplete02:07
trivaltofair enough..02:07
trivaltocorrect me if I am wrong ... does the iso not pull newer packages during the install ??02:08
trivaltoif there are any ??02:08
gnarfacethe netinstall one does, they don't all though02:08
trivaltoah ok02:08
fsmithredyou can choose whether to use a mirror or not02:08
trivaltocheers, again many thanks02:09
gnarfacemaybe you need to be in expert mode to be asked that, i'm not sure02:12
fsmithredI don't remember02:12
fsmithredI think it always asks to select a mirror02:13
Jjp137from the Devuan install guide online it seems to be the case02:19
EHeMI tend to use the approach02:40
EHeMErk.02:40
EHeMI'm aware of /var/cache/apt/archives, I tend to download the packages, then copy them to other systems; for my network size it is effective.02:41
EHeMThe country mirrors which point to pkgmaster presently give 404 for the Release file though.02:44
rwptrivalto, Reading the scrollback...  If you are trying to keep bandwidth minimized then I recommend and use myself apt-cacher-ng as the best that is available at this time.02:49
rwpIf you must be able to operate disconnected then best is a full mirror.  That will need the full amount of disk space for the entire repository.02:50
trivaltothanks rwp02:50
rwpFor a full mirror the upstream is "ftpsync" but frankly I have been using "debmirror" as the best just to make partial mirrors.02:50
rwpIf you decide to try debmirror if you ping me I will share the scripts I use around it as that would probably help getting all of the options you need for making it a full network bootable repository.02:51
trivaltoso rwp can I ask do you use di-netboot-assistant ??02:52
rwpBut lately I pretty much use apt-cacher-ng as that is good enough for me.02:52
rwpI am not using di-netboot-assistant.  Actually have never heard of it before.  (me go to search...)02:52
trivaltoit basically just takes care of the pxelinux.0 pxelinux.cfg stuff02:53
trivaltofor pxe network boot install02:53
rwpFor PXE booting I have always just done it the traditional way.  I can't even remember now and will have to refresh my memory of my setup.02:53
rwpI make small customizations to the initrd by concatenation and for that have a script called from make to make it super trivial for me.02:54
trivaltoyeah, ideally I wanted to use ipxe with the memdisk option for iso...02:54
trivaltobut that does not allow preseed stuff02:54
trivaltofrom my understanding ...02:54
trivaltothe other interesting route is booting an ISO via ipxe and their ATA over ethernet option... still researching this option02:55
trivaltoi have a few coreboot machines and they all start via ipxe .... with localboot as primary selection .02:56
rwpThere are a small number of preseed items that can't be answered otherwise and I add the preseed.cfg file for those things into the initrd.  But leave all of the rest to another preseed file I can update more often.02:57
trivaltoah yes.. I was going to try the preseed in initrd  next02:57
rwpdebian-installer/locale console-keymaps-at/keymap keyboard-configuration/xkb-keymap netcfg/choose_interface are the only four items I have in the initrd preseed file.02:58
rwpBut those do vary somewhat from major OS release to release.  But all of the rest can be configured in the separate preseed file.02:59
trivaltoah ok...02:59
rwpThe other perhaps not so obvious thing is that the cpio format used for initrd (as of Stretch, haven't updated for Beowulf) can be concatenated.03:00
rwpWhich means that instead of unpacking and modifying and repackaging it one can simply package up incremental small cpio files and then concatenate them onto the end of the original upstream one.03:00
trivaltoah geez .. you really know quite a bit about that part of it all03:01
rwpWhich makes updating them very easy.  Download a new upstream one and then concatenate the local additions onto the end of it with an append action (cat l1 l2 l3 >> initrd) and it works.03:01
trivaltonice ...03:01
rwpI need to update everything for Beowulf and then I will find out what has changed.  But I haven't been using it for Beowulf and so haven't had to scratch the itch yet.03:02
trivalto:)03:02
rwpI don't know why but it took me forever to run into the documentation that told me I could concatenate initrd files.  Prior to that time I was doing the unpack-modify-pack action.03:02
trivaltomaybe because it's such a niche need ....03:03
rwpI think the Refracta installer is the smarter way to do things.  I believe it simply copies the file system into place file by file.  I think.03:03
trivaltodon't know much about that03:04
trivaltoi am surprised that there is not a simple nfs install03:04
rwpThere is an NFS installation option documented somewhere.  I have not ever used it.03:05
trivaltooh shit ... that might be super useful to me03:05
rwpAs a by the by... Here is the script I use to build my custom PXE initrd. https://paste.debian.net/plain/119392703:07
trivaltocheers, and thanks03:07
trivaltoby the way all ... I think i just figured out the problem ... it's not a mirror problem ... the reason the ata-modules are not loaded is because the netboot packages uses kernel 4.19.0-16 while the iso contents are for 4.19.0-1403:35
trivaltodebian knows this is a big problem03:35
trivaltohttps://bugs.debian.org/cgi-bin/bugreport.cgi?bug=74999103:35
trivaltogreat community you guys have here ... many thanks again03:37
rwpHmm...  That bug was opened in 2014 and closed in 2019.03:45
crashoverrideI was stuck in the log03:46
crashoverrideand I was like "gosh, this is weird, this chan has activity but they are repeating themselves a lot"03:46
crashoverrideI think I might need sleep.03:46
crashoverriderwp: still faster than duke nukem forever, amarite?03:47
golinuxPlease go get some rest03:47
trivaltoHi all ...08:34
trivaltodoes anyone know if there is a listing of all the software in each cdrom ??08:35
cronoliothere is in mirror Packages.gz for example http://pkgmaster.devuan.org/devuan/dists/chimaera/main/binary-all/09:39
cronolionot sure id it present on cd09:39
rrqtrivalto: the installable packages carried on installation isos are all in their respective "pool" directory tree ; there's no published listing09:58
zalckoshow would I use the hostnamectl equivalent on devuan?11:00
Jorilzalckos: hostname <new_hostname> for a temporary change, edit /etc/hostname to make it permanent11:04
zalckosah, but the goal is to have a random hostname on every bootup11:06
zalckosI'll take a look11:06
zalckosthank you11:06
zalckossorry for asking all these questions, but how do I run a script from boot, preferably as root?11:34
gnarfacecheck out /etc/rc.local11:35
onefangRun it from /etc/rc.local11:35
onefangSNAP!11:35
zalckosso copy the bash script to /etc/rc.local?11:35
gnarfaceor just call it from there, it matters very little11:35
zalckosah ty11:36
gnarfacealso, everything that's run at boot is run by root unless you specify otherwise11:36
zalckoscool good to know11:36
zalckosok, brb11:37
zalckoseverything worked nicely, ty11:39
zalckosincase anyone is interested in the script: https://paste.debian.net/1193953/11:40
pablocastellanosDon't know if this is the place to ask, when I use the netinst CD, it asks for two options for the initrd, an initrd for the specific installation and a more general initrd. What is different? More modules? How can I recreate any of the two initrds?20:08
fsmithredpablocastellanos, I recently came across the answer to this. There's a file created somewhere. I'll try to remember.20:16
pablocastellanosfsmithred: Thank you!!20:21
fsmithredstill looking20:21
fsmithredpablocastellanos, /etc/initramfs-tools/conf.d/driver-policy20:49
fsmithredif you select targeted drivers, that file gets created. To undo it, you would remove that file and run 'update-initramfs -u'20:50
pablocastellanosfsmithred: Oooh. Thank you very much!!21:00
fsmithredpablocastellanos, two possible reasons for including all modules would be 1) in case you ever want to put the hard drive into another computer. 2) in case you wanted to make a disk image or live iso copy of the system to share with others.21:08

Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!