eyalroz | Why would atril (the PDF viewer) create a webkit2gtk-4.0 process, which grows a huge (> 80 GB) virtual memory footprint, even for a small document? | 00:44 |
---|---|---|
sauron- | hi all, i need to create an array from 2 files, does anyone here knows how to do that? | 00:46 |
eyalroz | sauron-: What kind of array? | 00:47 |
sauron- | for example: 1 file has 1 2 3 and other has a b c, the array should be: 1a 1b 1c 2a 2b.... | 00:48 |
syco- | split? | 00:48 |
sauron- | both files have the values in the next line | 00:48 |
sauron- | 1, under 1 is 2.... | 00:49 |
sauron- | i read in bash that you have to 'declare' but this files have more than 70 millions lines... | 00:50 |
fsmithred | no, you don't have to declare variables in bash | 00:50 |
eyalroz | And where do you need to put that array? | 00:50 |
fsmithred | just set them when you want to set them | 00:50 |
sauron- | in a new file | 00:50 |
eyalroz | Also, if it's such a large file - don't use bash. Use python or perl, or even - C or C++. | 00:51 |
sauron- | thats the easy part: ... > b16 (thats the name i plan to use) | 00:51 |
sauron- | the part i dont know is how to make array adding the values of both files | 00:52 |
sauron- | *adding the values with all the possible combinations | 00:52 |
eyalroz | Oh, well, maybe you can use the 'paste' command | 00:53 |
fsmithred | that's looks like it'll do it | 00:53 |
eyalroz | paste -d ' ' a.txt b.txt | 00:53 |
fsmithred | paste - merge lines of files | 00:53 |
fsmithred | or maybe -d '' (no space) | 00:54 |
eyalroz | each line of the output will contain a line from a.txt, then the delimiter (a space in this case), then a line from b.txt | 00:54 |
sauron- | paste doesnt give me all the possible combinations but i can use it in another script, is just what i needed | 00:56 |
fsmithred | all combinations? | 00:57 |
fsmithred | so not just 1a 2b 3c | 00:57 |
sauron- | a1, b2, c3, d4, thats all | 00:57 |
fsmithred | but 1a 1b 1c 2a 2b 2c? | 00:57 |
fsmithred | I think paste will do exactly what you want | 00:58 |
sauron- | thats for the 'easy' example, the real file has over 9 gb | 00:58 |
fsmithred | as long as the lines all match up in order and none are missing... | 00:58 |
sauron- | so i need to make sure it works in the test file before going to the file i need to create the array | 00:58 |
sauron- | however the paste -d... was very useful for another script, thanks for that | 01:06 |
sauron- | here i found the solution, hope it helps others... https://www.thegeekstuff.com/2010/06/bash-array-tutorial/ | 01:23 |
specing | sauron-: wooledge.org | 01:25 |
tuxd3v | Kernel 5.9 may be big for AMD GCN 1.0 apus.. | 02:14 |
sauron- | fsmithred specing eyalroz https://termbin.com/4l0h | 03:07 |
sauron- | done!!!! that did what i need | 03:08 |
eyalroz | sauron-: : That is not such a good idea for large files. | 08:22 |
tedious | Is it a known problem that a stock beowulf system made with debootstrap is unusable due to console errors? | 15:08 |
gnarface | well it's probably missing some important packages to make it bootable, like a kernel and boot loader... | 15:09 |
tedious | RIght I did that part. :) | 15:09 |
gnarface | in that case you're probably gonna have to mention errors specifically | 15:10 |
tedious | It boots but there are a few hundred console errors per second so the system isn't usable. | 15:10 |
tedious | rc rc0: error -5 | 15:10 |
tedious | ANd some of them are rc2 I think. | 15:10 |
tedious | It's hard to tell what proportion they're coming in so fast. | 15:11 |
gnarface | i think you should google for that error | 15:11 |
tedious | Funny thing is I can't get a straight answer what the hell that error even is. | 15:11 |
gnarface | it doesn't sound like a devuan specific problem, it looks like a hardware issue | 15:11 |
tedious | Even the source doesn't say. | 15:11 |
tedious | Nah nothing else gives this problem. | 15:12 |
fsmithred | try adding 'quiet' to the boot command | 15:12 |
gnarface | the first link i come up with suggests it's a bios configuration issue with a pcie card | 15:12 |
tedious | fsmithred: This is well past boot messages. | 15:12 |
fsmithred | yeah, I know | 15:13 |
fsmithred | it might need to be -- quiet | 15:13 |
tedious | It starts before agettys are spawned I think. | 15:13 |
fsmithred | but that is supposed to suppress console messages | 15:13 |
tedious | That supresses printks right? | 15:13 |
tedious | These are like syslog messages. | 15:14 |
fsmithred | not sure exactly what it does | 15:14 |
tedious | gnarface: How are you searching? | 15:14 |
gnarface | "rc0: error -5" | 15:14 |
gnarface | use quotes | 15:14 |
gnarface | even if it turns out to be kernel/driver related, it could still be a particular card | 15:15 |
tedious | How does the video card affect sysvinit but the rest of the system boots? | 15:16 |
gnarface | i couldn't tell you, but i doubt that's what is even happening | 15:17 |
gnarface | is it a nvidia card? | 15:17 |
tedious | It's an older AMD card. | 15:19 |
gnarface | that's the only pcie card? | 15:20 |
gnarface | https://www.linuxquestions.org/questions/linux-general-1/dmesg-var-log-messages-errors-4175632203/ | 15:22 |
gnarface | anything on here look familiar? is it mentioned in any udev persistent files? they could be in /etc/udev or /lib/udev | 15:23 |
gnarface | any bios settings possibly changed recently? | 15:23 |
gnarface | cards changed, card order changed, etc? | 15:23 |
gnarface | if all else fails you could try the backports kernel to see if it's any better | 15:24 |
gnarface | some of the amd cards may need non-free firmware for full functionality too but i'm not sure if this is a symptom of that | 15:24 |
gnarface | mostly that's only the newer ones though | 15:24 |
tedious | Hmm I don't think I installed anything non-free. | 15:39 |
tedious | Is that normal for ATI/AMD cards? | 15:40 |
openbsdtai123 | a bit rethinking about base utils, they are usually under-optimized. look just "ls" to list files for instance, this utils is very unefficient. you can test it. it will perform slowly for a great number a files. A simple C code is basically more efficient if not sorting files. | 15:46 |
yeti | that that to RMS | 15:59 |
yeti | or who is in charge with coreutils? | 15:59 |
yeti | http://gnu.org/software/coreutils | 16:01 |
yeti | have a chat with the holy cow... eeeeh gnu | 16:01 |
sauron- | eyalroz well, thats what i found and tested. asked for help in several channels, got no answer in any so thats the solution so far... | 17:27 |
fred` | are there any 'common problems' known with dnsmasq after upgrading from ascii to beowolf ? | 19:17 |
fred` | my problem is, that suddenly no dhcp-leases are distributed anymore | 19:18 |
fsmithred | fred`, check buster release notes. There might be something about it. | 19:40 |
fred` | fsmithred: didnt find anything, but working now. dont know why, but dnsmasq wasnt able to listen 67/udp anymore (failed to bind DHCP server socket) | 20:45 |
fred` | netstat didnt show any process listening to this | 20:45 |
mcr | @openbsdtai123, so /bin/ls is not inefficient because it can't implement qsort well. /bin/ls is inefficient because listing a very large directory of files, *if* you have to stat(2) all the files to find out how big they are, and what type (so you can colorize them), can take a lot of disk I/O. | 21:22 |
openbsdtai123 | cat is not supporting UTF-8. on devuan and raspbian. If you do the same under BSD, it just works. | 23:32 |
openbsdtai123 | the command that shows it: find -iname "*.txt" | while read -r i ; do cat "$i" >> ~/merge.txt ; done | 23:32 |
openbsdtai123 | then the merge.txt will fails to have right utf-8. | 23:32 |
openbsdtai123 | A simple replacement of "cat" by a little C code to cat the file will create a merge.txt with right utf. | 23:33 |
yeti | bugreport to the owner of the sources... coreutils, gnu project | 23:43 |
openbsdtai123 | it comes from vi mostly. nano and less have less troubles with utf-8. I tested cat and mcat and it seems not too differnt. | 23:52 |
openbsdtai123 | I will recompile vim myself to see it it comes from the debian/devuan vim packages(i.e. the deb file). | 23:53 |
yeti | <--- not a vim-er | 23:59 |
Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!