systemdlete | I've tried cputool, cpulimit, and nice to try to prevent *mozilla* from eating the entire system's cpu. None of it seems too effective to me. I run, say, speedtest.net and I watch one of the cpu's dart over 100% (there are 2 vcpus) even though I set the limit to 40% | 06:34 |
---|---|---|
systemdlete | mozilla apparently has a voracious appetite. It does not worry about being, say, a total cpu pig, or being a "nice" person. | 06:35 |
systemdlete | It devours every last resource it can grab when it needs them. | 06:35 |
systemdlete | Yeah, so we all know this perhaps. But is there anything that can be done to prevent these pigs from locking up my system? | 06:36 |
systemdlete | (my VM is currently locked up) | 06:36 |
systemdlete | (and I'm not even running firefox last htop updated) | 06:37 |
systemdlete | oh. it's ascii running under vbox 5.2.30 (latest). And the only stuff I am running is the firefox-esr browser and the cpulimit tool etc | 06:41 |
systemdlete | and htop | 06:41 |
systemdlete | I guess I might also mention I am running xfce. I wonder if a different desktop might change the outcomes? | 06:49 |
gnarface | you might be running into a bug but i don't know | 06:51 |
gnarface | does memory use go out of control too? | 06:52 |
gnarface | does one of those tools deal with cgroups? | 06:52 |
gnarface | if not, maybe try cgroups | 06:52 |
gnarface | i don't know much about them but i think they're the new way to do CPU quotas | 06:53 |
systemdlete | cgroups. I know about them, but not much. I will examine those too. Thanks. | 06:55 |
systemdlete | it seems like a much cleaner way to do things | 06:56 |
systemdlete | didn't notice memory using shooting up especially, but the main issue is that the cpu usage was shooting up over 70 or 80%, sometimes over 100%. Another thing I read is that the tool (cputool I think) is based on a kernel running 100 Hz. I wonder if that might be out of date | 06:57 |
gnarface | the other thing is to make sure you're actually throttling the right process | 07:15 |
gnarface | i think in the newer versions it might spawn child processes of a different name to run javascript stuff | 07:16 |
gnarface | and it could as easily be misbehaved javascript on some page as a problem with firefox or it's UI | 07:17 |
systemdlete | Well, I used the -P option to cputool, which is supposed to capture all of the spawned processes (I think) | 07:18 |
systemdlete | and in cpulimit, I used -m, which is supposed to monitor children also | 07:18 |
systemdlete | But I don't know. I wonder if all that SIGSTOP/SIGSTART'ing might be making the problem worse. For one thing, it is certainly not entirely deterministic, since a userland program is attempting to maintain a limit on another resource, which it has very imprecise access to. | 07:21 |
systemdlete | the man pages even mention that these tools (cpulimit and cputool) could theoretically interfere with window managers. Which it did, incidentally. I started having heisenbug issues, where a call to, say, ps(1) would make a bug disappear. | 07:22 |
systemdlete | lol | 07:22 |
systemdlete | yes, I think you are right. cgroups will be the right way to do this. The only issue is me learning cgroups. Which I am starting to do. This effort is worth spending the time learning it because I am sick of hung systems | 07:23 |
systemdlete | freezes, long delays, etc. | 07:23 |
systemdlete | gnarface: I have a question: I see that only a part of the cgroups system is present. It is required that I install at least a few other packages to make it functional. | 07:38 |
systemdlete | e.g., there is no /sys/fs/cgroup/cpu, one I would need. | 07:38 |
systemdlete | I am wondering, though, if anyone knows if this has been tested or is in use anywhere in the non-systemd world | 07:38 |
systemdlete | istm that cgroups, although pre-dating systemd, is sort of intertwined with it | 07:39 |
systemdlete | (I could misunderstand this) | 07:39 |
grayrider | re: cgroups. Why don't you just run systemd? one of it's main functions is to 'manage' cgroups. | 07:41 |
grayrider | I prefer something like nice or ... cpulimit -l 20 firefox | 07:41 |
pardis | cgroups are perfectly usable without systemd | 07:41 |
pardis | I've done stuff with cgroups from shell scripts before | 07:41 |
pardis | For /sys/fs/cgroup/cpu, surely you just need to mount the cgroup? The support should be there in the kernel even if it isn't mounted by defualt | 07:42 |
systemdlete | thanks pardis. grayrider, if you are into systemd, then you are in the wrong place here! | 07:42 |
systemdlete | pardis: Yes, the tutorial I am reading discusses all this. | 07:43 |
systemdlete | I'll configure it appropriately. My concern is whether cgroups is "stable" in the non-systemd world, and you have addressed this, thank you | 07:43 |
grayrider | I hate systemd. That's my point... you took the words out of my mouth. "In shell scripts..." you can use cgroups." Nice when we are writing servers (such as myself.) Systemd and other "forced" cgroup schemes get in my way. Firefox problems is not a reason to start injecting it into the rest of the system. | 07:43 |
systemdlete | grayrider: Well, I wasn't proposing to do so. I am simply looking at a means of limiting cpu usage by hogs like ff and tbird | 07:44 |
grayrider | I wasn't sure what your proposal was. I just know what I read and my reaction was what it was. | 07:45 |
systemdlete | I tried nice and cpulimit, and cputool (see above) they do not work for me | 07:45 |
systemdlete | I monitored ff with htop and saw it was using more cpu than I specified through cputool/cpulimit | 07:46 |
systemdlete | and nice did not have much of an effect either. | 07:46 |
systemdlete | not sure why. | 07:46 |
systemdlete | I am using the standard-issue kernel that comes with the default ascii install. | 07:46 |
systemdlete | I have not performed extensive reconfiguration of the system. | 07:47 |
grayrider | My ff cpu goes sky high when I read CNN. ;) | 07:52 |
systemdlete | (why would anyone read CNN? official government line, but if that's what you like...) | 07:56 |
systemdlete | so grayrider, you think I should not waste time chasing this down just for firefox? B/c this tutorial I think tries to give such an example. | 07:56 |
grayrider | Personally, I wouldn't. | 08:01 |
gnarface | systemdlete: sorry, i don't know. you're showing all threads in htop though, right? | 08:01 |
gnarface | i know it's supposed to work, the tip about maybe having to mount a directory in /sys sounds vaguely familiar though | 08:01 |
gnarface | also i don't know for sure you don't need another package, or maybe even just to load a module that is installed but doesn't load automatically | 08:02 |
grayrider | what's the stock cpu/memory footprint of ff immediately after you load it? Just the stock search window in a single tab? | 08:02 |
gnarface | but the primary difference from the systemd world is usually just permissions actually | 08:02 |
gnarface | systemdlete: grayrider sounds like he knows what to do | 08:02 |
grayrider | The problem with browsers is this: It's a presentation platform for every f'n file type on the planet. Any one of those "elements" on a page can suck you dry if something's not right with it. | 08:04 |
systemdlete | or if it is YOOOOOJ | 08:04 |
gnarface | hmm. yea the video player would probably be some entirely different spawned thread or process too | 08:04 |
systemdlete | javascript that goes on for miles | 08:04 |
gnarface | javascript, now with memory leaks! | 08:05 |
gnarface | make sure you're not using flash still | 08:05 |
systemdlete | I didn't modify the browser, iirc | 08:05 |
gnarface | i also recommend against the bundled cisco openh264 decoder. just disable that POS. it's crippled compared to the native linux one | 08:06 |
systemdlete | openh264 is the only addon, and it is grayed out | 08:06 |
gnarface | oh ok | 08:06 |
gnarface | might be disabled by default now i'm not sure | 08:07 |
systemdlete | I didn't touch it, so yeah. | 08:07 |
grayrider | systemdlete: Infowars. I like Alex | 08:07 |
systemdlete | jimmy dore, but we are getting o.t. | 08:07 |
systemdlete | gnarface: The /sys has cgroups, and it appears that elogind is already configured, out-of-the-box on ascii | 08:10 |
systemdlete | grayrider: ff spikes a bit at the beginning, but quickly settles down to under 10% cpu and mem after a few moments (one open tab) | 08:13 |
systemdlete | gnarface: yes, showing all threads (tree view or filter view) | 08:14 |
systemdlete | gnarface: Flash? Unless it is installed by default, I haven't. | 08:15 |
systemdlete | (sorry for the delayed response; just trying to keep up with the convo here) | 08:17 |
grayrider | Now that you have your baseline... open another tab. It should be the same cpu (~idle)... but ~2x memory | 08:20 |
systemdlete | ok, I admit the open tab is just preferences | 08:24 |
systemdlete | or would google or duckduckgo search page be better for this? | 08:24 |
grayrider | no... just getting baselines for now | 08:24 |
systemdlete | since neither tab is doing anything, the only activity is some commercials and junk | 08:26 |
systemdlete | everything is under 20% | 08:26 |
systemdlete | (cpu and mem) | 08:26 |
systemdlete | that's with 2 search tabs open | 08:26 |
grayrider | you shouldn't even have commercials.... just open tabs to the firefox standard opening | 08:26 |
systemdlete | google has those "pocket" ads... you know the ones that tell you about the girl who has 3 tongues and stuff | 08:27 |
systemdlete | ok, they're not ads really, but they are garbage | 08:27 |
grayrider | if your default home page is some hijacker (or if you've got something embedded in your ff)... all bets are off. | 08:28 |
systemdlete | no. just the google.com page | 08:28 |
grayrider | reset your ff back to 'defaults'... start over. | 08:28 |
systemdlete | sorry | 08:29 |
systemdlete | I mean the mozilla ff start page | 08:29 |
systemdlete | (it does have a google search bar) | 08:29 |
systemdlete | I think the mozilla ff start page IS the default. No? | 08:29 |
grayrider | once you've reset your browser to defaults... you should be able to open *almost* an unlimited number of tabs without causing your system to hang. | 08:29 |
systemdlete | agreed. What will that prove? | 08:30 |
systemdlete | I mean, what is the objective to this? | 08:30 |
systemdlete | that IS the default. You get a search bar PLUS 3 links to pocket ads articles. Including such dillies as "you can learn a new language in just 3 weeks" | 08:31 |
grayrider | If you can do that... opening an infinite number of tabs... just the default page... then your problem is being caused by an "element"(s) I mentioned before. When that happens, it's time to take inventory of your sites that you visit. I've seen that crap before. In fact, "advertisements" that pop into a page can "inject" crap, too. I've seen it many times. I avoid those sites. | 08:32 |
systemdlete | but those links... they may be static, but they still fall under the column called "trash" | 08:32 |
grayrider | I don't have any ads showing up in my ff. | 08:33 |
systemdlete | I am using firefox esr, 60.7 (whatever the latest in the repo) | 08:34 |
systemdlete | that's the default here. I don't know why yours is different than mine | 08:34 |
systemdlete | So, anyway, I did what you asked. I opened 2^10 zillion tabs and no observable change in system response. Which I'd expected. | 08:36 |
grayrider | That's what I wanted find out. Now, just keep track of your various sites and pay attention to the ones that cause you to drag. I "kill" chrome and ff every few days, myself. | 08:37 |
systemdlete | Those ads are pretty static, actually. And they are not really "ads" per se. Just links to supposedly interesting articles designed to widen your horizons and enthuse you. | 08:37 |
systemdlete | Oh, I constantly kill ff. And tbird. I used to let them run for weeks and months. but lately they have become so unstable I have to kill them, if not restart the system | 08:38 |
grayrider | "Spyware"... funny how they suggest stuff that came out of your most recent email(s) and youtube vids, no? | 08:38 |
systemdlete | eh... no, not these. But I know EXACTLY what you are referring to, those "targeted" ads based on your google search history. Why I have abandoned google (largely) for duckduckgo. Sometimes I still have to google things though | 08:39 |
systemdlete | you know... | 08:39 |
grayrider | I'm thinking they are putting keyloggers in ff or, more likely, the pages ... I read the source for many pages that give me fits only to find 10,000 lines of jscript in 'em | 08:40 |
systemdlete | just recalling. Over the years, I've run into memory leaks with ff. I wonder if they are back in style. | 08:40 |
systemdlete | keyloggers? For real, or just too many hours of Alex Jones? | 08:40 |
* systemdlete ducks | 08:40 | |
grayrider | Hey,... reminder.... FF even includes "sync" now... just like Chome to Gmail/google | 08:41 |
systemdlete | oh. That. | 08:41 |
systemdlete | I don't use sync. | 08:41 |
grayrider | Alex... No. He takes lessons from me. I've been coding for 40 years | 08:41 |
systemdlete | And I use multiple google and yahoo and aol accounts, along with other services. Just to prevent cross-contamination. | 08:41 |
systemdlete | So you are the guy who calls in to the show each week? LOL | 08:42 |
systemdlete | (I believe you) | 08:42 |
systemdlete | (and I've been coding, on and off, for 40 years, though mostly not low-level stuff) | 08:42 |
systemdlete | I'm one of those "silly" people who actually use DIFFERENT passwords on each site and system. | 08:43 |
systemdlete | 28 letters long, that sort of thing | 08:43 |
systemdlete | upper lower case, specials (if permitted), etc | 08:44 |
sixwheeledbeast | I wouldn't say that's silly i do the same | 08:44 |
systemdlete | sixwheeledbeast: I was being sarcastic, sorry. Of course, it is best practices. | 08:44 |
grayrider | I have a system. Use an encrypted hash that you save in your contacts. ssha512 that includes your password and some identifier related to the authentication site. It's a system. | 08:45 |
sixwheeledbeast | ah I wasn't sure | 08:45 |
systemdlete | (np. I have a dry sense of humor. Sometimes it's even funny.) | 08:46 |
sixwheeledbeast | Text doesn't pass sarcasm well | 08:47 |
sixwheeledbeast | BTW there is KeePass for local password encryption/management | 08:47 |
systemdlete | I find that generating long strings with something like uuidgen | 08:48 |
grayrider | I don't use any of that stuff. I have my own mail servers. Nothing gets saved in "the cloud." Cloud computing is for airheads and communists. ;) | 08:48 |
systemdlete | Does KeePass do anything the ff and tbird password minders don't do? | 08:48 |
systemdlete | grayrider: If your house burns down (I pray not), how will you recover 40 years of hard work? | 08:49 |
systemdlete | fireproof NAS? | 08:49 |
systemdlete | (just wondering) | 08:49 |
grayrider | I keep weekly and monthly backups in a safe deposit box(es) | 08:50 |
systemdlete | on thumb drives, or a SSD | 08:50 |
systemdlete | ? | 08:50 |
grayrider | WD 4 TB Golds | 08:50 |
systemdlete | That's a lot of trips to the bank, but I guess it works. | 08:51 |
grayrider | Possession is 9/10ths of the law. Who owns the data on my disk drives? I do. Who owns the data on Google or Amazon? | 08:51 |
systemdlete | You know, grayrider. Good point, actually. A few years back, I was using a cloud service that went out of business. It left me with nothing for a few months until I found Mega. But Mega could go bad or unfree too. | 08:53 |
systemdlete | I've been thinking about getting a safe deposit for other reasons, so you might just be on to something. | 08:53 |
grayrider | I can by a 4 TB SAS drive for $200 and it lasts for 5+ years. I can rent 4TB from Amazon for $500 per month. | 08:54 |
grayrider | Donald Trump should put me in charge of DOD computers. ;) | 08:55 |
systemdlete | $500 a month? Did you compare prices? Just to say it, Mega offers much cheaper. | 08:55 |
systemdlete | But then you must trust his eminence | 08:55 |
systemdlete | (and he's been in trouble before...) | 08:56 |
sixwheeledbeast | I also use pen drives, one off site on rotation with on site one. KeePass is encrypted i don't believe FF password management is, it's also protected by a password or key | 08:56 |
systemdlete | FF password management does use some sort of encryption, at least if you put a master lock on the vault. | 08:56 |
systemdlete | but I don't know how hardened that is. | 08:57 |
systemdlete | https://mega.nz/propay_2, just to take a look-see | 08:58 |
systemdlete | I'm not a re-seller, nor do I advocate for Mega. I'm just pointing out that Amazon is not the only game in town for mass cloud storage | 08:58 |
systemdlete | fyi only, ok? | 08:59 |
systemdlete | of course, mega doesn't back up your cloud. But for me, that is kind of redundant. I figure I'll lose either my data at home, or my data in the cloud. not likely both. | 09:00 |
grayrider | Takes me 1/2 hour to copy 4TB from one disk to another. It takes a couple of days to transmit that much to "the cloud." If I need to download it, it takes me 2 more days. Why would anyone use "the cloud"? Ignorance is bliss. | 09:00 |
systemdlete | grayrider: I use bareos (nee bacula) to do incrementals each night to hard disk "tapes" which are then copied to the cloud real time (more or less). | 09:01 |
systemdlete | So it is only a few minutes delay between backup and cloud sync. | 09:01 |
systemdlete | This has been working for me for years. I've never yet had an out-and-out disaster, but I'm ready if it does happen. | 09:02 |
grayrider | delete your partition. Try to do a system recovery in an hour. A day. And a week. Then you'll see Mega (or whatever) ain't worth spit. | 09:03 |
systemdlete | actually, I did a rehearsal of disaster recovery a few years ago. yes, it took some time, but everything was restored hunkey-doree | 09:03 |
grayrider | Haven't you noticed that "real companies" own their own disk drives? (That makes Google, Amazon, Microsoft, IBM, etc... a 'real company'. Anything else is a "virtual" company" who merely rents a room in a hotel. | 09:05 |
grayrider | With housekeepers that come in an "clean" your room, make your bed, and throw away your condoms. :) | 09:05 |
systemdlete | well, it is late here. Time to watch some television, then sleep. | 09:06 |
systemdlete | night all. thanks for all the feedback. Gives me somethings to think about | 09:07 |
grayrider | Later | 09:08 |
gnarface | systemdlete: maybe try disabling "pocket" https://support.mozilla.org/en-US/kb/disable-or-re-enable-pocket-for-firefox | 09:26 |
cynicfm | hi | 10:18 |
cynicfm | how r things going here? :) | 10:18 |
redrick | cynicfm: In most relevant time zones, people are sleeping. May I help you with any Devuan matters, though? | 10:32 |
redrick | (Or perhaps someone else. My offer of help may have been a little hasty, as I'm fading fast towards sleep.) | 10:34 |
cynicfm | well have a good sleep then it's early morning here 10 am :P | 10:34 |
Xenguy | Fuck Trump, again | 13:16 |
Xenguy | oops, wrong channel | 13:16 |
EHeM | Having the channel silently ignore people unless they auth to NickServ is rather unfriendly. | 23:31 |
MinceR | letting spammers fill the channel with crap, even more so | 23:35 |
debdog | paranoid IT peeps | 23:37 |
specing | you can register, its not hard | 23:39 |
specing | and freenode wont datamine your life like some other services | 23:39 |
debdog | the key word here is _silent_ | 23:39 |
debdog | right now I don't eben know whether you guys can read me or not. with my other nick, registered to the same account, I was not able to talk | 23:40 |
debdog | *even | 23:40 |
debdog | see? I am silent | 23:42 |
MinceR | hi silent, i'm dad | 23:43 |
* debdog is _really_ uncertain right now. specing, can you read me? | 23:43 | |
debdog | or MinceR | 23:43 |
debdog | or gnarface | 23:43 |
debdog | or golinux | 23:43 |
MinceR | yes, i can | 23:43 |
debdog | ok | 23:43 |
debdog | phew | 23:44 |
golinux | Yup. But doesn't require human verification. You can always check by looking at the logs: http://maemo.cloud-7.de/irclogs/freenode/_devuan/ | 23:50 |
Generated by irclog2html.py 2.17.0 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!