 Welcome to Gentoo Universe, an aggregation of weblog articles on all topics written by Gentoo developers. For a more refined aggregation of Gentoo-related topics only, you might be interested in Planet Gentoo.
August 28, 2009
While I should write it down on autotools mythbuster in a most generic fashion, since I found this today, I wanted to write down these notes for other developers. With autoconf-2.64 there can be a problem with “phantom macros” as in macros that are called, but seem not to produce any code.
In particular, I noticed a configure failure in recode today. The reported error out is the following:
checking for flex... flex
checking lex output file root... lex.yy
checking lex library... -lfl
checking whether yytext is a pointer... yes
checking for flex... (cached) flex
./configure: line 10866: syntax error near unexpected token `fi'
./configure: line 10866: `fi'
Looking at the actual configure code, you can easily see what the problem is around line 10866:
if test "$LEX" = missing; then
LEX="\$(top_srcdir)/$ac_aux_dir/missing flex"
LEX_OUTPUT_ROOT=lex.yy
else
fi
In sh, you probably know already, “else fi” is invalid syntax; but what is the code that produces this? Well, looking at configure.in is not enough, you need to also check an m4 file for the package:
# in configure.in:
ad_AC_PROG_FLEX
# in m4/flex.m4
## Replacement for AC_PROG_LEX and AC_DECL_YYTEXT
## by Alexandre Oliva <oliva@dcc.unicamp.br>
## Modified by Akim Demaille so that only flex is legal
# serial 2
dnl ad_AC_PROG_FLEX
dnl Look for flex or missing, then run AC_PROG_LEX and AC_DECL_YYTEXT
AC_DEFUN(ad_AC_PROG_FLEX,
[AC_CHECK_PROGS(LEX, flex, missing)
if test "$LEX" = missing; then
LEX="\$(top_srcdir)/$ac_aux_dir/missing flex"
LEX_OUTPUT_ROOT=lex.yy
AC_SUBST(LEX_OUTPUT_ROOT)dnl
else
AC_PROG_LEX
AC_DECL_YYTEXT
fi])
So there are calls to AC_PROG_LEX and AC_DECL_YYTEXT macros, so there should be code in there. What’s happening? Well, maybe you remember a previous post where I listed some user-advantages in autoconf-2.64 :
Another interesting change in the 2.64 release which makes it particularly sweet to autotools fanatics like me is the change in AC_DEFUN_ONCE semantics that makes possible for macros to be defined that are executed exactly once. The usefulness of this is that often times you get people to write bad autoconf code, that instead of using AC_REQUIRE to make sure a particular macro has been expanded (which is usually the case for macros using $host and thus needing AC_CANONICAL_HOST), simply call it, which would mean the same check is repeated over and over (with obvious waste of time and increase in size of the generated configure file).
Thanks to the AC_DEFUN_ONCE macro, not only it’s possible to finally define macros that never gets executed more than once, but also most of the default macros that are supposed to work that way, like AC_CANONICAL_HOST and its siblings, are now defined with that, which means that hopefully even untouched configure files will be slimmed down.
Of course, this also means there are more catches with it, so I’ll have to write about them in the future. Sigh I wish I could find more time to write on the blog since there are so many important things I have to write about, but I have not enough time to expand them to a proper size since I’m currently working all day long.
Indeed the two macros above are both once-expanded macros, which means that autoconf expand them before the rest of the now-defined macro. Now, the solution for this is using M4sh properly (because autoconf scripts are not pure sh, they are M4sh, which is a language in the middle between sh and m4). Instead of using if/then/else, you should use AS_IF; indeed changing the above macro to this:
AC_DEFUN(ad_AC_PROG_FLEX,
[AC_CHECK_PROGS(LEX, flex, missing)
AS_IF([test "$LEX" = missing], [
LEX="\$(top_srcdir)/$ac_aux_dir/missing flex"
LEX_OUTPUT_ROOT=lex.yy
AC_SUBST(LEX_OUTPUT_ROOT)dnl
], [
AC_PROG_LEX
AC_DECL_YYTEXT
]])
allows autoconf to understand the flow of the code and produces the proper sh code (this is true sh code) in the final configure file:
checking for flex... flex
checking for flex... (cached) flex
checking lex output file root... lex.yy
checking lex library... -lfl
checking whether yytext is a pointer... yes
(see how the two checks for flex are both up the list of checks?).
Unfortunately there are more problems with recode, but at least this documents the first problem, which I’m afraid is going to be a common one.
|
My podcast on LinuxCrazy (August 28, 2009, 13:03 UTC)
Hello all,
Yesterday (Thursday, 27 August 2009), David Abbott from LinuxCrazy, and Gentoo-PR interviewed me for his 62nd podcast. We discussed many aspects of Gentoo, including my involvement with the fora, documentation, project strengths, areas of concern, Openbox and LXDE, and more. This is a two-part podcast, and the first portion is an interview with Zachary (son of Gentoo user weirdedout) about one of his favourite Linux games, Warzone 2100. Thank you Zachary for your review of WZ2100! 
If you would like to listen to the podcast, it is available in Ogg format (preferred), or in MP3. The Ogg format is available here on the Z-Issue, while the Ogg and MP3 versions are both available on LinuxCrazy.
OGG format of the podcast (please right-click and hit "save as" to download a copy)
If you don't want to listen to the podcast, there is a transcription of most of it (not verbatim, but hits many of the key points) on the Gentoo Fora.
Thanks for the interview David!
|:| Zach |:|
|
Tech support (August 28, 2009, 03:41 UTC)
Hello all,
A friend of mine sent me this really funny video yesterday. For all of us "computer nerds," this should put some things in perspective.
Monk Tech Support:
If for some reason the embedded player above doesn't work for you, here's a link to it on YouTube:
http://www.youtube.com/watch?v=0z84F1fHABw
|:| Zach |:|
|
I fell in love with London (August 28, 2009, 00:44 UTC)
As I said earlier I wanted to write a bit about my vacation in London, so here it comes, if I can write this and make sense before I also fell asleep.
I really really enjoyed my vacation; maybe it was because it was my first vacation ever, maybe because it was my first time out of Italy, or maybe because I overcame my fear of planes once and hopefully for all. I also fell in love with London and with the say stuff there seems to work, in a way that, here in Italy, is hard even to imagine. Unfortunately, one week wasn’t really enough to see half the stuff I wanted to see, starting with Broadcasting House, which is why I hope to come back to London before end of the year.
Now that I can finally fly, I guess I’ll finally be dropping by on conferences; I just need to start looking at the calendars so I can set up my schedule for that. If somebody has a quick way to do that, or has some links for conferences to check the schedules from now on, I’d be happy of the help.
To be honest, I also fell in love with the weather up there, and when I came back I was hit tremendously by the heat here. Given I don’t have A/C at home, and I have been always against the idea of wasting power in stuff like that (it’s waste), I start to have a yet undecided, uncertain idea, about spending next summer in London (or around). Really for now it’s just a random thought, some vague idea. But at least it would be a cool place, and I wouldn’t have problems with language (mostly).
Indeed, the week I spent there didn’t feel extremely out of place for me, since I was a bit in the loop either way thanks to following general news and BBC as well. And I really would love to spend some more time there, with enough time and space to go around visiting Broadcasting House, and maybe some other England areas.
After all, thankfully, my job does not force me to any particular location: I rarely have to go to my customer’s workplace, and especially during the summer this is pretty limited. Just having a laptop, like the one I’m writing on right now, and access to my main box at home (Yamato) allows me to do most of my work without any limitation. This would mean that I wouldn’t be taking three months of vacation, but rather half out-of-office time.
Also, before I forget, after ensuring this was supposed to be the case with the local customer service of 3 Italy, I went out daring to use the 3G connection with my phone while I was in London, under 3 UK coverage. It was, indeed, included in my monthly 10GB limit, and I didn’t spend any money to use it. At the end, the only euro I “wasted” were 2.5 in SMS (because the hotel I was staying at wasn’t covered by 3 UK and I used SMS to sync with my friends on what time to wake up) and 2 for a connection on the Orange network when I didn’t note the out-of-network and thus didn’t kill it soon enough. Not bad considering a lot of people end up paying lots for using their phones outside of Italy (and I did use it quite a bit, both to call Italy and UK itself — some friends had an UK cellphone already).
|
August 27, 2009
All,
Many of you have, no doubt, learned of the recent loss to the Gentoo
community. Known fondly as fmccor, Mr. Ferris E. McCormick's death was tragic
and unexpected. His many contributions to the greater open source community
will always be remembered as well as his generous friendship. It is in due
honor to his life and good name that the Gentoo Foundation has donated a sum
of $500 to the Electronic Frontier Foundation (EFF). The board of trustees
believe that our donation is reflective of his wishes, given fmccor's
professional life as a lawyer, and that this gift will further the movements
he cared a great deal about, open source software and protecting our freedom.
The board would like to take this opportunity to encourage any and all
individuals that personally knew fmccor or were benefiting from his life long
contributions to donate, in kind and to the best of your ability, either to
the EFF, the Gentoo Foundation, or another organization that you feel
expresses these ideas.
|
I’ve been reading some worrisome news about Mininova being requested to filter down the torrent links (to the point that it’ll have no more sense to exist in the first place, I guess). This actually upsets me, even though not in the way most people seem to be upset.
First of all I have to say I don’t like copyright infringement (even though I dislike calling it piracy in the first place): Free Software licenses are based on the idea of respecting copyright and thus I don’t like being the kind of hypocrite who asks to abide to licenses and at the same time infringe on others’ copyright. On the other hand, I find myself thinking about double-standards pretty often. Mostly, when there is no real other option from doing something illicitly.
For instance, anime and, even more, Japanese drama are sometimes impossible to find without having to wait for years, or often have bad translation or some kind of “localization” that ruins the pretty much (usually watering them down with political-correctness, censuring and cutting down anything that might make them unsuitable for children — even when the original version was simply not aimed at children but rather at young adults, but I’m going down a different road now).
Now I don’t want to play saint, it happened to me, and sometime happens still, that I went to watch something that was illegally downloaded; on the other hand, I don’t do this systematically, and I spend a few hundreds euro each year in original content (DVDs, BluRay, games for PS3 and PSP, software — if I do count this year I guess I’m well over €1K thanks to software: between Microsoft Visual Studio 2008 and Microsoft Office 2007 I already reach €600), and these usually include more than a few things that I previously watched downloaded (The Melancholy of Haruhi Suzumiya I had seen fansubbed, but I bought the Italian original box set earlier this year, for instance).
But there is one thing I absolutely rely on Mininova for, nowadays, and I’d be pretty upset if it was shut down: Real Time with Bill Maher ! Yes I do like this show, I have seen a piece of this some time ago in relation to an article by Richard Dawkins and then went on to listen to it (in podcast form) and then watch it (when the audio podcast was obscured for a while, and had to work around the US-only limitation, and found the full-fledged video podcast), up to now that I actually watch it downloaded from torrents each weekend.
Now, I know this is illegal, but HBO does not really provide me any other mean to watch it. And mind you, I’d be happy to spend €5/month to subscribe to it; I could even live with downloading it with iTunes, and having it DRM’d (which would upset me a bit but would be bearable). It’s a friggin’ late night show, not a movie, and not some general show like Mythbusters, which actually gets translated, dubbed and aired in other places, like Italy, although an year after the original American airing (on a related note: finding DVDs in Italy is still impossible; and region 2 DVDs from Amazon UK are limited to the first season…).
So if this for some reason arrive on the screen of some HBO guy: please, think about us, Bill Maher fans on the other side of the pond, and give us the chance of legally follow the video episodes. I’m sure that I’m not the only one who’s going to pay for the subscription, if given the chance. Then we can stop illegally downloading this through Mininova…
|
So I went on vacation and… (August 27, 2009, 14:18 UTC)
And now I got to work 18 hours a day. I wanted to write a bit about my one week in London but the time, since the start of the week, have been more than entirely spent on two main work projects. I even had to give up one project entirely because I didn’t have much time after an urgent consultancy started this week.
I have also very limited time for Gentoo as you might have noticed; I’m trying to do some of the standard maintenance operation on my packages and on Gentoo as a whole, but it really doesn’t have the same speed as I used to have. So please bear with me if the next weeks will be very slow on my Gentoo side.
On the bright note, I’ve been able to update PulseAudio to the latest test version, so you might want to try that out. And I’ll be working on a few more notes here and there, included autotools mythbuster .
|
Quotes update (August 27, 2009, 03:54 UTC)
I just wanted to make a quick note (nothing urgent at all) that I have updated my random quotes database with about 20 new quotations. I hope you enjoy them, and come back to visit often to see new ones. 
|:| Zach |:|
|
August 26, 2009
RIP, nemesis (August 26, 2009, 19:03 UTC)
Nemesis, my main fileserver/webserver/dhcp/etc. just bit the big one. Bad, too: no response to the power button. The power supply is probably okay, because several LEDs on the motherboard light up, but no fan spin, no HD spin up.
Yay.
So, I get to try to replace it. Temporarily, I'm going to try to put the drives in my desktop (thanatos), and re-purpose it. But that's not a long term solution, since I need thanatos to be my desktop.
One possibility is to buy a new desktop. I'm planning on getting a new gaming machine when Diablo 3 comes out anyway, so maybe I should buy it early. However, with no ETA for Diablo 3, I can get much more machine by waiting. Then, too, I'm not done with Fallout 3, and the DLC isn't even out yet for the PS3, and I have to go back and finish InFamous at some point, so I probably won't have time for Diablo 3 any time soon anyway. So buying a new desktop is probably out.
Another possibility is to just replace nemesis with the cheapest setup I can find. That's certainly quick, and easy. Another possibility, which I've been considering for a while, is to get a NAS. Some of them are quite nice, and I'm too old to enjoy administering a box anymore. I've also read some good things about some of them. I guess some serious pricing of options is in order...
Of course, my decision may be made for me if something happened to the drives in the crash of nemesis. There may be no point in trying to build a quick-and-easy replacement. Time to find out I guess.
|
Funtoo Halucinations (August 26, 2009, 11:03 UTC)
So I'm reading through my RSS feeds and stumble across this gem:
Ciaranm quoting something from the funtoo.org FAQ about how funtoo.org only works with Internet Explorer or something
So, like, I look at the Funtoo FAQ that is linked from that blog.
Read it.
Don't find any mention of Firefox
Do a fulltext search just in case
So now I'm wondering, wtf is happening?
Is this a fast edit from the funtoo people in under 30 minutes? I find that unlikely. Or is Ciaran hallucinating badly (as seen with
PMS and other works of fiction) and needs to have his medication adjusted?
I'd guess it's the usual FUD, and most likely ignoring it would be the "right" thing to do, but if you catch a kid urinating in the pool
you usually spank it in the hope of teaching it not to do it again.
|
August 25, 2009
common alsa issues (August 25, 2009, 12:03 UTC)
I started a thread on the Gentoo Forums the other week, trying to get users to post what are common issues that they run into collectively. I'm hoping to see if I can find some patterns and either update the documentation or write a FAQ. If you have anything to share, please do.
And for the record, here is my first line of defense that I will tell anyone when they have no sound / wrong driver issues:
- Use latest ALSA (and kernel) in the tree. In this case, it's 1.0.20, and we've cleaned up a lot of crap that was causing issues.
- Compile everything sound-related in the kernel as a module. Yes, everything. No, not just the stuff that you *think* you can statically compile in --- *ev-e-ry-thing.* Once you've done that, run alsaconf. If your card doesn't show up, it's either completely unsupported (unlikely) or you didn't pick the right drivers. Go back in and flip on more stuff. As modules.
- If the correct drivers are loaded (aplay -L works), and you have no sound, then your mixer levels are probably wrong.
Apologies for coming across so heavy-handed, but that's the approach that has always worked for me, and works for most everyone when I tell them to do that: latest kernel, latest ALSA, everything as modules, alsaconf, then mixer.
Edit: Just as a postscript, the reason for the bluntness is that I recently started taking a more active role in the ALSA herd. Normally, I would just do version bumps and leave it at that. But, I'm trying to get practical issues resolved, and the one common thread I see over and over and over again on the forums and IRC is people just going off on their own little path and stabbing in the dark to see if they can get their sound to work, and then acting surprised that some random configuration didn't work.
I want to very much find both the source of this disinformation and correct it, and make sure that setting up sound is a really simple process. The *problem* though, is that it's always been pretty extremely easy for me, and so I am having a really difficult time understanding *why* people are hitting these issues -- hence, the reason for the forum post asking people why they are running into problems, and what thoughts and conclusions lead to that direction. Once I figure that out, then I can go back and tweak the docs to clarify situations and attack the common confusion.
I keep getting the idea that we could use a really simplified version of the ALSA doc, one that is a quick basic howto get setup for people with one soundcard, and then include examples using the most popular hardware out there right now (intel-hda). Then, have a separate doc for more advanced issues, for people who need help and information on alsa plugins, or have multiple sound cards and things like that. I think that lumping them together into one, as it is now, makes it hard for people who just want to get up and running.
So, apologies if it feels like I'm browbeating here, but the reality is that I'm really motivated to streamline the process of getting sound in Linux. Nothing but love, yo.
|
I think I stumbled upon Linux Mint on DistroWatch, upon this screnshot:
Somehow I wanted to see that wallpaper on my desk. Finally I found the image and put it up my desk:
It didn’t take long to where I wanted a version without the mint logo on it. The logo is nice but I don’t like to look at logos all day long. So I contacted the wallpaper’s author Zwopper who sent me a no-logo version in both green and blue in no time also allowed me to share it with you under a CC-BY-SA-3.0 license here. As far as I understand they have not been published like that elsewhere before. Here they are.
Click the thumbnails for PNG downloads with 2560×1600 pixels size.
|
August 24, 2009
Trip to the UK (August 24, 2009, 13:45 UTC)
I'm currently in Scottland on a trip through the UK. I'm trying to get some contacts to the much more active environmental movement here. For those who don't know, the UK has probably the most active climate movement in the world. I just came from a gathering in the Lake District and now I want to visit a protest site against open cast coal mining in Mainshill.
Afterwards I'll visit the Climate Camp.
It's quite interesting to see discussions here. The main topics at the moment are the third runway at the heathrow airport (see e. g. Plane Stupid) and the building of a new coal plant in Kingsnorth (done by the german company e-on). I heared quotes like »we shouldn't wait till they build the new plant, they're burning coal every day in the existing ones«, which is a large difference compared to the discussion in germany.
|
August 23, 2009
Long title, hopefully catchy enough so that both users and fellow developers can get to read this, since it’s half a rant, half an explanation on why the QA team can be quite anal when it comes to bugs that, for most developers, and especially for the maintainers of the packages involved, might look minor or not causing problems to the general population of users.
Today’s problem for instance was with packages that, for non-live (thus, snapshot or release) versions used the SCM eclasses, fetching directly from CVS, Subversion, GIT, Mercurial and so on. QA already have stated that the ebuilds using SCM eclasses should be masked (it’s in the devmanual if you wish to look at it), and that by extension should tell that using them for relesed code is bad. Among the various reasons for not using SCM eclasses for proper versions of the software, no matter whether upstream has or hasn’t made any serious release, there are safety involvements (you sidestep the Manifest in portage) and problems with proxy (not all SCMs use HTTP for fetching), but what creates quite a bit of a problem to me with the tinderbox: those ebuilds don’t abide the fetch command! When I run the tinderbox, I launch in parallel both a build sequence and a fetch sequence (I cannot use the parallel fetch feature because I launch each package one by one); when the packages using SCM hit, they spend time not building, which is bad for the tinderbox. And it gets even worse when you add stuff like the old, removed rubinius that spent time timing out because the server went away.
But the same class of problems involve using too big files in the tree: when you add a 100K patch for a package that just a few users are going to merge, you’re wasting bandwidth and disk space for a huge amount of people who just don’t care. That’s why we stress the need for making filesdir as lightweight as possible without messing with the development process, of course. Again, this is just another little task for the developer: package the patches and send them on the mirrors, then add them to the ebuild so that they are only downloaded by those who do need them.
And again it’s the same problem with packages ignoring compilers, compiler flags, linker flags, or prestripping when they shouldn’t. These are a problem because one of the selling points of Gentoo is the customisability of it all, at all different levels. So while they might be seen as minor points, these are all the little details that the QA team has to answer for. And it goes on and beyond this, making sure software builds, that it builds in parallel if it’s possible, that it doesn’t fail with new version of dependencies, that it builds with the correct kernel.
So please help us helping everybody, and don’t just ignore our requests, or start a pissing contest on why your package should be special, and not abide to the common rules and directions of the rest of Gentoo. Sorry, but unless it is really special, and that’s pretty rare, your software will have one way or another to abide to those rules, and if I have to piss you off by forcing the decision as QA, then I will. I hope I won’t have to, though.
|
The status of some deep roots (August 23, 2009, 16:41 UTC)
While there are quite a few packages that are know to be rotting in the tree, and thus are now being pruned away step by step, there are some more interesting facets in the status of Gentoo as a distribution nowadays.
While the more interesting and “experimental” areas seem to have enough people working on them (Ruby to a point, Python more or less, KDE 4, …), there are quite some deeper areas that are just left to rot as well, but cannot really be pruned away. This includes for instance Perl (for which we’re lagging behind a lot, mostly due to the fact that tove is left alone maintaining that huge piece of software), and SGML, which in turn includes all the DocBook support.
I’d like to focus a second on that latter part because I am partly involved in that; since I like using DocBook and I actually use the stylesheets to produce the online version of Autotools Mythbuster using the packages that are available in Portage. Now, when I wanted to make use of DocBook 5, the stylesheet for the namespaced version (very useful to write with emacs and nxml) weren’t available, so I added them, adding support for them to the build-docbook-catalog script. With time, I ended up maintaining the ebuilds for both versions of the stylesheets, and that hasn’t been always the cleanest thing given that upstream dropped the tests entirely in the newer versions (well, technically they are still there, but they don’t work, seems like they lack some extra stuff that is nowhere documented).
Now, I was quite good as I was with this; I just requested stable for the new ebuilds of the stylesheets (both variants) and I could have kept just doing that, but … yesterday I noticed that the list of examples in my guide had broken links, and after mistakenly opening a bug on the upstream tracker, I noticed that the bug is fixed already in the latest version. Which made me smell something: why nobody complained that the old stylesheets were broken? Looking at the list of bugs for the SGML team, you can see that lots of stuff was actually ignored for way too long a time. I tried cleaning up some stuff, duping bugs that were obviously the same, and fixing one in the b-d-c script, but this is one of the internal roots that is rotting, and we need help to save it.
For those interested in helping out, I have taken note of a few things that should probably be done with medium urgency:
- make sure that all the DTDs are available in the latest release, and that they are still available upstream; I had to seed an old distfile today because upstream dropped it;
- try to find a way to install the DocBook 5 schemas properly; right now the
nxml-docbook5-schemas package install its own copy of the Relax-NG Compact file; on Fedora 11, there is a package that installs more data about DocBook 5, we should probably use the same original sources; the nxml-docbook5-schemas package could then either be merged in with that package or simply use the already-installed copy;
- replace b-d-c, making it both more generic and using a framework that exists already (like eselect) instead of reinventing the wheel; the XML/DTD catalog can easily be used for more than just DocBook, while I know the Gentoo documentation team does not want for the Gentoo DTD to just be available as a package to install in the system (which would make it much easier to keep updated for the nxml schemas, but sigh), I would love to be able to make fsws available that way (once I’ll finish building the official schema for it and publish it, again more on that in the future);
- find out how one should be testing the DocBook XSL stylesheets, so that we can run tests for them; it would have probably avoided the problem I had with Autotools Mythbuster in the past months;
- package the stylesheets for Xalan and Saxon, which are different from the standard ones; b-d-c already has support for them to a point (although not having to explicit this kind of things in the b-d-c replacement is desirable), but I didn’t have reason to add them.
I don’t think I’ll have much time on working on them in the future, so user contributions are certainly welcome; if you do open any bug for these issue, please do CC me directly, since I don’t intend (yet) to add myself to the sgml alias.
|
Progress Update (August 23, 2009, 09:39 UTC)
Well… I’ve been busy getting the boxes into shape ready for new stagebuilds and a heap of other activities.
I have Firefox 3.5 going on mipsel… albeit a little shakey. I’ve got 99% of KDE 4.3 going also, again, a few glitches. I have turned my attention for the time being to the SGI machines here, since the kernels on all of them are out of date… and the userland is in a bit of a mess. Particularly on the Indy… which hasn’t been touched in a couple of years (e2fsck complained the disk wasn’t checked in over 1000 days).
The Indy (R4600SC) needs a new kernel, as its current one is too unstable to do anything useful. I remember kernel 2.6 being a royal bitch on this machine, hopefully things have improved. The IP28 is up and running… old kernel and userland, but it’s not quite as bad as the Indy… at least it’s stable. The O2 is similarly suffering an old kernel, but at least parts of its userland are in reasonable shape.
The two Fulongs are also getting an overhaul which is badly needed. The Yeeloong too, is undergoing further work to get things running.
Tonight, I managed to figure out battery monitoring within KDE 4.3… the trick was to unmask the apm USE-flag and re-merge hal with this feature enabled. Now the system displays the battery status as it should… if only I could get NetworkManager working properly, then everything would be sweet there.
I have a couple of tracker bugs relating to this work… bug 282264 is a tracking bug for KDE 4.x related tasks, and bug 282265 pertains to the changes needed for in-tree Lemote system support.
I intend to do a bit of work on both as I run between Brisbane and Laidley using the Yeeloong as a test platform, so hopefully we will have something for public release soon. In addition, I’ll be doing stagebuilds for the Gentoo/MIPS port generally, once my systems are back online.
|
August 21, 2009
A few days before leaving for my vacation (more on that later), I have noticed an identi.ca post from tante that related to XML parsers’ vulnerabilities from CERT-FI. Since I was leaving for vacation I didn’t want to pick it up myself, but I nudged our security team in that respect. Unfortunately this was a preamble to a multi-level fuck up.
When I first saw the advisories, it didn’t even name expat, not even in passing, but it referred to the Python parser, and I remembered that Python used an internal copy of expat by default. So I was worried; the worry seems to have been correct: the bug is in the expat code, rather than in the glue to Python, so the bug is present in all software using expat; Robert was able to reproduce the issue with a software that only used libexpat, and not Python; CERT-FI at the time of writing does not list standalone expat in the list of vulnerable software, though, just listing “Python’s libexpat”.
Indeed, the fix is present in the latest revision of expat in Gentoo’s tree, but that fix was escalated and pushed without going properly through security up to today which would have meant the fix wouldn’t have been scheduled for security stable.
But there is an even greater fuck-up in all this, and those who probably follow me from some time ago are already expecting it: bundled copies of libexpat ! Indeed the thing is not only bundled in a bunch of closed-source software but also in a lot of free software packages. The bundled libs bug is a good index for those things.
The problem now is to make sure the list is updated, and also make sure that the proprietary software that is vulnerable will be handled properly, hopefully. Unfortunately expat is probably the second most commonly bundled library after zlib, and that already made me shiver more than a few times at the thought of a vulnerability in it. Well, time has come.
Now, can somebody really find the unbundling effort still pointless? Seriously?
|
FROSCON (August 21, 2009, 09:48 UTC)
Hi y'all,
If you're unsure what to do this (22. and 23. of August) weekend and you're accidentally near Bonn or Cologne in Germania ...
FROSCON is happening again. And Gentoo will have a presence there.
So if you find the time, feel free to visit (and the 5Eur entrance fee are really worth it!) and meet us.
This year we have a booth and a dev room where we can demonstrate out superior slacking skills (and, of course,
the most awesome metadistribution ever!)
Experience from last years suggests a very nice, filled-with-fun, meeting of geeks, nerds and people that just like meeting other people.
There's a nice program filled with interesting speeches and discussion rounds,
lots 'o beer and quite likely some nice grilling or other kinds of food.
At the moment it looks like the weather will be good, so that'll make it even more fun. And if all that still doesn't convince you that you
have to be there ... well ... then you don't deserve it anyway!
Hope to see y'all there,
Patrick the bonsaikitten
|
August 20, 2009
I'm still trying to decide where I wanna go with my media browser/frontend solution -- if I'm going to write my own or keep hacking on MythVideo. I only have one really nagging issue left now, and that is that the file structure presented is static once you enter the "Watch Videos" menu. I'd like it to be dynamic (that is, upon entering a new folder, check the contents again) so that I can add stuff like symlinks to series that I'm currently watching, or whatever. Doing that is pretty tricky.
I spent a few hours last night digging through the code, trying to find out exactly how the code is operating and what it's doing. What I learned was that, well Myth was doing exactly what I thought it was -- it builds a file list upon first entering, and then it doesn't examine it at all until you re-enter the video browser through the main myth menu. (I wish I had a decent screenshot about now, it's a bit confusing if you don't know what I'm talking about.)
There's a couple of problems with this approach, in my mind. First of all, the time it takes to actually load the mythvideo plugin grows in relation to how much media you have that it needs to parse. That is, it iterates over *every* single file that is in your media storage, and adds it to one variable. It's essentially like running find on your filesystem, saving it into one variable, and then when browsing, just using that snapshot that you took.
The simpler way, in my opinion, would be to just refresh the directory structure and metadata for the directory you are in. While I was poking at it, one thing I tried was to get the directory scan to not go more than one level deep. That reduced the startup time from about 8 seconds to less than one. Nice.
Ideally, I'd like to change it so it just updates the directory scan as it enters a new one, progressively growing the variable as you jump around the directory tree, but I couldn't figure out how to do that in the code (and if someone wants to help, that'd be awesome). MythVideo calls fetchVideos() only when first entering, and not anytime after that. The real problem is that it in turn calls about eight other levels of functions that eventually get to scanning the directory tree. I could probably hack it together to pass the current directory I'm in and update the directory scan from there, but again, I'm so limited in my C++ skills, at this point it's just code and guess. So, I can find and explain the problem, but not fix it myself.
Fortunately, it's a minor wish list item of mine, and so it's not a show stopper. I can live with not being able to do it, and it's probably just a matter of me learning how to code a bit more that I could figure it out. On the plus side, I'm learning more about the internals of the code, and each time I go in there, I find a few small inefficiencies that I can cleanup myself, which is fun. Making progress, I suppose.
|
Just a short comparison after the initial report: The shipped Debian takes 60 seconds till the Gnome desktop appears, while the LXDE of my Gentoo installation needs 40 seconds. Of course less features (or cruft) is available with the latter, so no real benchmark. Also Ubuntu has formed a team to do a port to the Loongson CPU.
The kernel provided by Lemote is 2.6.31-rc5 and I used the attached configuration to succcessfully built and run the kernel on my Loongson 2F-based Yeeloong netbook.
CONFIG_MIPS=y CONFIG_MACH_LOONGSON=y CONFIG_ARCH_SPARSEMEM_ENABLE=y CONFIG_LEMOTE_YEELOONG2F=y CONFIG_CS5536=y CONFIG_SYS_HAS_MACH_PROM_INIT_CMDLINE=y CONFIG_CS5536_MFGPT=y CONFIG_UCA_SIZE=0x400000 CONFIG_RWSEM_GENERIC_SPINLOCK=y CONFIG_ARCH_SUPPORTS_OPROFILE=y CONFIG_GENERIC_FIND_NEXT_BIT=y CONFIG_GENERIC_HWEIGHT=y CONFIG_GENERIC_CALIBRATE_DELAY=y CONFIG_GENERIC_CLOCKEVENTS=y CONFIG_GENERIC_TIME=y CONFIG_GENERIC_CMOS_UPDATE=y CONFIG_SCHED_OMIT_FRAME_POINTER=y CONFIG_GENERIC_HARDIRQS_NO__DO_IRQ=y CONFIG_DMA_NONCOHERENT=y CONFIG_DMA_NEED_PCI_MAP_STATE=y CONFIG_EARLY_PRINTK=y CONFIG_SYS_HAS_EARLY_PRINTK=y CONFIG_SYS_SUPPORTS_HOTPLUG_CPU=y CONFIG_I8259=y CONFIG_GENERIC_ISA_DMA=y CONFIG_GENERIC_ISA_DMA_SUPPORT_BROKEN=y CONFIG_CPU_LITTLE_ENDIAN=y CONFIG_SYS_SUPPORTS_LITTLE_ENDIAN=y CONFIG_IRQ_CPU=y CONFIG_BOOT_ELF32=y CONFIG_MIPS_L1_CACHE_SHIFT=5 CONFIG_CPU_LOONGSON2F=y CONFIG_CPU_LOONGSON2=y CONFIG_SYS_HAS_CPU_LOONGSON2F=y CONFIG_SYS_SUPPORTS_32BIT_KERNEL=y CONFIG_SYS_SUPPORTS_64BIT_KERNEL=y CONFIG_CPU_SUPPORTS_32BIT_KERNEL=y CONFIG_CPU_SUPPORTS_64BIT_KERNEL=y CONFIG_64BIT=y CONFIG_PAGE_SIZE_16KB=y CONFIG_BOARD_SCACHE=y CONFIG_MIPS_MT_DISABLED=y CONFIG_CPU_HAS_WB=y CONFIG_CPU_HAS_SYNC=y CONFIG_GENERIC_HARDIRQS=y CONFIG_GENERIC_IRQ_PROBE=y CONFIG_CPU_SUPPORTS_HIGHMEM=y CONFIG_SYS_SUPPORTS_HIGHMEM=y CONFIG_ARCH_FLATMEM_ENABLE=y CONFIG_ARCH_POPULATES_NODE_MAP=y CONFIG_SELECT_MEMORY_MODEL=y CONFIG_FLATMEM_MANUAL=y CONFIG_FLATMEM=y CONFIG_FLAT_NODE_MEM_MAP=y CONFIG_SPARSEMEM_STATIC=y CONFIG_PAGEFLAGS_EXTENDED=y CONFIG_SPLIT_PTLOCK_CPUS=4 CONFIG_PHYS_ADDR_T_64BIT=y CONFIG_ZONE_DMA_FLAG=0 CONFIG_VIRT_TO_BUS=y CONFIG_HAVE_MLOCK=y CONFIG_HAVE_MLOCKED_PAGE_BIT=y CONFIG_DEFAULT_MMAP_MIN_ADDR=4096 CONFIG_TICK_ONESHOT=y CONFIG_NO_HZ=y CONFIG_HIGH_RES_TIMERS=y CONFIG_GENERIC_CLOCKEVENTS_BUILD=y CONFIG_HZ_1024=y CONFIG_SYS_SUPPORTS_ARBIT_HZ=y CONFIG_HZ=1024 CONFIG_PREEMPT=y CONFIG_SECCOMP=y CONFIG_LOCKDEP_SUPPORT=y CONFIG_STACKTRACE_SUPPORT=y CONFIG_DEFCONFIG_LIST="/lib/modules/$UNAME_RELEASE/.config" CONFIG_CONSTRUCTORS=y CONFIG_EXPERIMENTAL=y CONFIG_BROKEN_ON_SMP=y CONFIG_LOCK_KERNEL=y CONFIG_INIT_ENV_ARG_LIMIT=32 CONFIG_LOCALVERSION="-fauli" CONFIG_HAVE_KERNEL_GZIP=y CONFIG_HAVE_KERNEL_BZIP2=y CONFIG_HAVE_KERNEL_LZMA=y CONFIG_KERNEL_LZMA=y CONFIG_SWAP=y CONFIG_SYSVIPC=y CONFIG_SYSVIPC_SYSCTL=y CONFIG_POSIX_MQUEUE=y CONFIG_POSIX_MQUEUE_SYSCTL=y CONFIG_BSD_PROCESS_ACCT=y CONFIG_BSD_PROCESS_ACCT_V3=y CONFIG_TREE_RCU=y CONFIG_RCU_FANOUT=64 CONFIG_IKCONFIG=y CONFIG_IKCONFIG_PROC=y CONFIG_LOG_BUF_SHIFT=15 CONFIG_GROUP_SCHED=y CONFIG_FAIR_GROUP_SCHED=y CONFIG_RT_GROUP_SCHED=y CONFIG_USER_SCHED=y CONFIG_CGROUPS=y CONFIG_CGROUP_DEBUG=y CONFIG_CGROUP_NS=y CONFIG_CGROUP_FREEZER=y CONFIG_CGROUP_DEVICE=y CONFIG_CGROUP_CPUACCT=y CONFIG_RESOURCE_COUNTERS=y CONFIG_CGROUP_MEM_RES_CTLR=y CONFIG_CGROUP_MEM_RES_CTLR_SWAP=y CONFIG_MM_OWNER=y CONFIG_RELAY=y CONFIG_NAMESPACES=y CONFIG_UTS_NS=y CONFIG_IPC_NS=y CONFIG_USER_NS=y CONFIG_PID_NS=y CONFIG_NET_NS=y CONFIG_BLK_DEV_INITRD=y CONFIG_INITRAMFS_SOURCE="" CONFIG_RD_GZIP=y CONFIG_SYSCTL=y CONFIG_ANON_INODES=y CONFIG_EMBEDDED=y CONFIG_SYSCTL_SYSCALL=y CONFIG_KALLSYMS=y CONFIG_HOTPLUG=y CONFIG_PRINTK=y CONFIG_BUG=y CONFIG_ELF_CORE=y CONFIG_PCSPKR_PLATFORM=y CONFIG_BASE_FULL=y CONFIG_FUTEX=y CONFIG_EPOLL=y CONFIG_SIGNALFD=y CONFIG_TIMERFD=y CONFIG_EVENTFD=y CONFIG_SHMEM=y CONFIG_AIO=y CONFIG_VM_EVENT_COUNTERS=y CONFIG_PCI_QUIRKS=y CONFIG_COMPAT_BRK=y CONFIG_SLUB=y CONFIG_HAVE_OPROFILE=y CONFIG_HAVE_SYSCALL_WRAPPERS=y CONFIG_RT_MUTEXES=y CONFIG_BASE_SMALL=0 CONFIG_MODULES=y CONFIG_MODULE_FORCE_LOAD=y CONFIG_MODULE_UNLOAD=y CONFIG_MODULE_FORCE_UNLOAD=y CONFIG_MODVERSIONS=y CONFIG_BLOCK=y CONFIG_BLOCK_COMPAT=y CONFIG_IOSCHED_NOOP=y CONFIG_IOSCHED_CFQ=y CONFIG_DEFAULT_CFQ=y CONFIG_DEFAULT_IOSCHED="cfq" CONFIG_FREEZER=y CONFIG_HW_HAS_PCI=y CONFIG_PCI=y CONFIG_PCI_DOMAINS=y CONFIG_ISA=y CONFIG_MMU=y CONFIG_BINFMT_ELF=y CONFIG_BINFMT_MISC=y CONFIG_MIPS32_COMPAT=y CONFIG_COMPAT=y CONFIG_SYSVIPC_COMPAT=y CONFIG_MIPS32_O32=y CONFIG_MIPS32_N32=y CONFIG_BINFMT_ELF32=y CONFIG_ARCH_HIBERNATION_POSSIBLE=y CONFIG_ARCH_SUSPEND_POSSIBLE=y CONFIG_PM=y CONFIG_PM_SLEEP=y CONFIG_SUSPEND=y CONFIG_SUSPEND_FREEZER=y CONFIG_HIBERNATION_NVS=y CONFIG_HIBERNATION=y CONFIG_PM_STD_PARTITION="/dev/sda2" CONFIG_CPU_FREQ=y CONFIG_CPU_FREQ_TABLE=y CONFIG_CPU_FREQ_STAT=y CONFIG_CPU_FREQ_DEFAULT_GOV_ONDEMAND=y CONFIG_CPU_FREQ_GOV_PERFORMANCE=y CONFIG_CPU_FREQ_GOV_POWERSAVE=y CONFIG_CPU_FREQ_GOV_ONDEMAND=y CONFIG_LOONGSON2F_CPU_FREQ=y CONFIG_NET=y CONFIG_PACKET=y CONFIG_PACKET_MMAP=y CONFIG_UNIX=y CONFIG_XFRM=y CONFIG_XFRM_USER=y CONFIG_XFRM_IPCOMP=y CONFIG_NET_KEY=y CONFIG_INET=y CONFIG_IP_MULTICAST=y CONFIG_IP_ADVANCED_ROUTER=y CONFIG_ASK_IP_FIB_HASH=y CONFIG_IP_FIB_HASH=y CONFIG_IP_MULTIPLE_TABLES=y CONFIG_IP_ROUTE_MULTIPATH=y CONFIG_INET_AH=y CONFIG_INET_ESP=y CONFIG_INET_IPCOMP=y CONFIG_INET_XFRM_TUNNEL=y CONFIG_INET_TUNNEL=y CONFIG_INET_XFRM_MODE_TRANSPORT=y CONFIG_INET_XFRM_MODE_TUNNEL=y CONFIG_INET_XFRM_MODE_BEET=y CONFIG_INET_LRO=y CONFIG_INET_DIAG=y CONFIG_INET_TCP_DIAG=y CONFIG_TCP_CONG_CUBIC=y CONFIG_DEFAULT_TCP_CONG="cubic" CONFIG_FIB_RULES=y CONFIG_WIRELESS=y CONFIG_CFG80211=y CONFIG_WIRELESS_OLD_REGULATORY=y CONFIG_WIRELESS_EXT=y CONFIG_WIRELESS_EXT_SYSFS=y CONFIG_LIB80211=y CONFIG_MAC80211=y CONFIG_MAC80211_DEFAULT_PS=y CONFIG_MAC80211_DEFAULT_PS_VALUE=1 CONFIG_MAC80211_RC_PID=y CONFIG_MAC80211_RC_MINSTREL=y CONFIG_MAC80211_RC_DEFAULT_PID=y CONFIG_MAC80211_RC_DEFAULT="pid" CONFIG_MAC80211_LEDS=y CONFIG_UEVENT_HELPER_PATH="/sbin/hotplug" CONFIG_STANDALONE=y CONFIG_PREVENT_FIRMWARE_BUILD=y CONFIG_FW_LOADER=m CONFIG_FIRMWARE_IN_KERNEL=y CONFIG_EXTRA_FIRMWARE="" CONFIG_CONNECTOR=y CONFIG_PROC_EVENTS=y CONFIG_PNP=y CONFIG_BLK_DEV=y CONFIG_BLK_DEV_LOOP=y CONFIG_BLK_DEV_CRYPTOLOOP=y CONFIG_BLK_DEV_RAM=y CONFIG_BLK_DEV_RAM_COUNT=16 CONFIG_BLK_DEV_RAM_SIZE=8192 CONFIG_EEPROM_93CX6=y CONFIG_HAVE_IDE=y CONFIG_SCSI=y CONFIG_SCSI_DMA=y CONFIG_BLK_DEV_SD=y CONFIG_BLK_DEV_SR=y CONFIG_CHR_DEV_SG=y CONFIG_SCSI_WAIT_SCAN=m CONFIG_ATA=y CONFIG_ATA_SFF=y CONFIG_PATA_AMD=y CONFIG_NETDEVICES=y CONFIG_NET_ETHERNET=y CONFIG_MII=y CONFIG_NET_PCI=y CONFIG_8139TOO=y CONFIG_8139TOO_PIO=y CONFIG_8139TOO_TUNE_TWISTER=y CONFIG_WLAN_80211=y CONFIG_RTL8187B=y CONFIG_INPUT=y CONFIG_INPUT_MOUSEDEV=y CONFIG_INPUT_MOUSEDEV_SCREEN_X=1024 CONFIG_INPUT_MOUSEDEV_SCREEN_Y=768 CONFIG_INPUT_EVDEV=y CONFIG_INPUT_KEYBOARD=y CONFIG_KEYBOARD_ATKBD=y CONFIG_INPUT_MOUSE=y CONFIG_MOUSE_PS2=y CONFIG_SERIO=y CONFIG_SERIO_I8042=y CONFIG_SERIO_LIBPS2=y CONFIG_VT=y CONFIG_CONSOLE_TRANSLATIONS=y CONFIG_VT_CONSOLE=y CONFIG_HW_CONSOLE=y CONFIG_DEVKMEM=y CONFIG_SERIAL_NONSTANDARD=y CONFIG_SERIAL_8250=y CONFIG_SERIAL_8250_CONSOLE=y CONFIG_SERIAL_8250_PCI=y CONFIG_SERIAL_8250_PNP=y CONFIG_SERIAL_8250_NR_UARTS=16 CONFIG_SERIAL_8250_RUNTIME_UARTS=4 CONFIG_SERIAL_8250_EXTENDED=y CONFIG_SERIAL_8250_MANY_PORTS=y CONFIG_SERIAL_8250_FOURPORT=m CONFIG_SERIAL_8250_ACCENT=m CONFIG_SERIAL_8250_BOCA=m CONFIG_SERIAL_8250_EXAR_ST16C554=m CONFIG_SERIAL_8250_HUB6=m CONFIG_SERIAL_8250_SHARE_IRQ=y CONFIG_SERIAL_8250_RSA=y CONFIG_SERIAL_CORE=y CONFIG_SERIAL_CORE_CONSOLE=y CONFIG_UNIX98_PTYS=y CONFIG_LEGACY_PTYS=y CONFIG_LEGACY_PTY_COUNT=16 CONFIG_HW_RANDOM=y CONFIG_RTC=y CONFIG_RAW_DRIVER=m CONFIG_MAX_RAW_DEVS=256 CONFIG_DEVPORT=y CONFIG_I2C=y CONFIG_I2C_BOARDINFO=y CONFIG_I2C_CHARDEV=y CONFIG_I2C_HELPER_AUTO=y CONFIG_HWMON=y CONFIG_SENSORS_PCF8591=y CONFIG_THERMAL=y CONFIG_THERMAL_HWMON=y CONFIG_SSB_POSSIBLE=y CONFIG_FB=y CONFIG_FIRMWARE_EDID=y CONFIG_FB_CFB_FILLRECT=y CONFIG_FB_CFB_COPYAREA=y CONFIG_FB_CFB_IMAGEBLIT=y CONFIG_FB_MODE_HELPERS=y CONFIG_FB_SM7XX=y CONFIG_FB_SM7XX_ACCEL=y CONFIG_FB_SM7XX_DUALHEAD=y CONFIG_BACKLIGHT_LCD_SUPPORT=y CONFIG_BACKLIGHT_CLASS_DEVICE=y CONFIG_BACKLIGHT_GENERIC=y CONFIG_DUMMY_CONSOLE=y CONFIG_FRAMEBUFFER_CONSOLE=y CONFIG_FRAMEBUFFER_CONSOLE_ROTATION=y CONFIG_FONT_8x8=y CONFIG_FONT_8x16=y CONFIG_LOGO=y CONFIG_LOGO_LINUX_CLUT224=y CONFIG_SOUND=y CONFIG_SND=y CONFIG_SND_TIMER=y CONFIG_SND_PCM=y CONFIG_SND_HRTIMER=y CONFIG_SND_VERBOSE_PROCFS=y CONFIG_SND_VMASTER=y CONFIG_SND_AC97_CODEC=y CONFIG_SND_DRIVERS=y CONFIG_SND_AC97_POWER_SAVE=y CONFIG_SND_AC97_POWER_SAVE_DEFAULT=10 CONFIG_SND_PCI=y CONFIG_SND_CS5535AUDIO=y CONFIG_AC97_BUS=y CONFIG_HID_SUPPORT=y CONFIG_HID=y CONFIG_USB_HID=y CONFIG_USB_HIDDEV=y CONFIG_USB_SUPPORT=y CONFIG_USB_ARCH_HAS_HCD=y CONFIG_USB_ARCH_HAS_OHCI=y CONFIG_USB_ARCH_HAS_EHCI=y CONFIG_USB=y CONFIG_USB_ANNOUNCE_NEW_DEVICES=y CONFIG_USB_DEVICEFS=y CONFIG_USB_SUSPEND=y CONFIG_USB_EHCI_HCD=y CONFIG_USB_EHCI_ROOT_HUB_TT=y CONFIG_USB_OHCI_HCD=m CONFIG_USB_OHCI_LITTLE_ENDIAN=y CONFIG_USB_UHCI_HCD=m CONFIG_USB_STORAGE=y CONFIG_MMC=m CONFIG_MMC_BLOCK=m CONFIG_MMC_BLOCK_BOUNCE=y CONFIG_NEW_LEDS=y CONFIG_LEDS_TRIGGERS=y CONFIG_LOONGSON_PLATFORM_DEVICES=y CONFIG_EC_KB3310B=y CONFIG_EXT2_FS=m CONFIG_EXT3_FS=y CONFIG_EXT3_DEFAULTS_TO_ORDERED=y CONFIG_EXT3_FS_XATTR=y CONFIG_EXT3_FS_POSIX_ACL=y CONFIG_EXT3_FS_SECURITY=y CONFIG_EXT4_FS=y CONFIG_EXT4_FS_XATTR=y CONFIG_EXT4_FS_POSIX_ACL=y CONFIG_JBD=y CONFIG_JBD2=y CONFIG_FS_MBCACHE=y CONFIG_FS_POSIX_ACL=y CONFIG_FILE_LOCKING=y CONFIG_FSNOTIFY=y CONFIG_DNOTIFY=y CONFIG_INOTIFY=y CONFIG_INOTIFY_USER=y CONFIG_FAT_FS=m CONFIG_VFAT_FS=m CONFIG_FAT_DEFAULT_CODEPAGE=437 CONFIG_FAT_DEFAULT_IOCHARSET="utf8" CONFIG_NTFS_FS=m CONFIG_NTFS_RW=y CONFIG_PROC_FS=y CONFIG_PROC_KCORE=y CONFIG_PROC_SYSCTL=y CONFIG_PROC_PAGE_MONITOR=y CONFIG_SYSFS=y CONFIG_TMPFS=y CONFIG_CONFIGFS_FS=m CONFIG_NETWORK_FILESYSTEMS=y CONFIG_CIFS=m CONFIG_CIFS_XATTR=y CONFIG_CIFS_POSIX=y CONFIG_MSDOS_PARTITION=y CONFIG_NLS=y CONFIG_NLS_DEFAULT="iso8859-1" CONFIG_NLS_CODEPAGE_437=y CONFIG_NLS_CODEPAGE_850=y CONFIG_NLS_ISO8859_1=y CONFIG_NLS_ISO8859_15=y CONFIG_NLS_UTF8=y CONFIG_TRACE_IRQFLAGS_SUPPORT=y CONFIG_FRAME_WARN=1024 CONFIG_TRACING_SUPPORT=y CONFIG_HAVE_ARCH_KGDB=y CONFIG_CMDLINE="" CONFIG_CRYPTO=y CONFIG_CRYPTO_ALGAPI=y CONFIG_CRYPTO_ALGAPI2=y CONFIG_CRYPTO_AEAD=y CONFIG_CRYPTO_AEAD2=y CONFIG_CRYPTO_BLKCIPHER=y CONFIG_CRYPTO_BLKCIPHER2=y CONFIG_CRYPTO_HASH=y CONFIG_CRYPTO_HASH2=y CONFIG_CRYPTO_RNG2=y CONFIG_CRYPTO_PCOMP=y CONFIG_CRYPTO_MANAGER=y CONFIG_CRYPTO_MANAGER2=y CONFIG_CRYPTO_WORKQUEUE=y CONFIG_CRYPTO_AUTHENC=y CONFIG_CRYPTO_CBC=y CONFIG_CRYPTO_ECB=y CONFIG_CRYPTO_HMAC=y CONFIG_CRYPTO_CRC32C=m CONFIG_CRYPTO_MD5=y CONFIG_CRYPTO_SHA1=y CONFIG_CRYPTO_AES=y CONFIG_CRYPTO_ARC4=y CONFIG_CRYPTO_DES=y CONFIG_CRYPTO_DEFLATE=y CONFIG_BITREVERSE=y CONFIG_GENERIC_FIND_LAST_BIT=y CONFIG_CRC_CCITT=m CONFIG_CRC16=y CONFIG_CRC_ITU_T=m CONFIG_CRC32=y CONFIG_LIBCRC32C=m CONFIG_ZLIB_INFLATE=y CONFIG_ZLIB_DEFLATE=y CONFIG_DECOMPRESS_GZIP=y CONFIG_HAS_IOMEM=y CONFIG_HAS_IOPORT=y CONFIG_HAS_DMA=y CONFIG_NLATTR=y
|
Every one of us dumb workhorses called architecture developers has its own way of scripting all the commands necessary to stabilise/test a package on its architecture, but I would like to describe how I do it, for the curious. The bug list of the architecture (x86 in my case) with all keywording and stabilisation requests is the starting point here.
Normally I install the packages in a chroot and I follow the never-uninstall-a-package policy to catch file collisions, while others keep the system lean to find missing dependencies (they probably use the buildpkg feature of Portage to keep compile times for dependencies down). To put all needed packages in the package.keywords file, I use the Gentoo Arch Testing Tool (app-portage/gatt) which does that automatically. Compile test includes up to three runs: With all USE flags enabled, then all disabled and then finally what make.conf and the profile defines. The last iteration is then tested, either by starting the program and using it for some time (games usually get a longer testing period) or by building packages that depend upon the package to be stabilised. I have a little script that extracts that information from the tinderbox' rindex and determines which package is in stable and needs to be rebuilt. Manual work includes a short glance if USE flags are needed to activate the support for that package. Installing as most depending packages as possible makes sure all reverse dependencies still build, this sometimes leads to other stabilisation requests or bug reports blocking the stabilisation of the initial package.
After everything went successfully I tell Gatt to create a script in the /tmp/ directory which is shared with my main system. From there I call that script which is quite capable and there is an extensive manual for it.
That's how your package hits stable on x86 usually. Big things like KDE or Gnome are handled differently, the script is shorter:
- Install it with the package list provided by the team (normally that's the case)
- Test it
- Keyword all packages and add ChangeLog entries (without commit)
- Run QA checks with repoman over the whole category
- Run commit with --force to disable QA checks to speed up process (it still takes hours for KDE)
|
August 19, 2009
Writer’s Community and Store (August 19, 2009, 22:41 UTC)
My friend the reporter (who still has a job this week...) was visiting today, and we were talking about the newspaper industry, and how reporters everywhere are getting laid off. In fact, my "home town" newspaper (the Ann Arbor News) recently folded, fired their reporters, and became some kind of online monstrosity (named after my city with "dot com" on the end; I won't give them Google Juice by listing the name) that does nothing interesting with news, and dumps printed ads (not news or content, mind you, just ads) on my lawn all the time. They're basically paper spammers... Anyway, we were talking, and it occurred to me that there is probably a fairly large set of out-of-work writers at the moment. People with lots of skill, and love of writing. What we need is a business model to take advantage of that to make everyone involved a bit of money. What model should this be, I wonder?Here's my idea: iTunes for ebooks, but done right.
See, ebook readers are becoming good right about now, and Kindle has shown that they can even become popular. And people are buying iPhone and Android apps for a buck or two right and left. What if we could come up with a way to get these writers to be able to write good content, and get that content to consumers, all at low enough overhead that you could charge a buck? What I want is two things: A community and a ratings system. It works like this.
There's a community for writers, where they can collaborate on, edit, comment on, rate, and so on each other's work. The community provides appropriate licenses (in collaboration with Creative Commons, probably), and hosting, and forums, and mailing lists, and all the snazzy web 2.0 things that fan-fic sites have. The community also provides, and here's the important part, a store.
The store would support Kindle, Sony's reader, Plastic Logic's reader, at least one decent iPhone app, at least one decent Android app, at least one decent Pre app, and at least one decent blackberry app. Probably a Windows Mobile app too, but that's a pain. Buyers would be able to rate things, tag things, and link things. Each book would link to the authors community page, so that people could follow and interact with their favorite authors. Authors, subjects, tags, and so on, should have feeds that you can follow: blog-like, twitter like, and so on. Integration with other services (such as twitter, facebook, myspace, and so on) would be a plus.Prices should be low; $.50 - $1.
The idea is to encourage people to buy. Overhead should be low: 5-10%, maybe. Some works could (and probably would) be given away, as teasers or other incentives. There should be no DRM; it wouldn't help, and isn't really necessary.The point of the store/community should be convenience: get things for your device easily and cheaply, support people providing your content, and get good content our the deal.
The point of this whole thing is to make an opportunity out of the failure of the newspaper industry: we have a surplus of talented, professional, skilled writers, who need money. We also have the beginnings of devices that make reading ebooks a good experience. Let's put them together, and allow the fans to help pay for the works of the writers.
|
So I recently have been trying out the various different terminal based emails clients to see if any of them were suitable to my needs. Sadly I have to report that I have yet to find one that does everything I need of it.
The first client I tried was alpine. I have to say setting up the program and using it was really easy. Adding accounts was a snap and it was decently performing. Sorting into threads was a bit slow but I suspect that was gmails fault. However, alpine falls short in showing me if I have new emails in folders other than the main Inbox or the folder I have open. I didn’t find a quick at a glance type view listing all the folders and an unread count next to them. Bummer, I really need this. I can’t simply open every folder to check if there’s new mail as some of them are very large and take a long time to open. Alpine gets brownie points for being able to use vim as an editor by default, but looks like I need to keep looking.
The next client I tried was cone. Cone seemed very familiar to alpine and was slightly easier to set up and get going, but lacked as many configuration options that alpine had. I also have to say the colorscheme it chose on my urxvt terminal wasn’t exactly pleasing to the eye, but bearable. I was extremely pleased that cone’s folder list did list unread message counts and did almost everything I asked of it. I could even use vim in the place of leaf if I wanted. The wall I hit, however, is deal breaking. It’s not even particularly cone’s fault but from google’s refusal to follow IMAP standards. As such, I cannot mark emails as read when using cone on my gmail IMAP account. Shame, this is all that I found on the net about it. I figured if I could just get cone to fire off \Send when it should have been marked read by gmail anyway would work but I just can’t quite grasp the internals of cone. Sigh. I tried to hack cone’s sourcecode to implement sending UID STORE +FLAGS \Seen but couldn’t get it working. The functions weren’t documented and my knowledge of C was lacking so I was just clobbering things together. I gave up after it would open a message and simply segfault.
Next I attempted to try mutt. Mutt seems overly complicated for my needs and I don’t think it would play very nice with over 5 IMAP accounts. It’s configuration is a nightmare and I gave up after barely just getting one account functioning.
So for now I’m still using Claws-Mail which is the best graphical client I’ve tried so far. There are times when I don’t have access to a graphical display , however, and wanted a nice email client in a terminal which is why I started this search. Would also be handy as I could ssh in from anywhere and read email with a terminal email client.
Now that I’ve wasted half a day stabbing email clients I suppose I should start reading my unread email :/
|
August 18, 2009
Before the netbook-boom called 'mini notebook', Lemote now promotes it as netbook (what it really is). The specialty of that little thing is the hardware: Not an Intel Atom or some AMD CPU, but a 900Mhz Mips chip. Honestly, after my disaster with something ARM-based (NSLU2, it still is bricked and will never be revived I think), I wanted something more end-user friendly and the Lemote is just that. Equipped with a full-fledged desktop installation (the Debian mipsel variant) it allows installing Gentoo with few problems. Chrooting and installing the stage tarball from Zhang Le gets you off quite fast. The provided kernel did not boot, but Le gave me a newer one, which worked just fine after creating some missing device files (console, tty* and pty*, see man mknod). Meanwhile I have compiled my own kernel and the system just runs with LXDE...so finally a possibility to have the third Gtk-based destop installed. Gnome on sol (the big iron desktop), Xfce on the main lappy (called terra) and LXDE now on mars. Performance is good, for surfing and mailing it is more than sufficient, compile times are ok (even GNU Emacs runs), but the battery is way too small (1.5 hours only, but a peak of 14W consumption, while having 12W during normal surf sessions).
The Loongson processor seems to me as the future of the Gentoo Mips port. Supporting the old SGI machines is nice but they will eventually die out, while Lemote actively works on new machines and supports Linux as its main platform (they don't have any other choice apart from the BSDs anyway). Ordering is really simple: Either use Lemote directly (and handle all customs yourself), use KD85 (what I did, really pleasing experience, shipped from Belgium) or Tekmote from the Netherlands.
Zhang Le (r0bertz) and Stuart Longland (redhatter) wrote enough about the Loongson processor and the Gentoo support in various entries on their blogs, so I won't go into more details.
|
Introducing to Gentoo-Quebec (August 18, 2009, 10:09 UTC)

Gentoo-quebec is a project which aims to meet people around gentoo stuffs.
At the origin it was created on 1st December 2007 per 5 guys
-Laurent Duchesne
-Sylvain Alain
-Patrick Blanchard
-Éric Langlois
-Mathieu Bouchard
Providing great documentations as PDF format (generated using LaTeX ) and excellents wiki howtos pages, this is the right place to share and learn experiences.
There is also an useful and powerful forum for our community, to get feedbacks and ask all your questions, don't worry admins didn't forget an english section .
Actually I help them when I've time enough, my areas of responsability are mostly fix or write articles in the wiki, and share my experiences (and learn too) on the forum.
Gentoo-quebec always search great users with good gentoo skills, or developer who want to share their knowledges (like zmedico with portage, thanks to him).
so because you finished to read this entry don't wait and join gentoo-quebec ! 
|
Over the past weekend, I was at Sky Knights skydiving drop zone near Milwaukee, WI. The main event was the canopy relative work (CRW) state record attempts. I had only participated in approximately 25 CRW jumps before this, but I was able to add another 13 jumps this weekend. The previous state record for CRW in Wisconsin was 14 and this year we completed a 25 way diamond on our second attempt to set the new record. I was able to jump with eight CRW world record holders which was awesome and really helped me improve.
 25way CRW formation
I am in the third row from the bottom on the left side. (Photo Credit goes to: Eric Bernetzke)
|
August 16, 2009
Well… after much building by one of the older Lemote systems, I finally have a Gentoo desktop with KDE 4.3.0 on the Lemote Yeeloong.
I’m still working on the rest of the KDE suite… and will have to track down the necessary bits and pieces for battery monitoring and other goodies… but it seems everything is working. It also is slightly more responsive on Gentoo than Debian (which I still have in a chroot).
This post is being written in Konqueror 4.3.0 on the said installation… it passes the Acid 2 test, but has a few stability glitches here and there… so far both the Acid 3 test, and Google Groups crashes it. I’ll sort this out later.
In short, this does mean I’ll be coaxing my O2 into making the same journey and making the necessary tree modifications in order to allow KDE 4.3 on Gentoo/MIPS.
|
I always thought that writting documentation is much more difficult than coding. This is because, writting documenation and guides, is kinda boring(?), requires a lot of our free time and it is not as fun as coding. All of these arguments IMHO are true but is documentation really needed?
During my six month Gentoo journey I faced a common problem: “I want to write a python/gnome/qt ebuild. How on earth am I suppose to do it??”
Looking through Gentoo docs I ‘ve found some guides about writting games and python ebuilds. Maybe there are more, I haven’t checked. Those guides are quite handy for anybody who wants to write a quick ebuild without making serious mistakes.
Eclasses usage is another tricky thing. Based on my experiense, I believe that the most difficult part is to understand how they work and when they should be used on an ebuild. E.g., a Qt4 ebuild doesn’t always require to inherit qt4 eclass because it might wants cmake functions to build and install. In this case, despite the fact that it is a pure Qt4 package, you need to inherit the cmake-utils eclass. That was a simple example but I believe you got the point
This blog post is a kind request to all fellow developers, to make some time and write proper ebuild guides ( and keep them updated based according to eclasses’ latest changes ) for the sake of developers and users. People tend to believe that ebuild writting is quite hard because of all the e-* functions ( wrappers ) and ebuild phases. Prove them wrong
ps: A Qt4 ebuild guide, can be found here
|
August 15, 2009
Makers vs. Managers Schedule (August 15, 2009, 14:35 UTC)
August 14, 2009
August 13, 2009
After talking with Ben (yngwin), I found that there really wasn't anyone working on documentation related to LXDE inside of Gentoo. So, I decided that I would write a HOWTO for getting it installed and configured. I finished the document this morning, and uploaded it to my Developer webspace. You may see a working copy of the document there, and if you want to see the xml, you have two options. Firstly, when looking at the finished copy, you append the following to the end of the URL:
?passthru=1
making the full URL:
http://dev.gentoo.org/~nathanzachary/documentation/lxde_1.0.xml?passthru=1
and that will show you the XML. Secondly, you can view Bug 281345, and click on the attachment. Hopefully the documentation team will pick up the guide in the near future, and commit it. The only holdup that I can foresee is that LXDE is still available only through the testing (~arch) branch.
|:| Zach |:|
|
I have made several changes to the Openbox HOWTO. There were many typographical errors that I didn't catch the first time around, and package links that weren't added. Here's a full list of the updates for version 1.4:
- In code listing 2.5, changed the $ to # as the operation requires root actions.
- Added a note to the 2.5 listing about becoming root before the command.
- In code listing 2.6, fixed the typographical error (7gt; instead of gt;).
- In code listing 2.6, made the
- In code listing 2.8, fixed the typographical error (extra > in closing tag).
- In code listing 2.8, fixed the typographical error (missing closing ").
- Added a link to the package information for conky before code listing 2.10.
- Added a link to the package information for feh after code listing 2.10.
- Added a link to the package information for nitrogen after code listing 2.10.
- Removed the library dependency bug reference for nitrogen.
- In terminals section, changed "customized" to "customised" for consistency.
- In file managers, fixed typographical error for Nautilus (a "bit" heavy).
If you would like to see the new document revisions before it gets committed to the official documentation repository, it is available on my Developer webspace. You may also view the XML for version 1.4 via Gentoo Bug 256693.
|:| Zach |:|
|
August 12, 2009
It is with sadness that we as Trustees bring forward this news that we have
recently received. Ferris Ellsworth McCormick, better known as fmccor, has
passed away unexpectedly on the 5th of August. His family does not wish to be
contacted. We have expressed our gratitude for his contributions on behalf of
the Community.
Ferris studied mathematics in college at Indiana University, graduating in 1968
with a Bachelor of Arts. Later he entered into the Law school at the University
of Michigan, earning his Juris Doctor degree in 1991.
He passed the bar in Michigan that same year and has continued to be an
actively certified Lawyer with the State of Michigan since then. He was also a
member of the Association for Computing Machinery (ACM).
Ferris joined Gentoo on April 16th 2004 as part of the sparc team and improved
sparc support for the entire open source community. Within a year he also
joined the Developer Relations team to help with mediation of any issues that
might come up between people. As time went on Ferris continued to expand and
assist Gentoo in many ways including assisting with the User Relations team and
growing to become the Strategic Manager of the sparc project. Finally, he
became a trustee and the Vice President of the Foundation assisting in getting
the foundation back into good standing.
While it is too late to say in person, the Foundation would like to thank
Ferris once again for all that he did for both Gentoo and the Open source
community. He will be missed.
Please join the community in eulogizing Ferris in our forums here.
|
August 11, 2009
This is a quick note for anyone using compiz, that x11-wm/compiz-0.7.8-r3 will allow KDE-4.3.0 and that the KDE use flags were updated now that KDE-4 has become the "default" KDE version and that 3.5 is approaching its final days.
As such, the kde use flag will add support for KDE-4.X and the kde3 use flag will add support for KDE-3.5. So be sure to check your use flags for compiz.
I plan to move compiz-0.7.8-r3 from the overlay to the tree in a few hours.
Following my attempts to deal with bug 259715, I broke libcompizconfig again - bug 278146. Although I've masked libcompizconfig-0.8.2-r2 sometime ago, it was unmasked long enough to break the config files for enough users. If you still have ccsm / compiz failing for you, you need to downgrade to libcompizconfig-0.8.2 and to remove the contents of ~/.config/compiz/compizconfig/. I'm still working on removing the bundled iniparser from libcompizconfig.
|
August 10, 2009
LXappearance and icon themes (August 10, 2009, 23:24 UTC)
After having recently reinstalled Gentoo on my main production machine, I thought I would look into some theming to make things more aesthetically pleasing. I installed a bunch of GTK themes that I ended up not liking, so I got rid of them. I use Openbox with a bunch of LXDE applications installed to ease the process of customisation. One such application is LXappearance. Getting rid of the unwanted themes from the LXappearance menu wasn't all that difficult. I simply went to /usr/share/themes and removed the respective folders. However, I couldn't seem to get the unwanted icon themes to go away. If I'm not mistaken, icon themes are usually installed to /usr/share/icons. When I went to manually delete the icon theme folders, however, there were no such directories. Hmmmmmmmm...
Since searching the web didn't yield any significant results, I thought I would go to the source code and figure out just what happens when one installs an icon theme using LXappearance. In /usr/share/lxappearance there is a script called install-icon-theme.sh, and it contains the following line:
export XDG_DATA_HOME="$HOME/.local/share";
That lead me to check that respective directory. Bingo, there were my icon theme folders. I simply deleted the folders, and the respective icon theme choices were no longer present in LXappearance. I was simply excited as it was my first success of the day. 
|:| Zach |:|
|
PostBot test (August 10, 2009, 20:01 UTC)
Post from PostBot on my G1.
Nice app. I wonder if it will make me post more?
|
I’ve been playing around more with Linux Containers after my post about init scripts and I start to think they are quite near being working for Gentoo. I hope once I come back from my vacations to get them in the tree together with Tiziano.
Right now the problems we have are:
- the standard stage3 needs to be heavily tweaked or it’ll be a massacre when started;
- if I do set ttys in the configuration, at start time it moves me to the real tty1, which causes a domino effect with X11 that is annoying, although not critical;
- OpenRC needs to be tweaked to add support for Linux-Containers; there are quite a few things that could be eased up by having a working OpenRC that ignores some init scripts when running in containers; the code seems to be in
src/librc/librc.c (look for openvz) and should be easy to check whether we’re running on containers, by checking the running cgroup (/proc/self/cgroup);
- the current ebuild in Tiziano’s overlay creates a
/var/lib/lib directory and installs the lxc- binaries in /usr/bin, both of which shouldn’t happen in Gentoo once installed;
- running
rc shutdown inside the container will stop all the services properly, but will not kill init and thus not kill the vserver, I’m not sure why; running kill 1 also seems not to work, I have yet to check whether sending the kill signal from outside will properly shut down the rc inside, if yes, then it’ll be a good way to shut down the container.
Once I’ll be back and I’ll be working on the init scripts, they’ll be in a separate package, kinda like mysql’s, since what I have for now is slightly more complex, will add a few more standard locations (for instance they’ll use a /var/log/lxc directory that is not part of the standard install of lxc) and will require a couple of packages that are not part of lxc.
|
Booting up my productivity (August 10, 2009, 06:56 UTC)
So, I’ve lately not been blogging or generally doing anything other than being lazy. Now that the next semester of college is starting to ramp up in the near future I’ve decided to attempt to jump-start my productivity. The first step was updating my machines into a usable environment which meant clobbering portage blockers and such until I had my world fully updated to the latest ~amd64 and my developer chroot to the latest stable amd64. The latter was a bit more work, with tons of perl blockages and fetch restricted packages on the java side. All in all not too bad, after a series of
emerge -avuD world --keep-going; revdep-rebuild; dispatch-conf
the chroot was sane again and ready for developer work. Now I can stop slacking so much and help squish some amd64 bugs. (Also, why isn’t –keep-going default? Sigh, maybe I’ll just alias it along with nice and ionice.)
Besides working on Gentoo I’ll be ramping development back up on my two pet projects: GPytage and Zito.
GPytage is currently undergoing a near complete rewrite to support recursive folders and file structures under /etc/portage/. Currently reading in all the files and constructing the internal database is functional and so is a basic UI. Saving still needs to be reimplemented among a variety of other things. I plan to eventually redo all of the accelerator shortcuts into something more sane and to recode glade-based dialogs and windows into pure pygtk.
Zito is currently still in development and undergoing Internationalization refactoring. After that is done, some code tidying and perhaps UI changes are due. I’m still at a loss on how to actually package something like Zito being a java project. I know Ant can do it, but I’m still not exactly sure how to use Ant in the sense of coding a build and install file for it. Seems quite a pain setting up the XML file for Ant.
On a related note, I can say that I am fairly happy with bzr now. I used to be a large git supporter, but many git commands require extensive knowledge of syntax, flags to pass, and just isn’t as user friendly. Bzr I’ve found is very easy to work with and I have not had any problems with it so far. Most of my projects I’ve converted locally to bzr repositories. In my observation, Bzr knows what “the right thing to do” is most of the time and prevents most repository screwups.
|
August 09, 2009
The tree fasting has started (August 09, 2009, 19:25 UTC)
Today I finally went around writing a script that could help me with sending QA last rites, without using Evolution; this way, I was able to send out quite a few last rites before I went to have my vacations. It actually took me a bit of tinkering because my first try was using bash and sendmail to prepare the messages, and in particular to sign them. Since encoding my name properly is quite hard, I gave up and I now use mutt to send the stuff; unfortunately i was unable to find how to sign the messages with mutt and gpgme; if somebody can help me with that, it’s very welcome.
With the script at hand I then went on checking some of my older bugs to send some of them out; some bugs weren’t really correct before (caused by the older tinderbox attempts, which used --buildpkg) and I fixed them up, others were fixed with time, others were still valid. All the packages that failed to build for whatever reason the past October (or at least, most of those) have been last-rited, masked and ready for removal. There are other packages that have been masked and prepared for removal, for failures to build, QA concerns and other stuff.
Now, since these are last rites for QA reasons, they get a 60-days grace period (I usually just did two months, but since I’m now running it through the script, it’s easier to use a real 60-days time). If the package maintainers, other developers, or users, have interested in keeping these packages alive, they should have enough time to do so. Keeping them broken as they are now, though, is not an option, and just fixing them to build, and keep them rotting forever, is not an option either.
Now, while Samuli and Victor are going through to fix all the possible glibc 2.10 and gcc 4.4 failure for the tree, I’m trying to find the problems that are not related to those, and decide on a number of reasons whether to remove the packages or not. These include, but don’t limit to, build failures not stopping the ebuild, broken dependencies, old ebuild not touched for years (sometimes fixes are made but no major change is present, some of those have to go as well), and a sum of minor QA issues.
Since minor issues are, as the name imply, not big enough to call for a removal of a package, I don’t stop at one or two of those, but when I get a package that fails to build, for whatever reason, and then I find that it doesn’t respect flags, CC, and fails with --as-needed as well, then the package is as good as broken to me, and it’s deemed to go.
At the same time, spending eight months or so being broken, in ~arch, is enough for the package to be deemed broken, even if it works fine in stable. Why this? Because it’ll be keeping other packages from going stable, or it’ll break when they go, so it’s not something ignorable.
The date for the start of the final cleanup is October 8th 2009, that day, about 20 packages will be removed (probably even more); while this is just a minimal part of the tree, that keeps growing and growing with time (I also have quite a few packages to add myself), it is part of the standard maintenance that we have to do to make sure that the tree is healthy.
The added advantage is that the packages that are masked will not be rebuilt repeatedly by the tinderbox in the future, which reduces the amount of work and thus the time needed for a full rebuild (it’s already pretty long as it is running all the testsuites: some take hours to complete, some even freeze in the middle and require manual handling (which is why I won’t be leaving the tinderbox running while I’m in London). And on a related note, glib’s testsuite completely freezes Gentoo/FreeBSD to a stop. Scary!
|
SSDs and filesystems, part 2 (August 09, 2009, 10:07 UTC)
So, a couple days in, and I'm still trying to (re)install Gentoo. More on that in a bit. First, let's talk about speed.
It's hard to tell whether or not my new SSDs are really a speedy improvement over the old software RAID1 array of magnetic HDDs. Normally, a bare-bones commandline system feels much faster than an aging graphical desktop, even on the same hardware.
I notice that compile times are slightly faster, though I've also been using tmpfs for Portage and the usual tmp file locations, so putting it all on RAM will lead to a significant speedup anyway.
Boot times are indeed quite zippy; the longest wait is for my media HDD to finish mounting -- it's on ReiserFS, which is known to have very slow mounts.
Now, let's talk filesystems.
The critical showstopper that's made me reinstall two times (and counting) is ext4. So far, ext4 has completely corrupted a whole drive (/var and /usr/portage) and made the other drive (/ and /boot) almost unbootable.
ext4 has eaten my data, hosed my system, and ruined my life.
No amount of fscking has fixed /var and /usr/portage, both on the second SSD. Did you know that you shouldn't let fsck try to resize broken inodes? apparently the resize behavior is known to be broken in the latest versions. It's known to corrupt filesystems. I didn't know that, either. I'm sorry, but what part of "production-ready" applies to ext4? Yeah, it's a new kid on the block, but it's moved out of the "experimental" status into the kernel.
That does not make it ready for your system. The first and second Gentoo installs largely didn't work because (I think) there might have been an invalid mount option. Or something could not be found. Or a superblock was missing. Or the moon was wrong. #$#^#&@ shitty unintelligible error messages. (Here's a tip, developers: don't put every possible thing that could have gone wrong into an error message, then repeat that message for every different error.)
My mount options seemed to be good after double-checking the manpage and around the internet, including kernel.org. Here was my original fstab, from when I had only one partition for / (no separate /boot):
/dev/sda1 / ext4 noatime,data=writeback,commit=60,nobarrier 0 1
/dev/sdb1 /var ext4 noatime,data=writeback,commit=60,nobarrier 0 1
/dev/sdb2 /usr/portage ext4 noatime,data=writeback,commit=60,nobarrier 0 1
Livin' on the edge here. I figured I wouldn't need a separate /boot partition on my first drive, so I lumped it all into one. I did that back in 2005 and 2006 with no problems, right? Right. The rest of the options were designed to maximize SSD performance.
Unfortunately, I couldn't get the system to boot. Made it past grub, the kernel loaded, but when it came time to mount /, it couldn't mount the filesystem rw. No amount of changing options worked -- adding rw to grub.conf, to the fstab options, nothing.
So I figured it must be my one-partition setup, and wiped my disks. Reinstalled again, this time adding a /boot partition on sda. Same ext4 options for /boot as for the other partitions. Rebooted and . . . nope, same errors. Now I'm also seeing a message about a possible bad option or other variable, which I can only assume was in fstab, thanks to the aforementioned shitty nonspecific error messages.
Hit up Google. Not much help. I again backed off on some of the ext4 options, tried playing with Grub parameters, but got the same results. The filesystems mostly weren't mounting, and when a few of them did, it was all readonly.
Sigh. Time to reinstall again. Set up a similar fstab, but this time I changed an ext4 option for /boot to data=ordered, based on this blog post. Reboot and . . . hey, it works. /boot gets mounted. Nothing else does, but it's a start.
I quickly booted back into the LiveCD, changed the other fstab entries to data=ordered, and reboot again. This time, the system seems to boot just fine . . . until it tries to mount /var and /usr/portage from the second SSD. *bzzt*, these cannot be mounted! Something's gone wrong. One more reboot, just for luck, then . . . *bzzt*, now there are filesystem errors! Fsck wants to fix them, so I let it run. Except it completely hoses both partitions. They seem to be so badly scrambled that even running mkfs.ext4 on them from the liveCD results in errors, some of which seem to be emitted from the libata system, which makes me wonder if now the SSD itself has also been corrupted.
I'll have to completely reinitialize and repartition that disk, now. Thanks, ext4. Thanks for hosing my data. Up yours, ext4.
I'm done trying to figure out why ext4 doesn't work. I don't care that it's supposed to be a fast file system for SSDs. I don't care that it's 40 times faster than ReiserFS to mount at bootup. I don't care. ext4 has lost my data three times now. I think my fingers are sufficiently burned to know that "the oven is hot; don't touch."
Up yours, ext4. I'm going back to ReiserFS. At least it works. It's never failed me in more than four years.
Update: On top of the initial ext4 errors, fsck problems, and mount issues, the Mobi drive was also going bad. Now the motherboard BIOS can't see it, regardless of which SATA port or cable I plug in. So just a day or so after trying out the device, when it was initially working for the first install (though the filesystem was throwing ext4 errors, at least /var and /usr/portage worked okay), and it finally finished failing. F***. I contacted the seller to request an RMA; I have a feeling that I'll end up having to go through the manufacturer, which will take a long time. Meanwhile, I'm without a workstation for an indefinite time, so I've set my devaway on dev.gentoo.org. I did find a couple other reports on the internets that say that their Mobis also died shortly after they arrived, so maybe there was a batch of bad drives.
But don't get me wrong, the Mobi drive dying doesn't absolve ext4 of any guilt. The ext4 filesystem still completely f**ked itself repeatedly on the system drive, the UltraDrive ME. It still refuses to do what it's told to do. But rather than continue to investigate related LaunchPad bugs on mounting ext4 rw and fsck errors, I'm going to move back to ReiserFS for the UltraDrive, and just live with longer boots. The RMA process will take awhile, so I may have to reinstall everything on a single drive and just avoid syncing Portage for awhile.
On a good note, OCZ (the company that makes the Vertex, an identical drive with an Indilinx controller), has been experimenting with a homegrown beta firmware that lets the drive do online garbage collection in the background. This is important for keeping the performance of the drive as fresh as when it was first used, even after it gets filled up with files and repeated (re)writes. The firmware is still in testing, but I'm hopeful that it'll make it out the door soon. Hopefully the same firmware features will find their way to my Super Talent drive -- and hopefully the TRIM command will also be implemented in the firmware.
Of course, the only Linux filesystem I know of that supports TRIM is ext4 . . .
|
August 08, 2009
Katzenjammer… (August 08, 2009, 18:33 UTC)
Today I stumbled upon an interesting band from Norway: Katzenjammer (MySpace, last.fm). They got an refreshing mix of genres combined with great vocals and quite some instruments. Besides that they are currently on tour and selling their debut album (Le Pop)… Definately worth to check out…
|
Evolution: Broken IMAP Sync (August 08, 2009, 04:16 UTC)
Since I already use evolution for my calendar needs on my laptop, I thought it would be ideal to also use it for email. So I went through adding all of my email accounts tediously to evolution and all seemed good as they started to sync.
However, suddenly multiple folders failed to sync on my gmail IMAP account. I tried to refresh the account and download everything again but Evolution fails out on downloading all of my email. So I open up the debug log and see errors like Incomplete server response: no information provided for message 1401. Wonderful. After some googling around, I found this bug which describes my exact problem.
Good right? Nope! Unfortunately it looks like an ancient bug that no one cares to fix and it’s “working as intended” as far as I can tell from the responses. This effectively terminates my ability to use Evolution as my email client as I don’t have the time or patience to go through 500 broken emails and deleting them manually just so Evolution doesn’t throw a wobbly over a corrupt email.
If anyone knows a fix for this problem I’d love to hear it, but as far as I can tell I’m effectively barred from using Evolution for email without manually going in and nuking crap off gmail. Quite disappointing really, considering almost every other email client such as Claws Mail or Thunderbird does not have this problem.
|
Against to avoid the problem of bus factor, I’m going to write down here what the plans are, for what concerns me, with PulseAudio and Gentoo for this end of Summer 2009, mostly related to what will happen when I’ll come back from my vacations in London, after mid August.
This actually is also out of candrews asking for it as I haven’t really thought about writing this before that.
So the first thing to say is that I am following PulseAudio pretty well; or rather I’m following Lennart pretty well (he’s also the one that suggested me to rewrite udev’s build system to use non-recursive automake — something I’ll write more about another day), so I’m not sleeping waiting.
Indeed, the 0.9.16 test releases are available in Gentoo already, although masked, and since recently they both support udev hotplug (preferring it over HAL), and also pass all the checks already. A note on the tests is needed though: the mix-test lacks a few entries, in particular regarding 24-in-32-bit samples, and is for this reason disabled in the current ebuild (Lennart should be working on it); at the same time, the ebuild is running test specifically in the source directory, because the intltool checks fail; badly. In theory the problem should be fixed in 0.41 series of intltool, but I am unsure whether that should be packaged or not by us.
In the next release, whether it’ll be another test release or the final release, there will also be a few differences in the handling of audio APIs. The OSS support will be restricted, masking the USE flag on Linux (leaving it enabled for FreeBSD obviously); this means that users wanting to use stuff like OSS4, which is not in Portage and if it’s for me will never be, will have to go a slightly longer way to get it to work with PulseAudio. The reason for this is that Lennart really don’t want to support that, and I can agree with him. Now, if you know the package well, you’ll probably be wondering “what about the OSS-compatibility wrapper?” this is solved already: in GIT the OSS output and wrapper supports are split in two different options, the former will be tied to the oss USE flag, the latter will be left in “auto-mode”, which will create the padsp rapper on all Gentoo Linux and FreeBSD systems. And this should fix your problem Luca!
As for some of the new features, like for instance Rygel UPnP support, well, I’ll probably be working on the sometime in the future; I do want to get Rygel in portage, especially if that will allow me to look at my vacation’s photos directly on my Sony Bravia networked TV.
|
August 07, 2009
swearing off radio (August 07, 2009, 16:30 UTC)
I'm not sure if I'm getting older and more cranky, or am just starting to wake up to the fact that so much of media that is presented is not really what I asked for or what, but this time it's terrestrial radio that is on the chopping block.

One thing I am sure of, it's a sign I'm getting older because I'm starting that phase where I'm unimpressed with music with arbitrary lyrics. I think to myself, "what the heck are they even talking about?" My tastes in music have always been a bit volatile though ... every few years, I'll completely shake up what I want to listen to, and I guess the turning point has finally hit again. I just didn't think it'd hit me so hard.
I was on the way to work this morning, and had a CD in the player (more on hardware specs later), but I switched to the radio. First of all, listening to the radio in the morning is a huge gamble that you'll find anything worth listening to. It is, of course, always that way since most of the airtime is devoted to commercials, but in the morning, there is also morning shows. I loathe morning shows on the radio. They are, in my opinion, the *lowest* form of mass media entertainment out there. A couple of DJs guffawing to themselves over the air, while running stupid contests and commenting on the stupid "news of the days" stories on the wire. Mostly, I just can't stand the pretense, that they treat their audience like everyone is involved in this big insider's joke and we are all just laughing along.
Anyway, that wasn't the thing that ticked me off. What ticked me off is I switched to a different channel, and I heard the same song for the 800th time playing. I was so sick of hearing it even being played, again, that I just shut off the radio in disgust. For good, this time, I decided.
The whole business market around over the air radio is totally whacked, in my opinion. The only explanation I have for the reason they keep playing the *very same* songs over and over again is because they don't want the idea of the top 40 songs to die off. Now, from a business standpoint, I can understand that approach IF it was easier on their supply and demand chain -- that is, you want to produce a large number of records that will sell, and create them en masse so you can project good sales and get a good return on your investment. That would be well and good, but it's totally out of sync with the way music works now. Thanks to the Internet, all music can be easily distributed and deployed to everyone on the planet at the same cost. So, the rationale should be -- instead of selling as much as one album as possible, let's sell as much *different music* as possible!
That is, in fact, one of the reasons I absolutely loved XM Radio when I first signed up for it years ago. They would constantly play new music I had never heard of, and I was always taking notes to write down what artist and song I had just heard so I can get myself a copy. But, XM was having serious cash flow issues, and it looks like the way they started to fix that problem was by bowing to the more traditional method of just playing the same songs over and over. I remember more than once finding the same song playing on three of my preset stations *at the same time*. That's about when I knew it was time to jump ship. I don't miss XM, I miss how it used to be.
Obviously, this whole situation could be solved if I had Internet access in my car, but I doubt that'll be happening for the next 10 years or so, so it's up to me to find a solution in the meantime. Right now, I've just got a CD player in my car, the stereo is the still the same one as the stock one that I bought it with. I've started looking around for stereos, but I was pretty pessimistic about the whole thing. The last time I looked at the idea, years ago, was when they were first starting to get support for iPods. I have an old Nano that I play with every now and then, but it only holds 4 GB of data, which is a drop in the bucket compared to today's MP3 players. Plus, the hardware and the company is very much against sharing and openness, so syncing it with Linux is not worth the pain and hassle.
I've since found in my more recent research, that there are radios on the market now that you can directly plug in a USB stick. That would be awesome, since you can buy a 32 GB stick for not a lot of money. There are also some that have support for MicroSD, but they cap out in size limit pretty quickly right now too.
Either way, I gotta get something soon. I needs my music.
As a postscript, I wanna point a couple of things out. I don't want to make it sound like I'm complaining, because I'm not. I'm more upset with the state of mass media in general than I am with anything else. Listening to the radio, like watching over the air television, is free, and I don't expect too much out of them in the first place. It's just my opinion, however, that things have gotten so out of control. They have been the dominant pipe for media input for so long, that they long ago stopped caring about what consumers wanted since there was no alternative. Thank goodness that the Internet is slowly breaking up those archaic fiefdoms, and I'm glad to see them go. If nothing else, choice is finally starting to drive market forces again. It's obviously been painful to watch the old school businesses try and adapt, but they either will, or die. I can't imagine I'm the only one bothered by the whole scenario.
The second thing that makes me sad is that I have to spend so much money just to avoid being constantly bombarded with advertisements and less-than-mediocre playtime. I realize that what I'm really doing is buying into luxuries, but the fact is, unless I wanna listen to classical music on the radio, there's no station to tune into where I won't hear a car dealer's advertisement every 7 minutes.
There's a lot of parallels to me building up my own library at home of TV shows to watch. Sure, it costs a lot more building up my own collection, but the convenience and reward of never having to hear another forced advertisement or commercial again is absolutely priceless. Plus, you can set the standard of quality yourself and cater to it how you want. The entire process is driven by personal taste.
Now, get off my lawn.
|
August 06, 2009
traffic court (August 06, 2009, 15:08 UTC)
So, I have to go to traffic court next week, and I'm a bit freaked out about the whole thing. I got pulled over the other night for speeding (which doesn't really bother me, I got ticketed for 10 over), but the real shocker was when the officer came back and said "You wanna explain to me why your license is suspended?" My jaw totally dropped and it took me a few seconds to even respond since I had no idea *why* it would be suspended to start with.
Turns out I made a stupid mistake -- I need to send in a medical form signed by my doctor that states I can drive. The reason I need to do that is that I take some prescription meds, and when I got my renewal notice in the mail last year, they ask if you are taking anything regularly, so I answered yes and put my info down. I figured that was the end of that. Except that I got a longer form in the mail asking for more specifics and demanding that the doctor sign it, and I had to send it in before I could get my license. Well, poop, more paperwork. I took care of that, and got my license okay.
What happened, though, and I had no idea, is that you have to send one in every year after that, too. I probably would have known that except that my address on my driver's license was still at my old address -- I had moved a few months after getting it renewed and forgot to update it. The officer kept saying, "they would have sent you something in the mail if it was suspended," and I just replied, "I'm pretty sure I wouldn't have missed something like that."
So, I have two charges against me -- speeding, and driving with a suspended license. Getting my license reinstated was simple. I just had to go to my doctor the next day, have her fill out a new form, and dropped it off at the driver's license division and was cleared to drive again right away. Oh, and I updated my address at the same time.
I have to go to court now, and I have no idea what I'm gonna plead (probably either guilty or no contest), but I hope I at least get a chance to explain myself. I'd never *intentionally* drive without a suspended license (it was revoked back in March), it's just that I had no idea, and I probably would have if I had my address updated. So, I have no idea what to expect, and of course, being the nervous type that I am, all these fear-mongering scenarios race through my head. Not really looking forward to this one.
On the plus side, my driving record is mostly really clean -- I've never been in an accident before and I think this is only the fourth or fifth ticket I've ever gotten for speeding ever since I started driving, so maybe it won't be that bad. I just hope I can explain to the judge that I'm a dumb cluck who forgot to do some paperwork, and it's probably not a good idea to demote me to just skating to work after that.
|
August 05, 2009
KDE 4.3 has arrived
Lots of behind-the-scenes fixes, a new pretty (debatable) default plasma theme and various new stuff across the board make kde 4.3 an exciting release!
Gentoo ebuilds were available the moment tarballs were released, thanks to the hard work of our Gentoo KDE team
However, since 4.3 brings some new packages (and dependencies), we’ve hard masked the ebuilds until everything gets the proper keywords.
You can follow the keywording progress in bug 280312.
Instructions on how to unmask kde 4.3 after the screenshot

unmasking & installing kde 4.3
kde 4.3 might be masked but it works fine on x86 and amd64 (for other archs check the bug above).
to install it, you can easily unmask it using the unmask file provided in the kde-testing overlay, [kde-testing]/Documentation/package.unmask/kde-4.3
if you don’t have / don’t want the overlay, you can grab the file here.
you can also use a command similar to
# unmasking kde 4.3
wget -O /etc/portage/package.unmask/kde-4.3 'http://git.overlays.gentoo.org/gitweb/?p=proj/kde.git;a=blob_plain;f=Documentation/package.unmask/kde-4.3'
to automatically save the unmask file to your unmask folder (if you use folders)
for those using stable gentoo, there’s a similar keywords file
# adding kde 4.3 in package.keywords/
wget -O /etc/portage/package.keywords/kde-4.3 'http://git.overlays.gentoo.org/gitweb/?p=proj/kde.git;a=blob_plain;f=Documentation/package.keywords/kde-4.3.keywords'
troubleshooting
if you’re trying to upgrade from kde 4.2, but portage gives you nice little blocks, there are a few things you can check:
- make sure you’ve synced the tree and kde-testing overlay (if using it) :p
- make sure the unmask/keyword files are correct and up-to-date
- check that you don’t have any 4.2 versioned kde-base/* items in /var/lib/portage/world
- check that you don’t have any 4.2 versioned sets in /var/lib/portage/world_sets
emerge -avDuN world — you’ll probably get some messy output but all blocks should be automatically resolved
if you hit any issues feel free to leave a comment, check the gentoo kde 4 guide (should be up-to-date soon) or visit us @ #gentoo-kde (freenode).
enjoy your shiny new kde!
share this post:
|
The Hip in S'toon (August 05, 2009, 11:50 UTC)
a) just saw the almighty Hip in Saskatoon. best concert ever. b) drove four hours home on Saskatchewan "highways" in the middle of the night, having to watch the road for wildlife the entire time (had to slam on the brakes for 3 deer, 5 raccoons, 2 badgers, a cat, and a pillow (?!)), with a hangover. worst headache ever.
still worth it.
|
My take on amending GLEP 39 (August 05, 2009, 05:43 UTC)
Earlier today Calchan blogged about amending GLEP 39 here. During the council meeting I voted against council being able to change the document and on deciding a process for changing it. Why? First I think as the developer population voted the GLEP I think they should decide about the changes as well. Secondly I think we don't need to decide on a process because we already have one. Using the existing elections team and votify is enough when needed. If council members think we are wrongly skipping items in meetings, I challenge them to step up and take chair in the next meeting making sure items are properly handled.
|
Amending GLEP 39 (August 05, 2009, 02:53 UTC)
I'm going to go ahead and assume you have all read the summary of the last council meeting. It can be summarized even further.
- We decided the #gentoo-council channel would be moderated during meetings. Developers and users have plenty of opportunities to tell us what their opinion is prior to and during the meetings.
- We confirmed Thomas Anderson as the council secretary and clarified that the role of the secretary is limited to posting the logs and summaries of council meetings.
- The council decided it wasn't competent to decide how GLEP 39 should be amended.
Some would say that it isn't much. And I wouldn't disagree. I wished this council could be someday called the council that slacked less but we're apparently not taking that direction. Let's see if we can change that. By the way I encourage everybody, anybody, to post discussion topics to the gentoo-council mailing list and debate there.
What I really wanted to discuss today is amending GLEP 39, and more exactly how to proceed. This GLEP serves in certain ways as our constitution and is more critical than any others. It was written almost 4 years ago and as such relects the situation as it was back then. It has been criticized a lot, many want or wanted to replace it at some point in time, some even went as far as writing replacements for it (count me as one of them), but I have yet to see something that is worth discussing in public.
Now, I'm not going to say that it's perfect. No text of that kind can be even close to perfect. My point today isn't about discussing what should be kept in it and what should be changed (don't worry though, I'll discuss that soon), but to make sure we agree on the fact that we need a mechanism to modify it. And by extension replace it if we decide so someday. Not that it wasn't ever amended in the past, it was, but in a way that I can't imagine satisfies the whole developer community. Don't extrapolate from what I just wrote that I disagree with the changes or how they happened, quite the contrary actually. But I talk to a lot of you and many tell me they believe that since GLEP 39 was the result of the vote of all developers, any change to it needs to be again voted by all developers. I disagree with that simply because GLEP 39 itself has provisions that would imply the contrary. However, all opinions need to be taken into account, especially when the same one comes back often.
So, what happened during that last council meeting? One of the questions was whether the council could decide on a process to amend GLEP 39. The vote ended up saying no. The next item on the agenda was then to organize a vote of the whole developer community to decide, since the council declared itself incompetent. Strangely enough this item was skipped. How can that be interpreted? Frankly, I'm not sure.
Someone argued that there was no point bothering with how to amend GLEP 39 since we could always organize a quick vote of all developers. I see two issues with that. One is that we had just voted that we couldn't decide on a process, but arguing that we can always use an all-developer vote is precisely deciding on a process, and it's inconsistent. The second one is that GLEP 39 was already amended a few times, and each time without an all developer vote. I don't seem to remember anybody complaining about that. So there must be at least a significant part of the developer population which is happy with not having to vote on changes of GLEP39, and is comfortable with the "vote out the bums" clause.
Most probably what happened is that we were running late with the meeting and the item was skipped because it didn't seem important to your new council. Yep, you heard me. Your new council doesn't really care about what you think on amending GLEP 39. If you think your council should care more then let it be known.
|
|