The IPS pkg* tools work pretty well when they try to find dependencies between different packages automatically. But so far, they claim to do it only for ELF binaries and Python files. So for Ruby, I would either have to specify dependencies manually (and miss half of them) or try to find a way to inspect the Ruby files as well.

So I tried to get some bash lines together to do what I wanted;-) They will probably not be complete yet!! But so far, they work pretty well. I also found, that the pkgdepend does not really handle the #!/usr/bin/env ruby code found in some scripts, so I tried to fix that as well.

So for the old Mongrel gem, the following dependencies were automatically created;-) I think that’s pretty complete.

depend fmri=pkg:/my_prefix/ruby/gem/cgi_multipart_eof_fix@2.5.0-0.1 type=require
depend fmri=pkg:/my_prefix/ruby/gem/daemons@1.1.6-0.1 type=require
depend fmri=pkg:/my_prefix/ruby/gem/fastthread@1.0.7-0.1 type=require
depend fmri=pkg:/my_prefix/ruby/gem/gem_plugin@0.2.3-0.1 type=require
depend fmri=pkg:/my_prefix/ruby/rubygems@1.6.2-0.1 type=require
depend fmri=pkg:/my_prefix/ruby@1.8.7.357-0.1 type=require
depend fmri=pkg:/system/library/math@0.5.11-0.174.0.0.0.0.0 type=require
depend fmri=pkg:/system/library@0.5.11-0.175.0.2.0.3.1 type=require
depend fmri=pkg:/system/linker@0.5.11-0.175.0.2.0.2.1 type=require

Most IPS guides specify to run pkgdepend generate and then pkgdepend resolve, the following code would go right in between those two steps.

pkgdepend generate -md $DESTDIR/dist/ $DESTDIR/pkg/$SW.p5m.2 | \
        pkgfmt > $DESTDIR/pkg/$SW.p5m.3

# XXX handle the usr/bin/env ruby case
dest_prefix=`echo $DEST | sed -e 's:^/::'`
mv $DESTDIR/pkg/$SW.p5m.3 $DESTDIR/pkg/$SW.p5m.3.orig
awk -F= -e "
        BEGIN {
                e = 0;
        }
        \$4 ~ /^env / {
                e = 1;
                printf \"%s=%s=%s=ruby \\\\\n\", \$1, \$2, \$3;
                next;
        }
        e == 1 && \$2 ~ /^usr\/bin / {
                printf \"%s=$dest_prefix/bin \\\\\n\", \$1;
                e = 0;
                next;
        }
        {
                e = 0;
                print \$0;
        }" < $DESTDIR/pkg/$SW.p5m.3.orig > $DESTDIR/pkg/$SW.p5m.3

for i in `find $DESTDIR/dist$DEST/lib/ruby/gems/1.8/gems/*/lib/ -name '*.rb' `
do
  i_path=`echo $i | sed -e "s:$DESTDIR/dist/::"`
  i_reqs=`awk '$1 == "require" { print $2; }' < $i | tr -d "'" | tr -d '"' | sort -u`
  for k in $i_reqs
  do
    x=""
    y=""
    x=`ls $DESTDIR/dist$DEST/lib/ruby/gems/1.8/gems/*/lib/$k.rb 2>/dev/null`
    if [ -z "$x" ]
    then
      # XXX might not find the best version?
      y=`ls -r $DEST/lib/ruby/gems/1.8/gems/*/lib/$k.rb 2>/dev/null | head -1`
    fi
    if [ -z "$x" -a -z "$y" ]
    then
      y=`ls $DEST/lib/ruby/1.*/$k.rb 2>/dev/null`
    fi
    if [ -z "$x" -a -z "$y" ]
    then
      y=`ls $DEST/lib/ruby/vendor_ruby/$k.rb 2>/dev/null`
    fi
    if [ -z "$x" -a -z "$y" ]
    then
      y=`ls $DEST/lib/ruby/site_ruby/$k.rb 2>/dev/null`
    fi

    if [ -n "$y" ]
    then
      echo "depend type=require fmri=__TBD pkg.debug.depend.file="`basename $y`" \\"
      echo "    pkg.debug.depend.path="`dirname $y | sed -e 's:^/::'`" \\"
      echo "    pkg.debug.depend.reason=$i_path pkg.debug.depend.type=script"
    fi
  done
done >> $DESTDIR/pkg/$SW.p5m.3

i=`ls $DESTDIR/dist$DEST/lib/ruby/gems/1.8/specifications/*.gemspec 2>/dev/null`
if [ -n "$i" ]
then
  for k in $i
  do
    echo "depend type=require fmri=__TBD pkg.debug.depend.file=gem \\"
    echo "    pkg.debug.depend.path="`echo $DEST/bin | sed -e 's:^/::'`" \\"
    echo "    pkg.debug.depend.reason="`echo $k | sed -e "s:$DESTDIR/dist/::"`

    dev_deps=`fgrep 'add_development_dependency(' < $k | \
        sed -e 's:^.*add_development_dependency(%q<\([^>]*\)>.*$:\1:' | \
        sort -u`
    deps=`fgrep 'add_dependency(' < $k | \
        sed -e 's:^.*add_dependency(%q<\([^>]*\)>.*$:\1:' | \
        sort -u`
    for l in $deps
    do
      found=0
      for m in $dev_deps
      do
        if [ "$l" = "$m" ]
        then
          found=1
        fi
      done

      if [ $found -eq 0 ]
      then
        spec=`ls -r $DEST/lib/ruby/gems/1.8/specifications/$l-*.gemspec | head -1`
        if [ -n "$spec" ]
        then
          echo "depend type=require fmri=__TBD pkg.debug.depend.file="`basename $spec`" \\"
          echo "    pkg.debug.depend.path="`dirname $spec | sed -e 's:^/::'`" \\"
          echo "    pkg.debug.depend.reason="`echo $k | sed -e "s:$DESTDIR/dist/::"`
        fi
      fi
    done
  done
fi >> $DESTDIR/pkg/$SW.p5m.3

pkgdepend resolve -m $DESTDIR/pkg/$SW.p5m.3

This little patch adds a list of zones and a mapping for shared IP interfaces to their zones to the facts. Something like

root@global:~# /opt/bin/facter
...
interfaces => lo0,lo0_1,beaggr0,beaggr0_1,feaggr0,feaggr0_1
ipaddress => 0.20.72.116
ipaddress6 => ::
ipaddress_beaggr0 => 0.20.72.116
ipaddress_beaggr0_1 => 0.20.72.180
ipaddress_feaggr0 => 1.231.85.66
ipaddress_feaggr0_1 => 1.231.85.71
ipaddress_lo0 => 127.0.0.1
ipaddress_lo0_1 => 127.0.0.1
...
macaddress => 00:21:28:af:fd:06
macaddress_beaggr0 => 0:21:28:af:fd:6
macaddress_feaggr0 => 0:21:28:af:fd:7
...
netmask => 255.255.252.0
netmask_beaggr0 => 255.255.252.0
netmask_beaggr0_1 => 255.255.252.0
netmask_feaggr0 => 255.255.255.240
netmask_feaggr0_1 => 255.255.255.240
netmask_lo0 => 255.0.0.0
netmask_lo0_1 => 255.0.0.0
network_beaggr0 => 0.20.72.0
network_beaggr0_1 => 0.20.72.0
network_feaggr0 => 1.231.85.64
network_feaggr0_1 => 1.231.85.64
network_lo0 => 127.0.0.0
network_lo0_1 => 127.0.0.0
...
zone_beaggr0_1 => z004
zone_feaggr0_1 => z004
zone_lo0_1 => z004
zones => global, z003,z002,z001,z004

I don’t know if that’s useful for anybody else. But just in case;-)

Have fun,

– Marco

$ PS1='\u@${FOO}\$ '
marcow@YY$ FOO=XX
marcow@XX$


Sorry for the confusion

– Marco

OK, long time nothing new here:-( I did a lot of stuff but nothing really interesting for the outside. But today I had a little problem which might also be useful for others – Adding the value of a shell variable into the GNU Bash prompt.

I followed the \D{<format>} example and added an \E{var_name} to the bash 4.2.20 sources. It seems to work as expected and even honours changes to the variable;-)


root@foo:~$ echo $PS1
\u@\E{MW_HOST}:\w$
root@foo:~$ MW_HOST=x
root@x:~$ MW_HOST=mwbuild01z1
root@mwbuild01z1:~$


The little patch to the parse.y source is below. For interested people without bison/yacc, the same patch could be added to the included y.tab.c file.


--- bash-4.2.20.orig/parse.y    2012-01-28 00:42:44.010257843 -0600
+++ bash-4.2.20/parse.y 2012-01-27 22:00:55.192082732 -0600
@@ -5199,6 +5199,37 @@
temp = savestring (timebuf);
goto add_string;

+/* MARCO */
+            case ‘E’:           /* Environment Variable */
+              {
+                char *var_name;
+
+                if (string[1] != ‘{‘)           /* } */
+                  goto not_escape;
+
+               string += 2;                    /* skip { */
+               var_name = xmalloc (strlen (string) + 3);
+               for (t = var_name; *string && *string != ‘}’; )
+                 *t++ = *string++;
+
+               *t = ‘\0′;
+               c = *string;    /* tested at add_string */
+
+                t = get_string_value(var_name);
+                if (t == (char *)NULL)
+                  t = “”;
+
+                if (promptvars || posixly_correct)
+                  /* Make sure that expand_prompt_string is called with a
+                     second argument of Q_DOUBLE_QUOTES if we use this
+                     function here. */
+                  temp = sh_backslash_quote_for_double_quotes(t);
+                else
+                  temp = savestring(t);
+
+                goto add_string;
+              }
+
case ‘n’:
temp = (char *)xmalloc (3);
temp[0] = no_line_editing ? ‘\n’ : ‘\r’;

Maybe that helps somebody else. The patch is very small but it might still create problems with the formatting, so here is a download version bash-4.2.20.patch.

As always, have fun;-)

– Marco

Once you decide and buy your audio books, Borders adds links into your account which are only useful for a program called OverDrive Media Console which is not available from Linux:-( Or more precisely Linux on x86 PC’s. It seems to be available for Android;-)

OK, I have a VBox image for those cases when I really need to run some Windows software. But even after the download was successful, there is the next problem:-( You end up with MP3 files which represent the content of a complete audio CD. So that does not really help when you want to listen to those files with anything other than OMC:-( Car stereos, especially the ones which would understand MP3, would see the files as 65+ minute files without any borders were you could easily restart to listen:-(

But OMC somehow had chapters and boundaries.  So something was in the files, which helped OMC but was not normally useful for other programs. I looked for a program to check the MP3 meta data. One program which seemed to be useful was metaguru . It’s was not available for my x86-64 Ubuntu system but the compile was easy;-)

So running metaguru on one of the MP3 files showed one interesting tag:

TXXX {OverDrive MediaMarkers} = {<Markers><Marker><Name>Introduction</Name><Time>00:00.000</Time></Marker><Marker><Name>Chapter 1</Name><Time>00:33.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 1 (05:11)</Name><Time>05:11.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 1 (10:06)</Name><Time>10:06.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 1 (15:06)</Name><Time>15:06.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 1 (19:12)</Name><Time>19:12.000</Time></Marker><Marker><Name>Chapter 2</Name><Time>23:02.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 2 (27:57)</Name><Time>27:57.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 2 (32:46)</Name><Time>32:46.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 2 (35:55)</Name><Time>35:55.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 2 (39:18)</Name><Time>39:18.000</Time></Marker><Marker><Name>Chapter 3</Name><Time>43:20.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 3 (48:13)</Name><Time>48:13.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 3 (53:12)</Name><Time>53:12.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 3 (58:07)</Name><Time>58:07.000</Time></Marker><Marker><Name>Chapter 3</Name><Time>01:02:52.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 3 (01:07:28)</Name><Time>01:07:28.000</Time></Marker><Marker><Name>\a0\a0\a0\a0\a0\a0Chapter 3 (01:10:42)</Name><Time>01:10:42.000</Time></Marker></Markers>}

That was the way OMC was able to have boundaries. My first test was to try to use that info to create meta info ( a CUE file) to be used with the KDE CD burning application K3b. I wrote a little cue_creator.rb Ruby program to do just that.  That program creates a CUE file with the same base name as the MP3 file with the info from the OMC data. At least K3b seems to be happy and I think I could also use that to split the large MP3 into a couple of smaller files.

I don’t know if that’s useful for others, but maybe;-)

Have fun,

– Marco

I played with Ushahidi, an Open Source crowdsourcing platform written in PHP, which is used in different crisis situations. GeorgeCh. wanted the included alert mechanism to be expanded so that alerts could be limited to different categories. That patch was working fine on my test setup;-) If somebody is interested in playing with it, u.diff based on 2.0rc1.

The second application, I was playing with, was FrontlineSMS, a SMS management application in Java. This is a desktop application which can work with MySQL as backend database. So we were trying if we could run multiple instances against the same DB. That pretty much works except `client instances’ without wireless modems could not send any SMS out. The messages would end up in the Outbox and would only be sent when the `server instance’ would be restarted. I looked at the code and found that it would only on startup check in there are any messages in the Outbox. So I added a little daemon thread to wake up every five minutes and flush the Outbox. The thread seems to run and check but we had not enough time to set the complete test environment up again. If somebody is interested, the patch f.diff is against 1.6.16.3.

Overall those were two interesting days;-)

Thanks to TROPO & inveneo for sponsoring such events. They even provided some prices and I got a Amazon gift card;-) Thanks to JasonG for the photo, I’m normally the guy behind the camera;-)

As always have fun;-)

So far, all years had pretty good weather. Or let’s say mostly sunny & dry;-) Because the snowy weather was a lot of fun as well. So the weather was just as good, but somewhat different;-) Two feet of snow limit where and how far you can hike, but even so, we found enough to keep busy all the days;-)
Just some impressions;-)

As always, get out there and make the best of every day;-)

Find a good book, a warm blanket, and have fun;-)

– Marco

But be careful, what you wish for. As it is right now, my diff (against 3.2.8) uses the same DB-user as Bugzilla overall! So one wrong move and the admins could ruin the DB.

Maybe this is helpful either directly or as an example how to extend Bugzilla.

Have fun

– Marco

So here are the diffs I did to build a GF gem for GF 3.0.1 & JRuby 1.5.2. My first little tests did not reveal any problems. If you find something, let me know. The SVN repo for the base is @ dev.java.net (https://svn.dev.java.net/svn/glassfish-scripting/trunk/rails/gem)

gf_gem/gem$ svn diff pom.xml
Index: pom.xml
===================================================================
— pom.xml     (revision 1740)
+++ pom.xml     (working copy)
@@ -8,12 +8,12 @@
<description>This module creates the jruby gem distribution image</description>

<properties>
-        <glassfish.version>3.0-b74b</glassfish.version>
-        <gem.version>1.0.3.dev</gem.version>
-        <jruby-container.version>1.0-b17</jruby-container.version>
-        <hk2.version>1.0.0</hk2.version>
+        <glassfish.version>3.0.1-b15</glassfish.version>
+        <gem.version>1.0.3.1.dev</gem.version>
+        <jruby-container.version>1.0-b18</jruby-container.version>
+        <hk2.version>1.0.9</hk2.version>
<grizzly-jruby.version>1.8.30</grizzly-jruby.version>
-        <jruby.version>1.4.0</jruby.version>
+        <jruby.version>1.5.2</jruby.version>
</properties>
<build>
<plugins>

I don’t know if/when I’ll look at this again, but since I had it, maybe it’s useful for others;-)

Have fun out there,

– Marco

Our biggest concern is to make sure, everybody has updated information so that the meet can flow smoothly without much waiting for swimmers or volunteers.

So far we have a PA system around the pool. But the big grass area at the high school where we host the meet is like 150++ meters away from the pool. So our speakers will not reach there. Putting extra speakers that far away from the amp without a good way to run cables would need really heavy-duty cables if it would be possible at all.

So the idea was to find a wireless setup which could be placed somewhere in the grass area where there is a power outlet. The problem here is that most commercial systems have a wireless microphone which reaches 25-35 meters. And they are expensive when you need a larger, outdoor rated system

I’m running a Wi-Fi access point at the meets to basically let people check the meet information based on my mmweb code. So the idea was to add a streaming server to that host so that any Wi-Fi client could actually receive the PA stream as well. So we  set up a special client, which would send the stream to a second Amp somewhere in the field. The Wi-Fi client is based on the internet radio setup from MightyOhm. Unfortunately, the newer OpenWRT sources get pretty close to the flash limit of the Asus WL-520GU. So I had to build a very specialized image for my use.

So far, the setup works fine for a distance of two meters in my living room;-) Let’s see how it works over the weekend;-)

As always, have fun playing with stuff.

– Marco