M-x blog

Thanks, Sean!

2010-02-21T16:39:00.000-08:00

Thanks to my friend, Sean, I noticed yesterday that my last blog entry was posted exactly one year ago today. Well, I'm nothing if not punctual, and I'm committed to blogging at least once a year, whether I have anything to say or not.

So on the off-chance you're wondering what I've been doing this past year...

Well... I learned to juggle... a little... a few tricks, only 3 balls.

It's a little depressing when I think about it.

Thanks again, Sean. ;-)

A little lithp

2009-02-21T12:30:00.000-08:00

After almost 20 years of fairly hardcore Emacs love, I finally wrote my first Lisp macro. And now I want to smear my good fortune all over you, dear reader, by recounting my experience in more depth.

How lucky for you!

About Lisp...

Created in 1958, Lisp is the 2nd oldest (not to mention sexiest) programming language in widespread use today. Its syntax is simple: lists of tokens contained within parentheses. In Lisp, code and data are represented the same way: as lists of tokens, duh. This deceptively powerful quality is what allows "Lispers" to create new syntax, i.e. Domain Specific Languages, within Lisp itself.

Lisp is basically what the "executable XML geniuses" -- yes, I'm looking at you Ant, Spring, J2EE, VoiceXML, and countless others -- should have used! XML is what you use when your chosen language for manipulating data can't adequately represent it.

My Macro

Ok, enough with the history. Here's the macro:


(require 'sqlplus)
(defmacro def-oracle (name connect-string)
  (let* ((buf-name (concat "oracle-" (symbol-name name)))
         (fun-name (intern buf-name)))
    `(defun ,fun-name ()
       (interactive)
       (sqlplus ,connect-string ,buf-name))))

Lisp macros are like functions, except that instead of computing a value, they compute another Lisp expression that will compute the value. In this case, my macro creates a defun expression, which defines a function. Simple, huh?

The trick to macros is the backquote character: `. Combined with the comma character, they allow you to selectively evaluate elements of a quoted list. In my macro, the list whose first token is defun is quoted (by a backquote) and my "selectively evaluated elements" are fun-name, connect-string, and buf-name.

Here's how I invoke my macro:

(def-oracle dev   "user/password@dev.host:port/sid")
(def-oracle qa    "user/password@qa.host:port/sid")
(def-oracle prod  "user/password@prod.host:port/sid")

After those lines execute, three new functions are created:

oracle-dev
oracle-qa
oracle-prod

Ta-da!

Um, hello?

Your stolid reaction belies the awesomeness of my macro!

Maybe I should've started with my reasons for creating the macro in the first place.

Create a handy function that "wraps" the Emacs sqlplus function for each of the databases to which I must often connect
Don't prompt me for the dang connection credentials every time I invoke the handy wrapper function
Enforce a consistent naming convention for the various sqlplus buffers I have open so that I may, for example, easily switch between qa and dev
Make it easy to add more of these handy wrapper functions

There. Is that better? I certainly think so. :-)

But perhaps it would be enlightening to see what I would've had to code to achieve the same result without using a macro:


(defun oracle-dev () 
  (interactive)
  (sqlplus "user/password@dev.host:port/sid" "oracle-dev"))
(defun oracle-qa () 
  (interactive)
  (sqlplus "user/password@qa.host:port/sid" "oracle-qa"))
(defun oracle-prod () 
  (interactive)
  (sqlplus "user/password@prod.host:port/sid" "oracle-prod"))

See how verbose and redundant that is? It's positively VERBOSIDUNDANT!!! And my naming/calling conventions are sprinkled all over the place. To change any one would require multiple redundant changes. And that's not DRY, and that's not good.

PoopTag = Social Defecation

2008-08-15T22:20:00.000-07:00

(It's not as gross as it sounds!)

Everybody poops. Every U.S. president. Every Jonas Brother. Every Olympic athlete. Even Michael Phelps. Actually, at 12,000 calories a day, he poops a LOT!

And so while you're pooping, have you ever wondered who else is pooping at exactly the same time? Really? Me, too!

So with the help of some friends, I created PoopTag, a sort of game that strives to be both encouraging and enlightening. It's easy to play: you simply notify PoopTag whenever you poop. You do this by sending a direct message to the pooptag account on Twitter using your mobile device. PoopTag will then determine whether anyone else is pooping at that time. If they are, you will have successfully "tagged" them, and PoopTag will notify its followers of this happy event.

And in response to your direct message, whether you successfully tag anyone or not, you will receive a random pithy reply. That's the "encouraging and enlightening" part.

There are two modes of play: public and covert. You decide which way to play each time you poop.

Public (send more than one character):
d pooptag This text will be broadcast to all PoopTaggers

Covert (send any single character):
d pooptag !

Obviously, the public notification makes it easy for someone to tag you, though they must be pooping in order to do so.

Eventually, we'll publish statistics at pooptag.com, enabling services like Poop Cycle Compatibility Matching, prospective home-buyer bathroom sizing tools, and life-saving medical history to present to your doctor, among other things.

Come join the fun!

UPDATE 9/20/08: Changed covert pooping method from an empty message to one containing only punctuation due to Twitter no longer delivering blank direct messages.
UPDATE 10/13/08: Covert pooping now triggered by a message containing only a single character (letter, number, punctuation, whatever)

Create

2008-08-09T12:03:00.000-07:00

I'm big on creativity. You know, building stuff. Putting things where nothing was before. I think it's both the secret to happiness and the meaning of life. I think it's what humans are SUPPOSED TO DO.

Create. Re-create. Recreation. Play, especially at work.

I follow why the lucky stiff on Twitter. His tweets are usually funny and clever. And once in a while, he'll write something like this:

when you don't create things, you become defined by your tastes rather than ability. your tastes only narrow & exclude people. so create.

Very cool.

Making Gardening Cool

2008-06-12T18:06:00.000-07:00

As if we didn't have enough, here's yet another reason ya gotta love Bob!

Trying to Save the Crum & Forster

2008-05-18T08:30:00.000-07:00

My grandfather, Lewis "Buck" Crook, was a prominent architect. He and his partner, Ernest "Ed" Ivey, comprised the firm of Ivey & Crook, responsible for almost 600 commissions over the course of 43 years, most of which were built in and around the city of Atlanta, Georgia.

One of them, the Crum & Forster building, a midtown landmark at 771 Spring Street since 1927, is in imminent danger of being torn down. Ironically, the demolition is being proposed by Georgia Tech, who purchased the property in December of 2007, apparently with the intent to demolish it and expand the development of their Technology Square.

Georgia Tech is the alma mater of both my grandfather and his partner, Ed Ivey, who helped found the school of architecture there one hundred years ago this year. Through their works, they made a substantial contribution to the esteemed academic reputation Georgia Tech enjoys today.

Rather than destroy it, Georgia Tech has an opportunity to celebrate the work of Ivey & Crook, just as world-renowned architect John Portman, another Tech graduate, did when he expanded Emory University's student center in the 1980's. Ivey & Crook designed and built the original dining hall at Emory. Portman could've torn it down, but instead he chose to incorporate it into his own vision for the Dobbs University Center.

Georgia Tech has every reason to do the same for Technology Square!

An online petition to save the Crum & Forster has been created. Please add your name.

The building has an official blog. More pictures and info can be found here, here, and here.

Bizzlr

2008-05-06T07:09:00.000-07:00

Our first press release!

A Few Poems

2007-11-03T11:18:00.000-07:00

While doing some digital housekeeping recently, I ran across some poems I wrote back in the mid 90's when I worked with a very creative group of people at a now-defunct company. We were programmers, each responsible for one or more inter-related components of a large distributed system. When someone released a new module, the others would have to recompile to incorporate the changes. Often, a new-release email would be accompanied by a poem -- most often original -- or maybe song lyrics or even particularly elegant snippets of code.

My component was called the Data Access Daemon or DAD, for short. My first release email included this haiku:


  Restless, like a child,
  searching for its potential,
  DAD, ever-changing.

Many of the poems I wrote were related to some feature of the DAD, i.e. stupid when taken out of context in a blog post, but a few of them I think stand on their own, or are at least "somewhat less stupid":


Quicksort
=========
I happened across a big pile of stuff
  And decided that it should be sorted.
The time I could spend was hardly enough,
  Any more time could not be afforded.

I picked up a thing, at random, I'm sure,
  And to each of the rest I compared it.
I made two more piles of stuff, as it were:
  The things found above and below it.

To each of those piles, the same thing I done,
  And to those thereafter created.
And not 'til the size of each pile was one --
  Were my efforts quite quickly abated.

Hardly a minute of time had passed by,
  When I realized something important.
The stuff that had been on that very first pile,
  After just a short while, was now sorted!

A Little Number I Call "9"
==========================
Begin with twelve and four,
  then take away seven.
If you add two more,
  You're left with eleven.

Eleven, you could say,
  Is two one's combined.
If you take those away,
  You end up with nine.

Stressed (Chill) Out
====================
Never settle (Be still) for less.
Always strive (until) to be best.
Never stop (your will) to rest.
Everything (is nil.) is a test.

Work It
=======
"Work it, baby, work it!"
  I heard some dancers say.
"Toil it, baby, toil it!"
  I joined in their refrain.

At this, they hesitated,
  And turned, and frowned at me.
"What did you say?!" they shouted.
  For dancers, they seemed mean.

A misinterpretation
  Was all that had occurred.
Instead of inspiration,
  It was "toilet" that they heard.

Men and Women
=============
"Men are from Mars," of course,
  "And women are from Venus."
As if those stupid metaphors,
  Some wisdom they could gain us!

Men and women are different,
  But not because of Venus.
Only women can get pregnant,
  And only men can have a... prostate!

Kicking Squirrels
=================
A squirrel came hopping through my yard,
  And got a little careless.
The distance wasn't all that far --
  From him to my Adidas.

Ducking behind the nearest tree,
  I lied in vengeful wait.
And by the time he noticed me,
  It was much too late.
  
In mid-jump I caught him square --
  Just like that fella, Pele.
Soaring higher into the air,
  I watched him sail away.

He landed atop my neighbor's house
  A little shaken, but still alive.
About that time I spied a mouse,
  But my mom called me back inside.

Cubicles
========
The chains descended from the ceiling,
  And fastened to the tops --
  Of the cubicles.
The motors began slowly turning,
  Then rising were the walls --
  Like theatre curtains.
The workers stopped what they were doing,
  And looked up from their desks --
  To peer at themselves.
Then came some men who owned the building,
  Too late to warn the folks --
  Of their new plans.

Nashville and Seattle
=====================
What if Nashville was Seattle
  And therefore, vice versa?
In the place of Mother Maybelle
  Could be Ann and Nancy Wilson.

Then Little Jimmy Dickens 
  And Minnie Pearl, yes ma'am,
Would be Little Jimi Hendrix
  And Minnie Pearl Jam.

We could hear Kurt Cobain
  Or even Courtney Love
Sing "Blue Eyes Cryin' in the Rain"
  Or "Wings of a Dove"

Wouldn't it make you feel alive
  To see Shania Twain
Hockin' loogies between stage-dives
  Apparently in pain?

Well, maybe not "alive" per se,
  But it would be pretty rad,
Seeing Alice and Reba in chains
  Switching cities, switching fads.

Fonts
=====
Arial is fairly boring,
  And Courier's way too plain.
Modern is the same ol' story,
  And frankly, Script is a pain.

Garamond comes off as haughty.
  Sans Serif a tad too smooth.
Lucida strikes me as naughty,
  And Roman a bit long in the tooth.

Symbol is symbolic of nothing.
  Terminal should be put to rest.
Hardly better is Times New Roman,
  And Wingdings is simply a mess!

In the end, the font doesn't matter.
  You may choose whichever you like.
Whether one or another is better --
  Counts far less than how well you write.

Long-Eared, Pickle-Toed Pirate
==============================
Wouldn't it be funny --
  If my ears were long, like a bunny?
I'd tuck 'em up under my arm pits.
  That wouldn't be gross, would it?

Wouldn't you be tickled --
  If instead of toes I had pickles?
I'd clip off the nails and make relish.
  Everyone would be so jealous.

Wouldn't it be a riot --
  If my leg was a peg, like a pirate?
I'd buckle swashes, say "Aye" and grin,
  And eat relish, and... um... listen?

Tony Gwynn
==========
Tony Gwynn's amazing,
  But a little overweight.
It won't be getting past him
  If it makes it 'cross his plate.

Rooms
=====
There are rooms to do your sleeping,
And rooms to take your bath,
Rooms to do your eating,
And rooms in which you laugh.

Most realtors show you common rooms
In the houses that they sell.
But an agent took me on a tour
I'll long remember well.

"Here's a room for your improvement,
And one for you to grow.
These rooms are not the kind you rent
They're rooms you come to know."

That's what the agent sang to me.
That's right, my realtor sings -- 
'Bout rooms that ain't so roomy,
But let you spread your wings!

Childbirth
==========
It won't be long for her.
It will all be over soon.
What now seems like November -
Will tomorrow seem like June.

What Is Is
==========
By the definition
  In my deposition,
I have no recollection
  Of a sexual relation.

I mean to be truthful
  Without being helpful.
To admit that I'm a mouthful
  Would be very, very harmful.

A Crappy Poem
=============
"Roses are blue,
  Violets are red."
Er...no... that's not true.
  Nevermind what I said.

"Stars in the morning,
  Sunshine at night."
Now wait just a minute!
  That can't be right.

"Ships on the prairie
  Planes in the sea."
What am I saying?
  What's happening to me?

"My eyes won't steady --
  I feel like a nap."
Shut up, already.
  Enough of this crap!

Seven Fools
===========
Seven separate fools considered their lot,
  And in turn, each of them ruled,
"I know well enough to know I know not,"
  "I'm content", as fools are, "to be fooled".

"Be wary of too-happy people", one claimed,
  "And also avoid the too-sad",
"Try to eat well!"  "Make beautiful things!"
  "And be a good mother or dad."

Mr. Stroustrup
==============
An email, from Bjarne,
  today I received.
"Thanks" was all that --
  it said.

Ironic that he 
  should be thanking me.
I should thank him --
  instead.

New Job, New Spin on Frank

2007-10-13T15:35:00.000-07:00

Well, it's been a while since I've blogged about anything. Since then, I've signed on with WebSingularity. We're attempting to build a social networking site that doesn't suck. More on that later, but for now, in honor of Frank Zappa, here's this:

Java shell tips

2007-07-06T11:53:00.000-07:00

In which jar file does the class, CLASSNAME, reside?

for i in lib/*.jar; do jar tf $i | grep CLASSNAME >/dev/null && echo $i; done

To recursively search through all jars in the current directory...

find . -name "*.jar" | while read i; do jar tf $i | grep CLASSNAME >/dev/null && echo $i; done

And here's a handy little Python script that recursively "explodes" J2EE artifacts into their constituent components. If they're already exploded, it'll "implode" them. This is a great tool for quickly updating deployment descriptors at the command line.


#!/usr/bin/env python
#
# Each file passed on the command line that is a valid j2ee archive
# (war, jar, ear, sar) will be either exploded if archived or archived
# if exploded.

import sys,os
from zipfile import is_zipfile,ZipFile
from os.path import isdir,exists,realpath,dirname,basename,join
from shutil import rmtree

# The result of this try block is a function named 'mktempdir' that
# makes a temporary directory and returns its path.  Python 2.3
# provides tempfile.mkdtemp, which does exactly what we need, but we
# must implement it ourself in older versions.
try:
    from tempfile import mkdtemp as mktempdir
except ImportError:
    from tempfile import mktemp
    def mktempdir():
        path = mktemp()
        os.mkdir(path)
        return path

# The result of this try block is a function called 'move', which
# moves a file or directory, possibly across filesystems.  Python 2.3
# provides shutil.move, but older versions do not, so we revert to a
# system call.  The os.rename function will not work across
# filesystems.
try:
    from shutil import move
except ImportError:
    def move(src,dest):
        os.system("mv "+src+" "+dest)
        
# The presence of one of these indicates a J2EE artifact.
DEPLOYMENT_DESCRIPTORS = ("META-INF/application.xml",     # ear
                          "WEB-INF/web.xml",              # war
                          "META-INF/ejb-jar.xml",         # jar
                          "META-INF/jboss-service.xml")   # sar

def explode(file):
    '''Recursively unpack the contents of a J2EE file into a directory of same name.'''
    file = realpath(file)
    tmp = mktempdir()
    os.system("cd "+tmp+"; jar xMf "+file)
    [explode(join(tmp,f)) for f in os.listdir(tmp) if is_j2ee_zip(join(tmp,f))]
    os.remove(file)
    move(tmp,file)
    print "Exploded "+file

def implode(dir):
    '''Recursively package the contents of a directory into a J2EE file with same name.'''
    dir = realpath(dir)
    [implode(join(dir,f)) for f in os.listdir(dir) if is_j2ee_dir(join(dir,f))]
    tmp = mktempdir()+"/"+basename(dir)
    os.system("cd "+dir+"; jar cMf "+tmp+" *")
    rmtree(dir)
    move(tmp,dir)
    os.rmdir(dirname(tmp))
    print "Imploded "+dir

def is_j2ee_dir(path):
    '''Return True if directory contents are structured as a valid J2EE artifact.'''
    if isdir(path):
        for dd in DEPLOYMENT_DESCRIPTORS:
            if exists(join(path,dd)): return True

def is_j2ee_zip(path):
    '''Return True if path refers to a valid J2EE artifact.'''
    if is_zipfile(path):
        files = ZipFile(path).namelist()
        for dd in DEPLOYMENT_DESCRIPTORS:
            if dd in files: return True

for path in sys.argv[1:]:
    if is_j2ee_zip(path):
        explode(path)
    elif is_j2ee_dir(path):
        implode(path)

Stupidest Guitar Chord: D# minor

2007-06-18T19:20:00.000-07:00

I love the Beatles' song, "I'm Only Sleeping", especially the very first chord, played with a beautiful, exaggerated "up-stroke" for emphasis. Strictly speaking, listening to the recording, the chord is a D# minor, but a guitar just ain't made to play that! For a guitarist, a D#m is a pretty stupid chord.

Why? Because E minor sounds so much better! The open strings allow it to ring long and full, using the lowest note possible in standard tuning. And it's easier to play! And it's only a half-step away! A mere semi-tone!

So either George Martin altered the speed of the recording, or maybe the guitars were tuned down a half step. But either way, nobody was playing a D#m on their guitar that day. The Beatles weren't stupid.

So you shouldn't be, either. But it's a pain to detune your guitar just to play along, right? Thankfully, there's an easier way: Audacity, a free audio editor for Linux, can do magic for the budding guitarist. It can change the pitch of a song without changing its tempo. Conversely, it can slow the tempo without changing the pitch, which is really handy for figuring out solos. What was impossible with analog recordings is now amazingly simple with digital audio.

Nobody should be forced to play D# minor.

Tease

2007-05-15T04:17:00.000-07:00

Tanya Thompson, the third tallest tenured teaching typist, told Timmy Timmington to try to take the touch-typing test tomorrow.

Ta-da!

Remote Monitoring with Ruby and sshfs

2007-05-11T05:05:00.000-07:00

At work I've been doing some performance analysis as of late. Specifically, I've been combing JBoss server.log files recording the time it takes various transactions to complete. Admittedly, I'm fighting a little with Werner Heisenberg because configuring the app to produce the log messages on which I depend will affect performance, but my interest is in relative rather than overall performance, i.e. I'm looking for potential bottlenecks.

Still, I don't want to take up any more resources from the app server's CPU than absolutely necessary. The Ruby script that processes the log files obviously makes much use of regular expressions. Here's an example of a Request object from my script.


  Request.new("Typical request") { |request|
    request.expect /Processing Request/
    request.expect /No existing Session found/
    request.reject /ERROR/
    request.reject /reaping required/
    request.expect /Processing message took \d+ millis/
  }

Here's an example of a line from the server.log:

2007-05-09 16:28:51,511 INFO  [UDPListener] (Thread-16) UDPListener thread running

The Ruby script organizes the log messages by thread id. If it finds matches for each expected regular expression in the correct order without finding any it should reject, it records the total time for the Request. When finished, it reports various statistics (average, mean, stddev, etc) for each type of Request it found in the log.

Ideally, I would run that script on a log after a particular load test was performed, but hey that's no fun! I'd rather see how the server is doing in realtime, monitoring its performance while it's running. Here comes sshfs to the rescue!

With sshfs, I can mount the file system of the app server on a remote machine running my Ruby script. The app server doesn't need Samba or NFS installed, only ssh, and what respectable app server wouldn't have sshd running?

With the server.log mounted via sshfs, far fewer CPU resources are taken up by the analysis script, no more than if you were "tailing the log" yourself while the app server was running.

Installing sshfs is very simple on modern Debian-based distros:

  $ sudo apt-get install sshfs

Depending on the distro, you may need to add your user to the 'fuse' group or modprobe fuse, or chmod /dev/fuse, or some other such minor detail, but once installed, remote, realtime log file analysis is a breeze:


  $ sshfs appsrvr:/ /mnt/appsrvr
  $ cd /mnt/appsrvr/usr/local/jboss/server/default/log
  $ tail -f server.log | statistics.rb

So you use local CPU resources to parse a remote log file. Cool, huh?

My Mother's Blog

2007-04-08T17:06:00.000-07:00

I've been meaning to create a blog for my mother for some time now. I think she's a pretty good writer. I have to. She's my mother.

So here is My Mother's Blog.

1952 Vincent Black Lightning

2007-03-11T18:13:00.000-07:00

The theme for this weekend: 1952 Vincent Black Lightning. That's because I heard Richard Thompson's song for the first time. It immediately appealed to me, what with its protagonist sharing my name and his girl being red-headed, not to mention some pretty tasty finger picking throughout... but who's this cat, Vincent?

And so began my journey of not only learning what the heck a Vincent is -- it's a famous motorcycle -- but also about Richard Thompson, his technique, and a new open tuning I'd never tried before.

I also learned about Rollie Free and decided that being famous for this photo is darn cool.

And even though I've previously cautioned against it, here is why YouTube is so freaking great:

So I ignored all the stuff I had wanted to get done this weekend and attempted to learn to play the tune. My youngest daughter thinks I'm a bit obsessed with it. Maybe so, but it's fun to sing, and especially funny to hear her sing it.

I ended up with a decent approximation... and a newfound respect for both Richard Thompson and Phil Vincent.

Testing EJB3 (JPA) with Maven2

2007-03-04T23:13:00.000-08:00

This tutorial describes how to test EJB3 beans as a part of a Maven2 build, i.e. without an EJB container but with an in-memory, transactional database. I make the following assumptions:

JDK 1.5
EJB 3.0, i.e. Java Persistence API (JPA) 1.0
Maven 2 (2.0.5)

I don't assume much more than that. Our application contains no explicit references to Spring or Hibernate as EJB3 itself borrows much of their goodness. We avoid all the XML config usually associated with Spring/Hibernate by using the JPA persistence annotations in our entity beans. To facilitate testing, any injected dependency references, e.g. @PersistenceContext or @EJB, are declared package access so that the JUnit test classes can set them appropriately.

As with many enterprise applications, much of our business logic is embedded within database queries, most in JPQL, and some can be quite complex. It's vital that we're able to test them outside of a container as a part of our normal, continuously-integrated build. For that, we use the Hypersonic (hsqldb) in-memory database. We'll need a JPA implementation, of course, and because we deploy to JBoss 4.0 in production, which uses Hibernate's JPA, we choose the same. Of course, any certified JPA implementation should work just as well.

pom.xml

So our first step is to declare our testing dependencies in our POM:


  <!-- For in-memory sql testing -->                                                                                 
  <dependency>                                                                                                       
    <groupId>org.hibernate</groupId>                                                                           
    <artifactId>hibernate-entitymanager</artifactId>                                                           
    <version>3.2.0.ga</version>                                                                                
    <scope>test</scope>                                                                                        
  </dependency>                                                                                                      
  <dependency>                                                                                                       
    <groupId>hsqldb</groupId>                                                                                  
    <artifactId>hsqldb</artifactId>                                                                            
    <version>1.8.0.7</version>                                                                                 
    <scope>test</scope>                                                                                        
  </dependency>

Aside: I toyed with using the new H2 database instead of Hypersonic, but the version I tested, 1.0.20061217, included only table locks, causing my app to deadlock. Hypersonic supports row locking.

Although not strictly necessary, I recommend adding this to your POM, too:


  <testResources>                                                                                                     
    <testResource>                                                                                                    
      <directory>src/test/resources</directory>                                                                 
      <filtering>true</filtering>                                                                               
    </testResource>                                                                                                   
  </testResources>

You'll see why in the next section.

Note that we didn't need to change the POM much. In particular, no special configuration of the Surefire plugin (the testcase invoker) is required.

src/test/resources/META-INF/persistence.xml

All JPA apps need a persistence.xml file. Your app will likely already have one beneath src/main/resources. Both will be in your CLASSPATH when the tests are run. The JPA will aggregate them, so you need to make sure all your persistence-units, both real and test, are uniquely named. How you organize your persistence-units is up to you. It's probably easiest to have just one for testing, or you might, for example, prefer to create one per test class.

Here's what I recommend:


 <persistence>                                                                                                         
   <persistence-unit name="hibernate-hsqldb">                                                                          
     <provider>org.hibernate.ejb.HibernatePersistence</provider>                                                 
     <jar-file>${project.build.directory}/classes</jar-file>                                                     
     <properties>                                                                                                      
       <property name="hibernate.dialect" value="org.hibernate.dialect.HSQLDialect"/>                                  
       <property name="hibernate.connection.driver_class" value="org.hsqldb.jdbcDriver"/>                              
       <property name="hibernate.connection.url" value="jdbc:hsqldb:."/>                                               
       <property name="hibernate.connection.username" value="sa"/>                                                     
       <property name="hibernate.connection.password" value=""/>                                                       
       <property name="hibernate.hbm2ddl.auto" value="create-drop"/>                                                   
     </properties>                                                                                                     
   </persistence-unit>                                                                                                 
 </persistence>

Note the jar-file element. The ${...} expansion only works when filtering is turned on in the testResources element of the POM (see above). By setting the jar-file this way, we're telling the persistence provider to find our entities by searching for persistence annotations in our classes. From these, the required DDL is generated and the schema is created. Alternatively, you could use one or more class elements instead. This would allow you finer-grained control over which classes and/or packages are involved in a test. This strategy would probably also lead to multiple persistence-unit elements defined.

One thing to keep in mind about Hibernate. There's a known bug in which it won't create a schema before creating tables for your entities, so you're in trouble if you've set the schema attribute in your @Table annotations. I recommend removing this attribute from your entities anyway: it's a violation of the DRY principle. A better solution is to set the hibernate.default_schema property in your persistence-unit.

One debugging tip: you may want to include the following property in your persistence-unit:


       <property name="hibernate.show_sql" value="${hibernate.show_sql}"/>

That way, you could add something along these lines in your POM:


 <properties>                                                                                                          
   <hibernate.show_sql>false</hibernate.show_sql>                                                                
 </properties>                                                                                                         
 <profiles>                                                                                                            
   <profile>                                                                                                           
     <id>debug</id>                                                                                           
     <properties>                                                                                                      
       <hibernate.show_sql>true</hibernate.show_sql>                                                             
     </properties>                                                                                                     
   </profile>                                                                                                          
 </profiles>

So when you want to see the SQL produced by your unit tests...


 $ mvn -Pdebug test

src/test/resources/import.sql

Some apps make use of Hibernate's ability to run some SQL after a schema is created. If it finds a file named import.sql on the classpath, it'll run the SQL within it. This can be a problem if, for example, your import.sql is exploiting Oracle PL/SQL commands that wouldn't make any sense to Hypersonic. Fortunately, you can easily solve the problem by simply putting a different -- possibly empty -- import.sql file beneath src/test/resources, because Hibernate will find that one first in the CLASSPATH.

Aside: I experienced some problems with a test-specific import.sql file, strange stack traces generated by Hibernate's SchemaExport class dumped to stdout without actually failing the tests. I ended up truncating src/test/resources/import.sql completely.

src/test/java/org/yours/SomeTest.java

Speaking of unit tests, here's an obviously-contrived example:


  package org.yours;

  import javax.persistence.*;
  import junit.framework.*;
  import org.apache.log4j.Logger;

  public class SomeTest extends TestCase
  {
      public void testService() throws Exception
      {
          log.info ("testService");
          EntityManager em = emf.createEntityManager();
          TestData.build (em);
          ServiceBean slsb = new ServiceBean();
          slsb.em = em;
          assertTrue (slsb.something());
      }
      protected void setUp() throws Exception
      {
          log.debug ("setUp");
          emf = Persistence.createEntityManagerFactory ("hibernate-hsqldb");
      }
      protected void tearDown() throws Exception
      {
          log.debug ("tearDown");
          emf.close();
      }
      private Logger log = Logger.getLogger(getClass());
      private EntityManagerFactory emf;
  }

There is a lot of room for artistic freedom within this structure, but the essential point is the create/close of the EntityManagerFactory in the setUp/tearDown methods. This provides a clean database to each testXXX method.

If your transactional requirements are minimal, you may also want to create/close an EntityManager member variable in setUp/tearDown, too.

If your seed data requirements are complex, you may want to look into something like DBUnit, but in my experience, it's often easier to construct "builder" objects that can model various situations for your tests.

Transactions

For a lot of test cases, you can probably safely ignore transactions. Within one test, letting each of your beans use the same EntityManager without ever beginning or committing its transaction may go a long way toward testing your app sufficiently, especially if all of your beans are simply propagating the transaction anyway.

But transactions can get icky quickly, especially when you have multiple cooperating session beans with their transaction attribute set to REQUIRES_NEW. I'm going to show you one way of solving the problem using Java's dynamic proxies, but there's probably a more elegant solution.

Here's something I call a TransactionProxy. Others might call it "a good argument for AOP". It assumes your target bean class has an EntityManager member named em.


public class TransactionProxy implements InvocationHandler
{
    private EntityManagerFactory emf;
    private Object target;
    private Field field;

    private TransactionProxy (Object target, EntityManagerFactory emf) 
    {
        this.emf = emf;
        this.target = target;
        try {
            this.field = target.getClass().getDeclaredField ("em");
            this.field.setAccessible (true);
        } catch (Exception e) {
            throw new RuntimeException (e);
        }
    }

    public static Object newInstance (Object target, EntityManagerFactory emf) 
    {
        return Proxy.newProxyInstance (target.getClass().getClassLoader(),
                                       target.getClass().getInterfaces(),
                                       new TransactionProxy (target, emf));
    }

    public Object invoke (Object proxy, Method m, Object[] args)
        throws Throwable
    {
        EntityManager em = emf.createEntityManager();
        try {
            field.set (target, em);
            em.getTransaction().begin();
            Object result = m.invoke (target, args);
            em.getTransaction().commit();
            return result;
        } catch (InvocationTargetException e) {
            em.getTransaction().rollback();
            throw e.getTargetException();
        } catch (Exception e) {
            throw new RuntimeException (e);
        } finally {
            em.close();
        }
    }
}

The idea is that you create it with an instance of say, a stateless session bean (SLSB) and an EntityManagerFactory, and subsequent invocations on the proxy will wrap calls to the real bean inside a transaction obtained from the EntityManagerFactory. For example:


    Service service = (Service) TransactionProxy.newInstance (new ServiceBean(), emf);

This allows you to combine your beans in any number of transactional contexts. But it's not optimal since it's not actually using the @TransactionAttribute annotation of the classes under test. Hopefully, that's what the more elegant solution mentioned above is doing.

I'll update this tutorial after I've confirmed that. Until then, happy hacking!

From Gentoo+Postfix+Courier to Debian+Exim+Dovecot

2007-03-04T06:57:00.000-08:00

Ok, let's say -- hypothetically, of course -- you chose Gentoo for your home email server a few years ago. You found one of Gentoo's great docs on setting up Postfix, Courier and SpamAssassin. You accepted all the reasonable default options during the install, and things seemed to work great.

Over time, you began to take the little email server for granted. Oh sure, you'd occasionally login and "emerge" some security updates, but the dang thing just worked. Why bother it?

Of course, entropy is a cold bitch, and "for granted taking" turned to neglect. After a while, you began to forget all the arcane portage commands, having to use rpms at work and happily experimenting with Ubuntu's adopted dpkg on your desktop. In the beginning, spam was under control, but it's a constant battle, and forgetting your distro's packaging commands won't exactly help you in that fight.

And then terror struck: the Gentoo maintainers decided to release a portage update that was incompatible with the version running on your little email server. And at that precise version did your server remain for the rest of its life. The prospect of recompiling your entire system was just too much to bear. You decided it was a good time to look for another distro, maybe in a couple weeks or so, when you're not so busy...

Well, a couple of weeks turned into a couple of years. And over that time, you came to realize the benefits of the maildir storage format over the traditional mbox one, the latter being one of those reasonable defaults mentioned above. More importantly, you began to appreciate apt/dpkg as "portage without all the compiling", and you became aware of Debian's reputation for server stability.

One day when the spam/ham ratio was particularly high, you decided the time had finally come to switch the ol' home server from Gentoo to Debian. You decided you'd build a new box, transfer the family email over and convert it to the Maildir format. Just because you're a total dumbass-glutton-for-punishment, you also decided to switch MTA's (Postfix to Exim) and IMAP daemons (Courier to Dovecot). "Why the hell not?" you wondered.

Um... I'm not sure I can keep up the hypothetical perspective any longer. I'm thinking you were seeing right through it, anyway. Sorry.

So you -- I mean, I -- found a cheap Dell P3 on Ebay for $33+s/h, installed Debian Etch, and then fired up aptitude...

Exim

By default, Debian installs exim4-daemon-light, which is fine for most purposes, but exim4-daemon-heavy is required for integration with most spam/virus detection packages and, despite its name, it's really not that heavy.


  # aptitude install exim4-daemon-heavy

Configuring Exim is easy enough, though it took me a while to grok the split vs non-split formats. I wasted a lot of time googling for docs/howtos: I wish I had just started with /usr/share/doc/exim4/README.Debian.gz like the maintainers suggest. I don't know why Google results seem so much more glamorous than the packaged docs.

I went through the normal routine:


  # dpkg-reconfigure exim4-config

I chose non-split, mail sent by smarthost, received via SMTP, and accepted mail for *.internal.domain;internal.domain;external.domain. Your -- my? -- domain names will differ, of course. I chose to relay mail for my local network, set the name of the outgoing smarthost, hid the local mail names making only my external domain visible, and made sure to set Maildir as my delivery format.

I then created user accounts for all my family members, and sent them some test mail from a box configured to relay outgoing mail to my new server. In addition to testing the above config, it also caused the Maildir structures to be created in the users' home directories. Easy-peazy-lemon-squeazy.

Something else cool: I can add entries to /etc/aliases and exim will pick them up immediately without restarting or rerunning newaliases or some such. I do that for extended relatives so I don't have to remember their real email addresses, only their alias, e.g. unclebob@crossleys.org. Let me know if you want one.

Dovecot

So delivery is working. Now I need an IMAP server for retrieval.


  # aptitude install dovecot-imapd

Configuring Dovecot was simple: I just needed to enable plaintext logins (I'm not exposed to the bad ol' Internet) and the imap protocol. Here's a diff of my changes to /etc/dovecot/dovecot.conf:


  21c21
  < protocols =
  ---
  > protocols = imap
  46c46
  < #disable_plaintext_auth = yes
  ---
  > disable_plaintext_auth = no

After saving those changes, a restart is required:


  # /etc/init.d/dovecot restart

imapsync

Now comes the hard part: how to move my email from the old server to the new one? After googling a bit, I came across a utility called mb2md, but its interface is a little weird, seemed to expect files to be in certain places, and seemed more geared toward a single user rather than a group. Somewhat discouraged, I restarted my search, and came across imapsync. This discovery simplified my approach: instead of copying mbox files (both spooled and saved) from the old server to the new and *then* converting them, I could simply encapsulate the format differences behind the IMAP interface, i.e. imapsync allows me to copy email from one IMAP server to another, irrespective of the underlying formats of each! Neat-Oh!

Installing imapsync is easy:


  # aptitude install imapsync

Using it takes some practice. Fortunately it provides a --dry option for just that purpose. Here's an example of my Courier-to-Dovecot imapsync incantations for a particular user. I needed to invoke it twice: once for the main inbox, and again for the categories of saved mail I kept beneath the ~/mail directory on the old server:


  imapsync --host1 oldbox --user1 jim --password1 oldpass \
           --host2 newbox --user2 jim --password2 newpass \
           --folder INBOX
  imapsync --host1 oldbox --user1 jim --password1 oldpass \
           --host2 newbox --user2 jim --password2 newpass \
           --include "^mail/.+"

The nice thing about imapsync is that it's a true sync. You can run it multiple times and it only copies over what's changed. This allowed me to be pretty sloppy about when I actually updated my firewall to send SMTP requests to the new server.

ClamAV

Ok, so we've (we, as in me, not you) accomplished a lot. The only thing remaining is to reject viruses and spam. ClamAV will handle the viruses:


  # aptitude install clamav-daemon

To integrate with Exim, two changes to /etc/exim4/exim4.conf.template were required. I set av_scanner to this:


  av_scanner = clamd:/var/run/clamav/clamd.ctl

And uncommented these lines (presumably put there by exim4-daemon-heavy):


  deny
    malware = *
    message = This message was detected as possible malware ($malware_name).

After running update-exim4.conf, restarting exim and sending a fake virus (as described here), I noticed some "lstat() failed" errors in the mainlog. Smells like a perms problem. To fix that, I did this:


  # adduser clamav Debian-exim
  # /etc/init.d/clamav-daemon restart

SpamAssassin, er... greylistd

At this point in our story, I expected to tell you how easy it was to integrate SpamAssassin with our (my) new setup, but frankly I haven't done it yet.

Instead, I discovered greylisting. This has eliminated 95% of my spam. For this reason, I'm holding off on SpamAssassin integration for the time being.

The greylistd package provides a convenient script that completely idiot-proofs exim4 integration:


  # aptitude install greylistd
  # greylistd-setup-exim4 add

Simple, huh?

Conclusion

That's it. We're done. Whew!

Now I have a stable home email server that I can actually update and try to secure. Sweet.

Hating Maven less than Ant

2007-02-18T14:40:00.000-08:00

I've been writing Java code since 1996 and struggling with build tools at least as long. Ant is the most comprehensive and Maven is the most ambitious. I hate both of them, mostly because they each require me to describe my project's build requirements using XML, which should never be used as a programming language, though often it's used as a configuration file format, but because all configuration files ultimately will evolve into programming languages... I digress.

For different reasons, Ant and Maven are both terrific and terrible at once. Ant allows you to describe your build however you please, but you must effectively do it from scratch for each project. Maven encourages many best practices by providing a lot of build features out-of-the-box, adopting a sort of "convention over configuration" philosophy popularized by the Ruby on Rails project, among others.

So for my money, Maven is the logical choice for a typical Java project. Unfortunately, few Java projects are typical, especially few enterprise Java projects. And for those projects, Maven can be frustrating because, like a child or a turtle, it's difficult to make it do something it doesn't want to do.

For example, let's say I'm debugging a build and I want to echo the value of a property to the console during a build. With Ant, I could add a target to build.xml:


<project>
  <target name="debug">
    <echo>The value is ${some.property}</echo>
  </target>
</project>

With Maven 1, I can invoke Ant tasks within a goal defined in maven.xml:


<project>
  <goal name="debug">
    <echo>The value is ${some.property}</echo>
  </goal>
</project>

Maven 1 provides easy access to Ant tasks, as you can see. Unfortunately, doing anything non-trivial with Maven 1 involves Jelly, which is pure "executable XML hell". Maven 2 did away with Jelly, but...

With Maven 2, it's bewilderingly complicated to echo a simple property to the console. You must include the "antrun" plugin in your pom.xml, configure an execution to run Ant's echo task, and bind that execution to a particular phase of your build (but see comments for other options). Ready? Here we go:


<project>
  <build>
    <plugins>
      <plugin>
        <groupId>org.apache.maven.plugins</groupId>
        <artifactId>maven-antrun-plugin</artifactId>
        <executions>
          <execution>
            <id>debug</id>
            <phase>validate</phase>
            <configuration>
              <tasks>
                <echo>The value is ${some.property}</echo>
              </tasks>
            </configuration>
            <goals>
              <goal>run</goal>
            </goals>
          </execution>
        </executions>
      </plugin>
    </plugins>
  </build>
</project>

Note that our choice of the "validate" phase is completely arbitrary, but in order for our task to execute, it must be bound to some phase. Unlike our Ant and Maven 1 examples above, Maven 2 provides no way to invoke a single task without invoking all other tasks bound to the same phase along with all those before it. Maven 2 introduced the concept of profiles to address this perceived limitation, but I'll save that discussion for a future blog post.

Clearly, the Maven designers have violated a fundamental tenet: "the solution cannot be more abstract than the problem!" In trying to define and encourage best practices, Maven unapologetically sacrifices simplicity and flexibility, arguably two of the most important qualities of any software build tool, even for those projects exhibiting all accepted best practices.

Somewhat surprisingly, I generally still think it's worthwhile to convert your Ant projects to Maven, no matter how difficult. Maven's pain is concentrated, sort of like filling a cavity early in the project, resulting in a relatively pain-free existence once your project leaves the dentist's office. Ant is more like a minor toothache annoying you for the entire duration of your project, and then spreading to the other projects in your mouth as each begins its life with a copy of some other's build.xml file. Yes, of course it's simpler to do simple things with Ant, but adding enough of those simple things to projects over time can (and will, in my experience) lead to a pretty darn complex, brittle, and incomprehensible build.

In the long run, I think you'll end up hating Maven less than Ant, too. But if you insist on using Ant, use Ivy to manage your dependencies.

UPDATED Maven 2 example, removing unnecessary <property> element to reflect Eric's comment.

Linux Podcasts

2007-02-17T16:32:00.000-08:00

Since I got my new Meizu, I've been listening to a lot of podcasts, especially those dedicated to Linux. There are a surprising number of them out there, and I've listened to quite a few, but I wanted to share my favorites.

Linux Reality - Chess Griffin's generous, informative and practical podcast, presumably for newbies but really for anyone interested in Linux
LugRadio - can't understand them half the time, but usually very funny
JaK Attack - kind of hit and miss, but nice to hear a female voice
ITConversations Programming series - not active any longer, and focused on software development rather than linux, but great interviews with industry heavyweights like Paul Graham, Kent Beck, etc
Linux Action Show - often silly and self-conscious, but not boring and usually informative
Run Your Own Server - smart cats, more geared toward BSD than Linux, though

Charter DNS still sucks

2007-02-03T09:08:00.000-08:00

I set up dnsmasq on the Debian box I had been running bind9 on. It was infinitely easier to configure than a "real" DNS server -- just edit /etc/hosts -- and it perfectly suited the host-naming requirements for my admittedly tiny home network.

As with all things computer, of course, I still had hurdles to overcome, and they all involved difficulties with the commercial operating systems in my network, specifically Win XP and Mac OS X. All the Linux boxes were blissfully easy to setup and predictably functional and even adaptable to the weirdness required by the commercial ones.

As far as the Mac goes, it wouldn't resolve my local domain name, apparently because it ended in .local. I used that suffix because I read somewhere that it was an illegal TLD (top level domain, e.g. .com, .org, .edu, etc). Apparently, Mac's lookupd process eats those names because of the file /etc/resolver/local. I could fix the problem by adding a file for my domain to /etc/resolver, but I decided it was easier to use the suffix .home instead. I'm pretty sure it's an illegal TLD, too.

The WinXP box was sad for another reason. I had initially tried configuring dnsmasq as a DHCP daemon, which was cool, because then I could control all my static IP's in /etc/dnsmasq.conf instead of having to configure each host on the network. But alas, that broke my work VPN client on the WinXP box. I didn't spend any time trying to figure out why, though.

So now my router still acts as the DHCP server, even though the work laptop is the only thing that uses it. The other hosts are configured with static IP's that are replicated in the /etc/hosts file on the host running dnsmasq. Suboptimal, but functional.

Musical Moments

2007-01-27T12:50:00.000-08:00

When I was in high school, a friend described me as "the type of person who listens to guitar solos". I didn't realize some (most?) people don't.

I don't really hear lyrics when I listen to music. I'm aware of the words being sung, of course, but I rarely have any emotional response to them, other than the way they're being sung. For example, I only have a vague notion of what Joe Strummer or Sly Stone sing, but I love how they sing it.

I'm not into lyrics or "story songs", but I dig other aspects of music: a groovy bass line, a soulful vocalist, tight harmonies, unusual instrumentation, exceptional tone, original technique, surprising syncopation, or maybe an incredibly poignant note in a solo -- one that fits the context of the song perfectly! In short, I'm more inspired by the delivery of the message than the message itself.

Also, rather than entire songs, there are specific moments in certain songs that always excite me; always send multiple chills down my spine. So instead of favorite songs, I have favorite "musical moments". Here are a few...

"Machine Gun" -- Jimi Hendrix -- It's difficult for me to describe my relationship to this song. So much power from three people. Amazing vocals, both Jimi and Buddy. Forceful, soulful drumming. It's the tone of the guitar I love the most, of course. It's angry. At (3:11) singer and guitar are one. At (4:00) the player finally relents to the guitar's obvious desire and lets it scream. One angry, long sustained scream to introduce a solo. Not overplaying. Just one fantastic note. Gives me chills every time.
"Gimme Shelter" -- The Rolling Stones -- The intro always blows me away; dark and gently descending, culminating in that note at (0:50) Richards holds on the verge of feeding back with beautiful vibrato, one of those notes on a hollow-body that resonates to the point of shaking furniture if left unchecked.
"Hey" -- Pixies -- I love how he sings "If you go, I will surely die" at (0:36). I also love the guitars throughout, both the bass/rhythm interplay and the lead. The chorus is beautifully unusual, the word "chained" alternately and unapologetically broken. The entire second verse is a masterpiece, "Said the man to the lady... the sound that the mother makes when the baby breaks". I even like the lyrics on that one, but loved the way he sings that last line long before I realized what he was saying! ;-)
"There There" -- Radiohead -- These guys are like musical crack. And this song is exceptionally potent. One of my favorite bike-riding tunes. I always get chills when the background vocals come in at (2:01). I have no idea what they're singing.
"My Funny Valentine" -- Miles Davis -- When he flattens that note at (1:06) , he turns the whole song much darker and mysterious.
"Georgia on My Mind" -- Jerry Reed -- A study in timing. Both the intro and the outro are amazing, especially the harmonics at the very end. I love when he says "Yeah" at (2:21), himself seemingly amazed at what his own fingers are doing. He indeed has amazing fingers, but not all of his recordings reflect this. Fortunately, every track on "Explores Guitar Country", beginning with this one, does. Did I mention how amazing he is? ;-)
"Advance Romance" -- Frank Zappa -- Ok, I admit the opening lyric to this song initially hooked me. How can you not pay attention to a song that opens with "No more credit at the liquor store"? Wow! Love the drumming and slide guitar on this one, too.
"Bohemian Rhapsody" -- Queen -- Everyone loves this song, and for good reason. And what's the image in your head at (4:08)? The "Pacer scene" in the movie, Wayne's World, right? :-)
"I'll Take You There" -- Staple Singers (1:15) The solo begins with the piano trills and ends with the forever-familiar bass breakdown, the rim shots, kick drum accents and Mavis' vamping throughout. Love that groove.
"Statesboro Blues" -- Allman Brothers Band -- For my money, Duane achieved perfection on this recording. His slide has such a vocal quality, as if it's translating Greg's lyrics for all the guitars in the audience.
"Reelin' in the Years" -- Steely Dan -- Most people have no clue who Elliot Randall is. He's known mainly for one thing: he's the guitarist on this song. It was recorded in one take. The lick he plays around (4:02) in the outro is one of my all-time favorites in all of guitar-lick-dom.

Those are but a few of many. What are yours?

Learning (to hear) an Instrument

2007-01-19T00:11:00.000-08:00

I'm a pretty good guitar player. Been playing since I was maybe 12 or so, and I'm self-taught, which is why it took me so long to get any good. A great teacher can make you better faster.

But there aren't a lot of great teachers. If you really want to learn an instrument, you're going to have to teach yourself, and to do that you need to do two things:

Tap your foot
Listen

Always tap your foot when you play anything. Always, always, always. If not your foot, some other limb or digit. You must develop your rhythm. Timing is everything. Beginning musicians neglect rhythm/meter/tempo. They're too focused on pitch/melody/harmony. The tune means nothing without the rhythm. Don't tell me you can play something unless I can dance to it and/or accompany you, and your sense of rhythm is what enables me to do that. Tap your foot when you practice, always.

The Internet has produced two great tools for budding instrumentalists: tablature and YouTube. But without a good ear, they're dangerous, because quite frankly, most tablature available on the Internet is wrong and most YouTube performers suck. There are, of course, plenty of valuable exceptions, but even bad tablature and sucky performers can teach you something...

I'm not telling you anything new, of course. You already know the tabs/videos are wrong, because they don't sound quite right. Recognizing this is a big step! Unfortunately, your mind can trick you into thinking what you're playing is correct. If you practice it enough, you'll begin to think it's right, simply because through practice you've become better at playing it, even though it's not exactly what the artist you're trying to emulate is playing.

You would know this if you simply listened or -- even better -- played along with the song you're trying to learn. (which also improves your rhythm)

As your ear develops, you'll start to hear subtleties you missed before. There are many ways to play an F# chord on the guitar, for example. Any chord played around the 1st fret will have a completely different tonal quality around the 7th fret, even though both are the same chord. An open string sounds much different than a fretted one, even if it's the same note.

When I first started playing, I became very frustrated trying to play rock/blues solos, until I discovered string bending. My ear was telling me Hendrix was playing an E. I could hear the note, and I could play it: 1st string, 12th fret. Same note, exactly. But his sounded so much better than mine. Why? He was fretting the 1st string at the 10th fret (D), and then bending it up to the pitch it would be at the 12th fret (E). Or he'd bend the 2nd string from the 15th fret (D) up to (E), simultaneously playing the (E) at the 12th fret on the 1st string. Same note I was playing, but sounded WAY cooler.

Always trust your ear. I can remember struggling to "pick out" George Harrison's "Here Comes the Sun". When I thought I had a reasonable approximation -- though I knew it was wrong -- I went looking for some tab and experienced a huge "Doh! moment" when I discovered he was using a capo! That made it MUCH easier!

But even more important, because I had tried to play the song myself first BY EAR, and then by tab, the subtle effects a capo can have on a guitar's tone creeped into my subconscious. Over time, it became easier for me to recognize when a guitarist is using a capo, or bending a string, or pulling-off, or hammering-on, etc... without having to watch a video or read tablature.

I could hear it, and eventually, I could play it.

Charter DNS sucks

2007-01-14T11:32:00.000-08:00

For the most part, I've been happy with my Charter cable service, with two glaring exceptions:

They won't provide the NFL Network
Their DNS servers are unreliable, often down, and slow when they're up

I can't do much about the first issue -- other than relocate -- because the cable industry is rife with un-American anti-competition policies, but I stumbled across a VERY EASY, i.e. lazy, solution to the second: install a "caching forwarding nameserver". The performance improvement is ridiculous.

It so happens that Debian's default configuration of DNS (bind9) is to behave just that way: cache-ily and foward-ily. I realize there are other lighter-weight solutions, e.g. nscd, dnsmasq, or pdnsd, but it was just so bone-stupid-simple to install Debian on a spare PC (or VM, of course) and check the "DNS Server" option on the installation's package selection screen. And what better use for the $33 PC I just bought off ebay, right? Incidentally, the shipping cost was only 15 cents less than the bid price, which technically makes it a $65.85 PC, but hey, whenever server TCO is less than $100, I'm happy.

Of course, I now must configure the other computers in my home network to use my new nameserver. For my Ubuntu laptop, I edit /etc/dhcp3/dhclient.conf, and add (uncomment) this line:


  prepend domain-name-servers THE_IP_ADDRESS

Of course, you'll substitute THE_IP_ADDRESS with the real IP address of your $65.85 PC. This results in THE_IP_ADDRESS of my nameserver showing up ahead of Charter's nameservers in /etc/resolv.conf when the laptop obtains its DHCP address at boot. Alternatively, I could use my $65.85 PC as my DHCP server so that no per-client config is necessary at all. If only I wasn't so lazy...

Did I mention how ridiculously fast "the Internet" seems now? All the perceived slowness was due to Charter's name servers, which suck, btw. I mentioned that, right?

Maxtor OneTouch, HFS+ to ext3

2007-01-13T08:17:00.000-08:00

I bought a Maxtor OneTouch 300GB external USB/Firewire drive a couple of years ago, mostly to save my iMovie experiments on my wife's Mac, but also to serve as a general backup device for my other Linux boxen. Because I had no box other than the Mac with a firewire port, I hooked it up there and -- due to the normal fear and ignorance computer manufacturers have come to expect from their users -- I ran the supplied installation CD.

That turned out to be a mistake.

The Mac formatted the file system on the drive as HFS+, of course. This was fine, as long as the drive was connected to the Mac. But when I plugged it into a Linux box, it was none-too-happy with HFS+ and would only mount the thing read-only.

So today, I finally got around to reformatting the drive as ext3. This turned out to be way easier than I thought it would. Actually, the hardest part was finding places to temporarily store the files that were on there during the reformatting. Once that was done, I simply plugged the thing into my Ubuntu Edgy laptop, fired up gparted, deleted the old partitions -- for some reason, there were three of them -- and then I created a single ext3 partition.

Using, I assume, some combination of "udev/hotplug/hal/gnome" magic, Ubuntu recognized the drive when I power-cycled it and automounted it (/dev/sdb) to /media/usbdisk. Not liking that name, I realized gparted hadn't prompted me for a volume label, so I then umounted it and ran:


  $ e2label /dev/sdb1 maxtor

I guess I'm in the right group to allow me to do that. Yanking and reinserting the USB cable now caused the ghosts in the machine to mount the drive at /media/maxtor. Perfect!

But alas, I couldn't write to it. :-(


  $ sudo chmod 777 /media/maxtor

There, all better. Now I'm off to move all my files back to it, and hook it up to a "real" file server. In doing so, I'll no longer benefit from all the udev automounting hocus pocus, because I'm pretty sure that's a gnome-ish feature. If I'm not logged into gnome, nothing shows up in /media when I connect the drive, though /var/log/messages does show the device being detected as /dev/sdb. I'm pretty sure I'll need to put something like the following in /etc/fstab:


  LABEL=maxtor  /mnt/maxtor  auto  defaults  0 0

I'll let you know if that doesn't work out.

My New Meizu

2007-01-08T19:44:00.000-08:00

My wife bought me a MiniPlayer for Christmas, a portable media player made by Meizu, a Chinese manufacturer. I love the darn thing.

My wife has owned two iPods, an original and a Nano. I hate the darn things. I think they're unreliable and flaky. Oh, and overpriced.

But I have a large music library, and my new job has a long commute, plenty enough time to listen to some cool, geeky podcasts. She asked if I wanted one for Christmas. I said sure, but only if it works with Linux and plays ogg files. So she found the Meizu, which does that and much more, including videos, which I wasn't expecting. So far, I've been very impressed. There are plenty of reviews on the web, and YouTube has some demonstration videos.

If you're looking for a great DAP for Linux, I heartily recommend it. Amarok works well with it, and you can use mencoder to format your videos to play on it. It ships with the Windows-only VirtualDub, but the following mencoder incantation has worked great for me. SRC is the filename to be converted, and TGT is the name of the output file, sans extension.


CMD="mencoder $SRC \
-quiet \
-vc ffmpeg12,mpeg12, \
-ofps 20 \
-vf scale=320:240:0:0:0.00:0.75,expand=320:240,rotate=1 \
-ovc xvid \
-xvidencopts profile=dxnhtntsc:cartoon:zones=0,w,1.0:bitrate=384:pass=1 \
-oac mp3lame \
-lameopts cbr:br=128 \
-info name=$TGT \
-o $TGT.avi"

Beauty and the Bike

2007-01-06T12:47:00.000-08:00

It's the middle of January, and I just returned from a lovely bike ride on the Alpharetta Big Creek Greenway. There was a slight chill, but 'twas really downright balmy for January. A few clouds, but mostly bright and blue. Definitely could drive with the windows down.

I don't get outside often enough. My job keeps me indoors, and frankly I don't mind all that much, but when I get the chance to ride my bike on a good-weather day, I like to take it. And I usually like to drag parts of my family along, too.

I couldn't persuade any of them to go today, but I really wasn't trying that hard. I wanted to bring my new Meizu MiniPlayer with me, and that's a solitary endeavor, right? You can't very well listen to the DAP on a ride with other folks, especially family.

For me, few things are more enjoyable than riding a bike on a beautiful, i.e. cool but sunny, day listening to great tunes on a portable music player. DAP's avoid the Doppler effect. The music stays right with you as you try to move away from it. Plenty of songs sound great on a bike, but today I embraced the 70's. Steve Miller, ELO, Parliament, Al Green, Joni Mitchell, and the Staples Singers, among others.

In particular, Al Green and Mavis Staples made me so happy on the bike trail that I guess I was smiling a lot, because I received smiles from plenty of other folks on the trail, too, all of whom I thought I recognized, none of whom I actually did.

Is it any wonder Prince tried to revive Mavis Staples' career?

I love the Alpharetta bike trail. There's a creek -- a Big one, apparently -- that runs alongside it. In the summer, snakes are plentiful. It's always exciting to see one, and we always see at least one on any given trip. Most of the six-mile trail is paved but there's a certain swamp-like section comprised of twisty, wooden slats that are fun to navigate. The trail runs behind Northpoint Mall, various Alpharetta business parks and the usual McMansion subdivisions.

I have a touch of the flu on this day, so even though the entire ride was mostly perfect, the snot would tend to build up periodically. Finding an unpopulated stretch and snorting it out provided enormous relief and the occasional burst of energy that puts my butt in the air, my weight forward, the handlebars seemingly touching the ground with each pump of the pedal, finally reaching the pinnacle of one of the many bridges over that winding creek, and leaning back on the seat, straightening the spine, the wind on my face, coasting down with hands on hips while Al Green sings of Love and Happiness...

Life is beautiful.

New Year's Resolution

2006-12-19T20:01:00.000-08:00

My new year's resolution is to blog more.

So I'm getting a jump on 2007. I created this blog in September of 2004. I added my first post a year later. This is my second entry... in December of 2006. Clearly, I don't have a handle on this whole blogging concept yet.

So I'm going to blog more in 2007. More self-indulgence and opinions... woo-hoo!

First

2005-09-21T12:44:00.000-07:00

I'm a software developer.

At any given time, I know about 17 minutes worth of crap. After 17 minutes, I'll start to repeat myself. My job requires me to know more than 17 MWOC, so obviously I need to write stuff down. I've tried to do that here, but that's becoming unwieldy, so I'm going to try my hand at blogging. It's mostly for me, but I hope it might be useful to others, too.

17 minutes later...