Change Displayed Text SizeGrow Displayed Text SizeShrink Displayed Text Size
 

Monday, September 22, 2008

So you want to back up HBase?

Just released the solution Mahalo has been using for getting bulk data into and out of HBase, including backups.

You get see it here:Backup/Import/Export HBase data - HBASE-897. Documentation is included in the JIRA issue tracking it, as well as in the download.

Labels: ,


9/22/2008 05:39:00 PM ] [  0 comments  ]

Friday, August 29, 2008

Who would you vote for?

Which VP looks like a sure thing to you?
Democratic VP Candidate Joe Biden?
Republican VP Candidate Sarah Palin?

People rarely seem to realize how much power the VP actually has day to day, not to mention powers in the Legislative branch. Yet we often treat the President as if he were a king, when Executive power is very very limited. The Constitution was designed to keep the United States from ever having a king, yet the people seem to still be in love with the idea.

Sadly...
Cuteness may be the deciding factor in November

8/29/2008 03:55:00 PM ] [  0 comments  ]

Monday, August 11, 2008

Grownups Doing Open Source

Well, in response to [ this ]...

- We're using Hadoop and HBase every day, in production. We'd talk more about it, but haven't had much time.
- We'll be contributing some pretty useful code for backing up HBase that can also be used for importing and exporting data from other systems. In our case we used it for importing data that had lived in a MySQL table into HBase, and use it for live backups.
- I've been working on some even cooler applications of Hadoop which you may hear about in the near future.

HBase has a lot of advantages for certain problems, and absolutely none for a lot more. It weirds me out that several companies have deployed HBase into production without a way to back it up or monitor it's health and performance. We took a little more time to work out a very bare bones - but reliable - method to back it up and have several different monitors on it.

So the quickie beatoff in the blogosphere can begin. [Mahalo] has been running HBase in production for a while now, on top of Hadoop's HDFS.

8/11/2008 09:00:00 PM ] [  0 comments  ]

Friday, May 16, 2008

Scale what?

Oh darn, it seems that popular college gossip site Juicy Campus is down from even moderate loads of traffic - they are featured on 20/20 here in the US today. If you want to know what [ the juicy campus site ] is about, check out the Mahalo page.

Watched a video yesterday about a new testing tool at Google - when they were testing it, they found that most startup websites could not handle more than 20 concurrent users. Ouch.

5/16/2008 08:04:00 PM ] [  0 comments  ]

Sunday, January 27, 2008

Minor updates...

- Moved (finally) to blogger's commenting system
- Fixed some layout stuff
- Removed old search, replaced with something new

1/27/2008 01:34:00 AM ] [  0 comments  ]

Wednesday, June 13, 2007

No Matter Where You Go, There You Are

So the cat is out of the bag.
I left my last job with Infospace in March to join a startup. As some of you know, there were reasons to stay at Infospace at the time, though I would have been bored as hell. The startup came along really out of the blue, and it was completely the right fit for me.

Two weeks ago we came out of the land of conjecture and launched [ Mahalo.com ] at the [ D conference ] . Today we launched a companion to the main site, [ Greenhouse ] .


While the core application is MediaWiki with a number of extensions, there are a lot of other systems at work on both Mahalo and Greenhouse. On a technical level, there are a number of things we’re doing that are outside of the box - we use multicast for a lot of unexpected things, as well as multicast DNS. We use C extensions to everything from memcached to MySQL to support our needs, have (some) Java, a lot of PHP and Python. I don’t want to even think about how many shell scripts I’ve written in the past month or so as we neared launch for everything from monitoring to deployments!

Needless to say, this is a far cry from what I had been doing at Infospace. I was tasked with rich media applications for mobile, and for a year worked on a set of projects that would have been revolutionary in the mobile industry had they been released. In mobile, however, at the end of the day you are at whim of the carriers. That is not a position I liked being in, no matter how compelling mobile applications could be.

So that’s what I’ve been up to. Still racing, still training. I’m shooting for North America’s toughest Ironman-distance race this year in Nevada, which is a big step up for me. It certainly will be an interesting summer!

6/13/2007 03:47:00 PM ] [  0 comments  ]

Saturday, October 21, 2006

Test!

Just making sure all the moving parts still work.

10/21/2006 09:16:00 PM ] [  0 comments  ]
[archives]
A good quick laugh