Saturday, October 16, 2010

Apache Tika

I was amazed with the kind of extraction facility has been made available in open source world. Apache Tika has has gone a long way to help developers come with better crawlers. I was happy to use it in a project

HADOOP+PIG+HIVE

Its been fun working on humongous data with an abstraction created by the realm of different projects under hadoop. PIG, HIVE being the query language which provides even better idiots layers on top it. Aspects of keeping a cluster running, with managing data sizes with various compression initially driven by LZO (elephant-bird) drifting towards block compression. Making ones life easier by using scheduler like Azkaban. Humongous data and heavy loading, thats the way to go

Monday, October 04, 2010

Murder + Capistrano

Deployments are one painful task in any production environment and it shows its ugly face in a resource heavy environment. PUPPET for OS centric deb/config could be useful. Recently got a chance to use a combo of capistrano and murder. Murder is a beautiful concept of torrent inspired production deploy and capistrano brings in the feature of other abstracted functionalities.

In the end I wonder why so many deployment tools is in RUBY or support a tool written in ruby by providing a gem of itself

Saturday, October 02, 2010

Ant , Maven, Ivy

Moving from the trustworthy ant to abstracted maven. The only thing I realised, unless applied company wide maven becomes hard although its usp is well established. Time to dibble with ivy for it promises a lot with transitive dependencies.

One interesting realisation in maven that one can fake the repo if you have a local set of jars in your machine (for the jars not present in repo)

<dependency>
      <groupid>...</groupid>
      <artifactid>....</artifactid>
      <version>...</version>
      <scope>system</scope>
      <systempath>/absolute path to lib/XXX.jar</systempath>
</dependency>

And I am inclining more and more towards a combo of ant + ivy. In my view and use case and even generally it seems most promising.

JAVACC

http://en.wikipedia.org/wiki/JavaCC

As it turns out, I finally get to use it in a system. Not bad at all

Wednesday, September 29, 2010

Elephant Bird with PIG 0.7

A Fork on twitter's elephant-bird which is an untested version compatible with PIG 0.7 for LZO compression

http://github.com/hirohanin/elephant-bird

DROP ALL TABLES : MYSQL

One of the ways

mysqldump -u<user> -p<pwd> --add-drop-table --no-data <db> | grep ^DROP | mysql -u<user> -p<pwd> <db>

Monday, August 02, 2010

The Game : Neil Strauss



I have no clue what to make out of this book. Except it formed an easy read, probably very engrossing for it dwells in common insecurities and desires.

Friday, July 30, 2010

BOAT

Some say heart is just like a wheel..
If It is so..
Then at the moment its spinning aimlessly..
Dangerously rocking the boat of my life..
Get hold of it my gravest and trustworthy captain..
Before it sinks into the oblivion of the deep blue sea..

A Moment

Strange are the ways of human thoughts..
Stranger are the illusion it creates..
The unanswered calls which puts me down..
Sometimes uplifts me with strangest hope..
Only for a moment..
But its a moment when the clock stops ticking..
The seconds between two consecutive rings..
My heart stops beating..
Where my mind tells me you picked up the call..
Ecstatic is what I am..
Happiness takes over me..
Only for a moment, If for a moment.

Wednesday, July 28, 2010

Only if Known was a Known

Waiting for months for a response..
Its hard to remain in a stoic pose..
Empty thoughts and empty response..
Leads one to misleading unknowns..
Never knew my wrong were so wrong..
Only if I knew the doer that doeth..
Only if the knowledge was profound...
The blindness which overwhelms..
Darkness that over cometh..
Makes the default at every moment..
Make'th the heart default with every action..
Only if the known was a KNOWN..

Tuesday, July 27, 2010

Where ??

My eyes seek you..
My Mind seeks you..
My soul seeks you..
I am so much over the edge..
Where are you..
Why do you run..
Why don't you communicate..

Tuesday, July 13, 2010

Past

Our paths diverge..
Only to converge..
In time..
Belonging to future..
But why we have to spoil..
That present which could be beautiful..
Why are we creating a past to forget..

Thursday, June 10, 2010

Miss

Miss my Language..
Miss my expression..
Miss my ideology..
Miss my patience..
Miss myself..
Miss you..
Miss the one who understood..

Wednesday, June 09, 2010

Every Call

Every call of my liking..
Every effort on my part..
Is the reach out with honesty..
O my beautiful one..
O my complex one..
Smile on this crazy one..

Tuesday, June 08, 2010

Sky Clouds

The sky clouds..
Pours out rain in leaps and bounds..
Calling out in unison..
To play a game forlorn..
The beauty of you..
The beauty abound..
Come on angel for the calling is profound..

Friday, June 04, 2010

Silent..

Silent cries..
Silent echoes..
Silent communication...
Silence for the meek..
Silence for the powerful...
Silent revenge..
Silent infliction...
In the silence...
I move...
To the silent oblivion..
To the depths of silence...
A silent cry...
with the silent echoes..

Tuesday, June 01, 2010

Musical Psycho

The musical Psycho is driven..
Driven to the point of obsession..
What's the point..
What's it worth..
Only catalysing to self destruction..
What shall he get for his persistence when his heart is blackened..
Either ways he stand to loose..
She had the choice to make it not so difficult..
She says no hang ups no troubles..
Then why the mountain of every reaction..
She wanted normal then why doesn't she act so..
He is troubled, he is to lose either ways..
What is he getting for his liking..
Or she simply doesn't care

Monday, May 31, 2010

Loving HUG

Chillness of the air..
Frostiness all around..
A ray of the sun ..
Creates hope abound..
Warmth of a loving hug..
Changes the world around..

Sunday, May 30, 2010

Cool Wind Blows

When the cool wind blows..
N the music flows..
Do not lay low..
For they call out to you..
They call out for your glow..
Let all your doubts go..
N come out with an arrow and bow..
To play like a murmuring brook on the flow.