Input Params for Pig Script

A way to list all the input parameters of a pig script

open FILE, "<", "$pigfile" or die $!;
#GOING through the file to list out Parameters#
while (my $line = <file>) {
      #Only taking non commented line and content inside single quotes#
      if($line !~ /--/ && $line =~ /(')\$(.+?)(\1)/){
           print("\n$2");
}
close(FILE);

GIft YourSelf A Road Mishap

Here is the ALGORITHM for getting yourself a perfect GIFT.

1) Pick out a beautiful Day for a ride. When the weather is perfect with a little rain before

2) It helps if you pick out a day after the night when you had a fight with your affable ones. (You can blame them or get enlightened of your mistake)

3) Pick out the day which is officially a holiday

4) In spite of the day being a holiday choose your destination as your office.

5) Enjoy the ride towards your office and try to filter away your negativity.

6) That's it, let the COSMOS do the rest.

:)

Not possible

Here is what will Happen

7) For a change you will enjoy the weather.

8) For a change you shall cruise

9) For a change you shall not find any traffic

10) Then you will have to halt for some bugger in front of you finds the need to do so.

11) Rest leave it to the people on your behind to not find the need to do the same

12) Now enjoy the beautiful feeling of kissing the tar.

13) Enjoy even more the feeling of nakedness of being in a tee and jeans realising the one who desired to ride over you is well dressed with jacket and gloves .

14) Enjoy the fact the day is cooler than the rest, hence intensity is more than usual.

SO ENJOY and GIFT Yourself Something Different today

Diff of two DIR

Love this. Amazingly powerful

diff --brief --recursive <dir1> <dir2>

Hadoop 0.21, Pig 0.7, Hive 0.4.1, Sqoop 1.10, Hadoop-LZO, Elephant-Bird

Strangely but truly a lot of time has gone by when the last official hadoop release was made.

Unfortunately Hadoop 0.21 never became an official release but a release candidate was made by Tom White and co.

Felt happy to hack my way through along with a friend to make various software work with Hadoop 0.21

1) Hive 0.4.1
https://github.com/hirohanin/hive0.4.1hadoop21

2) Sqoop 1.1.0
https://github.com/hirohanin/sqoop-1.1.0hadoop21

3) Hadoop-LZO
https://github.com/hirohanin/hadoop-lzo-hadoop21

4) Elephant Bird
https://github.com/hirohanin/elephant-birdpig7hadoop21

5) Pig 0.7

https://github.com/hirohanin/pig7hadoop21

Disclaimer: The software are unofficial and unsupported, unless some one gives a better reason to do so.

Apache Tika

I was amazed with the kind of extraction facility has been made available in open source world. Apache Tika has has gone a long way to help developers come with better crawlers. I was happy to use it in a project

HADOOP+PIG+HIVE

Its been fun working on humongous data with an abstraction created by the realm of different projects under hadoop. PIG, HIVE being the query language which provides even better idiots layers on top it. Aspects of keeping a cluster running, with managing data sizes with various compression initially driven by LZO (elephant-bird) drifting towards block compression. Making ones life easier by using scheduler like Azkaban. Humongous data and heavy loading, thats the way to go

Murder + Capistrano

Deployments are one painful task in any production environment and it shows its ugly face in a resource heavy environment. PUPPET for OS centric deb/config could be useful. Recently got a chance to use a combo of capistrano and murder. Murder is a beautiful concept of torrent inspired production deploy and capistrano brings in the feature of other abstracted functionalities.

In the end I wonder why so many deployment tools is in RUBY or support a tool written in ruby by providing a gem of itself

Ant , Maven, Ivy

Moving from the trustworthy ant to abstracted maven. The only thing I realised, unless applied company wide maven becomes hard although its usp is well established. Time to dibble with ivy for it promises a lot with transitive dependencies.

One interesting realisation in maven that one can fake the repo if you have a local set of jars in your machine (for the jars not present in repo)

<dependency>
      <groupid>...</groupid>
      <artifactid>....</artifactid>
      <version>...</version>
      <scope>system</scope>
      <systempath>/absolute path to lib/XXX.jar</systempath>
</dependency>

And I am inclining more and more towards a combo of ant + ivy. In my view and use case and even generally it seems most promising.

JAVACC

http://en.wikipedia.org/wiki/JavaCC

As it turns out, I finally get to use it in a system. Not bad at all

Elephant Bird with PIG 0.7

A Fork on twitter's elephant-bird which is an untested version compatible with PIG 0.7 for LZO compression

http://github.com/hirohanin/elephant-bird

DROP ALL TABLES : MYSQL

One of the ways

mysqldump -u<user> -p<pwd> --add-drop-table --no-data <db> | grep ^DROP | mysql -u<user> -p<pwd> <db>

The Game : Neil Strauss

I have no clue what to make out of this book. Except it formed an easy read, probably very engrossing for it dwells in common insecurities and desires.

BOAT

Some say heart is just like a wheel..
If It is so..
Then at the moment its spinning aimlessly..
Dangerously rocking the boat of my life..
Get hold of it my gravest and trustworthy captain..
Before it sinks into the oblivion of the deep blue sea..

A Moment

Strange are the ways of human thoughts..
Stranger are the illusion it creates..
The unanswered calls which puts me down..
Sometimes uplifts me with strangest hope..
Only for a moment..
But its a moment when the clock stops ticking..
The seconds between two consecutive rings..
My heart stops beating..
Where my mind tells me you picked up the call..
Ecstatic is what I am..
Happiness takes over me..
Only for a moment, If for a moment.

Only if Known was a Known

Waiting for months for a response..
Its hard to remain in a stoic pose..
Empty thoughts and empty response..
Leads one to misleading unknowns..
Never knew my wrong were so wrong..
Only if I knew the doer that doeth..
Only if the knowledge was profound...
The blindness which overwhelms..
Darkness that over cometh..
Makes the default at every moment..
Make'th the heart default with every action..
Only if the known was a KNOWN..

Where ??

My eyes seek you..
My Mind seeks you..
My soul seeks you..
I am so much over the edge..
Where are you..
Why do you run..
Why don't you communicate..

Past

Our paths diverge..
Only to converge..
In time..
Belonging to future..
But why we have to spoil..
That present which could be beautiful..
Why are we creating a past to forget..

Miss

Miss my Language..
Miss my expression..
Miss my ideology..
Miss my patience..
Miss myself..
Miss you..
Miss the one who understood..

Every Call

Every call of my liking..
Every effort on my part..
Is the reach out with honesty..
O my beautiful one..
O my complex one..
Smile on this crazy one..

Sky Clouds

The sky clouds..
Pours out rain in leaps and bounds..
Calling out in unison..
To play a game forlorn..
The beauty of you..
The beauty abound..
Come on angel for the calling is profound..

Silent..

Silent cries..
Silent echoes..
Silent communication...
Silence for the meek..
Silence for the powerful...
Silent revenge..
Silent infliction...
In the silence...
I move...
To the silent oblivion..
To the depths of silence...
A silent cry...
with the silent echoes..

Musical Psycho

The musical Psycho is driven..
Driven to the point of obsession..
What's the point..
What's it worth..
Only catalysing to self destruction..
What shall he get for his persistence when his heart is blackened..
Either ways he stand to loose..
She had the choice to make it not so difficult..
She says no hang ups no troubles..
Then why the mountain of every reaction..
She wanted normal then why doesn't she act so..
He is troubled, he is to lose either ways..
What is he getting for his liking..
Or she simply doesn't care

Loving HUG

Chillness of the air..
Frostiness all around..
A ray of the sun ..
Creates hope abound..
Warmth of a loving hug..
Changes the world around..

Cool Wind Blows

When the cool wind blows..
N the music flows..
Do not lay low..
For they call out to you..
They call out for your glow..
Let all your doubts go..
N come out with an arrow and bow..
To play like a murmuring brook on the flow.

Shining Sun

The shining sun..
The cloudy skies..
Sometimes its happiness..
Sometimes you are sad..
With the desire for a move..
To put oneself in groove..
One thing is to remember..
Is not to keep thy joy under the hood..

Its ok

Its good that you were on phone..
Now at least I know that you are there..
But my pings are just too irritable to bear..
Its ok to not see an invisible man..
Just was troubled when I turned blind too..
Your silhouette itself has enough beauty..
Having the power to light up and pleasure

BirthDay

A day to remember..

A day to cherish..
A day to rejoice..
For today was the day..
When a beautiful being got created..
A person who would bring joy to so many..
A being with whom every moment is different..
Every moment is an adventure..
Come to me my lady..
For today I want to be a part which gives you the joy back..
Come and stay for you shall have the time of your life..
Come and lets run away from the things which bothers you just for the day..
For you deserved to be pampered in every way..
Happy Birth Day..

In Doubt

Whenever you feel down..
Whenever you feel not right..
Remember I will always be there..
As a keen listener..
To whom you can pour out everything..
For I want you to come to me when you want to smile..
Come to me to feel glad..
I know you get angry of late to whatever I may say..
The simple words of mine may not always have you sway..
But a clear heart seeks pleasure..
Awaits for you to not feel bad ..
Await for you to talk and speak for it is not wrong..
Await for your hug of innocence..
Await your kisses of warmth..
But I will not ask till you get alright..
Till your head gets untangled..
But with only hope that you stop resisting me so hard..

Aye Oh Angel

Aye oh angel..
I am just a human..
Who just praises and likes in his own way..
If there is a reason to make you snap
Just tell me..
If not dont be so harsh..
For I fear no one..
I do things out of my likeness..
Some day you may go away..
But the time although short I wish to spend with gladness in my heart..
Do not stop me from being happy..
N you know u r happy too, if u let the wind blow..
So come and sing..
A peaceful melody..
A symphony to which we can look back and say it is good..

To Help You Tow

When You feel low..
You will find my shoulder to help you tow..
When you want to talk..
You will find a friend who garrulously listens..
When you are happy..
Look behind you will see me glad..
When you feel like loving..
A simple me will gratefully love back..
For in me you will find what you want..
The rhythm created is due to the chords played..
A friend, a lover, a mate, a partner, a father, a son, or just a crazy stupid fool..
I am all yours my lady..
For my likeness is clear and unconsciousness unblemished..

I dunno

I dunno what happened..
I dunno what to conclude..
Since its you and me ..
And no one else..
I have Faith which is strong..
And U need proof..
I will await my dear lady..
For I am here..
I shall await for you to clear your head..
I shall await the day when you don't consider me wrong..
I will fight for you with enemies unknown..
For I like you with the childishness of heart..
Stop considering me wrong, just try it for a day..
And you will see the peace abound

Thirty Seconds

Thirty Seconds is all I get of late..
But that's how is fate..
The beauty of the angelic demeanour..
They can Create garden out of simple gestures..
O my lovely lady..
You make me glad by your complex simplicity..

For I know

With Sleep of peace..
Dawn of a new day..
Should start you with a smile..
Beware of the council you take..
For there are plenty who are divisive..
And smile at the useless fool out here..
Why waste so much of energy to be angry at me..
For the reason unknown to me..
But be true to yourself and not the world..
For I will be the pleasant wind always carrying you to the unknown..
I trust you ..
Although I prefer a known hand..
But do you trust me enough is the question..
N no one can diminish the likeness of my heart..
All the effort is in vain..
For I know what is right..
I know what is good..
Trust me my lady..
Fly with me to the unknowns..

Thank You

Thank You will never be enough..
For what you did..
So much of trouble you took..
For a guy like me..
Just to see you there..
Just to hold you while we theoretically slept..
Was more than I could have asked..
And I know now..
That I can never or will ever match the thing you did for me...
I like you my dear from the core of my heart..

Seek His Well

I don't know how..
But You Do..
Then I realised..
A man who thirst..
Has to seek his well..
In the desert of worldliness..
You are a life giver.

Shrub

You are my shrub..
And I am the gardener..
The relationship is strange..
For the shrub in its own way grows and play..
And the gardener feels the joy..
By feeding thou with waters of his ode..
Brings the peace which is abound..
You are the shrub which tells that their is something right in this world..

Come

Come to me my lovely lady..
Come to me and sit down..
Relax and converse..
For I may be a mess..
But I assure that each moment will be a special one..
Each moment will the one with passion..
Come fall with me in the hour unknown..
Come for you should know better..
Come for you know that I would never do a thing which you do not like..
Come let me wrap you around for the warmth..
Come and lets snuggle in affection..
Come lets play for joy..
Come and let us not bother..
Come and lets not weighed down by time and world..
Come my lovely lady..
Oh come..

Praises

Praises to your way..
I sing glory to your way..
Young in spirit..
Aged in wise-ness..
Unblemished in beauty..
What a joy is to share the cup of thy supper..

Pleasant Flute

A night cold..
Requiring warmth to keep you under fold..
A morning promisingly refreshing..
Giving desires a halo of serenity..
Your beauty, your soul is what I drank in sleep..
A pleasurable aroma for me to keep..
I wonder in gratitude..
That God made you to be a pleasant flute..

I Am A

For I am crazy..
For time after time I have paid my dues..
Did my sentence but committed no crime..
Have my share of sand kicked on my face, I have come through..
For I am a poet who will always romance..
A slack I may need..
A chance is what I deserve..
For u bring me fame and fortune and everything with it..
For you are the treasure of happiness worth seeking..
It wont be a bed of roses or a pleasure cruise..
A challenge to allow oneself smile a genuine smile..
A joy worth giving everything for..

Magical Moment

An action which is something different..
Something which a man would lay his life for..
For when your lips open up..
And you draw closer..
The warmth of your breath..
And the aroma of yourself..
All come together to create a magical moment..
A moment to cherish..
A moment of joy..

Running Amok

Awake in the morning ..
And the thoughts are running amok..
Itching to get the day done..
For you have so much to offload..
Don't let it make you miserable..
And let your calm and meaningful demeanour take over..
For you are the one with white and beautiful robe..
And it will let you shine through..

In Praise

Hopefully this will reach..
When the invisibility does not get breached..
This is just an ode..
In praise of the angel abode..
For when one looks into your loveliness..
Cannot remain untouched by thy engrained holiness..

Rains

When it rains..
Its a song of unison in play..
It thunders not to scare..
But is an introduction of something special to be displayed..
Seeing it from my balcony day after day..
All I can say..
I miss you girl in this rain..

Cold Breeze Blows

When the cold breeze blows..
Freshness of novelty flows..
Do not be perturbed by the insignificant blows..
But look at the possibilities which grows..
And what a joy it would be..
To have you in arms and let thy warmth glow..

Bubble

What happened..
O My Lovely Lady..
Don't be so troubled..
For this is a time to create a bubble..
A bubble of hope..
A bubble for the future..
So relax and call me..
For in me you shall find an honest listener..

Just Like That

A thousand different smile thy possess..
They can light up your life..
They can make you laugh just like that..
They can make you cry just like that..
They unguard you just like that..
Amazing , isn't it ..

From My Slumber

Strangest of Strangest dream I had yesterday...
You were calling out to me..
And it was so...so loud and clear..
That it was more than a reality..
Only angels can move me away from my slumber...
N thou are definitely the angel living in this world..

Blue Robin

The Blue Robin in the tree..
Sings the song which is in nature free..
Irrespective whether its cold or bearing the heat..
It Sings..
It sings just the same as your ever emancipating beauty sings..

Simple Song

Every Simple Song I write to you..
If for a moment it takes your breath away..
Then I write it all..
Till I have no more creativity to call..
So as to promise you..
That the world would never be the same..
Because of the beautiful and wise you and a crazy me..

A Chance

Give me a chance O mighty angel..
Is it something so hard to give..
Have I fallen so much..
That I cannot be redeemed..
Wont you...
Wont you..
To a person who desires to make it better..

Reckless

I have been wrong..
I have been reckless..
But never meant to do something..
To make you feel so bad..
Sometimes I am unable to convey..
The things I want to say..
In my writings I falter..
Thats why I am amateurish..
But do not doubt my intention..
For I always want to make you smile..
Forgive my dear..
Forgive the stupidity of mine..
For you are the person who can..
For you have always been the good one in my life...

Creatively Blink

The drive to wake up every morning..
To creatively blink..
And pen it down..
Into child like songs..
Comes from none other ..
But you My Dear..
For you make me see horizons..
Unknown to me..
Oh What a blessing you have been..

Paths so Fuzzy

Wondering where we are heading..
With paths so fuzzy..
And Destination unknowns..
But sometimes we got to believe..
To see..
Sometimes we just got to trust..
N oh u beautiful maiden..
Somehow I believe because of your presence..

Shower

Yesterday was one of the strangest realization..
Not many has people to shower their affection to..
And by sheer divine conspiracy..
I have you..
To share my ability of loving..
In my own crazy way..
With you, With an angel personified..

Dreams

The times are nearer..
When we dream not while we are asleep..
But have dreams which does not let us sleep..
When it starts happening..
We know for sure we are on the right track...
We together shall overcome ...
And win many a battle..

Seek

People seek nirvana..
If there is such a thing..
Then I know where to seek..
It is The aroma of thy essence..
So compelling..
So intoxicating..
So Pure..
So heavenly..
So joyful..
So trance like..
I thank God for He gave such a blessing in your mortal form..