[Lilug] Poor mans ETL processing

[Anthony Ehrhardt]

Hmm..this oddly enough sounds like SAP. If it IS SAP, I would say you're
lucky. Why? While S.A.P. is a load of crap, it is the standard of ERPs world
wiide, and it has made more millionaires in Germany than anything else.
You're luckty because it's very hard to get into the very high paying field
of SAP. Once you've worked on and learned a module, you're set and can now
be hired out for SAP work. (My friend from Germany has lived VERY
comfortably for 10 years only on 1 module for SAP. He had to come here last
month because there weren't enough qualified workers in CT.
If it's the paltry Oracle (the competition), it's not the behemoth as SAP
is. (Some people call it the microsoft of the ERP world, but it's MUCH biger
and you make more money) If it is SAP, it has all the tools for working with
it built in. I've never heard of a non-disclosure saying you can't mention
the software, unless you're working for a company that has headquarters in
N. Korea or Sudan :) If it's SAP, I'd like to work for your company just to
get my foot in the door of this lucrative career.

On Tue, Feb 24, 2009 at 3:53 PM, Peter Capazzi <Peter.Capazzi at tranzactis.com
> wrote:

>
> Hi Matt,
> Yes that's true, I was focusing on the Transforms, simply because that's
> where the bulk of my work is. The Extract and the Load would work with
> either cat or freetds/sqsh (to pull from SQL2000).
>
> Peter Capazzi wrote:
> > At our work place we use a software that has a pretty heavy price tag.
> > I'm actually not supposed to mention it by name. Anyway, the more I
> > work with and the more I learn about linux I see some similarities
> > between commands in linux and the functions in this application.
> >
> > I was wondering if there was a "poor man"s ETL engine that is simply a
>
> > front end to commands like these:
> > sort - sorting datasets on a field
> > join - merging data sets
> > cut - field selections/exclusions
> > cat - for input files
> > sed - To modify fields
> > grep - To filter
> > awk - To modify fields and partition datasets.
>
> Heh ... I think they call it "perl" :-D
>
> Seriously, though, I guess what you are looking for above is a lot of
> the "T" (transform); do you also need the "E" (extract) and "L" (load)
> as well?  Although I don't have any recommendations, perhaps that
> information can help guide others to suggest alternatives to what you
> currently have.
>
> Cheers
> Matt S
> LILUG Secretary
>
> _______________________________________________
> Lilug mailing list
> Lilug at lilug.org
> http://lists.lilug.org/listinfo.cgi/lilug-lilug.org
>



-- 
zu seinen Füßen
לפני שלו רגלים
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lilug.org/pipermail/lilug-lilug.org/attachments/20090225/695e148b/attachment-0003.htm>