-
What is data skew? how can you eliminate data skew while i am using partitiion by key?
hsevna
- May 15th, 2008
The skew of a data or flow partition is the amount by which its size deviates from the average partition size, expressed as a percentage of the largest partition:Skew of data =(partition size - avg.partition size)*100/(size of largest partition)
dontbuckme
- Sep 22nd, 2006
data not evenly partitioned. PBE uses hash function. choose the key that has the most distinct values might improve the data being distributed evenly.
-
Can anyone please explain with example how does m_mkfs command work to create MFS? What is its syntax?
anil
- May 21st, 2012
Hi,In abinitio we can create mfs with this command press F8 write the m_mkfs pathnamefilename
vijay_kramarao
- Oct 30th, 2006
Syntax: m_mkfs <name of the control partion> <URL of the first partion> <URL of the second partion> <URL of the third partion>....... Eg: m_mkfs controlpartion c:abin...
-
Where we keep the control file (controle partition)
sham2sushil
- Dec 16th, 2009
Ab Initio multifiles present in parallel directories called multidirectories, which are present into multifile systemsThe multidirectories contain the control file (controle partition) and data directory.-Shambhu
shashi_dhar
- Feb 19th, 2007
Control should present in the multifile directory, which contains the address of the serial files
-
-
-
How can we achieve scrubbing or data validation thru AB INITIO.I know that by using is_valid function in validate record component we can check the values of the fields to be consistent with the data type specified in the record format.Is there any other methods available. PLease someone explain with examples.
mahendra patnaik
- Feb 1st, 2007
Hi,you can achive this by using one component called record validation... it will use only if u want to validate the input record... if you want to validate field lavel values then there are some func...
Abinitio Geek
- Jan 27th, 2007
What exactly is your requirement? Can you specify that, as there are various other functions available apart from the more common ones like is_valid(as you had mentioned), is_null, is_blank and is_defined. Besides which, there are comparison operators available like any other programming language.
-
How to create SCDs(slowly changing dimensions) in abinitio?
abmaahi
- Apr 6th, 2010
Scds means its slowly changing dimension in sizes like int to long data types. we will work out scds with delta processing or redefining the formats by redefine format. thats it .dont take tension any more dont get confuse.
biyyanimv
- Mar 8th, 2009
If you want to implement the SCDs in abinitio then you should do the delta processing
-
What is main path and structure of abinitio?
sixto.dsilva
- Aug 15th, 2008
Main paths in Ab initio environment are AB_HOME , specifiec the directory where the co>operating system is installed. This need only be set for those hosts for which the installation directory is diff...
sixto.dsilva
- Apr 17th, 2008
I think the main thing in above is AB_HOME , AB_AIR_ROOT , then sandboxes , standard environment. you need to be specific as what you want in this question.
-
Explain about deadlock in Abinitio
sixto.dsilva
- Apr 17th, 2008
As explained in above answer that when two or more processes are requesting for one singel resource , that time deadlock can occur.in Ab initio deadlock is avoided by using phasing and also by using the resource pool.
varma
- Nov 22nd, 2007
When 2 or more processors are requested for the one single processor, that time deadlock situvation is occured.
-
Abinitio Bad-Straight-flow
When did we get error like 'Bad-Straight-flow'?
sixto.dsilva
- Apr 15th, 2008
It is error you get when there is mismatch in flow that is one is serial flow and other componet is mfs flow , the ab initio will complain about the bad flow and graph is will be aborted because of this. you should be using the partition component in order to avoid this.
rcoon7
- Mar 10th, 2008
Layouts problems in components. e.g. a straight flow connecting a component which is having serial layout with a component which is in muti-file layout.
-
Abinitio Partitions
What is the difference between partition, re-partition and departition?
sixto.dsilva
- Apr 15th, 2008
Partition is coverting a serial file(mfs) into multiple flows --> component used is partition by key or partition by round robin.departition is opposite of partition , sometime after the parallel processing , you want output to be serialized we using gather and merge component for this.
rcoon7
- Mar 10th, 2008
Dividing a single flow of records(data) into multiple flows is known as partitioning.Dividing a x-way flows of records(data) into y-way flows is known as re-partitioning.e.g: 2 ways flow ino 4 ways flowCombining multiple flows into a single flow of records(data) is known as departitioning.
-
Memory requirement of graph
How can I calculate the total memory requirement of a graph?
robmuza
- Jul 10th, 2008
When we did some benchmarking we found that it was closer to ~8MB + MAX_CORE (if any) per component and add in the file sizes.Basically, I agree with the existing answer.Just remember, don't use &...
dhanoo_p
- Jun 23rd, 2008
You can roughly calculate memory requirement as:1. Each partition of a component uses: ~ 7 MB + max-core (if any) 2. Add size of lookup files used in phase (if multiple compon...
-
Ab_job Command
What is use of Ab_job command in Abinitio?
annegrace1
- Apr 6th, 2009
When you want to run the same instance of the graph many times which is palced in one place then we go for AB_JOB. its should be defined in sandbox parameter. If you dont give the value for it it will take AB_JOB as default
er_jyoti028
- Nov 27th, 2008
AB_JOB parameter is set when we want to run the same graph at the same time for different job names.
-
Output Index
What is output index? How does it work in reformat?Does below function show Output index in useoutput:1:if(in.emp.sal
ahamed
- May 24th, 2016
If you want to send one input record to only one output port we can use the output index
geekrohit
- Jul 14th, 2009
Output index function is used in reformat having multiple output ports to direct which record goes to which out port. for eg. for a reformat with 3 out ports such a function could be likeif (value==&#...
-
Append Records
How do we append records to an already existing file usin abinitio graph?
abmaahi
- Apr 2nd, 2010
if you want to append the record to same out put file just go to acess in properties window there you will find the option s uncheck the option "delete file if tits exit" and check the...
Mihira Barik
- Nov 9th, 2009
Create a graph by taking the existing file as?the out put file and keep the mode of the output file in Append Mode. Pass the?new records from the input file?to this?output file through a?reformat. This will append new?records in the existing File.
-
Behaviour of Component in Differnt Version
How will you ensure that the components created in one version do not malfunction/cease functioning in other version?
abhi_fresh_as_dew
- Feb 3rd, 2010
Components should be compatibile to run in previous versions of GDE. The depreciated components would run in new versions.
bhangale_kishor
- Dec 29th, 2009
Runtime behaviour of components will remain same in all versions unless its requires to have any additional paramter to be defined in any version. Evolution of new version of ETL comes with some changes in component level parameters (observation as of now).
-
Record counts by Reformat Component
How to calculate the total number of records in the file using REFORMAT instead of ROLLUP?
biyyanimv
- Dec 29th, 2009
Connect reformat to log port and use this code and in select parameter specify event_type="finish"type reformat_final_msg = recorddecimal("records") read_count; string("readn&...
-
Order of Graph Execution
What is the order of execution of a graph when it runs?
Divya Sama
- Dec 14th, 2009
1. Initialisation of Parameters2. Start script execution3. Graph execution4. End script execution
shivhare.pankaj
- Nov 17th, 2009
1. All its parameters are initialized2. Start script call3. Graph start4. End script executed.
-
Compilation Errors
What are the compilation errors you came across while executing your graphs?
hsevna
- May 18th, 2010
If fan-in is used to the input flow of a Roll-up component, you will get a complilation error, though sort rquired is set false to the Roll-up.Correct me if i'm wrong.--Anvesh V.
sham2sushil
- May 7th, 2010
Scenario 1: When you built any graphs with Abinitio component, but the output DML is not same with the next component input port DML, then you will get the compilation errors. Scenario 2: Suppose...
-
Broadcast Vs Replicate
What is the functional difference between Replicate and Broadcast component?
sham2sushil
- Oct 26th, 2010
In General:Broadcast : Data parallelism.Replicate : Component parallelism.--Shambhu
abmaahi
- Jul 19th, 2010
1) Basic difference is broad caste is partition component and replicate is miscelleanous component.2) As broad cast is partition component it always defaultly throw in a fan out mode only where ...
Abinitio Interview Questions
Ans