What is phasing & checkpointing? What is the use ?

shan

• Oct 11th, 2012

For efficient graph management to channelize the priority of the outputs we use phases

coming to check points,we use them to consume time that takes while running graphs..

By placing checkpoints graph resumes to run from its earliest checkpoint.

prem.k

• Sep 6th, 2011

Phasing: Phasing in ab-initio means dividing the complex graphs into pieces. In order to improve the performance by reducing the resource utilization in different phases with in the same graph. Check...

Answer Question  Select Best Answer

shan

• Oct 11th, 2012

Temp file

PN Reddy

• Feb 7th, 2012

.rec file contains the information which is required to rollback the graph when it fails

Generally it will have some meta char information with hld and nld extension.

On failure we use to rollback using m_rollback to rollback the job to last committed check point.

Answer Question  Select Best Answer

my requirement

header contains - business date
details contains - reccords
trailler contains - total no of records in detail.
1) header , detail , trailer separation with indicator filed ( conditional dml with indicator field )
2)Comparing header with business date , if not match fail. ( using lookup with date function)
3)comparing the record count of...

raju

• Oct 9th, 2012

Input dataset---->dedup sort------> output file

In dedup sort component next_in_sequence > 1 then keep parameter make it as last. output port getting the trailer record, dedup port getting the detail records (if header, detail and trailer are in sequence)

Rushieksh Deshapnde

• Aug 30th, 2011

In Reformat have output index separate header,trailer and data based on it in transform 0 write xfr for matching business date using lookup expression for that use

Answer Question  Select Best Answer

raja

• Feb 9th, 2015

You can use the below the command to give form command.
air sandbox run / -parameter name

saneesh

• Nov 3rd, 2013

There is a small correction for the above command. You also should mention the PSET or SBOX for which you are adding the parameter

air sandbox parameter [ pset | sbox ] parameter [ interpretation ] [ value ] [ flag ]

Answer Question  Select Best Answer

sathish18

• Aug 8th, 2015

When we invoke the script for the first time, the jobname is determined from graph or pset or plan name and the mp job command is invoked to create jobname.job file. So basically the job files is the ...

Shubh

• Feb 5th, 2015

.job file is a catalog file which is created as the same name of graph with extension of .job and it calls launcher which initiates process

Answer Question  Select Best Answer

kalyanvadlamudi2kn

 Profile Answers by kalyanvadlamudi2kn Questions by kalyanvadlamudi2kn

• Jan 9th, 2014

You have to use include in thXFR. We define all the common functions like strip blanks,format date etc., in a common xfr and can be used environment wide.

RAM

• Aug 17th, 2012

By the use of common xfr & by the use of include option

Answer Question  Select Best Answer

What is the difference between m_mkfs and m_touch.
Both create a MFS how do they differ ?
Also what is the syntax for creating MFS using m_touch

balu

• Oct 6th, 2012

M_mkfs: to create a multifie system
m_touch: to create a empty file system

RAM

• Aug 17th, 2012

M_mkfs will creates a multifile system
M_touch will creates empty multifile

Answer Question  Select Best Answer

If I run the graph at 9 O'clock, it should pick the data with the latest updated timestamp records like from 8 to 9 O'clock updated records from the table. How to pick the delta data from specific files or tables?

Mahesh

• May 26th, 2021

1 - if its a table it should have a column with timestamp and accordingly you filter out the records
2 - if its a file again if there is a timestamp column its easier, else read the file and look it up and join on key and timestamp, anything that does not join is new.

irfan1patel1

 Profile Answers by irfan1patel1 Questions by irfan1patel1

• Jun 19th, 2017

You will definitely need a column in file or table which has the update timestamp. Based on timestamp you can simply filter the records using filter by expression

Answer Question  Select Best Answer

How to find a corrupted record in Multi file and how to correct the data if you know the correct value?

MJ

• Jul 4th, 2017

Considering scenario that record is not matching with metadata, thus it is bad, then you can find out it by using below method:-

m_dump

You will get record which is not matching with metadata & that will be faulty record

Vinit Singh Sheokand

• Jun 30th, 2017

This can be possible using m_dump with argument -show-partial

Answer Question  Select Best Answer

If a file contains 100 records and in that 5 depts. If I use rollup to process that file, How many time rollup will be called and how many times finalize will be called?

Ravi Kiran

• May 24th, 2017

Rollup will be called 100 times and finalize will be called 5 times if dept is the key

Bhuvana

• Mar 2nd, 2017

If the dept is used as key in the rollup then rollup function will be called 100 times and finalize function will be called 5 times (once for each group).

Answer Question  Select Best Answer

How to use rollup Component as Scan Component? On what condition Rollup component can be used as SCAN?

Jatin

• Apr 30th, 2018

Rollup will produce same number of columns as scan only in case when all the columns are selected as rollup key

Speedy

• Sep 22nd, 2017

As per my understanding, we cannot use rollup component as a scan component. The reason for this is Scan gets the cumulative data and can process the same number of output records as the number of inp...

Answer Question  Select Best Answer

Sort within group means data is already sorted on major keys and need to get the data sorted on minor keys.But if we already know tht the data is sorted on major keys then why donot we use SORT component and provide the key as {minor keys} in the SORT component? Why go for SORT WITHIN GROUPS

Ashish

• Oct 4th, 2020

As it will re-sort the data on the y key given ignoring the existing sort order

Aravind

• Sep 13th, 2020

When we use the already sorted data(based on field 1) to sort again with field 2 as you say, then the output will only be sorted with Field 2. In case of sort within groups, we will provide field 1 as...

Answer Question  Select Best Answer

JYOTI

• Dec 31st, 2017

Pipeline parallelism Data is pushed from component to component, via OS pipes, avoiding writing to disk. Component Parallelism Within the same flow, different sub-flows can execute at the same time...

sixtodsilva

• Sep 18th, 2007

Three kind of parallelisms1.Component Level Parallelism --> different components acting on different data at same time.2.Data Parallelism --> A graph that deals with data divided into segments a...

Answer Question  Select Best Answer

nithui

 Profile Answers by nithui Questions by nithui

• Mar 11th, 2009

1. It is used to increases the performance of the application. Because when we create Store procedure, they are compiled and stored in database. Later when applications call them, they are general...

sreyas kvm

 Profile Answers by sreyas kvm Questions by sreyas kvm

• Feb 9th, 2008

Stored procedure is a pre-compiled execution block,so they do not want to wait as the time for compilation.It is call from the server.It reduce the execution time

Answer Question  Select Best Answer

ashish jain

• Mar 1st, 2015

Hi Mohan, EME stands for Enterprose Metadata Environment. in newer version of Abinitio , EME is divided into two parts 1. Technical Repository 2. Metadata Hub Sandbox is a place where a developer...

mohan

• Feb 15th, 2015

What is the difference EME and sandbox in ab initio?

Answer Question  Select Best Answer

Nikhil

• Aug 19th, 2015

How can we integrate Ab Initio with Jenkins. Have you done anything like that or read about it. I want to integrate them.

robbyuk

 Profile Answers by robbyuk Questions by robbyuk

• Mar 27th, 2013

Hi All,

I appreciate I am a late entry for this question. I think tools like Jenkins can be used for Ab Initio automation test harness. Please correct if I am wrong.

Answer Question  Select Best Answer

How to remove Header and Trailer records from a file using abinitio components?

arnab ghosh

• Feb 22nd, 2012

Use Unix SED #--------------------------------------------------------------# # This line removes both the header and the trailer record #----------------------------------------------------------...

nagarjuna

• Jul 22nd, 2011

You cam redefine format, Filter by expression & Run program components.

Answer Question  Select Best Answer

arunsin

 Profile Answers by arunsin Questions by arunsin

• Mar 13th, 2011

Adding to all the point mentioned by others -- Thumb Rule is to prefer componet solution to a problem compared to logical solution.- Use Oracle hints and Ab Initio Hints (ABLOCAL utility for lower ora...

aditya_kundu

 Profile Answers by aditya_kundu Questions by aditya_kundu

• Sep 18th, 2010

I would like to add couple of more points to the already given explanations:1. Try to use lookups for joining instead of join if you have huge no. of records in one flow and relatively less no. of rec...

Answer Question  Select Best Answer

sixto.dsilva

 Profile Answers by sixto.dsilva Questions by sixto.dsilva

• Apr 21st, 2008

Limit  parameter contain an interger that represents a number of reject eventsthe ramp parameter contains a real number that represents a rate of reject events in the number of records processed. 

sangee

• Nov 29th, 2006

We will go for ramp limit to set the reject threshold for the record being processed.

Answer Question  Select Best Answer

PeeD1

 Profile Answers by PeeD1 Questions by PeeD1

• Apr 16th, 2009

When there are duplicate keys in either or all of the joined datasets the result is a cartesion product. This is termed as Cartesian Join in Abinitio.Eg:If there are two input datasets for a join func...

surabhiraghu

 Profile Answers by surabhiraghu Questions by surabhiraghu

• Jan 3rd, 2008

 join two tables without join key , that is crossproduct.

Answer Question  Select Best Answer