How to Join Data from Two Partitions of a Multifile in Abinitio..!

Hi,
I have a multifile having 8 partitions.
I want to join partition 1 and partition4 data.
Could someone explain the approach for the above requirement?

Thanks in advance,
Srikanth

Devendra Majhi

• Mar 19th, 2016

Use PBE to get partition 1 and 4 in seperate flows using this_partition=1 nd 4. Then use join

irfan

• Jan 13th, 2016

I guess, you should use this flow i/p -> FBE(this_partition() ==4 -> JOIN

Answer Question  Select Best Answer

How can I achieve cummulative sumary in AB Initio other than using SCAN component. Is there any inbuilt function available for that?

mk_44

 Profile Answers by mk_44 Questions by mk_44

• Feb 9th, 2016

I guess below code can help for 3rd max else 1st max for each group key. Input_file --> sort (descending) --> Rollup --> output type temporary_type=record decimal("") rank ; decimal("") sal ...

disha

• Jan 22nd, 2016

@Dinesh: but it is not taking care of the requirement, i.e. if there is no 3rd record, it should display the first highest sal. In the solution you mentioned it will display the second highest sal.

Answer Question  Select Best Answer

How to generate sequence number in a multifile using next_in_sequence().

Sachin

• Feb 3rd, 2016

Next_in_sequence()*(this_partition()+1)

srinivasareddy

• Jul 21st, 2015

hi I think this will be help you if the mfs is 4-way if (this_partition() == 0)((next_in_sequence()-1))+this_partition()+1 else if (this_partition() == 1) ((next_in_sequence()-1))+this_partition(...

Answer Question  Select Best Answer

I have a serial graph with below sequence:
i/p -> sort(key1)->rollup(key1)->sort(key2)->rollup(key2)->normalise->o/p.

How do we improvise this graph?

gouse

• Nov 20th, 2015

By reducing number of sort components

raja

• Feb 10th, 2015

It depends on your input data.If you specify some of your input data will be more helpful. My suggestion is instead of using two roll up and two sort keys try to use it only one rollup with key1 and key2

Answer Question  Select Best Answer

If you have one input file it have some thousands of records then how to Seperating the header and trailor records from the input file?

gouse

• Nov 1st, 2015

Record identifier with reformat or deduo sort or filter by expression.

Sagar Sali

• May 14th, 2015

1) If the header and trailor is denoted by some special separator like H or T, you can use filter by expression and condition like (rec_type != "H" and rec_type != T")

2) You can use 2 dedup component and in first comp, keep first and next use comp, keep last, so u can separate.

Answer Question  Select Best Answer

Himanshu Poddar

• Sep 23rd, 2015

What is the Ab Initio certification name for beginner?

ashutosh ojha

• Jan 9th, 2007

No it is not true they indeed offer certification and the cost is 1200$ .

Answer Question  Select Best Answer

Nikhil

• Aug 19th, 2015

How can we integrate Ab Initio with Jenkins. Have you done anything like that or read about it. I want to integrate them.

robbyuk

 Profile Answers by robbyuk Questions by robbyuk

• Mar 27th, 2013

Hi All,

I appreciate I am a late entry for this question. I think tools like Jenkins can be used for Ab Initio automation test harness. Please correct if I am wrong.

Answer Question  Select Best Answer

sathish18

• Aug 8th, 2015

When we invoke the script for the first time, the jobname is determined from graph or pset or plan name and the mp job command is invoked to create jobname.job file. So basically the job files is the ...

Shubh

• Feb 5th, 2015

.job file is a catalog file which is created as the same name of graph with extension of .job and it calls launcher which initiates process

Answer Question  Select Best Answer

Could you please explain me in details differences between Multi File s and Adhoc Files ?

Thanks in Advance.

gouse chpet

• Jul 15th, 2015

Collection of individual files is known as multifiles.
m_mkfs < control partition >< data partition >......

Collection of individual files having same dml is known as adhoc multi files.

anuvardhan

• May 18th, 2015

Collection of files is known as multifile.
collection of files having same dml function is known Adoc multifile

Answer Question  Select Best Answer

I have 10 million records in one file, if I develop a graph with this file, it takes more time to be executed, but I want to decrease the execution time. How can you proceed?

Jerry

• Jun 26th, 2015

You may use the following performance improvement techniques depending on the situation: 1. You may convert the serial file to multifile system using a partition by key, if it is a serial file. 2. Y...

Rajesh Matcha

• Jun 10th, 2015

You have not mentioned that whether your graph is a serial graph or a parallel graph , If it is serial make it parallel as soon as possible , if you are doing some specific business rules ..filter th...

Answer Question  Select Best Answer

a) Using a rollup,how many records will you get?
b) How can I get more than 100 records?
c) How can I get 1 record?

Bibhu Prasad Behera

• May 30th, 2015

A. Using Rollup ,you can get 100 or less than 100 records.(depending upon the key )
b.Use normalize to get more than 100 records.
c.Use Rollup with null key.

tanay

• May 24th, 2015

Using roll up on null key can give you one record.

Answer Question  Select Best Answer

Suhail

• May 27th, 2015

${} substitution is similar to $ substitution except that the parameter must be preceded by curly brackets. If we talk about these in parameter definitions then - 1. If the interpretation is $ subst...

Answer Question  Select Best Answer

How to find the schema either Star or Snowflake Schema in our project?

kishore

• May 4th, 2015

Based on joins between fact table and dimension tables

Answer Question  Select Best Answer

With open a graph how should we know how many input files are using in that graph?

Rahul

• Apr 7th, 2015

Hi Puneet its asking for object relative path...Could you please elaborate a little bit.

puneetdking

 Profile Answers by puneetdking Questions by puneetdking

• Sep 30th, 2011

there is one air command that can help you - air project get-required-file == This command finds and displays the files in a project that the specified object(s) depends on. This command is branch-sp...

Answer Question  Select Best Answer

Munmun

• Mar 31st, 2015

Air sandbox have many options. Each are having different use.

Such as air sandbox run will run graph pset plan

air sandbox show-common will show the included common sandboxes.

shan88

• Dec 21st, 2012

Air sandbox commands are used to run a graph,pset from the Unix

Answer Question  Select Best Answer

ashish jain

• Mar 1st, 2015

Hi Mohan, EME stands for Enterprose Metadata Environment. in newer version of Abinitio , EME is divided into two parts 1. Technical Repository 2. Metadata Hub Sandbox is a place where a developer...

mohan

• Feb 15th, 2015

What is the difference EME and sandbox in ab initio?

Answer Question  Select Best Answer

If a graph fails in between loading 1 millon records to a target table what is the alternative solution? I.e Will you run the grarh again? (The record count is very huge)

Raja

• Feb 10th, 2015

Its better to use check points and commit number in table to commit set of records before failing the graph

shan

• Oct 11th, 2012

Use checkpoints and partitions

Answer Question  Select Best Answer

How does force_error function work ? If we set never abort in reformat , will force_error stop the graph or will it continue to process the next set of records ?

raja

• Feb 9th, 2015

Force_error function will not throw any error when we keep the reject threshold as never abort. but it will reject all unwanted records per requirement and will provide you the message.

shan88

 Profile Answers by shan88 Questions by shan88

• Oct 22nd, 2013

Force error displays the error message upon the failure of the graph,as u r placing never abort, no failure,so no force error.

Answer Question  Select Best Answer

raja

• Feb 9th, 2015

You can use the below the command to give form command.
air sandbox run / -parameter name

saneesh

• Nov 3rd, 2013

There is a small correction for the above command. You also should mention the PSET or SBOX for which you are adding the parameter

air sandbox parameter [ pset | sbox ] parameter [ interpretation ] [ value ] [ flag ]

Answer Question  Select Best Answer

raja

• Feb 9th, 2015

You can keep the reformat reject threshold as never abort or
if you know for which column it is coming invalid ,we can use is_valid function and provide some default values

Harpreet Singh

• Jul 1st, 2013

Set the reject threshold to "Never Abort" and capture all data rejects in a file

Answer Question  Select Best Answer