How can i sort the data using reformat component in Abinitio?

And Tut

• Apr 13th, 2016

You can first create a vector using the rollup component and then use the vector_sort function in the reformat and then expand the vector using normalize. I hope this helps

gouse

• Jul 12th, 2015

Using next_in_sequence inreformat transform function

Answer Question  Select Best Answer

Using ROLLUP in Ab Initio, need to count the number of sites for each account e.g.

Input file:
SiteId, AcctId, Address
675765, 1, Smit Street
768768, 2, Orange Road
767876, 1, New Road
989898, 1, Jones Street
878787, 3, Ele Lodge
118768, 2, Red Street

Output:
AcctId, NoOfSites
1, 3
2, 2
3, 1

gouse

• May 26th, 2016

Rollup component key-acctid, no-of sites per accountid-count(acctid)

ahamed

• Mar 21st, 2016

Input file-->rollup{acctId}(input need not be sorted, out.acctid::in.acctid, out.count::count(in.siteId))-->Output file

Answer Question  Select Best Answer

I have a scenario like, I am getting a date field from input in MMDDYY format and I have to check for same year as processing year then I should pass "", else if the input date is to previous year to processing date and less than 0301 then I should pass Y.
How to check and process the date?

ahamed

• May 12th, 2016

Inputfile-->reformat-->outputfile
if((string_substring(in.indate),5,2)==string_substring(now(),5,2))""
else "Y";

mohankrishna

• Apr 8th, 2016

Use date function to get the current date and apply date_year function to get the processing year out of it. Do the same for input date to get the input year. If these two are equal set " " to output....

Answer Question  Select Best Answer

What are the date functions in Abinitio & How to check a file is not corrupted in Abinitio?

Arun Ramaswamy

• Dec 3rd, 2019

There are lots of date functions in abinitio.
For checking if a file is corrupted try reading the file with dml and do a is_valid on the fields.

KV

• Aug 27th, 2016

Date functions- now(), datetime_add(),date_month()

Answer Question  Select Best Answer

In which scenario, .rec files will not get created even if graph fails? How to use in Abinitio graph?

vijay

• Nov 14th, 2017

.rec files will be created only if you have checkpoints enabled in your graph.

Prakash Poongavanam

• Oct 14th, 2016

.rec file will not be created if you not enabled checkpoints in your graph. So even if it get failed the graph will start from the beginning as there is no .rec file in the $AI_RUN directory.

Answer Question  Select Best Answer

What is PDL? Explain with an example?

Anil

• Sep 25th, 2017

PDL is used for dynamic metadata injecting like DML into existing DML.

jaleel syed

• Jan 23rd, 2017

When you want the graph to behave dynamically, use PDL. ex: to add a dynamic field to the pre-defined DML

Answer Question  Select Best Answer

How to find corrupted record in multifile?

Monika Rani

• Aug 25th, 2017

M_dump dml file -show-partial -partition n

by giving value of n, check for each partition

Preetilagna Dash

• Aug 22nd, 2017

M_dump dml fileurl -show-partial

Answer Question  Select Best Answer

How to modify record in multifile if data is ASCCI and if data is Obserddata?

Mahesh

• May 26th, 2021

To check malformed records you can use m_dump -partial option.This option shows any incomplete records.Else run the graph and attach a reject and error port to see

SP

• Dec 11th, 2017

1. View data and get the malformed record using m_dump. Note down that record number(s). 2. Using Filter by Expression, deselect only that/those record(s). 3. Using Reformat, specify values manually...

Answer Question  Select Best Answer

How to delete a record from a multifile?

Sandeep

• Sep 10th, 2017

Linux command:
vi `m_expand -native file_name`
it will expand the control file and allow us to edit in all partition.

SP

• Jun 5th, 2017

a. Build a duplicate graph with the same logic that processes the file b. Select Never Abort for that component where a failure may occur. c. Arrange Reject port for that component and run the grap...

Answer Question  Select Best Answer

What is behavior of join with multifiles if I use Join via common key in both files and if the key is different what is the result?

swapnil5291

 Profile Answers by swapnil5291 Questions by swapnil5291

• May 12th, 2017

As per my understanding there will be two scenarios here, if multi-files are partitioned based don key to be joined upon then by join key with same data type it will produce normal join results depend...

• May 2nd, 2017

Use the override-key option in join parameter, but the key should be of same data type. It will perform as per join type you mentioned

Answer Question  Select Best Answer

What is the disadvantage of using multi-file if data volume is not much?

Jatin

• Apr 30th, 2018

1. When Graph starts there is time taken for start and shut down, so if data in multifile is not much use serial processing as over all time taken will not have any significant difference. 2. If mult...

Vinit

• Sep 26th, 2017

1. In multi files, there can be skew spillage due to imbalance in amount of CPU time
2. If data is not evenly partition, some of the partition can contain zero records and which will consume memory

Answer Question  Select Best Answer

What is Interpretation in Abinitio? What are types of interpretations available and its uses? Where do we use each interpretation?

Sandeep

• Mar 25th, 2018

Constant,$substitution,${}substitution,PDL

KV

• Mar 7th, 2018

Types of interpretation- PDL, Shell, Substitution

Answer Question  Select Best Answer

Explain what .air-lock file is?
What is the difference between .sandbox.pset and .project.pset and the need of .project-start.ksh and .project-end.ksh

Mahesh

• May 26th, 2021

Any changes required only at sandbox level are stored in sandbox.pset.So a parameter value for AI_FILE in project.pset will be overridden by sandbox.pset
.air-lock as the name suggests is a ab initio repository lock file created when a lock is applied on an object for changes.

Ashiq Aashu

• Jun 4th, 2018

Data from 1 column to be separated in multiple columns

Answer Question  Select Best Answer

How do I add Delimiter to a file which has text in the below format:
(There are multiple rows in the file like below row)
246631balacl1Lavanya Balachandran20120120R7891Unknown-1Unknown

Munni

• Sep 17th, 2018

Read the file using fixed length DML and use delimited DML at the output

PJ

• Apr 17th, 2018

But you havent mentioned where you want to add delimiters in given data

Answer Question  Select Best Answer

Give examples for pipeline, component and data parallelism

Prasanth

• Nov 17th, 2020

Pipeline: If the data is executing component by component is called pipeline parallelism. Remember sort component breaks pipeline parallelism. Component: If different data is executing in differ...

inamdnik

 Profile Answers by inamdnik Questions by inamdnik

• Jul 3rd, 2018

1. Pipeline Parallelism In pipeline parallelism, multiple components process data simultaneously. Each component in the pipeline continuously reads from upstream components, processes data, and wri...

Answer Question  Select Best Answer

Hi Experts,
I have to write the below floor function in reformat.
Floor(dp.lcl_Prod_cd/10)
The source column data type is string as shown {utf8 string("x01") lcl_prod_cd}, here column name is "lcl_Prod_cd ". now i have to apply the floor function on this like "Floor(dp.lcl_Prod_cd/10)". i was tried in different ways like i was changed target dml to decimal and tried as shown below....

Purva

• Oct 31st, 2019

Try using this:
out.lcl_prod_cd:: floor(decimal(10)in.lcl_prod_cd/10);

• Jul 4th, 2018

Hi Maheswari,
Can you please post the exact error. If it is type casting problem means you should convert input string value to decimal and then to integer, then it will work.

Let me know if am wrong.

Thanks,
Sivaramakrishna

Answer Question  Select Best Answer

How to add header and trailer in a file?
Header - column names
Trailer - count of the records

Mahesh

• May 26th, 2021

i/p file --> replicate --> 2 out ports -- one with data and secnd connected to rollup with no key and a count() function this gives the trailer record. Bring this flow back to a concat component as...

Suresh

• Mar 24th, 2020

There should be three input files created. one is Header file, second file is Body and the third file is the trailer. you should have three files connected to the concatenate component as inputs and it will produce the o/p file as expected.

Answer Question  Select Best Answer

I need to load a single load ready file in oracle table in chunks of 100 mb files. How to do that?

Mahesh

• May 26th, 2021

The intention here seems for a failure after 100 records, so besides breaking the file into 100 recs each, you can set the commit param to 100

Anu

• Jan 9th, 2020

What I would suggest is

1. Divide the file into 100 mb small files by using
Split -b Unix command

2. Then load the data into the table file by file

Answer Question  Select Best Answer

How can we fetch next record data for a particular field in ab initio?
i/p
id sal
101 500
102 800
103 900
105 200
o/p
id sal Next_sal
101 500 800
102 800 900
103 900 200
105 200 NULL

Ahmad Ali Quraishi

• Aug 12th, 2024

Step 1: Do the rollup on {} key out.id :: accumulation (in.id) out.amt :; accumulation(in.amt) Step 2: Do the normalization Length function Out :: length_of(in.amt) N...

Nishad P

• Feb 25th, 2024

use below flow, i/p -> reformat -> rollup -> normalize -> o/p reformat: add one more column with constant value out.id :: 1; out.* ::in.*; rollup : group the data based on column id created i...

Answer Question  Select Best Answer

sixto.dsilva

 Profile Answers by sixto.dsilva Questions by sixto.dsilva

• Jul 3rd, 2008

Rollup summarises the group of data records based on key eg you want the income of a particular city from a set of records , you can use the rollup component.example dml ...

sangee

• Nov 29th, 2006

Rollup summarize the group of data records.for eg: if we want the maximum value of the cust_id we will go for rollup.

Answer Question  Select Best Answer