How to get each partition count and total count of a multi file?

Mahesh

• May 26th, 2021

M_wc gives you the number of records in all the partitions and als a total at the bottom

Shubham

• Sep 18th, 2019

Reverse the Command... m_wc

Answer Question  Select Best Answer

How to modify record in multifile if data is ASCCI and if data is Obserddata?

Mahesh

• May 26th, 2021

To check malformed records you can use m_dump -partial option.This option shows any incomplete records.Else run the graph and attach a reject and error port to see

SP

• Dec 11th, 2017

1. View data and get the malformed record using m_dump. Note down that record number(s). 2. Using Filter by Expression, deselect only that/those record(s). 3. Using Reformat, specify values manually...

Answer Question  Select Best Answer

How to Split a 10 GB file into 10 files of 1 GB in Ab initio?

Mahesh

• May 26th, 2021

Use write multiple files component or create m_mkfs with 10 partition layout. Write data into that file with broadcast component, but might get 10 files in mkfs

Arun Ramaswamy

• Dec 9th, 2019

Why don't we use write multi files and take a approx rec space and do a split based on that.

Or keep as void of one and spilt when you write 1024*1024*1024*8.

Answer Question  Select Best Answer

I have a 4way mfs. I connected to rollup, i have mentioned key as null. How many records will come to output?

Mahesh

• May 26th, 2021

4 records, 1 per partition as rollup with be working in a component parallelism. So in the background there will be 4 processes each for a partition on which the component works.Hence 4.The question no where mentions there is a fan in happening anywhere.

Amaan Sajid Ansari

• Nov 14th, 2018

You have to understand how roll-up works, it makes group of records based on the key, If the key is null it considers all the record in a partition as one so it will throw 1 record per number of partition. In your case Its 4

Answer Question  Select Best Answer

How to add header and trailer in a file?
Header - column names
Trailer - count of the records

Mahesh

• May 26th, 2021

i/p file --> replicate --> 2 out ports -- one with data and secnd connected to rollup with no key and a count() function this gives the trailer record. Bring this flow back to a concat component as...

Suresh

• Mar 24th, 2020

There should be three input files created. one is Header file, second file is Body and the third file is the trailer. you should have three files connected to the concatenate component as inputs and it will produce the o/p file as expected.

Answer Question  Select Best Answer

I need to load a single load ready file in oracle table in chunks of 100 mb files. How to do that?

Mahesh

• May 26th, 2021

The intention here seems for a failure after 100 records, so besides breaking the file into 100 recs each, you can set the commit param to 100

Anu

• Jan 9th, 2020

What I would suggest is

1. Divide the file into 100 mb small files by using
Split -b Unix command

2. Then load the data into the table file by file

Answer Question  Select Best Answer

How to print the position of the char in a given word

I have a input like:
Column_name:
Indicator
YNNYYN
NNNYYN
YYYYYN
NNNNNN

REQUIRED O/P:
Where the Y is present in a given string, i want position of the string with CONCATENATE of P Letter.

o/p:
P1
P4
P5
P4
P5
P1
P2
P3

shivank b

• Apr 4th, 2021

The simplest solution would be using reformat with below function.
out.data :: string_concat("P",(decimal(1))string_index(in.column_name,"Y"))

Regards,
Shivank B

RR

• Jan 22nd, 2021

How do you define the output format of Reformat here?

Answer Question  Select Best Answer

In my sandbox i am having 10 graphs, i checked-in those graphs into EME. Again i checked-out the graph and i do the modifications, i found out the modifications was wrong. what i have to do if i want to get the original graph..?

Amruta

• Jan 9th, 2021

Do revert changes...
Another option is to checked out previous version of object from eme

Jatin Chawla

• Sep 21st, 2020

Air object rollback to rollback to previous version

Answer Question  Select Best Answer

Amruta

• Jan 9th, 2021

What I am thinking is to sort the data 1st and then use scan component--Give key and define temp variable which will generate sequence per group.....in output select seq number as 1...This will reduce duplicates and give distinct record at output

karti

• Aug 31st, 2020

It works if input is like below only
i/p
1
1
2
2
2
3
3

Answer Question  Select Best Answer

Give examples for pipeline, component and data parallelism

Prasanth

• Nov 17th, 2020

Pipeline: If the data is executing component by component is called pipeline parallelism. Remember sort component breaks pipeline parallelism. Component: If different data is executing in differ...

inamdnik

 Profile Answers by inamdnik Questions by inamdnik

• Jul 3rd, 2018

1. Pipeline Parallelism In pipeline parallelism, multiple components process data simultaneously. Each component in the pipeline continuously reads from upstream components, processes data, and wri...

Answer Question  Select Best Answer

I have 400 records in my in0 file, its 4-way multifile system. How can I find out particular 150th record will goes to which partition using Partition by Key?

Sjn

• Nov 26th, 2020

Hash_value(this_record,key)% no. of output partition = no of output partition for this record

kumar

• Oct 2nd, 2012

Yes, exactly, we can find out by using hash formula.

Answer Question  Select Best Answer

Sort within group means data is already sorted on major keys and need to get the data sorted on minor keys.But if we already know tht the data is sorted on major keys then why donot we use SORT component and provide the key as {minor keys} in the SORT component? Why go for SORT WITHIN GROUPS

Ashish

• Oct 4th, 2020

As it will re-sort the data on the y key given ignoring the existing sort order

Aravind

• Sep 13th, 2020

When we use the already sorted data(based on field 1) to sort again with field 2 as you say, then the output will only be sorted with Field 2. In case of sort within groups, we will provide field 1 as...

Answer Question  Select Best Answer

In input dataset i am having 100 records. I want records between 50-75 and i don't want to read 5th record? which component i have to use..

Krishna

• Aug 21st, 2020

What if we use (next_in_sequence() >=50 and invocation_number()

Shikha

• Mar 15th, 2020

You can use filter by expression in 1st FBE put condition
next_in_sequence() >=50 and invocation_number()

Answer Question  Select Best Answer

Hi,

How can I configure email notification for any graph failure with error and compnent details which caused the failure in AB Initio

NicoRobin

• Jul 8th, 2020

You can use $mpjret variable in the end script which returns the status of the graph as below:-
if [$mpjret -eq 0]
then echo "successful execution"
else
mailx -s [graph name] failed mail-id

Rahul Rasal

• Jan 17th, 2018

By using RUN component you can write script with mail utility.
Thanks ...!

Answer Question  Select Best Answer

What is the alternate component for output indexes?

Manish Sharma

• Jul 8th, 2020

We can achieve it by combing replicate and filter by expression.

Rishiraj Shengule

• Jul 28th, 2016

Filter By expression is also an alternate option

Answer Question  Select Best Answer

I have an XML file with all the details of an employee. I just want to mask the firstname and lastname records as AAAA and generate the XML with all other fields including firstname and lastname. Please suggest on this

Ajanth

• Feb 19th, 2020

Read xml-->reformat (concat(masked chars+substr(name))-->write xml

Answer Question  Select Best Answer

Why and When do we get the "Pipeline Broken Error" in Ab Initio

Alok S

• Jan 17th, 2020

When total number of process in a unix box connecting to a particular user reaches the limit, it throws the error "pipeline broken". Which means no more connection to the user can be made. So wait for sometime and re-login.

cutesree

 Profile Answers by cutesree Questions by cutesree

• Dec 29th, 2009

Pipeline broken error will actually indicates the?failure of a downstream component.It normally occurs when the database is?running out of memory?which makes?database components in the graph unavailable.

Answer Question  Select Best Answer

I have already created graph,and need to modify it so that output file gets page breaks. Any idea how can we implement page breaks in abinitio.

Anu

• Jan 10th, 2020

Sed G filename

swarna

• Apr 10th, 2014

I think they mean inserting new line character in unix or
meaning carriage return in windows environment.

Answer Question  Select Best Answer

What are the date functions in Abinitio & How to check a file is not corrupted in Abinitio?

Arun Ramaswamy

• Dec 3rd, 2019

There are lots of date functions in abinitio.
For checking if a file is corrupted try reading the file with dml and do a is_valid on the fields.

KV

• Aug 27th, 2016

Date functions- now(), datetime_add(),date_month()

Answer Question  Select Best Answer

Hi Experts,
I have to write the below floor function in reformat.
Floor(dp.lcl_Prod_cd/10)
The source column data type is string as shown {utf8 string("x01") lcl_prod_cd}, here column name is "lcl_Prod_cd ". now i have to apply the floor function on this like "Floor(dp.lcl_Prod_cd/10)". i was tried in different ways like i was changed target dml to decimal and tried as shown below....

Purva

• Oct 31st, 2019

Try using this:
out.lcl_prod_cd:: floor(decimal(10)in.lcl_prod_cd/10);

• Jul 4th, 2018

Hi Maheswari,
Can you please post the exact error. If it is type casting problem means you should convert input string value to decimal and then to integer, then it will work.

Let me know if am wrong.

Thanks,
Sivaramakrishna

Answer Question  Select Best Answer