What are the different Debug stages available in Datastage PX?

Amritendra kumar

 Profile Answers by Amritendra kumar Questions by Amritendra kumar

• Feb 22nd, 2008

Head, tail, rowgenerator,columngenerator,peek,sample, write range map .

pradeep.dwh

 Profile Answers by pradeep.dwh Questions by pradeep.dwh

• Jan 26th, 2008

head,tail,peak,rowgen,colgen

Answer Question  Select Best Answer

How to see the data in the Dataset in UNIX. What command we have to use to see the data in Dataset in UNIX?

karn khera

• Feb 23rd, 2013

The command which must be used is orchadmin dump datasetname(without quotes). But before that run this command "cd `cat/.dshome`dsenv" without quotes. The reason is: cd `cat/.dshome`-> This will cha...

Saravanan Mani

• Jun 20th, 2012

Orchadmin rm datasetname

Answer Question  Select Best Answer

in how many ways we can delete dataset? If a record is duplicated 3 times then how to get middle duplicated record? Is it advisable to use basic Tfr in Parallel jobs?

chhavis928

 Profile Answers by chhavis928 Questions by chhavis928

• Oct 9th, 2011

We can use filter stage here to get middle record from 3 duplicate records.

srkreddy111

• Aug 12th, 2011

First you have to open the data set and click on the partitioning and after click hash partition and next click perform sort after click on unique and after ok and after compile and run the job.open the target output,the duplicate records are removed..

Answer Question  Select Best Answer

how to fetch the last row from a particular column.. Input file may be sequential file...

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

There are multiple ways to do this, given that input is a sequential file. Two of them are

1. Use "Filter" option available in Seq file stage. Specify a unix command like: tail -1 (recommended)

2. Use a tail stage next to Seq filestage and then specify.

Akil

• Apr 1st, 2013

There are 2 ways to fetch the last row of any file if the number of records in the file is not known before run time:

1) Use the tail stage and run the tail stage in sequential mode
2) Use the lastrow() function in the transformer stage

Answer Question  Select Best Answer

How you will call shell scripts in sequencers in datastage

nikhilanshuman

 Profile Answers by nikhilanshuman Questions by nikhilanshuman

• Dec 25th, 2009

Tina-Shell scripts can be called from the execute command activity of a job sequence.

nikhilanshuman

 Profile Answers by nikhilanshuman Questions by nikhilanshuman

• Dec 11th, 2009

"Execute command activity " is used to run a command from Unix.bash /path of script/scriptname.sh is also a unix command.hence it can also be called from Execute command activity of a job sequence.

Answer Question  Select Best Answer

What are these terms used for in Datastage - Downstream and Upstream?

kamal

• Apr 22nd, 2016

We can interpret Upstream as some thing flowing up like extracting data from source systems(similarly like extracting water from well) and downstream as data flowing into (like water flowing into canal).

mohan

• May 17th, 2013

Upstream means data channel from source system to ETL.
there are verity of source system (RDBMS, Flat Files, XML, ODBC).this data is integrated by ETL.this is input to ETL.
same as upstream.

Downstream means data generated from ETL.

Answer Question  Select Best Answer

With a Lookup stage the input stage has 1million records and reference link has 1million records. What is the best Partition method and why?

Kumar Shourav

 Profile Answers by Kumar Shourav Questions by Kumar Shourav

• Oct 24th, 2009

Better to use JOIN or MERGE stage in place of Lookup. If input data is low in compare to reference data then Lookup is recommendable. Assumption is 1:100 or more.

gopalanrr

 Profile Answers by gopalanrr Questions by gopalanrr

• Mar 27th, 2009

When the reference link is too high in terms of records fetched, you should be performing a join instead of performing a lookup

Answer Question  Select Best Answer

What is data granularity? Explain.

Nutan Raut

• Dec 15th, 2014

High level of detail-low level of granularity.& low level of detail-high level of granularity.

pari

• Apr 26th, 2014

Explain data granularity and how it is applicable to data ware house?

Answer Question  Select Best Answer

By using the Lookup stage we will combine the data from multiple table. By using join stage also we will combine the data from multiple tables. Then what is the need of Lookup stage?

Venkat Poonati

 Profile Answers by Venkat Poonati Questions by Venkat Poonati

• Mar 29th, 2011

There are three things to consider here1.memory usage  As with joiner fewer rows has to be in memory at any time.This is not with lookup2.treating of rows with unmatched keys   Joiner w...

narra satish

 Profile Answers by narra satish Questions by narra satish

• Mar 21st, 2011

Join and lookup is differ in terms of memory usage. Join is light weight than lookup stage. Join stage won't use much system resources. While performing lookup will used more system resources. In case of lookup it fetch the whole data from refernce link into RAM memory and then it perform lookup.

Answer Question  Select Best Answer

What is job commit in Datastage?

If I am working on parallel jobs, how can I give this option(in each odbc satge) that commit should perform after specific number of records transaction.

Please help

RAJESH

• Sep 11th, 2011

Read Committed and arraysize u option in target ODBC stage.

Venkat Duvvuri

• Sep 9th, 2011

Hi Im not sure which version of datastage you r using..this is pretty much simple in Datastage8.5 by using DTS

Thanks n Regards
Venkat Duvvuri

Answer Question  Select Best Answer

How to get the dataset record count? with out using orchadmin command

Priyanka Sinha

• Mar 17th, 2016

1) The Datastage Designer GUI (also available Manager and Director) provides a mechanism to view and manage data sets. It can be invoked in Tools -> Data set management. 2) orchadmin command-line uti...

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

There are only two ways to this -

1. Use datastage dataset management utility[GUI].
2. Use orchadmin utility from commandline

Answer Question  Select Best Answer

How to improve the Performance Tuning any 5 points

Lalit

• Oct 6th, 2017

1)Set Proper configuration file
2)Handle null and duplicate values properly
3)Reduce number of transformers as much as possible
4)Do not take more than 20 stages in a perticuler job
5)Use Dataset stage instead of sequential file stage
6)Use join merge and lookup stages properly

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

Use Copy stage instead of a Transformer for simple operations like : placeholder between stages renaming Columns dropping Columns implicit (default) type Conversions USe Stage variab...

Answer Question  Select Best Answer

Sushils13

 Profile Answers by Sushils13 Questions by Sushils13

• Aug 20th, 2013

Oracle Call Interface (OCI), it is a set of low-level APIs used to interact with Oracle databases. It allows one to use operations like logon, execute, parss etc. using a C or C++ program.

Ramon

• Sep 22nd, 2011

It is your connectivity stage object to your database. Think of it as your db stage.

Answer Question  Select Best Answer

How can we retrieve the particular rows in dataset by using orchadmin command?

sunitha

• Nov 29th, 2013

Orchadmin dump -part 0 -n 17 -field name input.ds

Sushils13

 Profile Answers by Sushils13 Questions by Sushils13

• Aug 20th, 2013

$orchadmin dump [options] Sample.ds

options : -p period(N) : Lists every Nth record from each partition starting from first record.

Answer Question  Select Best Answer

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

It depends on the job design and requrement. When you specify SAME partitioning, datastage uses the partioing method defined in the previous stage and will not perform any partitioning in the current...

Muralidhar

• May 30th, 2013

Same partition.
The reason is it keeps the previous partition and send to output as it is.

Answer Question  Select Best Answer

Source is a flat file and has 200 records . These have to split across 4 outputs equally . 50 records in each .

The total number of records in the source may vary everyday ,according to the count records are to split equally at 4 outputs.

Could someone post an answer for this question.
Thanks

Vinay

• Mar 20th, 2015

We can use the split command in the Filter section of the Sequential

file stage:
Split -l 50 File.txt Segment
O/P: will give 4 files namely Segmentaa,Segmentab,Segmentac and Segmented each of 50 records.

Gandhi

• Jan 13th, 2015

Hi all,

Keep four files as output.Simply give modulus(col_name,4)=0 constraint for first file ,modulus(col_name,4)=1 second file and modulus(col_name,4)=2 for third file and finally modulus(col_name,4)=3

Answer Question  Select Best Answer

INPUT:

SOURCE DESTINATION DISTANCE(KM)

HYD CHN 500
CHN HYD 500
BANG HYD 600
HYD BANG 600
PUN HYD 750
HYD PUN 750

OUTPUT :

Rudra

• Feb 9th, 2016

Source->Transformer Stage -> Target
In transformer use 2 stage variables. Use hash Partition in the source and select key field and select sort option only. STG1 -> if stg2= keyfield then 1 else 0
stg2 - keyfield
Then in filter put condition stg1=0

Ram

• Feb 5th, 2016

Simple:
Source --> Sort (key distance) --> RD (retains 1st occuance) --> Target

Please let me know if it is not work.

Answer Question  Select Best Answer

Solve in Datastage

Input:

col1, col2, col3
----------------
a, b, c
d, e, f

Output like

Col
---
a
b
c
d
e
f

Ram

• Mar 23rd, 2016

Src --> colgen(Dummy) --> Pivot (type=Horizntal & derivaion col=col1,col2,col3) -->copy(drop dummy col) --> trg.

sai3689

 Profile Answers by sai3689 Questions by sai3689

• Oct 10th, 2015

In the properties Pivot type=horizontal Tell me which to take pivot column?

Answer Question  Select Best Answer

My input data:

Field_Name Value
Customer_ID 100
Customer_Name ABC
Customer_City Delhi
Customer_ID 200
Customer_Name BCD
Customer_City Mumbai

My output should look like
Customer_ID Customer_Name Customer_City
100 ABC Delhi
200 ...

Arpit jain

• Apr 5th, 2016

We can do this by using roll up component by using accumulation function in it .

Ram

• Mar 10th, 2016

Its simple..
Src(file 2 cols) --> Transform (drop 1st col and create dummy field for group id) -->
Pivot enterprise(type vertical and array size=3) --> copy (rename the column names as required) --> trg.
Pls try , it will work..thanks !

Answer Question  Select Best Answer

What will happen if we will change the partition to Auto in Join stage?

Huma

• Feb 18th, 2017

We usually go for join stage when the source input data is huge!!! If we select Hash partitioning only then it will improve the performance of job because Hash partitioning ensures that the data with ...

Aloka

 Profile Answers by Aloka Questions by Aloka

• Jul 1st, 2016

Thanks Suresh for your reply !
But when Hash partition used..It will also verify for all the partition.
It will be more helpful if you will elaborate more on this.

Answer Question  Select Best Answer