By using the Lookup stage we will combine the data from multiple table. By using join stage also we will combine the data from multiple tables. Then what is the need of Lookup stage?

Venkat Poonati

 Profile Answers by Venkat Poonati Questions by Venkat Poonati

• Mar 29th, 2011

There are three things to consider here1.memory usage  As with joiner fewer rows has to be in memory at any time.This is not with lookup2.treating of rows with unmatched keys   Joiner w...

narra satish

 Profile Answers by narra satish Questions by narra satish

• Mar 21st, 2011

Join and lookup is differ in terms of memory usage. Join is light weight than lookup stage. Join stage won't use much system resources. While performing lookup will used more system resources. In case of lookup it fetch the whole data from refernce link into RAM memory and then it perform lookup.

Answer Question  Select Best Answer

What is job commit in Datastage?

If I am working on parallel jobs, how can I give this option(in each odbc satge) that commit should perform after specific number of records transaction.

Please help

RAJESH

• Sep 11th, 2011

Read Committed and arraysize u option in target ODBC stage.

Venkat Duvvuri

• Sep 9th, 2011

Hi Im not sure which version of datastage you r using..this is pretty much simple in Datastage8.5 by using DTS

Thanks n Regards
Venkat Duvvuri

Answer Question  Select Best Answer

How to get the dataset record count? with out using orchadmin command

Priyanka Sinha

• Mar 17th, 2016

1) The Datastage Designer GUI (also available Manager and Director) provides a mechanism to view and manage data sets. It can be invoked in Tools -> Data set management. 2) orchadmin command-line uti...

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

There are only two ways to this -

1. Use datastage dataset management utility[GUI].
2. Use orchadmin utility from commandline

Answer Question  Select Best Answer

How to improve the Performance Tuning any 5 points

Lalit

• Oct 6th, 2017

1)Set Proper configuration file
2)Handle null and duplicate values properly
3)Reduce number of transformers as much as possible
4)Do not take more than 20 stages in a perticuler job
5)Use Dataset stage instead of sequential file stage
6)Use join merge and lookup stages properly

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

Use Copy stage instead of a Transformer for simple operations like : placeholder between stages renaming Columns dropping Columns implicit (default) type Conversions USe Stage variab...

Answer Question  Select Best Answer

Sushils13

 Profile Answers by Sushils13 Questions by Sushils13

• Aug 20th, 2013

Oracle Call Interface (OCI), it is a set of low-level APIs used to interact with Oracle databases. It allows one to use operations like logon, execute, parss etc. using a C or C++ program.

Ramon

• Sep 22nd, 2011

It is your connectivity stage object to your database. Think of it as your db stage.

Answer Question  Select Best Answer

How can we retrieve the particular rows in dataset by using orchadmin command?

sunitha

• Nov 29th, 2013

Orchadmin dump -part 0 -n 17 -field name input.ds

Sushils13

 Profile Answers by Sushils13 Questions by Sushils13

• Aug 20th, 2013

$orchadmin dump [options] Sample.ds

options : -p period(N) : Lists every Nth record from each partition starting from first record.

Answer Question  Select Best Answer

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

It depends on the job design and requrement. When you specify SAME partitioning, datastage uses the partioing method defined in the previous stage and will not perform any partitioning in the current...

Muralidhar

• May 30th, 2013

Same partition.
The reason is it keeps the previous partition and send to output as it is.

Answer Question  Select Best Answer

Source is a flat file and has 200 records . These have to split across 4 outputs equally . 50 records in each .

The total number of records in the source may vary everyday ,according to the count records are to split equally at 4 outputs.

Could someone post an answer for this question.
Thanks

Vinay

• Mar 20th, 2015

We can use the split command in the Filter section of the Sequential

file stage:
Split -l 50 File.txt Segment
O/P: will give 4 files namely Segmentaa,Segmentab,Segmentac and Segmented each of 50 records.

Gandhi

• Jan 13th, 2015

Hi all,

Keep four files as output.Simply give modulus(col_name,4)=0 constraint for first file ,modulus(col_name,4)=1 second file and modulus(col_name,4)=2 for third file and finally modulus(col_name,4)=3

Answer Question  Select Best Answer

INPUT:

SOURCE DESTINATION DISTANCE(KM)

HYD CHN 500
CHN HYD 500
BANG HYD 600
HYD BANG 600
PUN HYD 750
HYD PUN 750

OUTPUT :

Rudra

• Feb 9th, 2016

Source->Transformer Stage -> Target
In transformer use 2 stage variables. Use hash Partition in the source and select key field and select sort option only. STG1 -> if stg2= keyfield then 1 else 0
stg2 - keyfield
Then in filter put condition stg1=0

Ram

• Feb 5th, 2016

Simple:
Source --> Sort (key distance) --> RD (retains 1st occuance) --> Target

Please let me know if it is not work.

Answer Question  Select Best Answer

Solve in Datastage

Input:

col1, col2, col3
----------------
a, b, c
d, e, f

Output like

Col
---
a
b
c
d
e
f

Ram

• Mar 23rd, 2016

Src --> colgen(Dummy) --> Pivot (type=Horizntal & derivaion col=col1,col2,col3) -->copy(drop dummy col) --> trg.

sai3689

 Profile Answers by sai3689 Questions by sai3689

• Oct 10th, 2015

In the properties Pivot type=horizontal Tell me which to take pivot column?

Answer Question  Select Best Answer

My input data:

Field_Name Value
Customer_ID 100
Customer_Name ABC
Customer_City Delhi
Customer_ID 200
Customer_Name BCD
Customer_City Mumbai

My output should look like
Customer_ID Customer_Name Customer_City
100 ABC Delhi
200 ...

Arpit jain

• Apr 5th, 2016

We can do this by using roll up component by using accumulation function in it .

Ram

• Mar 10th, 2016

Its simple..
Src(file 2 cols) --> Transform (drop 1st col and create dummy field for group id) -->
Pivot enterprise(type vertical and array size=3) --> copy (rename the column names as required) --> trg.
Pls try , it will work..thanks !

Answer Question  Select Best Answer

What will happen if we will change the partition to Auto in Join stage?

Huma

• Feb 18th, 2017

We usually go for join stage when the source input data is huge!!! If we select Hash partitioning only then it will improve the performance of job because Hash partitioning ensures that the data with ...

Aloka

 Profile Answers by Aloka Questions by Aloka

• Jul 1st, 2016

Thanks Suresh for your reply !
But when Hash partition used..It will also verify for all the partition.
It will be more helpful if you will elaborate more on this.

Answer Question  Select Best Answer

By seeing a Datastage job how you will identify which one is Normal lookup and which one is Sparse Lookup?

Ram

• May 23rd, 2017

Sparse look up can be used only for DB stages as Source and Target where as Normal can be used for both files as well as DB stages

Sri

• Mar 30th, 2017

It can be viewed when you open the Oracle connector stage and where the lookup type is mentioned.
By default lookup type is normal

Answer Question  Select Best Answer

Source have single column data, How can I get Target like row 1 goes to target 1, row 2 goes to target 2.

src :-
column_id
1
2
3
4
.
.
.
1000 ,
Target :-
Target1(1)
Target2(2)
Target3(3),
Target4(4)
.
.
Target1000(1000)

How can you achieve this scenario?

Yash Ojha

• May 9th, 2020

We can use the option "generate multiple files" in sequential file stage and then assign the data column as Key. SO with every change in key it will generate a new target file.

Rv

• Dec 7th, 2019

There are thousand rows, who will write thousand different where conditions and then will configure 1000 different files, is there any other solution which dynamic?

Answer Question  Select Best Answer

introJ

 Profile Answers by introJ Questions by introJ

• Mar 25th, 2010

First import the columns through metadata importer for xmlFolder stage(Path for xml. or if it  doesnt  work put the xml file in the project directory)   |   |XML Input St...

tisha24

 Profile Answers by tisha24 Questions by tisha24

• Dec 29th, 2008

XML files can be read using FOLDER stage followed by XML input stage in server jobs.

Answer Question  Select Best Answer

nagoosk

 Profile Answers by nagoosk Questions by nagoosk

• May 29th, 2008

sort the records using the key field.In sort stage put "key change column = true".Then zero will be assigned to the duplicate records.then put a condition as which is record is zero then send it to reject link

nagoosk

 Profile Answers by nagoosk Questions by nagoosk

• Jan 17th, 2008

we can remove duplicate records by specifying the one of the column in target stage as key column

Answer Question  Select Best Answer

a)Star Schema - Simple & Much Faster. Denormalized form. b)Snowflake Schema - Complex with more Granularity. More normalized form. 

cyberdiptikanta

 Profile Answers by cyberdiptikanta Questions by cyberdiptikanta

• Jun 26th, 2010

Star Schema is performance wise better than Snow Flake Schema.  As Star schema uses denormalise tables, so there will be less no of join as compared to Snow flake Schema.RegardsDiptikanta

shady2pac

 Profile Answers by shady2pac Questions by shady2pac

• Oct 19th, 2008

Is not star schema better performance wise (querying) as it has less no of join due to denormalized structure? Please clarify

Answer Question  Select Best Answer

veer.dwh

 Profile Answers by veer.dwh Questions by veer.dwh

• Oct 1st, 2009

Hi,I have worked on server to px migration project. you can't directly convert a server job to PX job. the only way is, you have to redevelop the px job using px environment.Regards,Veeru.

Abhijain

 Profile Answers by Abhijain Questions by Abhijain

• Feb 20th, 2008

On a job level- to convert server jobs into a parellel job is not possible.The mechnism of server jobs is different then that of parellel jobs.You have to re-build the job.

Answer Question  Select Best Answer

uma

• Sep 15th, 2017

Kill the process id for the specific job.

jamesbond777

• Mar 9th, 2017

Just to elaborate on kogantis answer. Independent links are stream/input links and dependent links would be the reference links from lookup.

Answer Question  Select Best Answer

Sequencers are job control programs that execute other jobs with preset Job parameters.    

Read Best Answer

Editorial / Best Answer

jagannimmagadda  

 Profile Answers by jagannimmagadda Questions by jagannimmagadda

• Member Since Jan-2006 | Jan 10th, 2006

---

A sequencer allows you to synchronize the control flow of multiple activities in a job sequence. It can have multiple input triggers as well as multiple output triggers.The sequencer operates in two modes:ALL mode. In this mode all of the inputs to the sequencer must be TRUE for any of the sequencer outputs to fire.ANY mode. In this mode, output triggers can be fired if any of the sequencer inputs are TRUE

Tariq Awan

• Oct 25th, 2016

As previous posts already pointed out, there are only two modes: All or Any. All means all incoming triggers must be true and Any means at least one needs to be true. However, in case, if you want to execute next job even though all the incoming triggers are False, then Seqencer is NOT the solution.

Priyanka

• Mar 10th, 2016

@Rohit: Yes you can run the 2nd job even if the first one fails. For that you need to set the trigger option to unconditional. However, the control comes to the 2nd job only after the 1st job has run (pass or fail).

Improve Answer