Surrogate Key is a Primary Key for a Dimension table. Most importance of using it is it is independent of underlying database. i.e Surrogate Key is not affected by the changes going on with a database. 

Ganesh

• Oct 8th, 2017

Surrogate key and business key are both are same or not,
if different business key act as a primary key but Surrogate key acts as ?

Datastage Etl

 Profile Answers by Datastage Etl Questions by Datastage Etl

• May 13th, 2011

Surrogate Key is used to ?produce the Sequence numbers. So that, based on the Surrogate Key generated, we can ?identify the ?Unique Id in ?any column.?Surrogate Key is mainly implemented ?in the...

Answer Question  Select Best Answer

ajay kumar

• Oct 25th, 2017

Order of execution inside transformer
Derivation, stage variables then constraint

Amit_Mishra

 Profile Answers by Amit_Mishra Questions by Amit_Mishra

• Apr 11th, 2011

Please follow the following details:Stage Variables-> Constraints-> Derivations/Expressions.Link ordering is mainly based to which link you want to process first.Link Ordering is mainly useful f...

Answer Question  Select Best Answer

ss

• Mar 28th, 2013

JJ, you are wrong.

Apt_ Dump_Score
By using this only we can find.

jj

• Nov 26th, 2012

1 conductor process
3 Section leader process
3 player process ( modify and filter are combined)
1 source sequential file
1 target sequential file
Total : 9

Answer Question  Select Best Answer

pundlik

• Sep 5th, 2014

Compared to Informatica the Data Stage is more User friendly

sunrays_arun

 Profile Answers by sunrays_arun Questions by sunrays_arun

• Oct 26th, 2007

SAS DI studio is best when compared to Informatica and Datastage as it generates SAS code at the back end .SAS is highly flexible compared to other BI solution.

Answer Question  Select Best Answer

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

If those two stages are sources and if it is valid that though the names of columns from two sources differ but they are same, then use a copy stage infront of one source stage and rename column as pe...

muralidhar

• May 30th, 2013

This is little tricky question.we can do in two ways.

1)we can connect using lookup stage if both columns having same datatype.

2)We can add one extra column that is common for two files then we can connect.

Answer Question  Select Best Answer

If you have a huge volume of data to be referenced, which stage will you use? Join or Lookup stage? Why

Gopi N

• Jul 11th, 2012

If we have a Huge data at reference defiantly we should go to Join stage because Look up takes much time to process hence we will use entire partition but in Join stage we will give the sorted data and it will simplify better than Look-up

arjunreddy

• Aug 24th, 2011

Look up stage

Answer Question  Select Best Answer

How to remove leading zeros in data and transform data to target?

Sunitha

• Dec 2nd, 2013

The main differences between 8.1 and 8.5 are 8.5 has Input looping ,Output looping. 8.5 has saving ,editing and compling is 40% faster. 8.5 has functions like LastRow,LastInGroup and Iteration system...

Rupesh Agrawal

• Nov 8th, 2013

Convert data to integer and convert back to string.

Answer Question  Select Best Answer

i have a sequence of job in DataStage which is taking more than 4 hrs which is supposed to complete in less than 1 hr
so what could be the possibilities to take much longer time than expected?

RamyaSujith

• Oct 6th, 2014

Check if any stage is reading/processing data sequentially which could have been done in parallel.

Raveena Mittal

• Sep 11th, 2014

When sometimes ,some DML statements are executed in the db and they are not committed,then also it may keep the job running for long hours

Answer Question  Select Best Answer

I have a source file having data like:
10
10
10
20
20
20
30
30
40
40
50
60
70
i want three output from the above input file, these output would be:
1) having only unique records no duplicates should be there. Like:
10
20
30
40
50
60
70
2) having only duplicate records,...

Ruchi Gautami

• Dec 30th, 2019

File -->> Sort -->> Transformer -->> O/P File
Sort:
Define the key field and in Property set Key Change column as TRUE.
Transformer:
In Constraints put the below condition:
KeyChange=1 for Unique record O/P
KeyChange=0 for Duplicate O/P.

shaheed

• Nov 20th, 2019

Src->Sggr->Trans->Target(3)
1) Unique- send as it is with link sort
2) Duplicate only- Loop through Count of each row count (constraint Count . 1)
3)Unique Only- Constraints Count = 1

Answer Question  Select Best Answer

input is
cola
1
2
3
this should be populated at the output as

cola
1
2 2
3 3 3

satish

• Apr 2nd, 2015

In Transformer use stage variable Str(%Input_column%,%Input_column%)

sai3689

 Profile Answers by sai3689 Questions by sai3689

• Mar 17th, 2015

@iteration

Answer Question  Select Best Answer

can anyone pls solve in datastage.........
source column is..
A
A
B
B
B
C
C
D
........want output columns(2 cols) as.........
A 1
A 2
B 1
B 2
B 3
C 1
C 2
D 1

THANX IN ADVANCE.

Amulya Kumar Panda

• Jul 11th, 2016

Job flow sequential_file-> eggregate->sort->tranformer-> sequential

fast aggregate stage use count rows and add extra column seq_no
next stage sort -key source column sort order ascending.
tranformer stage use loop while ex-@ITERATION

Kumar

• Jul 8th, 2016

Seq file>transformer>Seq file
1.Mode of execution in transformer must be sequential and data must be sorted on col1
2. Transformer logic:
Stv1=Input column
Stv2=if Stv1=Stv3 Then Stv2+1 Else 1
Stv3=Stv1
3.Output of transformer
Col1,Col2
Input column,Stv2

Answer Question  Select Best Answer

I have 2 files having different meta data and 2 files does not have any common key. How can I load the 2 files data into a single file without using Join stage?

mala

• Feb 9th, 2017

Can we use Merge?

Pavan Kumar

• Jul 11th, 2016

If Metadata is same then you can use "Funnel stage". If tables are different then, use column generator to create a common column for both the tables, then using join stage (Full outer join), join the two different tables.

Answer Question  Select Best Answer

1.Without using stage variable how can we delete the duplicates using Transformer?

2.If we will remove duplicates using Transformer then minimum how many stage variable required for this?

bhargav Konduru

• Nov 21st, 2024

1.goto tfm stage
2.goto stage properties > goto partitions tab > select hash >select all the columns which duplicates>select sort > select unique
3. that will solve your problem

Mokshada

• Jul 10th, 2021

The prerequisite for this is data should be partitioned by a key and sorted.
Later, follow the below steps:
S2 = if input.column = S1 then 0 else 1
S1 = input.column
In constraint : S2=1

And, you will get the expected result.

Answer Question  Select Best Answer

input
-------------
name | no
--------------------
Bose 1
Mani 2
Arun 3

Output
-------------
name | no
--------------------
Bose 1
Mani 2
Mani 2
Arun 3
Arun 3
Arun 3



to get the Using transformer stage

help me...

Sandy

• Feb 15th, 2018

Tx => Functins=>string=>str(iput.name ,no)

muni

• Dec 20th, 2017

Using normalize component
in that transform < length(in.no) >
and assign drop to drag input to output

Answer Question  Select Best Answer

In almost all cases we have to delete the data inserted by this from DB manually and fix the job and then run the job again.

Read Best Answer

Editorial / Best Answer

ritu singhai  

 Profile Answers by ritu singhai Questions by ritu singhai

• Member Since Jul-2008 | Jul 5th, 2008

---

Have you set the compilation options for the sequence so that in case job aborts, you need not to run it from from the first job. By selecting that compilation option you can run that aborted sequence from the point the sequence was aborted.
Like for example, you have 10 jobs(job1, job2, job3 etc.) in a sequence and the job 5 aborts, then by checking "Add checkpoints so sequence is restartable on failure" and "Automatically handle activities that fail" you can restart this sequence from job 5 only. it will not run the jobs 1,2,3 and 4.
Please check these options in your sequence.
Hope this helps.

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

Two things needs to be handled when a Job Sequence aborts. 1. We must have an exception handling code that notifies us about the failure 2. When we re-run the sequence after fixing the Sequence, it ...

Riten

• May 30th, 2012

To Handle Aborted Sequence These are the steps to be taken: First Add Terminator to Job Sequence and Choose Terminator with Other option(Trigger in Job sequence) ( if job fails it will go to Other lin...

Improve Answer

praveen

• Apr 28th, 2012

Data set and file set are file/stage ,these to are data extract from db.in the data set does not have rejected link file set had rejected link

arjun

• Jan 25th, 2012

The fundamental concept of the Orchestrate framework is the Data Set. Data Sets are the inputs and outputs of Orchestrate operators. As a concept a Data Set is like a database table, in so far as it...

Answer Question  Select Best Answer

veer.dwh

 Profile Answers by veer.dwh Questions by veer.dwh

• Sep 28th, 2009

There are several performance techniques are avilable to help run the job faster1. Eliminate unwanted data and columns as early as possible in your job design, each unwanred column and data  requ...

Bhaskar

• Dec 29th, 2006

We can put hash file in lookup. This will index the input data based on key column (which we define). Thus improve performance. Also Array size can be increased in final table stage.

Answer Question  Select Best Answer

Anjaneyulu Pagadala

• Mar 15th, 2018

Hash partitioning and in link sorting on grouping keys give better performance and correct results if it is in parallel mode and Auto partition will give correct results if there is no sorting happened only one of the keys we are grouping in previous stage

yassine

• Jul 12th, 2017

Hello Harish I would like to ask you a question How I can choose the appropriate partition for each stage and job how can I analyse situation
thank you

Answer Question  Select Best Answer

How do you you delete header and footer on the source sequential file and how do you create header and footer on target sequential file using datastage?

Monisha jain

• Jul 31st, 2017

In sequential file using filter property where we can use UNIX command: sed -e 1d -e 1p

sri

• Mar 28th, 2017

Use UNIX command in the sequential file stage
sed -n1!p filename|sed -n $!p

Answer Question  Select Best Answer

How to Delete Dataset in Datastage Parallel Jobs?

ramoojobs

 Profile Answers by ramoojobs Questions by ramoojobs

• May 11th, 2010

From Unix / Linux1) Go to the path where DataSet exists2) Use ORCHADMIN DELETE

siddy76

 Profile Answers by siddy76 Questions by siddy76

• Dec 8th, 2009

Go to the particular folder where the datasets are located, then typeorchadmin rm <datasetname.ds>

Answer Question  Select Best Answer