I have a job with 2 parameters sets, I added new parameters sets, is it necessary to compile the job or not?

Karthik

• May 26th, 2017

Yes the jobs needs to be compiled whenever we are making changes to Parameter Set

Amruta

• Aug 1st, 2016

Yes..The DS job needs to be compiled after adding new parameter sets.

Answer Question  Select Best Answer

I have data in Table as

ID
1
2
3
1
4
3
3
5
6
6
7

Now I want to have Output as repeatating records in one table & non-repeatating in another table

Table 1 :
Id
2
4
5
7

Table 2:
ID
1
1
3
3
3
6
6

anirudh

• May 9th, 2017

You can use sort->aggregrator->count_rows->transformer stage write constraints row_count>1 to one file and row_count>1 to another output file

Neha

• Apr 7th, 2017

Seq File-> Aggregator (Count group by ID)->Transformer(Two output link , Use @Iteration1 and put @Iteration value in OpLnk2

Answer Question  Select Best Answer

I have an input file in the below format :

NAME SAL
---- ---

A 4000
B 3000
C 8000
A 2000
B 7000
C 5000
B 2000
C 9000
A 1000


If I will use Sort ---> Aggregator Group by then it will give 3 columns like NAME,MAX(),MIN()

NAME MAX() MIN()
---- -----...

Sirisha d

 Profile Answers by Sirisha d Questions by Sirisha d

• Apr 18th, 2017

Job Design : Sequential File --> Aggregator --> Transformer --> Sequential File Aggregator : Group by - EmpName Col for Calculation - Salary Generate two columns - one for maximum salary (Max()...

Neha

• Apr 7th, 2017

Use Seq File->Aggregator Stage (group by Salary, Emp_Name and find min, max salary)->use Pivot(horizontal Pivot)

Answer Question  Select Best Answer

Anil.K.Thodeti

• Mar 31st, 2017

Cat abc.txt | tr
, | sed s/,$//(Exec command stage), Start Loop (pass this output $CommandOutput), and then send this into a job, and then end loop at the end

karthick

• May 30th, 2014

Parameter file will have comma delimiter.
use cat file1.txt |cut -d, -f1| tr -d "
" command to extract the first field ...
use execute command activity for extracting all the parameter. then finally pass the value to actual job.

Answer Question  Select Best Answer

While implementing SCD, there are two output links updating data to same table. One link for insert and one link for update. How it is possible? Will it not result a write lock on a table if two links accessing same table for writing?

Ammu

• Mar 30th, 2017

Thanks for the answer

sri

• Mar 27th, 2017

Table level lock applies only when we explicitly define during table creation. In the case you mentioned to update and insert, there will be row level lock implies on that table. Logically, Insert re...

Answer Question  Select Best Answer

Can we implement SCD stage using Lookup stage? If Yes then how?

Neha

• Feb 21st, 2017

We can Perform SCD using lookup stage and Change Capture stage depending upon the type of SCD.

vibgyss

• Oct 7th, 2016

Yes, We can impliment SCD by Lookup stage

Answer Question  Select Best Answer

What will happen if we will change the partition to Auto in Join stage?

Huma

• Feb 18th, 2017

We usually go for join stage when the source input data is huge!!! If we select Hash partitioning only then it will improve the performance of job because Hash partitioning ensures that the data with ...

Aloka

 Profile Answers by Aloka Questions by Aloka

• Jul 1st, 2016

Thanks Suresh for your reply !
But when Hash partition used..It will also verify for all the partition.
It will be more helpful if you will elaborate more on this.

Answer Question  Select Best Answer

I have 2 files having different meta data and 2 files does not have any common key. How can I load the 2 files data into a single file without using Join stage?

mala

• Feb 9th, 2017

Can we use Merge?

Pavan Kumar

• Jul 11th, 2016

If Metadata is same then you can use "Funnel stage". If tables are different then, use column generator to create a common column for both the tables, then using join stage (Full outer join), join the two different tables.

Answer Question  Select Best Answer

1. What is the difference between Oracle connector stage and Oracle enterprise stage.

2. If we can achieve Oracle enterprise stages task using Oracle connector stage then why Oracle enterprise stage exists?

Siva

• Feb 3rd, 2017

Oracle connector having test connection. Ie plugin which is not Present in the enterprise state

vibgyss

• Aug 24th, 2016

2) Ans: min of 3 stage variables are required according to my view. example: if the source has two columns cid, address. we want to remove the duplicates in cid, our job design follows like below se...

Answer Question  Select Best Answer

Why we are using orchadmin to remove dataset. why we are not using rm commond in remove dataset..and why you need dataset remove waht is the reason?

Reddy

• Dec 19th, 2016

Dataset is not like a normal file & it is not a single file...based on number og node in config file, those many data files and one descriptor file..are created for each dataset. Hence removing using rm command will corrupt the dataset and will not be removed properly.

Answer Question  Select Best Answer

Sequencers are job control programs that execute other jobs with preset Job parameters.    

Read Best Answer

Editorial / Best Answer

jagannimmagadda  

 Profile Answers by jagannimmagadda Questions by jagannimmagadda

• Member Since Jan-2006 | Jan 10th, 2006

---

A sequencer allows you to synchronize the control flow of multiple activities in a job sequence. It can have multiple input triggers as well as multiple output triggers.The sequencer operates in two modes:ALL mode. In this mode all of the inputs to the sequencer must be TRUE for any of the sequencer outputs to fire.ANY mode. In this mode, output triggers can be fired if any of the sequencer inputs are TRUE

Tariq Awan

• Oct 25th, 2016

As previous posts already pointed out, there are only two modes: All or Any. All means all incoming triggers must be true and Any means at least one needs to be true. However, in case, if you want to execute next job even though all the incoming triggers are False, then Seqencer is NOT the solution.

Priyanka

• Mar 10th, 2016

@Rohit: Yes you can run the 2nd job even if the first one fails. For that you need to set the trigger option to unconditional. However, the control comes to the 2nd job only after the 1st job has run (pass or fail).

Improve Answer

I have 10 files, in 5 files having same data(3 columns), 5 columns having same data(4 columns). How can I perform funnel and what are stages required from me?

Srinivas

• Oct 7th, 2016

Use column generator to add columns to make the column count is same and also the column names should be same in each files. Then you can perform funnel.

Answer Question  Select Best Answer

Suppose I have designed a Datastage job using sequential file stage,It will run in sequential mode.How can I run it it Parallel mode.

Suresh

• Sep 13th, 2016

Aloka, There are two ways in your example. In sequential file stage, number of readers per node and multiple nodes. These options will run an sequential stage in parallel.

Sandhyaram

• Jul 24th, 2016

In sequential file stage, we have two options No. of readers per node and reading from multiple nodes. We can run job in parallel mode.

Answer Question  Select Best Answer

Without using Sequencer how to design a Datastage job which normally receives input file to run. If tomorrow we will not receive any input file Job should not fail. It will run successfully without any warnings.

Ram

• Sep 6th, 2016

Hi Aloka,

you can achieve this by using unix shell scripting and schedule the job/script in any third party scheduling tool.

Thanks !

suresh

• Sep 2nd, 2016

Using JCL (Job Control Language) we can achieve this.

Answer Question  Select Best Answer

I have a file having columns C1,C2,C3,C4,C5 with comma delimited.In target I want store the first two columns value into one column.

Like below

Input Output I need
-------------- ----------------------
C1 C2 C3 C4 C5 C1(C1 & C2 value) C3 C4 C5

That means my input is 5 columns & Output will be 4 columns.
Can...

Chikka

• Aug 27th, 2016

Create a new stage variable and using concatenation operator combine first two columns data and map it to a column.

subbu

• Aug 26th, 2016

You can try using copy & tx stages

Answer Question  Select Best Answer

What is the minimum number of input and output required for Lookup ?

vibgyss

• Aug 24th, 2016

Min of 2 inputs is required by lookup stage and 1 output link is mandatory for any type of lookup i.e. we have 4 types of lookups from 8.0 version those Normal lookup, sparse lookup (only supports 2 inputs one is primary and second is reference), range lookup, caseless lookup

Answer Question  Select Best Answer

How to handle rejects in Transformer & How many rejects a xfm support?

vibgyss

• Aug 24th, 2016

Transformer
The transformer only rejects the data of a column which has nulls and that column is used in the expression then that type data is rejected by transformer stage

No other data is rejected by Transformer Stage
Only one reject link supported by transformer

Answer Question  Select Best Answer

Link Partitioner - Used for partitioning the data.Link Collector - Used for collecting the partitioned data.

Read Best Answer

Editorial / Best Answer

nikhilanshuman  

 Profile Answers by nikhilanshuman Questions by nikhilanshuman

• Member Since Nov-2009 | Dec 17th, 2010

---

Link Partitioner and collecter are basically used to introduce data parallellism in server jobs.link partitioner,splits the data on many links.Once the data is processed,link collector collects the data and passes it to a single link.These are used in server jobs.In datastage parallel jobs,these things are inbuilt and automatically taken care of.

karthik

• Aug 23rd, 2016

Link Partition and Link collector are used in Server jobs for to split data.
Partition technique can be done in server jobs by using these two stages.

nikhilanshuman

 Profile Answers by nikhilanshuman Questions by nikhilanshuman

• Dec 17th, 2010

Link Partitioner and collecter are basically used to introduce data parallellism in server jobs.link partitioner,splits the data on many links.Once the data is processed,link collector collects the da...

Improve Answer

I have 5 source files. In target I need to write it into a single file. But in the output file I need the corresponding input file name i.e which records are coming from which source file. How to achieve this?

sreeni

• Aug 8th, 2016

Hi Aloka we can use seq file properties -> Options -> File Name Column = FileNameCol
you will get source file name to each column. You can identify easily...

Ram

• Aug 4th, 2016

Hi
Use file name column option in seq file stage & do funnel then you will get required output.

Thanks !

Answer Question  Select Best Answer

We are using below command in Unix to run a Datastage Job:
dsjob run mode project_name job_name
When we are executing the above command in Unix what exactly it returns?

Aloka

 Profile Answers by Aloka Questions by Aloka

• Aug 8th, 2016

Hi,
May be a question for reviewers who wanted to know more on this.You can leave it.
Thanks !

Ram

• Aug 4th, 2016

Hi,
is it question for reviewers or your doubt ?
you got answer if you run the command.

Thanks !

Answer Question  Select Best Answer