How do you you delete header and footer on the source sequential file and how do you create header and footer on target sequential file using datastage?

Monisha jain

• Jul 31st, 2017

In sequential file using filter property where we can use UNIX command: sed -e 1d -e 1p

sri

• Mar 28th, 2017

Use UNIX command in the sequential file stage
sed -n1!p filename|sed -n $!p

Answer Question  Select Best Answer

I have two files target 3 files

file no1:
1
2
3
4

file2
3
4
5
6

output like first file 1,2 first file 3,4 second file 5 ,6 3rd file target how to achieve this

Thwara

• Jul 15th, 2017

First copy the value from your seq. file using "copy stage", then use "funnel stage" to join the two seq. file, then sort them and use "remove duplicate stage" to find the duplicate values (eg: 3,4) t...

Amit

• Jul 28th, 2015

Basically Question is about how you will achive Left Join, Inner Join and Outer Join.

Answer Question  Select Best Answer

I have the 10 input file like F1,F2...F10 then I need to load these 10 input files into 10 target Output tables like T1,T2...T10. Here is the scenario for 10 tables But in future If i will receive 100 input files then I need to load it into respective 100 target tables.

After loading the input files into target tables I need a confirmation in the respective target tables(By input File...

Reddy

• Jun 28th, 2017

This can be achieved by creating multiple instance job and parameterizing the source file name, table name and also need to enable run time column propagation.

shasank

• Apr 24th, 2017

We can do that allowing multiple instances for a single job in the job properties tab.

Answer Question  Select Best Answer

By seeing a Datastage job how you will identify which one is Normal lookup and which one is Sparse Lookup?

Ram

• May 23rd, 2017

Sparse look up can be used only for DB stages as Source and Target where as Normal can be used for both files as well as DB stages

Sri

• Mar 30th, 2017

It can be viewed when you open the Oracle connector stage and where the lookup type is mentioned.
By default lookup type is normal

Answer Question  Select Best Answer

I have a job with 2 parameters sets, I added new parameters sets, is it necessary to compile the job or not?

Karthik

• May 26th, 2017

Yes the jobs needs to be compiled whenever we are making changes to Parameter Set

Amruta

• Aug 1st, 2016

Yes..The DS job needs to be compiled after adding new parameter sets.

Answer Question  Select Best Answer

I have data in Table as

ID
1
2
3
1
4
3
3
5
6
6
7

Now I want to have Output as repeatating records in one table & non-repeatating in another table

Table 1 :
Id
2
4
5
7

Table 2:
ID
1
1
3
3
3
6
6

anirudh

• May 9th, 2017

You can use sort->aggregrator->count_rows->transformer stage write constraints row_count>1 to one file and row_count>1 to another output file

Neha

• Apr 7th, 2017

Seq File-> Aggregator (Count group by ID)->Transformer(Two output link , Use @Iteration1 and put @Iteration value in OpLnk2

Answer Question  Select Best Answer

I have an input file in the below format :

NAME SAL
---- ---

A 4000
B 3000
C 8000
A 2000
B 7000
C 5000
B 2000
C 9000
A 1000


If I will use Sort ---> Aggregator Group by then it will give 3 columns like NAME,MAX(),MIN()

NAME MAX() MIN()
---- -----...

Sirisha d

 Profile Answers by Sirisha d Questions by Sirisha d

• Apr 18th, 2017

Job Design : Sequential File --> Aggregator --> Transformer --> Sequential File Aggregator : Group by - EmpName Col for Calculation - Salary Generate two columns - one for maximum salary (Max()...

Neha

• Apr 7th, 2017

Use Seq File->Aggregator Stage (group by Salary, Emp_Name and find min, max salary)->use Pivot(horizontal Pivot)

Answer Question  Select Best Answer

Anil.K.Thodeti

• Mar 31st, 2017

Cat abc.txt | tr
, | sed s/,$//(Exec command stage), Start Loop (pass this output $CommandOutput), and then send this into a job, and then end loop at the end

karthick

• May 30th, 2014

Parameter file will have comma delimiter.
use cat file1.txt |cut -d, -f1| tr -d "
" command to extract the first field ...
use execute command activity for extracting all the parameter. then finally pass the value to actual job.

Answer Question  Select Best Answer

While implementing SCD, there are two output links updating data to same table. One link for insert and one link for update. How it is possible? Will it not result a write lock on a table if two links accessing same table for writing?

Ammu

• Mar 30th, 2017

Thanks for the answer

sri

• Mar 27th, 2017

Table level lock applies only when we explicitly define during table creation. In the case you mentioned to update and insert, there will be row level lock implies on that table. Logically, Insert re...

Answer Question  Select Best Answer

Can we implement SCD stage using Lookup stage? If Yes then how?

Neha

• Feb 21st, 2017

We can Perform SCD using lookup stage and Change Capture stage depending upon the type of SCD.

vibgyss

• Oct 7th, 2016

Yes, We can impliment SCD by Lookup stage

Answer Question  Select Best Answer

What will happen if we will change the partition to Auto in Join stage?

Huma

• Feb 18th, 2017

We usually go for join stage when the source input data is huge!!! If we select Hash partitioning only then it will improve the performance of job because Hash partitioning ensures that the data with ...

Aloka

 Profile Answers by Aloka Questions by Aloka

• Jul 1st, 2016

Thanks Suresh for your reply !
But when Hash partition used..It will also verify for all the partition.
It will be more helpful if you will elaborate more on this.

Answer Question  Select Best Answer

I have 2 files having different meta data and 2 files does not have any common key. How can I load the 2 files data into a single file without using Join stage?

mala

• Feb 9th, 2017

Can we use Merge?

Pavan Kumar

• Jul 11th, 2016

If Metadata is same then you can use "Funnel stage". If tables are different then, use column generator to create a common column for both the tables, then using join stage (Full outer join), join the two different tables.

Answer Question  Select Best Answer

1. What is the difference between Oracle connector stage and Oracle enterprise stage.

2. If we can achieve Oracle enterprise stages task using Oracle connector stage then why Oracle enterprise stage exists?

Siva

• Feb 3rd, 2017

Oracle connector having test connection. Ie plugin which is not Present in the enterprise state

vibgyss

• Aug 24th, 2016

2) Ans: min of 3 stage variables are required according to my view. example: if the source has two columns cid, address. we want to remove the duplicates in cid, our job design follows like below se...

Answer Question  Select Best Answer

Why we are using orchadmin to remove dataset. why we are not using rm commond in remove dataset..and why you need dataset remove waht is the reason?

Reddy

• Dec 19th, 2016

Dataset is not like a normal file & it is not a single file...based on number og node in config file, those many data files and one descriptor file..are created for each dataset. Hence removing using rm command will corrupt the dataset and will not be removed properly.

Answer Question  Select Best Answer

Explain telecom related project in data stage? For example You are handling data usage and roaming related data. How you will get the data? What mediation team will do? What are the terms such as CDR (Call Detail Record), CDF will you use?

Sequencers are job control programs that execute other jobs with preset Job parameters.    

Read Best Answer

Editorial / Best Answer

jagannimmagadda  

 Profile Answers by jagannimmagadda Questions by jagannimmagadda

• Member Since Jan-2006 | Jan 10th, 2006

---

A sequencer allows you to synchronize the control flow of multiple activities in a job sequence. It can have multiple input triggers as well as multiple output triggers.The sequencer operates in two modes:ALL mode. In this mode all of the inputs to the sequencer must be TRUE for any of the sequencer outputs to fire.ANY mode. In this mode, output triggers can be fired if any of the sequencer inputs are TRUE

Tariq Awan

• Oct 25th, 2016

As previous posts already pointed out, there are only two modes: All or Any. All means all incoming triggers must be true and Any means at least one needs to be true. However, in case, if you want to execute next job even though all the incoming triggers are False, then Seqencer is NOT the solution.

Priyanka

• Mar 10th, 2016

@Rohit: Yes you can run the 2nd job even if the first one fails. For that you need to set the trigger option to unconditional. However, the control comes to the 2nd job only after the 1st job has run (pass or fail).

Improve Answer

I have 10 files, in 5 files having same data(3 columns), 5 columns having same data(4 columns). How can I perform funnel and what are stages required from me?

Srinivas

• Oct 7th, 2016

Use column generator to add columns to make the column count is same and also the column names should be same in each files. Then you can perform funnel.

Answer Question  Select Best Answer

Suppose I have designed a Datastage job using sequential file stage,It will run in sequential mode.How can I run it it Parallel mode.

Suresh

• Sep 13th, 2016

Aloka, There are two ways in your example. In sequential file stage, number of readers per node and multiple nodes. These options will run an sequential stage in parallel.

Sandhyaram

• Jul 24th, 2016

In sequential file stage, we have two options No. of readers per node and reading from multiple nodes. We can run job in parallel mode.

Answer Question  Select Best Answer

Without using Sequencer how to design a Datastage job which normally receives input file to run. If tomorrow we will not receive any input file Job should not fail. It will run successfully without any warnings.

Ram

• Sep 6th, 2016

Hi Aloka,

you can achieve this by using unix shell scripting and schedule the job/script in any third party scheduling tool.

Thanks !

suresh

• Sep 2nd, 2016

Using JCL (Job Control Language) we can achieve this.

Answer Question  Select Best Answer

I have a file having columns C1,C2,C3,C4,C5 with comma delimited.In target I want store the first two columns value into one column.

Like below

Input Output I need
-------------- ----------------------
C1 C2 C3 C4 C5 C1(C1 & C2 value) C3 C4 C5

That means my input is 5 columns & Output will be 4 columns.
Can...

Chikka

• Aug 27th, 2016

Create a new stage variable and using concatenation operator combine first two columns data and map it to a column.

subbu

• Aug 26th, 2016

You can try using copy & tx stages

Answer Question  Select Best Answer