input file A contains12345678910input file B contains6789101112131415Output file X contains12345Output file y contains678910Output file z contains1112131415How can we do in this in a single ds job in px ?....could you please give me the logic to implement ???

Read Best Answer

Editorial / Best Answer

Answered by: vinod chowdary

• Jul 28th, 2011

---

Hello guy's, I would like to solve this by using the Change capture stage. First, i am going to use source as A and refrerence as B both of them are connected to Change capture stage. From, change capture stage it connected to filter stage and then targets X,Y and Z. In the filter stage: keychange column=2 it goes to X [1,2,3,4,5] Keychange column=0 it goes to Y [6,7,8,9,10] Keychange column=1 it goes to Z [11,12,13,14,15] Revert me PLz

Priya Ranjan kumar

• Aug 28th, 2017

You can solve this question in easily way like.
First use the funnel to take the input data from different sources and used check box for unique data(No duplicate data) then
you can use transformer where you can apply logic like. @INROW

Pavan Kumar

• Jul 30th, 2015

Using change capture stage:

File1(Master),File2----> change capture---> Filter ---->
T1, T2, T3
In Filter,
Change_code=1 then send then to T1-->(Insert records)
Change_code=0 then send then to T2-->(Copy records)
Change_code=2 then send then to T3-->(Delete records)

Improve Answer

I am having input--> I want Output like-->
slno|Name slno|Name
1|X 1|X
2|Y 2|X
3|Z 2|X
...

Sirisha d

 Profile Answers by Sirisha d Questions by Sirisha d

• Sep 12th, 2017

Considering the input data is below. slno|Name 1|X 2|Y 3|Z desired output is slno|Name slno|Name 1|X 1|X 2|Y 2|Y 3|Z 3|Z In the transformer output link add a new column called Na...

Sirisha d

 Profile Answers by Sirisha d Questions by Sirisha d

• Apr 18th, 2017

Considering the input data is below. slno|Name 1|X 2|Y 3|Z desired output is slno|Name slno|Name 1|X 1|X 2|Y 2|X 3|Z 2|X In the transformer output link add a new column called Name_slno...

Answer Question  Select Best Answer

I have source like this

a,b,c,1,2,3 ( All this in one column)

I wanna target following below

a,b,c,1 ( Ist row)
a,b,c,2 (2nd row)
a,b,c,3 (3rd row)

Thanks in advance.

lalit

• Sep 12th, 2017

Its really simple Take one sequential file which contains data a,b,c,1,2,3 ( First line column name=false) Then take one copy stage with three output link and then copy a,b,c,1 at one output link ...

Ram

• Mar 10th, 2016

Hi Tulasi,
This is for you..

Src -->Trns (use Function Str(inputcolumn,@inputrow) --> Trg

Thats all !

Answer Question  Select Best Answer

uma

• Sep 15th, 2017

Kill the process id for the specific job.

jamesbond777

• Mar 9th, 2017

Just to elaborate on kogantis answer. Independent links are stream/input links and dependent links would be the reference links from lookup.

Answer Question  Select Best Answer

How to improve the Performance Tuning any 5 points

Lalit

• Oct 6th, 2017

1)Set Proper configuration file
2)Handle null and duplicate values properly
3)Reduce number of transformers as much as possible
4)Do not take more than 20 stages in a perticuler job
5)Use Dataset stage instead of sequential file stage
6)Use join merge and lookup stages properly

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

Use Copy stage instead of a Transformer for simple operations like : placeholder between stages renaming Columns dropping Columns implicit (default) type Conversions USe Stage variab...

Answer Question  Select Best Answer

i have a source file1 consist of two datatypes

file1:
no(integer)
1
2
3

&

dept(char)
cs
it
ie

and i want to seperate these two datatypes and load it into target files
file2 & file3.

how can i do this in datastage and by using which stage?

lalit

• Oct 10th, 2017

So you can do it with transformer constraints like
allnum(), alpha() like function and separate both datatypes in two different outputs

dileep Janga

 Profile Answers by dileep Janga Questions by dileep Janga

• Jan 31st, 2014

I think this Question is to confuse the Job Aspirant by using Datatypes and all... Its very simple... File1-->2 Columns. 1.NO(Integer) 2.DEPT(Char). Target1: NO(Integer), Target2: DEPT(Char). Take ...

Answer Question  Select Best Answer

Which partition followed by joiner,merge. lookup,remove duplicate

lalit

• Oct 9th, 2017

For join, merge and remove duplicated you can use Hash partitioning and for lookup you can use entire partitioning
Thank you

Mallikarjuna_G

 Profile Answers by Mallikarjuna_G Questions by Mallikarjuna_G

• Aug 10th, 2013

For Join, Merge and Remove duplicates, have data on links hash key partitioned an sorted on Key columns specified. For lookup - primary link needs to be hash key partitioned and sorted and reference link has to use entire partition method.

Answer Question  Select Best Answer

Surrogate Key is a Primary Key for a Dimension table. Most importance of using it is it is independent of underlying database. i.e Surrogate Key is not affected by the changes going on with a database. 

Ganesh

• Oct 8th, 2017

Surrogate key and business key are both are same or not,
if different business key act as a primary key but Surrogate key acts as ?

Datastage Etl

 Profile Answers by Datastage Etl Questions by Datastage Etl

• May 13th, 2011

Surrogate Key is used to ?produce the Sequence numbers. So that, based on the Surrogate Key generated, we can ?identify the ?Unique Id in ?any column.?Surrogate Key is mainly implemented ?in the...

Answer Question  Select Best Answer

Incase of only dropping columns(without any transformations or business rules), we can go for copy stage instead of transformer.But can anyone tell me exactly why copy stage is better in performance than transformer?

Lalit

• Oct 9th, 2017

Look Copy stage is made up for only copying data and transformer stage is made up for multiple functionalities and also it is made up of c++ code. So if you want to only copy data and rename datatypes...

Atangel

 Profile Answers by Atangel Questions by Atangel

• Oct 12th, 2012

Transformer is a heavier stage as apart from the orchestrate we do have the C++ operators for various derivations. Right from compilation to execution a Transformer will always take more time than a copy stage which is a simple straight forward passive(if we can call) stage

Answer Question  Select Best Answer

ajay kumar

• Oct 25th, 2017

Order of execution inside transformer
Derivation, stage variables then constraint

Amit_Mishra

 Profile Answers by Amit_Mishra Questions by Amit_Mishra

• Apr 11th, 2011

Please follow the following details:Stage Variables-> Constraints-> Derivations/Expressions.Link ordering is mainly based to which link you want to process first.Link Ordering is mainly useful f...

Answer Question  Select Best Answer

input
-------------
name | no
--------------------
Bose 1
Mani 2
Arun 3

Output
-------------
name | no
--------------------
Bose 1
Mani 2
Mani 2
Arun 3
Arun 3
Arun 3



to get the Using transformer stage

help me...

Sandy

• Feb 15th, 2018

Tx => Functins=>string=>str(iput.name ,no)

muni

• Dec 20th, 2017

Using normalize component
in that transform < length(in.no) >
and assign drop to drag input to output

Answer Question  Select Best Answer

I have column X which having 3 values A;B;C. How can I load these values into 3 diff cols in the target. If tomorrow I will receive 100 values for same single column I will load into 100 target cols respectively (Same de-limiter) ?

Roopa

• Mar 2nd, 2018

Using Field function. Field(column,delimeter,1) and so on

ABACHREK

• Mar 3rd, 2017

Loop through the incoming field using looping functionality in transformer. Extract the individual values using field function and the iteration number. Output the individual values to the output link...

Answer Question  Select Best Answer

Scenario:
Objective: The interface aims to consolidate the round-trip ticket cost of passengers.
Description: The source file is a .txt file, train_route_src.txt, consolidated with trains from a particular source to destination. There are many repetitions in the source file (Reverse Duplication: eg. BLR --> BBS and BBS --> BLR). Remove the reverse duplicates and maintain the target in...

Bhargav

• Mar 2nd, 2018

I don't think you got the output for city in the format of SRC1-DES1-SRC1 (I mean two city names)? I tired your way but didn't get the expected output.

Alam

• Feb 15th, 2018

Ans--> Seq_File------>Sort------>Filter------->Seq_file
Sort Stage--->Generate key change column(it return for first value 1 and for duplicate 0) then used filter stahe
Filter Stage----> Filter by Key change column=1.
I think you will get the result.

Answer Question  Select Best Answer

Anjaneyulu Pagadala

• Mar 15th, 2018

Hash partitioning and in link sorting on grouping keys give better performance and correct results if it is in parallel mode and Auto partition will give correct results if there is no sorting happened only one of the keys we are grouping in previous stage

yassine

• Jul 12th, 2017

Hello Harish I would like to ask you a question How I can choose the appropriate partition for each stage and job how can I analyse situation
thank you

Answer Question  Select Best Answer

In a Column 123abc456xyz convert into two files like 123456 fil1 and abcxyz file2

Sandeep

• Apr 8th, 2018

By using convert fun we can achieve it:

in Tx->functions->string-> select convert

Convert (0123456789,,inputLink) ==

Target1 :abcxyz

Convert (abced....xyz, ,InputLink)==
Target2 : 123456

Answer Question  Select Best Answer

I have to design a job, if I run the job it should get 10 records from emp, if another person runs he should get all the records form emp. How to design such a job?

Shaktimaan

• May 2nd, 2018

If you are using Sequential file stage, there we have an option "Read the first row", make it parametrized.
and pass the value to the job using dsjob command as the parameter. also, you may like to use Invocation ID as you need to run the job with the different instances.

Answer Question  Select Best Answer

sangam

• May 23rd, 2018

Out of all those , i am not able to find/call them in a transformer , like @LOGNAME , while i use this in a stage variable, it throws error , saying its not defined. I am using Datastage 11.5 version. Any idea how to get this done ?
Thanks !

rameshkm

 Profile Answers by rameshkm Questions by rameshkm

• Apr 15th, 2009

The variables which used in through out the system not in singale project is called System variables .some of the system variables are  @FALSE,@PARTITIONNUM ,@NUMPARTITIONS,@TRUE, which are avaialable in Transformer

Answer Question  Select Best Answer

Input file contains 100 fields, target is
1st field is load into Target 1
2nd field is load into Target 2
3rd field is load into Target3
-----
-----
100th field is load into Target100
How can achieve this scenario ?

Amit Kumar

• Sep 18th, 2018

Step 1: take the columns names in a col_lits.txt file. $head -1 file_name > col_list #IFS="," (say the file was a comma seprated file or if other than , can use tr "other delimiter" ,) for colnm in...

Gurpreet singh

• Apr 5th, 2018

Create 100 target with that one field in DML. Then use a reformat having input file and map each field to target as per requirement.

Answer Question  Select Best Answer

How to get top five rows in DataStage? I tried to use @INROWNUM,@OUTROWNUM system variables in transformer..but they are not giving unique sequential numbers for every row...please help!

Thanks in advance!!

ravisankar

• Sep 24th, 2018

Also you can get form sequential file (Read first row (5))

lalit

• Oct 9th, 2017

If you want to use transformer only so you need to sort that data first....and after that you need to know how many no. of partitions you have in your transformer stage. Because @inrownum and @outrown...

Answer Question  Select Best Answer

I have a sequential file it is having some records and the same file is having header and footer now my question is how to count the records in a file which is not counts the header and footer records and then transform the records in to target and then again we fetch the header and footer to that file which records are matched with the header

Sasidhar Punna

• Oct 24th, 2018

Cat | sed 1d ; $d | wc -l

sed 1d --- for removing 1st row
sed $d ---- for removing last row

Answer Question  Select Best Answer