My input has a unique column-id with the values 10,20,30.....how can i get first record in one o/p file,last record in another o/p file and rest of the records in 3rd o/p file?

Bhargav konduru

• Nov 21st, 2024

In TFM stage do the below constraints 1). Link--> @inrownum=1 2).link --> lastrow() 3). link --> click the otherwise condition Some more things needs to do with above 1.In TFM properties set pa...

Prashant

• Nov 25th, 2018

If your output file is sequential file then you can you use filter property .

Answer Question  Select Best Answer

input file A contains12345678910input file B contains6789101112131415Output file X contains12345Output file y contains678910Output file z contains1112131415How can we do in this in a single ds job in px ?....could you please give me the logic to implement ???

Read Best Answer

Editorial / Best Answer

Answered by: vinod chowdary

• Jul 28th, 2011

---

Hello guy's, I would like to solve this by using the Change capture stage. First, i am going to use source as A and refrerence as B both of them are connected to Change capture stage. From, change capture stage it connected to filter stage and then targets X,Y and Z. In the filter stage: keychange column=2 it goes to X [1,2,3,4,5] Keychange column=0 it goes to Y [6,7,8,9,10] Keychange column=1 it goes to Z [11,12,13,14,15] Revert me PLz

Priya Ranjan kumar

• Aug 28th, 2017

You can solve this question in easily way like.
First use the funnel to take the input data from different sources and used check box for unique data(No duplicate data) then
you can use transformer where you can apply logic like. @INROW

Pavan Kumar

• Jul 30th, 2015

Using change capture stage:

File1(Master),File2----> change capture---> Filter ---->
T1, T2, T3
In Filter,
Change_code=1 then send then to T1-->(Insert records)
Change_code=0 then send then to T2-->(Copy records)
Change_code=2 then send then to T3-->(Delete records)

Improve Answer

I have source like this

a,b,c,1,2,3 ( All this in one column)

I wanna target following below

a,b,c,1 ( Ist row)
a,b,c,2 (2nd row)
a,b,c,3 (3rd row)

Thanks in advance.

lalit

• Sep 12th, 2017

Its really simple Take one sequential file which contains data a,b,c,1,2,3 ( First line column name=false) Then take one copy stage with three output link and then copy a,b,c,1 at one output link ...

Ram

• Mar 10th, 2016

Hi Tulasi,
This is for you..

Src -->Trns (use Function Str(inputcolumn,@inputrow) --> Trg

Thats all !

Answer Question  Select Best Answer

source table
name
A
A
B
B
B
C
C
D

In source table data like this
but I want traget table like this
name count
A 1
A 2
B 1
B 2
B 3
C 1
C 2
D 1


pls any one one solve this........

sachin kumar

• Jun 11th, 2024

Seq----transformer---seq.
Go to the stage variable properties create two staging variables first is s1 and second is s2 .
s2 = if inputcolumn = s1 then s2 +1 else 1
s1= inputcolumn
create new column is count.
s2= count

Rams

• Jul 10th, 2021

Seqfile---Sort----Trans-seqfile
Sort Stage---KeyChange column true
Transfor- in advance tab set mode-Sequence
Create one stage Variable: Stagevar= if KeyChangecol=1 then 1 else Stagevar+1
Create on extracolumn in output give Stagevar=Newcolname

Answer Question  Select Best Answer

1. Is the Hash file is active or passive? If we take as source ?2. can u take seq file as look up?3. In hash file dynamic 30, there r two types:1)genaric2)specific what is the meaning?4. how to connect MERGE STAGE while source as two tables?5. what is the purpose of MERGE?6. how can DS job scheduled in Unix?7. how do u know how many rows rejected?8. use of universe stage?9. what is SEQ file buffer?10. diff...

jallu

• Jun 3rd, 2015

Scheduling the datastage jobs in unix using corntab utility (or) uc4

jallu

• Jun 3rd, 2015

Merge stage combine two tables based on key column and its implemented two joins 1.innerjoin,2.leftouter join. merge stage can handle large volume of data and it need less memory, the data must be partitioned and sorted also it capture the rejected data from updated source.

Answer Question  Select Best Answer

Hi,

Can you please solve this in datastage..

my input is
name,city
johnson,newyork
johnson,mumbai
johnson,delhi

want output as
name,city1,city2,city3
johnson,newyork,mumbai,delhi

pls explain with steps
thanking in advance...

Ruchi Gautami

• Dec 30th, 2019

File -->> Sort -->> Transformer -->> O/P File Sort: Enable key column change as true. Transformer: Define one stage variable SVar if key_change =1 then city else SVar:,:city Define 3 columns Cit...

Alisha

• Aug 8th, 2019

Can you please elaborate the Staging variable condition? how we define staging variable and how we are putting in conditon

Answer Question  Select Best Answer

Stage Variable - An intermediate processing variable that retains value during read and doesnt pass the value into target column. Derivation - Expression that specifies value to be passed on to the target column. Constant - Conditions that are either true or false that specifies flow of data with a link. 

venkat

• Mar 28th, 2016

In Transformer stage there are 3 Types: 1) Stage Variables are used for passing a value as a input value. 2) Derivation: In this stage all functions like logical, Mathematical, String, Date and Time ...

HIANSHU SINGH

• Feb 17th, 2016

Order of execution is:
Stage Variable
Constraint then
Derivation

Answer Question  Select Best Answer

Scenario- if suppose we have 3 jobs in sequencer, while running if job1 is failed then we have to run job2 and job 3 ,how we can run? plz ans this thanks in advance

Rekha Ramakrishnan

 Profile Answers by Rekha Ramakrishnan Questions by Rekha Ramakrishnan

• Aug 23rd, 2012

In the first sequence trigger condition there would be option like condition, unconditional, failed etc. You can select Unconditional so that even if first sequence fails or succeed it automatically redirect to next sequence.

Gopi N

• Jul 11th, 2012

If the scenario we have like 1st is abort and then trigger 2nd and 3rd do the below, give the trigger condition like, 1> If job aborted give the link trigger condition which is going to 2nd and 3rd j...

Answer Question  Select Best Answer

A sequential file has 8 records with one column, below are the values in the column separated by space,1 1 2 2 3 4 5 6In a parallel job after reading the sequential file 2 more sequential files should be created, one with duplicate records and the other without duplicates.File 1 records separated by space: 1 1 2 2File 2 records separated by space: 3 4 5 6How will you do it

Ram

• Jul 1st, 2016

Hi Pooja, Its absolutely possible.. Src --> Copy(linksort) ---> Aggr(count rows) another link from copy -----------------> Join (Copy & aggr) ---> Filter(count=1 for trg1 and co...

Pooja Trivedi

• Jun 30th, 2016

This will not give the desired output as the we want the duplicate records also n number of times where n is the number of record present in the file.

Answer Question  Select Best Answer

How to get top five rows in DataStage? I tried to use @INROWNUM,@OUTROWNUM system variables in transformer..but they are not giving unique sequential numbers for every row...please help!

Thanks in advance!!

ravisankar

• Sep 24th, 2018

Also you can get form sequential file (Read first row (5))

lalit

• Oct 9th, 2017

If you want to use transformer only so you need to sort that data first....and after that you need to know how many no. of partitions you have in your transformer stage. Because @inrownum and @outrown...

Answer Question  Select Best Answer

I have data in Table as

ID
1
2
3
1
4
3
3
5
6
6
7

Now I want to have Output as repeatating records in one table & non-repeatating in another table

Table 1 :
Id
2
4
5
7

Table 2:
ID
1
1
3
3
3
6
6

anirudh

• May 9th, 2017

You can use sort->aggregrator->count_rows->transformer stage write constraints row_count>1 to one file and row_count>1 to another output file

Neha

• Apr 7th, 2017

Seq File-> Aggregator (Count group by ID)->Transformer(Two output link , Use @Iteration1 and put @Iteration value in OpLnk2

Answer Question  Select Best Answer

what is the difference between dataset stage and sequential file stage? even one more to be added here, What is the difference between dataset stage and fileset stage?

Sourabh Kulkarni

• Jan 22nd, 2023

Deepak!, how to load a sequential file stage having data more than 2 Gb?

ravikumar

• Jul 24th, 2017

1) Sequential file stage we can use UNIX commands and in dataset stage we cant use UNIX commands.
2) Sequential file stage filename save as .txt and dataset - .ds

Answer Question  Select Best Answer

We use a) "Iconv" function - Internal Convertion. b) "Oconv" function - External Convertion. Function to convert mm/dd/yyyy format to yyyy-dd-mm is Oconv(Iconv(Filedname,"D/MDY[2,2,4]"),"D-MDY[2,2,4]") 

vipul choudhary

• Aug 22nd, 2013

There are two types of hash file

1. modulus hash file- file size increases randomly
2. splitting hash file-file size decreases randomly

Muralidhar

• Jul 29th, 2013

By default datastage date format is :yyyy-mm-dd.The input is mm/dd/yyyy. String_to_date(inputdate,"%mm%dd%yyyy")

Answer Question  Select Best Answer

If you have Numerical+Characters data in the source, how will you load only Character data to the target? Which functions will you use in Transformer stage?

raj

• Nov 8th, 2012

Example : raje123ndh456ar

Code
convert(0123456789,,raje123ndh456ar) = rajendhar 

now it is converted to character string and we can load only character.

Vinay Sharma

• Oct 4th, 2012

Use alpha function.
Exp-->alpha(123vinay567)
Ans-->vinay

i thing this is your requeriment..

Answer Question  Select Best Answer

Scenario:
Objective: The interface aims to consolidate the round-trip ticket cost of passengers.
Description: The source file is a .txt file, train_route_src.txt, consolidated with trains from a particular source to destination. There are many repetitions in the source file (Reverse Duplication: eg. BLR --> BBS and BBS --> BLR). Remove the reverse duplicates and maintain the target in...

Bhargav

• Mar 2nd, 2018

I don't think you got the output for city in the format of SRC1-DES1-SRC1 (I mean two city names)? I tired your way but didn't get the expected output.

Alam

• Feb 15th, 2018

Ans--> Seq_File------>Sort------>Filter------->Seq_file
Sort Stage--->Generate key change column(it return for first value 1 and for duplicate 0) then used filter stahe
Filter Stage----> Filter by Key change column=1.
I think you will get the result.

Answer Question  Select Best Answer

What is the order of execution in the transformer?

Ravi

• Dec 20th, 2024

1. Stage variable
2. it will check for any looping condition is there next
3. it will go for Constraints and derivations

amarnath

• Oct 15th, 2012

What is

1.Stage variables
2.Constraints
3.Derivations

Answer Question  Select Best Answer

vydyu4u

 Profile Answers by vydyu4u Questions by vydyu4u

• Oct 29th, 2010

Hi guys... even I got the same problem... I worked on it ... at last I got the solution.. but I guess u don't believe...I got the same error...but once.. I have connect to internet for browsing ... an...

g.koteshwar

 Profile Answers by g.koteshwar Questions by g.koteshwar

• Oct 19th, 2009

Please try by specifying "." in the HostName.Best Regards,Koteshwar

Answer Question  Select Best Answer

vij

• Jan 6th, 2014

Default partition technique is Auto in all please check once

mallika_chaithu

 Profile Answers by mallika_chaithu Questions by mallika_chaithu

• Jun 8th, 2011

Hope the below one helps you.Join Stage: 1.) It has n input links(one being primary and remaining being secondary links), one output link and there is no reject link2.) It has 4 join operations: inner...

Answer Question  Select Best Answer

I have 3 jobs A,B & C, which are dependent each other, I want to run A & C jobs daily and B job run only on Sunday. How can I do it?

sudheer

• Aug 20th, 2015

A Job ----> Routine Activity ---Sunday---> B Job ----> C Job
--- Not Sunday -----> C Job

bimaljsr@gmail.com

• Aug 10th, 2015

Sequence Design -

A Job---> (B sequence explained later) --> C Job

B sequence contents
Dummy job to check specific day ---> condition activity with 2 link --> if Sunday run job B, if not Sunday run dummy job and finish.

Answer Question  Select Best Answer

I have one scenario below, how can we achieve.

City1,City2,Distance
==============
blr, pune,1000 km
pune, blr, 1000 km

As we have same data in 2 records but need to delete any one of the duplicate record.

kalyanreddy

• Jan 30th, 2024

Use the remove duplicate stage and use the hash partition, select the key column as 3 rd column (1000 km).
and select record retained = first , it will remove the duplicate record, you can also use sort stage for this.

Sirisha d

 Profile Answers by Sirisha d Questions by Sirisha d

• Aug 8th, 2017

Job Design : Sequential file(I/p) --> Transformer --> Sequential file (o/p) In the Transformer stage , define 2 stage varibles st1 and st2. Derivation for st1 => If city2:city1=st2 Then 1 Else 0 ...

Answer Question  Select Best Answer