-
Increment Values based on column (Looping)
I have source like this
Num, SeqNo,Ln,Qty
101, 1 ,1,5
I wanna target following below
Num,SeqNo,Ln,Qty
101, 1 , 1, 1
101, 1 , 2, 1
101, 1 , 3, 1
101, 1 , 4, 1
101, 1 , 5, 1
Based on Qty value records will be incremented.If qty value is 4 then o/p will be like below
Num,SeqNo,Ln,Qty
101, 1...akhilesh.shivhare
- Sep 13th, 2013
Yours i/p data
Num,SeqNum,Ln,Qty
101,1,1,5
and o/p data
Num,SeqNum,Ln,Qty
101,1,1,1
101,1,2,1
101,1,3,1
101,1,4,1
101,1,5,1
steps-
- use transformer
-define stage variable stgvar_Qty with value 1 means stgvar_Qty=1
-define loop with condition @ITERATION -
Most Difficult Jobs you have created
Hi Guys,
I have 3 yrs for experiences in datastage , though not much practical experience due to various reasons, now I have been asked this question in 4 of my interviews and I am always flounder at it . Have tried different approaches , telling the truth , telling a real situation I faced which actually was not that difficult , but I always seems to flounder at this question... -
Explain Datastage configuration File and its importance
Sushils13
- Aug 22nd, 2013
The Datastage configuration file is specified at runtime by a $APT_CONFIG_FILE variable. Configuration file structure Datastage EE configuration file defines number of nodes, assigns resources to ea...
-
How to handle Date convertions in Datastage? Convert a mm/dd/yyyy format to yyyy-dd-mm?
We use a) "Iconv" function - Internal Convertion. b) "Oconv" function - External Convertion. Function to convert mm/dd/yyyy format to yyyy-dd-mm is Oconv(Iconv(Filedname,"D/MDY[2,2,4]"),"D-MDY[2,2,4]")
-
What is the meaning by OCI stage ?
Sushils13
- Aug 20th, 2013
Oracle Call Interface (OCI), it is a set of low-level APIs used to interact with Oracle databases. It allows one to use operations like logon, execute, parss etc. using a C or C++ program.
Ramon
- Sep 22nd, 2011
It is your connectivity stage object to your database. Think of it as your db stage.
-
What are the Environmental variables in Datastage?
Sushil
- Aug 19th, 2013
Basically Environment variable is predefined variable those we can use while creating DS job.We can set either as Project level or Job level.Once we set specific variable that variable will be available into the project/job
glaciya
- Dec 12th, 2011
The Environmental variables in datastage are some pathes which can support system can use as shortcuts to fulfill the program running instead of doing nonsense activity. In most time, environmental variables are defined when the software have been installed or being installed.
-
How to perform loj nd ij in lookup stage
How to perform left outer join and right outer join in lookup stage
sivaksa
- Aug 13th, 2013
You need right outer join in lookup..please change the link order like left to right, Right to left put lookup failure condition ..continue...
mallika_chaithu
- Jun 9th, 2011
In Lookup stage properties, you will have constraints option. If you click on constraints button- you will get options like continue, drop, fail and rejectIf you select the option continue: it means l...
-
Job based scenario
TABLE T1 with c1 and Table T2 with c1
1 3
2 4
2 5
3
4
5
...Dinesh
- Aug 19th, 2011
Use lookup stage...and choose reject option !
you will get the matched records in master output file(3,4,5,5) and unmatched in reject file(1,2,2,6,7). -
How did you handle an 'Aborted' sequencer?
In almost all cases we have to delete the data inserted by this from DB manually and fix the job and then run the job again.
Read Best Answer
Editorial / Best Answer
ritu singhai- Member Since Jul-2008 | Jul 5th, 2008
Have you set the compilation options for the sequence so that in case job aborts, you need not to run it from from the first job. By selecting that compilation option you can run that aborted sequence from the point the sequence was aborted.
Like for example, you have 10 jobs(job1, job2, job3 etc.) in a sequence and the job 5 aborts, then by checking "Add checkpoints so sequence is restartable on failure" and "Automatically handle activities that fail" you can restart this sequence from job 5 only. it will not run the jobs 1,2,3 and 4.
Please check these options in your sequence.
Hope this helps.Mallikarjuna_G
- Aug 10th, 2013
Two things needs to be handled when a Job Sequence aborts. 1. We must have an exception handling code that notifies us about the failure 2. When we re-run the sequence after fixing the Sequence, it ...
Riten
- May 30th, 2012
To Handle Aborted Sequence These are the steps to be taken: First Add Terminator to Job Sequence and Choose Terminator with Other option(Trigger in Job sequence) ( if job fails it will go to Other lin...
-
How to connect two stages which do not have any common columns between them?
Mallikarjuna_G
- Aug 10th, 2013
If those two stages are sources and if it is valid that though the names of columns from two sources differ but they are same, then use a copy stage infront of one source stage and rename column as pe...
muralidhar
- May 30th, 2013
This is little tricky question.we can do in two ways.
1)we can connect using lookup stage if both columns having same datatype.
2)We can add one extra column that is common for two files then we can connect. -
Fetching last row from a particular column of sequential file
how to fetch the last row from a particular column.. Input file may be sequential file...
Mallikarjuna_G
- Aug 10th, 2013
There are multiple ways to do this, given that input is a sequential file. Two of them are
1. Use "Filter" option available in Seq file stage. Specify a unix command like: tail -1 (recommended)
2. Use a tail stage next to Seq filestage and then specify.Akil
- Apr 1st, 2013
There are 2 ways to fetch the last row of any file if the number of records in the file is not known before run time:
1) Use the tail stage and run the tail stage in sequential mode
2) Use the lastrow() function in the transformer stage -
What is the purpose of the copy stage:
What is the uses of the copy stage with out copies input link to output link datasetsand it can have any purposes pls send me with example
Mallikarjuna_G
- Aug 10th, 2013
Use Copy stage for simple operations like :
to multicast the same input data among multiple output links.
placeholder between stages to avoid buffer issues
renaming Columns
dropping Columns
implicit (default) type ConversionsAkila
- Apr 1st, 2013
Besides used for making copies of the input, copy stage is also helpful for achieving 1) dropping columns between stages 2) to change column names 3) if the scenario is to end the job flow directly f...
-
How do you use Surrogatekey key in reporting?
Mallikarjuna_G
- Aug 10th, 2013
In a typical data warehouse environment, we normally have a requirement to keep history. So, we would end up having multiple rows for a given Primary key. So, we define a new column that doesn't have ...
djkool4u
- Jul 11th, 2013
Is Slowly Changing Dimension (SCD) Implementation we use Surrogate key as the primary key is being duplicated for the sake of keeping history data for the records with the same pk.
-
Which partition is best in performance level?
Mallikarjuna_G
- Aug 10th, 2013
It depends on the job design and requrement. When you specify SAME partitioning, datastage uses the partioing method defined in the previous stage and will not perform any partitioning in the current...
Muralidhar
- May 30th, 2013
Same partition.
The reason is it keeps the previous partition and send to output as it is. -
No of processors in DataStage
How do we know the no of processors in a job? Is there any specific calculation for this.
Mallikarjuna_G
- Aug 10th, 2013
There will not be any processors in the job. Your question could be - find the number of nodes/processors on which the job is running. So the answer to this - go to Director and open the log for the ...
Kumaresh
- Jul 19th, 2013
Run the job. Go to director log. Check for the apt config data displayed over there. That will show the number of processors/nodes.
-
Job running slow
Hi,
Job1 is running for 10 minutes for the first time and the same job1 is running for 15 minutes for the second time ,the load being the same for both.Could someone explain..Mallikarjuna_G
- Aug 10th, 2013
One reason could be that - for the first time the job is just loading/inserting data into target. When you run the same job again, it would take more time as it tries to update from second time. Upda...
Raju Nath
- Jun 27th, 2013
Hi you can use the delete and then load command during loading then it will be the same time. First time when you are loading that time the dataset/table is empty that is why its taking less time bu...
-
Dimension Modelling types along with their significance
Data Modelling is Broadly classified into 2 types. a) E-R Diagrams (Entity - Relatioships). b) Dimensional Modelling.
BHANU
- Jul 9th, 2013
Dimensional modeling is a technique for conceptualizing and visualizing the data there are two types of dimensional modeling
1.Snowflake schema
2.Star schema
cyberdiptikanta
- Jun 26th, 2010
Dimensional Modelling:It is a designing methodlogy for designing datawarehouse with dimensions& facts.It is of three types 1) Conceptual Modelling 2) Logical Modelling 3) Physical Modelling1) Conc...
-
-
What is the size of your database ?
Please answer this question
-
DataStage Interview Questions
Read Best Answer
Ans