-
Remove Duplicate Records
what is process to remove duplicate records using Copy Stage.
Abhijain
- Sep 26th, 2008
In the copy stage, there is an option to sort the input data where you can select the key on the basis of which you can perform the sort operation. There is an option named 'Unique'. Select th...
-
What are the Job parameters?
lakshmib
- Sep 24th, 2008
It is a runtime parameter which allows you to enter the value to restrict the data at the job run time. A job parameter is created with name,promt,data type,default value,and it is reprsented as follows #parameter name#.
mallakishore
- Oct 20th, 2005
These Parameters are used to provide Administrative access and change run time values of the job.EDIT>JOBPARAMETERSIn that Parameters Tab we can define the name,prompt,type,value
-
How can we implement Lookup in DataStage Server jobs?
tanisha11
- Sep 24th, 2008
You can use Transformer stage in server jobs in place of LookUp Stage in PX and Hashfile for reference data set in place of LookUp File stage which was used in PX.
Purnima
- Mar 30th, 2006
In server canvs we can perform 2 kinds of direct lookupsOne is by using a hashed file and the other is by using Database/ODBC stage as a lookup.
-
How can i call a stored procedure only once instead of calling for each and every row?
Abhijain
- Sep 23rd, 2008
There is a stage named Stored Procedure available in Datastage palette under Database category. You can use that stage to call your procedure in Datastage jobs.
-
DataStage Transformer stage Server Jobs and Parallel Jobs
What is the difference between transformer stage in serverjobs and transformer stage in parallel job?
Abhijain
- Sep 19th, 2008
Transformer stage in server jobs vs Transformer stage in Parallel jobs In server jobs, support single input stream link and multiple input reference link where in parallel support only single input st...
-
Data Sets and File Sets
Expalin difference between Data Sets and File Sets? where each one is used and how they are used?What is the size limit?
Abhijain
- Sep 19th, 2008
The dataset and fileset both are file stage. Dataset can have single input link or single output link whereas, Fileset can have single input link or single output link and a single reject link.File se...
-
Hi everyone i have loaded datastage 7.5 on windows xp but i could not log on to it. The error i am facing is "host name not valid or host name not responding".i have tried all options found in this forum but still i could not
Saumendra_int
- Sep 16th, 2008
Hi,You need to know your computer name by right clicking on the computer icon on the desktop and then select properties. After that you will see small window, then you need to select "computer na...
imrankhateeb
- Sep 6th, 2006
The problem is that you have no password for compurter user. better create a password for user.try once
-
How will you determine the sequence of jobs to load into data warehouse?
First we execute the jobs that load the data into Dimension tables, then Fact tables, then load the Aggregator tables (if any).
luckyguy0007
- Nov 28th, 2007
The sequence of the job can also be determined by the determining the parent child relationship in the target tables to be loaded. parent table always need to be loaded before child tables.
-
Server transformer and Parallel transformer
Explain the difference between server transformer and parallel transformer
kairunnisha.k
- Aug 4th, 2008
Server transfomer is same as basic transfomer used in SMP systems. Uses a server interface to call a server transformer stage. But parallel transfomer are same as normal transfomer used in parallel jobs. They use a c-based environment that is called osh (orchestrate shell).
santhosh.gsk
- Dec 27th, 2007
The main difference is server Transformer supports basic transforms only,but in pararllel both basic and pararllel transforms. server transformer is basic language compatability,pararllel transformer is c++ language compatabillity.
-
In datastage how we can do for this type or requirement:The sales data will be extracted in 2 flat files.Here is the codification suggested: SALE_HEADER_XXXXX_YYYYMMDD.PSVSALE_LINE_XXXXX_YYYYMMDD.PSVXXXXX = LVM sequence to ensure unicity and continuity of file exchangesCaution, there will an increment to implement.YYYYMMDD = LVM date of file creation COMPRESSION AND DELIVERY TO: SALE_HEADER_XXXXX_YYYYMMDD.ZIP AND SALE_LINE_XXXXX_YYYYMMDD.ZIPif suppose we run first time means the job names are sale_header_1_systemcurrentdate & sale_line_1_systemcurrentdate.if we run next time means the file name are sale_header_2_systemcurrentdate & sale_line_2_systemcurrentdate.if we run next time means the file names aresale_header_3_systemcurrentdate & sale_line_3_systemcurrentdate.we want one increment in that xxxxx place .can any one give suggestion on this issue.?
Abhijain
- Jul 29th, 2008
I am not sure will this work or not, I've not tried, but you can check with the looping stage from a sequence.Call a job activity in a job sequence where you invoke a job ...
-
Are there any ways of passing parameters or values across parallel jobs in a sequencer? Scenario: Job 'A' would execute and based on the result of the Job we want either Job 'B' or Job 'C' to execute. Hence the result of Job 'A' would determine the sequence of operation.
Abhijain
- Jul 29th, 2008
Not clear from your question, what do you mean by the result of the job. what I got is- you want to perform the conditional run of the jobs. It can be possible through sequencer.In sequence, You can c...
subrahmanyam sanka
- Aug 2nd, 2007
Please eloborate your question "based on result of job", one techinque is to use the parameter file and set other session based on event wait.
-
How good are you with your PL/SQL?
On the scale of 1-10 say 8.5-9
padmanabhan.s
- Jul 29th, 2008
Though we dont write the PL/SQL directly, we can write a procedure or a fucntion which determines our needs and then can be called in the datastage ODBC or OCI stage using call() statement. For eg. if...
-
How to work with Repeating fields in Datastage?
I am working on Datastage. Can any body tell me how to work on repeating fields and multiple headers.
bhaskar.jha
- Jul 25th, 2008
We should create some staging variable & define the value for repeating fields there & then just map these to respective columns.
-
How can I identify the duplicate rows in a seq or comma delimited file?the case is...> the source has 4 values like, agent id, agent name, etc... our requirement is that the ID shouldn't be repeated. so how can i identify the duplicate rows , set a flag and send the rejects to the specified reject file? the source systems data is directly given to us. tha's why we are getting these duplicates.if it has a primary key set up already then it would have been very easy.thanks in advance.
ds_ng
- Jul 23rd, 2008
If your working server jobs, use Sort stage then use Aggregator stage. Use property like 'Last' or 'First'. Then duplicated rows will be removed
the_xxx
- Jul 3rd, 2007
Hi, if your working on Server jobs. Sort the data first and use Hash file stage which has the property of eliminating duplicates.
-
Surrogate key
What is the Disadvantage of surrogate key stage?
rajul.ds
- Jul 22nd, 2008
To my concern if the data is not properly processed on nodes..in such suitations this surrogate key generates holes(simply skips the ordering )ex:aa-1bb-2ba..bg...cc-3dd-4ddd-5here for ba and bg do not have seq key ,here ba and bg have holes
debojyoti_datastage
- Jul 21st, 2008
The main disadvantage of this stage comes when you use it second time around..There you have to give the initial value of the surrogate key....I faced the similar situation and the only way i found wa...
-
Debugging Stages
What is the purpose of Debugging stages? In real time Where we will use?
rajul.ds
- Jul 22nd, 2008
Hi the main use of Debugging Stages(row gen,peak,tail,head etc) are they are help full to monitor jobs,and they generate mock data wen we dont have real time data to test
-
What is Pipeline Parallelism?
What is Pipeline Parallelism in Datastage?
leelasankar.pr
- Jul 22nd, 2008
It is the ability of a down streem stage to process arow ,which the up streem stage processed that row
-
Why you need Modify Stage?
When you are able to handle Null handling and Data type changes in ODBC stages why you need Modify Stage?
leelasankar.pr
- Jul 22nd, 2008
By using this modify stage we can change data types,keep and drop columns and also we can handle null values
-
Sparse Lookup and Normal Lookup
What are the differences between Sparse Lookup and Normal Lookup?
karthikgeekkarthik
- Jul 9th, 2008
normal look-up:all the reference table data is stored in the buffer for cross- check with the primary table data.sparse lookup:each record of the primary table is cross checked with the reference tabl...
nagakalyan
- Jun 23rd, 2008
Sparse means we will generate query source bases and one by one record ,and normal is we can take look up on target table at a time multiple records
-
Find table count in Datastage
How to find out individual counts for a particular table
karthikgeekkarthik
- Jul 9th, 2008
While implementing the scd type-2, due to maintianing of history, the primary key constraint will be violated. to have a primary key for the table for the sake of unique key we use surrogate key.
DataStage Interview Questions
Ans