-
Transform XML file to sequential file
Using server job, how to transform data in XML file into sequential file?? i have used XML input, XML transformer and a sequential file.
shm_Ariel
- Jul 4th, 2008
Import the XSD for the xml file via manager-metadata importer and store it. If transformation functions are not required to be done on the data in XML file, there is no need for the tra...
dwh_com
- Jun 24th, 2008
i will explain u the stages used inorder..FOLDER STAGE--------->XMLINPUTSTAGE--------->TRANSFORMER------>SEQUENTIAL FILEfolder stage is to check for the folder which has xmlfile and u have to...
-
Change capture
What is the difference between change capture and change apply stages
ritu singhai
- Jul 7th, 2008
Change capture stage is used to get the difference between two sources i.e. after dataset and before dataset. The source which is used as a reference to capture the changes is called after dataset. Th...
HemaDS
- May 29th, 2008
Change Capture is used to capture the changes between the two sources.Change Apply will apply those changes in the output file.
-
Find table count in Datastage
How to find out individual counts for a particular table
karthikgeekkarthik
- Jul 9th, 2008
While implementing the scd type-2, due to maintianing of history, the primary key constraint will be violated. to have a primary key for the table for the sake of unique key we use surrogate key.
-
Sparse Lookup and Normal Lookup
What are the differences between Sparse Lookup and Normal Lookup?
karthikgeekkarthik
- Jul 9th, 2008
normal look-up:all the reference table data is stored in the buffer for cross- check with the primary table data.sparse lookup:each record of the primary table is cross checked with the reference tabl...
nagakalyan
- Jun 23rd, 2008
Sparse means we will generate query source bases and one by one record ,and normal is we can take look up on target table at a time multiple records
-
Why you need Modify Stage?
When you are able to handle Null handling and Data type changes in ODBC stages why you need Modify Stage?
leelasankar.pr
- Jul 22nd, 2008
By using this modify stage we can change data types,keep and drop columns and also we can handle null values
-
What is Pipeline Parallelism?
What is Pipeline Parallelism in Datastage?
leelasankar.pr
- Jul 22nd, 2008
It is the ability of a down streem stage to process arow ,which the up streem stage processed that row
-
Debugging Stages
What is the purpose of Debugging stages? In real time Where we will use?
rajul.ds
- Jul 22nd, 2008
Hi the main use of Debugging Stages(row gen,peak,tail,head etc) are they are help full to monitor jobs,and they generate mock data wen we dont have real time data to test
-
Surrogate key
What is the Disadvantage of surrogate key stage?
rajul.ds
- Jul 22nd, 2008
To my concern if the data is not properly processed on nodes..in such suitations this surrogate key generates holes(simply skips the ordering )ex:aa-1bb-2ba..bg...cc-3dd-4ddd-5here for ba and bg do not have seq key ,here ba and bg have holes
debojyoti_datastage
- Jul 21st, 2008
The main disadvantage of this stage comes when you use it second time around..There you have to give the initial value of the surrogate key....I faced the similar situation and the only way i found wa...
-
How can I identify the duplicate rows in a seq or comma delimited file?the case is...> the source has 4 values like, agent id, agent name, etc... our requirement is that the ID shouldn't be repeated. so how can i identify the duplicate rows , set a flag and send the rejects to the specified reject file? the source systems data is directly given to us. tha's why we are getting these duplicates.if it has a primary key set up already then it would have been very easy.thanks in advance.
ds_ng
- Jul 23rd, 2008
If your working server jobs, use Sort stage then use Aggregator stage. Use property like 'Last' or 'First'. Then duplicated rows will be removed
the_xxx
- Jul 3rd, 2007
Hi, if your working on Server jobs. Sort the data first and use Hash file stage which has the property of eliminating duplicates.
-
How to work with Repeating fields in Datastage?
I am working on Datastage. Can any body tell me how to work on repeating fields and multiple headers.
bhaskar.jha
- Jul 25th, 2008
We should create some staging variable & define the value for repeating fields there & then just map these to respective columns.
-
How good are you with your PL/SQL?
On the scale of 1-10 say 8.5-9
padmanabhan.s
- Jul 29th, 2008
Though we dont write the PL/SQL directly, we can write a procedure or a fucntion which determines our needs and then can be called in the datastage ODBC or OCI stage using call() statement. For eg. if...
-
Are there any ways of passing parameters or values across parallel jobs in a sequencer? Scenario: Job 'A' would execute and based on the result of the Job we want either Job 'B' or Job 'C' to execute. Hence the result of Job 'A' would determine the sequence of operation.
Abhijain
- Jul 29th, 2008
Not clear from your question, what do you mean by the result of the job. what I got is- you want to perform the conditional run of the jobs. It can be possible through sequencer.In sequence, You can c...
subrahmanyam sanka
- Aug 2nd, 2007
Please eloborate your question "based on result of job", one techinque is to use the parameter file and set other session based on event wait.
-
In datastage how we can do for this type or requirement:The sales data will be extracted in 2 flat files.Here is the codification suggested: SALE_HEADER_XXXXX_YYYYMMDD.PSVSALE_LINE_XXXXX_YYYYMMDD.PSVXXXXX = LVM sequence to ensure unicity and continuity of file exchangesCaution, there will an increment to implement.YYYYMMDD = LVM date of file creation COMPRESSION AND DELIVERY TO: SALE_HEADER_XXXXX_YYYYMMDD.ZIP AND SALE_LINE_XXXXX_YYYYMMDD.ZIPif suppose we run first time means the job names are sale_header_1_systemcurrentdate & sale_line_1_systemcurrentdate.if we run next time means the file name are sale_header_2_systemcurrentdate & sale_line_2_systemcurrentdate.if we run next time means the file names aresale_header_3_systemcurrentdate & sale_line_3_systemcurrentdate.we want one increment in that xxxxx place .can any one give suggestion on this issue.?
Abhijain
- Jul 29th, 2008
I am not sure will this work or not, I've not tried, but you can check with the looping stage from a sequence.Call a job activity in a job sequence where you invoke a job ...
-
Server transformer and Parallel transformer
Explain the difference between server transformer and parallel transformer
kairunnisha.k
- Aug 4th, 2008
Server transfomer is same as basic transfomer used in SMP systems. Uses a server interface to call a server transformer stage. But parallel transfomer are same as normal transfomer used in parallel jobs. They use a c-based environment that is called osh (orchestrate shell).
santhosh.gsk
- Dec 27th, 2007
The main difference is server Transformer supports basic transforms only,but in pararllel both basic and pararllel transforms. server transformer is basic language compatability,pararllel transformer is c++ language compatabillity.
-
How will you determine the sequence of jobs to load into data warehouse?
First we execute the jobs that load the data into Dimension tables, then Fact tables, then load the Aggregator tables (if any).
luckyguy0007
- Nov 28th, 2007
The sequence of the job can also be determined by the determining the parent child relationship in the target tables to be loaded. parent table always need to be loaded before child tables.
-
Hi everyone i have loaded datastage 7.5 on windows xp but i could not log on to it. The error i am facing is "host name not valid or host name not responding".i have tried all options found in this forum but still i could not
Saumendra_int
- Sep 16th, 2008
Hi,You need to know your computer name by right clicking on the computer icon on the desktop and then select properties. After that you will see small window, then you need to select "computer na...
imrankhateeb
- Sep 6th, 2006
The problem is that you have no password for compurter user. better create a password for user.try once
-
Data Sets and File Sets
Expalin difference between Data Sets and File Sets? where each one is used and how they are used?What is the size limit?
Abhijain
- Sep 19th, 2008
The dataset and fileset both are file stage. Dataset can have single input link or single output link whereas, Fileset can have single input link or single output link and a single reject link.File se...
-
DataStage Transformer stage Server Jobs and Parallel Jobs
What is the difference between transformer stage in serverjobs and transformer stage in parallel job?
Abhijain
- Sep 19th, 2008
Transformer stage in server jobs vs Transformer stage in Parallel jobs In server jobs, support single input stream link and multiple input reference link where in parallel support only single input st...
-
How can i call a stored procedure only once instead of calling for each and every row?
Abhijain
- Sep 23rd, 2008
There is a stage named Stored Procedure available in Datastage palette under Database category. You can use that stage to call your procedure in Datastage jobs.
-
How can we implement Lookup in DataStage Server jobs?
tanisha11
- Sep 24th, 2008
You can use Transformer stage in server jobs in place of LookUp Stage in PX and Hashfile for reference data set in place of LookUp File stage which was used in PX.
Purnima
- Mar 30th, 2006
In server canvs we can perform 2 kinds of direct lookupsOne is by using a hashed file and the other is by using Database/ODBC stage as a lookup.
DataStage Interview Questions
Ans