-
-
If i run the job first 10 times there is no time variation in job execution.In same way i run the job for 100 times it takes 10 times extra time.what is the solution for it?
nikhilanshuman
- Mar 19th, 2010
The solution is to check for any bottlenecks. Try running the job for two or three more times after certain intervals and take performance statistics. If the performace is still slow then try optimizing the jobs.
nikhilanshuman
- Mar 19th, 2010
Depends on the runtime environment. Sometimes on the datastage server many processes are running at the same time. Sometimes the server might be lacking enough resources required for the job. Th...
-
-
What is the use and advantage of procedure in datastage?
hemant.agarwal03
- Nov 13th, 2009
If we have a complex business logic and we may need to create mutiple jobs to achive that , then we use procedure in data stage which provide us final output in a single job. It is faster then normal SQL statement also.
Him121
- Jun 22nd, 2007
To trigger Database operations at before or after DB stage access.
-
How do we use Job Parameters in datastage jobs.
I know we use them in the project level and also in the job level and also that we can give values at run time(like UN, Pswd etc). Theoratically I understood. But practically unable to implement it. Can somebody explain me in detail with an example. I wud seriously appreciate your help. Thanks Guyz.
Behrouz
- Jan 27th, 2009
For example I create a parameter for my hashfile folder like it : Name: $pHashdir, type:string,def.value: C:DataStageInput DATAHash and when I use my hash file in path file name i use just ...
Fanguna
- Nov 19th, 2007
There is an icon to go to Job parameters in the tool bar. Or you can press Ctrl+J to enter into Job Parameters dialog box. Once you enter, give a parameter name and corresponding default value for it....
-
What is surrogate key? what is routine and explain the use in datastage parallel server jobs?
nikhilanshuman
- Nov 30th, 2010
A surrogate key is none business key. it can be a sequential number with no business meanings. these are useful for the underlying applications to maintain relationships between tables.Routines are th...
pavan.daddanalla
- Apr 14th, 2008
Surrogate key is a separate key column which is generated by surrogate key generator. routines are nothing but subset of functions
-
Explain the best approch to do a SCD type2 mapping in parallel job?
manoharkolukula
- Feb 12th, 2008
use CDC, lookup, trasformer stages to impliment SCD2. In CDC just give the changed values and key column, then capture the changed records, in transformer just give the constraint for 0,1,2,3(del,insert,copy,updated data), u will get inserted data and updated data, copied data, deleted data.
-
Problems with Datastage - Date format & Null Handling of a Date field in a schema file
Hi,I have a .csv file as my source.I am reading the data using asequential file stage.Then I am validating the format of the data using a schema file.The date format of the incoming file is '%dd/%mm/%yyyy'.So the datecolumn has a fixed length 10.Now according to the provided incoming data set the date column shouldbe nullable.Can anybody please provide an idea how to handle a nullable datecolumn using...
Abhijain
- Oct 19th, 2009
Read the date field column as varchar and use transformer to check nullabiltiy and if null found assign some default value say '12-Dec-9999' and use the appropriate conversion function an...
Abhijain
- Oct 19th, 2009
Read date field from sequential file as varchar datatype with nullable yes. Use modify stage or transformer to convert the datatype and also check the nullability of the incoming data and if null foun...
-
What is Pipeline Parallelism?
What is Pipeline Parallelism in Datastage?
leelasankar.pr
- Jul 22nd, 2008
It is the ability of a down streem stage to process arow ,which the up streem stage processed that row
-
Check for Job Errors in datastage
in datastage job successfully finished. but showing errors in director window. How do we fix and find the cause for the errors
manoharkolukula
- Feb 12th, 2008
I think in designer u find the green colour but in Director -> log view --> u find some fatal errors and job is aborted, is it, Means job is successfully completed but the data is not loaded in ...
-
What is the use of clear status file
What is the use of clear status file in DS?How we will use it?explain with examples?
nikhilanshuman
- Dec 30th, 2009
If status is cleared for a datastage job,all of its instaces will be deleted.I mean if there is a instance say jobname.inst1 or jobname.inst2 these will be deleted.The entries for that particular jobs will be cleared from RT_Status(n) table.Here n is the job number.
ketanshah123
- Feb 19th, 2008
When you clear a job’s status file you reset the status records associated with all stages in that job. You should therefore use this option with great care, and only when you believe a job has ...
-
Add 10 days to a particular date
How to implement the scenario: Add 10 days to a particular date in Datastage PX
Venkatesh Mekewar
- May 31st, 2016
You can use Date function named "DateFromDaySince()" present inbuilt in Datastage. Example: Consider Link.DaystoAdd contains 10 and Link.GivenDate contains 2016-10-31. Following function will retur...
nagoosk
- Mar 5th, 2008
extract the day part of the date by using the string function and then add how many days u want and then again add all those parts into single string and then convert the string into date object.
-
Find table count in Datastage
How to find out individual counts for a particular table
karthikgeekkarthik
- Jul 9th, 2008
While implementing the scd type-2, due to maintianing of history, the primary key constraint will be violated. to have a primary key for the table for the sake of unique key we use surrogate key.
-
Surrogate key
What is the Disadvantage of surrogate key stage?
rajul.ds
- Jul 22nd, 2008
To my concern if the data is not properly processed on nodes..in such suitations this surrogate key generates holes(simply skips the ordering )ex:aa-1bb-2ba..bg...cc-3dd-4ddd-5here for ba and bg do not have seq key ,here ba and bg have holes
debojyoti_datastage
- Jul 21st, 2008
The main disadvantage of this stage comes when you use it second time around..There you have to give the initial value of the surrogate key....I faced the similar situation and the only way i found wa...
-
Change capture
What is the difference between change capture and change apply stages
ritu singhai
- Jul 7th, 2008
Change capture stage is used to get the difference between two sources i.e. after dataset and before dataset. The source which is used as a reference to capture the changes is called after dataset. Th...
HemaDS
- May 29th, 2008
Change Capture is used to capture the changes between the two sources.Change Apply will apply those changes in the output file.
-
BASIC Transformer and NORMAL Transformer
What is the Exact difference between BASIC Transformer and NORMAL Transformer?When we will go for BASIC Or NORMAL Transformer?
nikhilanshuman
- Mar 19th, 2010
Difference: - A Basic transformer compiles in "Basic Language" whereas a Normal Transformer compiles in "C++".- Basic transformer does not run on multiple nodes wheras a Normal Tra...
Abhijain
- Sep 19th, 2008
The basic transformer stage is similar in appearance and function to the Normal Transformer Stage. Basic transformer stage can only be used for SMP(Symmetric Multiprocessors) systems and not for MPP(Massively Parellel Processing) system or clusters systems.
-
Filter and External Filter stages
What is the difference between Filter and External Filter stages?
shrushti
- Nov 12th, 2015
FILTER EXTERNAL FILTER Filters based on some condition datastage level filter------ Uses UNIX commands to filter Can have optional re...
nagoosk
- May 29th, 2008
Filter is used to pass the records basing on some condition.We will have multiple where conditions to specify.We can send to different output linksExternal filter is used to execute commands of unix.You can give the commands in the specified box with the corresponding arguements.
-
DataStage Engine Commands
I am eager to know about DataStage Engine commands. Can someone tell me something about that?
prasanth37
- Jun 12th, 2008
The following commands can be taken as DS Engine commands, used to start and stop the DS EngineDSHOME/bin/uv -admin -startDSHOME/bin/uv -admin -stop
HemaDS
- May 29th, 2008
According to me, Datastage Engine command is otherwise called as Universe Commands. It is used to retrieve the details that are stored in the datstage repository in the form of files and tables. We ca...
-
Transform XML file to sequential file
Using server job, how to transform data in XML file into sequential file?? i have used XML input, XML transformer and a sequential file.
shm_Ariel
- Jul 4th, 2008
Import the XSD for the xml file via manager-metadata importer and store it. If transformation functions are not required to be done on the data in XML file, there is no need for the tra...
dwh_com
- Jun 24th, 2008
i will explain u the stages used inorder..FOLDER STAGE--------->XMLINPUTSTAGE--------->TRANSFORMER------>SEQUENTIAL FILEfolder stage is to check for the folder which has xmlfile and u have to...
-
High Level Design
How high level design will be prepared in datastage?
vjrockings
- Sep 14th, 2009
HLD (High Level Design) is the overview of a project in very high level prospectus. Here we have to mention the project definition goal and objective of the project, flow diagram of the process, which functions are in scope and are not etc.
k2_swarupa
- Apr 16th, 2009
HLD (High Level Design) is the overview of a project in very high level prospectus. Here we have to mention the project definition, goal and objective of the project, which functions are in scope and which are not, flow diagram of the process etc.
DataStage Interview Questions
Ans