-
Tell me one situation from your last project, where you had faced problem and How did u solve it?
A. The jobs in which data is read directly from OCI stages are running extremely slow. I had to stage the data before sending to the transformer to make the jobs run faster.B. The job aborts in the middle of loading some 500,000 rows. Have an option either cleaning/deleting the loaded data and then run the fixed job or run the job again from the row the job has aborted. To make sure the load...
nikhilanshuman
- Dec 18th, 2010
a) We had a big job with around 40 stages.The job was taking too long tocompile and run.We broke the job into 3 smaller jobs.After this ,we observed that the performance was slighly improved and maint...
-
When should we use ODS?
DWH's are typically read only, batch updated on a scheduleODS's are maintained in more real time, trickle fed constantly
nikhilanshuman
- Dec 19th, 2010
An opearation data store contains the data which are constantly updated through the course of the business operations. ODS is specially designed such that it can quickly perform relatively simply que...
-
DSParams file
Is it like that if we define the values of variables in DSParams file then there is no need to give the values at job level ar Project level ?& how to configure this file at job level ?so that we need not hardcode the values.....
nikhilanshuman
- Dec 19th, 2010
yes.DSParams file contains all the project level parameters which are set up in Datastage Administrator.If the values are provided/modified in this file,the changes are automatically reflected in the ...
-
How can we load the flat file
How can i load a flat file into target as fast as i can?Assuming that the source bottleneck is not there,that is there is no performance issues in the source side.
nikhilanshuman
- Dec 18th, 2010
A Flat file can be read using sequential file stage.To make data load faster,try implementing least stages in you job and use minimal transformations.if you are trying to load the data of a flat file ...
-
Does the BibhudataStage Oracle plug-in better than OCI plug-in coming from DataStage? What is the BibhudataStage extra functions?
nikhilanshuman
- Dec 18th, 2010
There is no such thing like "BibhudataStage Oracle plug-in" in Datastage.The question seems to be wrong.
-
Hican any one can explain what areDB2 UDB utilitiesub
nikhilanshuman
- Dec 18th, 2010
"DB2 UDB" is a stage in Datastage using which the connectivity could be made to DB2 databases.It could be used to fetch the data from DB2 databases or to perform DML operations in DB2(e.g. Insert/update) or Bulk load etc..
-
A batch is running and it is scheduled to run in 5 minutes. But after 10 days the time changes to 10 minutes. What type of error is this and how to fix it?
nikhilanshuman
- Dec 18th, 2010
If the batch is taking more time to execute(10 mins),it may be due to the performance issues.In such cases the performance optimizstion mesures should be taken.If without making any changes,time taken...
-
Does type of partitioning change for SMP and MPP systems?
nikhilanshuman
- Dec 18th, 2010
Datastage is platform independent.A same job,when designed properly can run on SMP as well as MPP systems.Partitioning does not need to be changed for SMP/MPP systems.
-
What is trouble shhoting in server jobs ? what are the diff kinds of errors encountered while running any job?
nikhilanshuman
- Dec 18th, 2010
Troubleshooting in datastage server jobs involves monitoring the job log for fatal errors and taking appropriate actions to resolve them.There can be various errors which could be encountered while ru...
-
Read the String functions in DS
Functions like [] -> sub-string function and ':' -> concatenation operatorSyntax: string [ [ start, ] length ]string [ delimiter, instance, repeats ]
nikhilanshuman
- Dec 17th, 2010
It seems that it is being asked to explain string function.Following are some string functions used in datastage:Compare,Field,Convert,Padstring,TrimB,TrimF,TrimLeadingTrailingSome string conversion functions :StringToDate,StringToDecimal,StringToTime,StaringToUstring,StringToTimestamp etc...
-
Actually my requirement is like that :Here is the codification suggested: SALE_HEADER_XXXXX_YYYYMMDD.PSVSALE_LINE_XXXXX_YYYYMMDD.PSVXXXXX = LVM sequence to ensure unicity and continuity of file exchangesCaution, there will an increment to implement.YYYYMMDD = LVM date of file creation COMPRESSION AND DELIVERY TO: SALE_HEADER_XXXXX_YYYYMMDD.ZIP AND SALE_LINE_XXXXX_YYYYMMDD.ZIPif we run that job the target file names are like this sale_header_1_20060206 & sale_line_1_20060206.if we run next time means the target files we like this sale_header_2_20060206 & sale_line_2_20060206.if we run the same in next day means the target files we want like this sale_header_3_20060306 & sale_line_3_20060306.Ie if whenever we run the same job the target files automatically changing in to filename_increment to previous number(previousnumber + 1)_currentdate;please do needful by repling this question..
nikhilanshuman
- Dec 17th, 2010
Here,the basic thing required is to add 1 to the number which was used in last load.Following is the logic for this:a) Initially take a file and write 0 to it.b) Now in the sequence,create a user vari...
-
What is the difference between DataStage and DataStage Scripting?
nikhilanshuman
- Dec 17th, 2010
Datastage jobs,when compiled generate OSH.OSH is the abbreviation of Orchestrate scripting language.When a datastage job is run,the generated OSH is executed in the backend.
-
How to enable the datastage engine?
nikhilanshuman
- Dec 17th, 2010
To enable datastage engine follow these steps:a) Go to the "DSEngine" directory in Unix.b) now type the command ./uv –admin –startc) the datastage engine will be enabled/started.
-
Orchestrate Vs Datastage Parallel Extender?
Orchestrate itself is an ETL tool with extensive parallel processing capabilities and running on UNIX platform. Datastage used Orchestrate with Datastage XE (Beta version of 6.0) to incorporate the parallel processing capabilities. Now Datastage has purchased Orchestrate and integrated it with Datastage XE and released a new version Datastage 6.0 i.e Parallel Extender.
-
How we use the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting e/xecutable versions on ad hoc or scheduled basis?
nikhilanshuman
- Dec 17th, 2010
The jobs can be scheduled by Datastage Director.In order to schedule the jobs,follow these steps :a) Click on View -> Schedule in the menu of datastage director.b) You will see a list of the ...
-
The above might rise another question: Why do we have to load the dimensional tables first, then fact tables:
As we load the dimensional tables the keys (primary) are generated and these keys (primary) are Foreign keys in Fact tables.
nikhilanshuman
- Dec 17th, 2010
In dimensional model,fact tables are dependenet on the dimension tables.This means that fact table contains foreign keys to dimension tables.This is the reason,dimension tables are loaded first and then the fact table.
-
Compare and Contrast ODBC and Plug-In stages?
ODBC : a) Poor Performance. b) Can be used for Variety of Databases. c) Can handle Stored Procedures. Plug-In: a) Good Performance. b) Database specific.(Only one database) c) Cannot handle Stored Procedures.
nikhilanshuman
- Dec 16th, 2010
ODBC stages are slower as compared to Plugin stages.ODBC stages can handle many databases whereas plugin stages are made specially for a particular database for example Oracle enterprize stage.
-
What is the Batch Program and how can generate ?
Batch programe is the programe it's generate run time to maintain by the datastage it self but u can easy to change own the basis of your requirement (Extraction, Transformation,Loading) .Batch programe are generate depands your job nature either simple job or sequencer job,You can see this programe on job controll option.
nikhilanshuman
- Dec 17th, 2010
A Batch Program is used to run a batch of jobs by writing the Server routine code in the job control section.To generate a batch program,do following:a) Open datastage director.b) Go to Tools->Batch->...
nikhilanshuman
- Dec 17th, 2010
A Batch Program is used to run a batch of jobs by writing the Server routine code in the job control section.To generate a batch program,do following:a) Open datasatge director.b) Go to Tools->Batc...
-
How many places u can call Routines?
Four Places u can call (i) Transform of routine (A) Date Transformation (B) Upstring Transformation (ii) Transform of the Before & After Subroutines(iii) XML transformation(iv)Web base trannsformation
nikhilanshuman
- Dec 16th, 2010
Routines can be called at the following places:a) In the job properties,There is an option to call the Before and After job subroutines.b) In the job sequence,there is an activity called "Routine...
-
Could you please help me with a set of questions on Parallel Extender?
X
DataStage Interview Questions
Ans