-
Read the String functions in DS
Functions like [] -> sub-string function and ':' -> concatenation operatorSyntax: string [ [ start, ] length ]string [ delimiter, instance, repeats ]
nikhilanshuman
- Dec 17th, 2010
It seems that it is being asked to explain string function.Following are some string functions used in datastage:Compare,Field,Convert,Padstring,TrimB,TrimF,TrimLeadingTrailingSome string conversion functions :StringToDate,StringToDecimal,StringToTime,StaringToUstring,StringToTimestamp etc...
-
Actually my requirement is like that :Here is the codification suggested: SALE_HEADER_XXXXX_YYYYMMDD.PSVSALE_LINE_XXXXX_YYYYMMDD.PSVXXXXX = LVM sequence to ensure unicity and continuity of file exchangesCaution, there will an increment to implement.YYYYMMDD = LVM date of file creation COMPRESSION AND DELIVERY TO: SALE_HEADER_XXXXX_YYYYMMDD.ZIP AND SALE_LINE_XXXXX_YYYYMMDD.ZIPif we run that job the target file names are like this sale_header_1_20060206 & sale_line_1_20060206.if we run next time means the target files we like this sale_header_2_20060206 & sale_line_2_20060206.if we run the same in next day means the target files we want like this sale_header_3_20060306 & sale_line_3_20060306.Ie if whenever we run the same job the target files automatically changing in to filename_increment to previous number(previousnumber + 1)_currentdate;please do needful by repling this question..
nikhilanshuman
- Dec 17th, 2010
Here,the basic thing required is to add 1 to the number which was used in last load.Following is the logic for this:a) Initially take a file and write 0 to it.b) Now in the sequence,create a user vari...
-
What is the difference between DataStage and DataStage Scripting?
nikhilanshuman
- Dec 17th, 2010
Datastage jobs,when compiled generate OSH.OSH is the abbreviation of Orchestrate scripting language.When a datastage job is run,the generated OSH is executed in the backend.
-
How to enable the datastage engine?
nikhilanshuman
- Dec 17th, 2010
To enable datastage engine follow these steps:a) Go to the "DSEngine" directory in Unix.b) now type the command ./uv –admin –startc) the datastage engine will be enabled/started.
-
Orchestrate Vs Datastage Parallel Extender?
Orchestrate itself is an ETL tool with extensive parallel processing capabilities and running on UNIX platform. Datastage used Orchestrate with Datastage XE (Beta version of 6.0) to incorporate the parallel processing capabilities. Now Datastage has purchased Orchestrate and integrated it with Datastage XE and released a new version Datastage 6.0 i.e Parallel Extender.
-
How we use the DataStage Director and its run-time engine to schedule running the solution, testing and debugging its components, and monitoring the resulting e/xecutable versions on ad hoc or scheduled basis?
nikhilanshuman
- Dec 17th, 2010
The jobs can be scheduled by Datastage Director.In order to schedule the jobs,follow these steps :a) Click on View -> Schedule in the menu of datastage director.b) You will see a list of the ...
-
The above might rise another question: Why do we have to load the dimensional tables first, then fact tables:
As we load the dimensional tables the keys (primary) are generated and these keys (primary) are Foreign keys in Fact tables.
nikhilanshuman
- Dec 17th, 2010
In dimensional model,fact tables are dependenet on the dimension tables.This means that fact table contains foreign keys to dimension tables.This is the reason,dimension tables are loaded first and then the fact table.
-
Compare and Contrast ODBC and Plug-In stages?
ODBC : a) Poor Performance. b) Can be used for Variety of Databases. c) Can handle Stored Procedures. Plug-In: a) Good Performance. b) Database specific.(Only one database) c) Cannot handle Stored Procedures.
nikhilanshuman
- Dec 16th, 2010
ODBC stages are slower as compared to Plugin stages.ODBC stages can handle many databases whereas plugin stages are made specially for a particular database for example Oracle enterprize stage.
-
What is the Batch Program and how can generate ?
Batch programe is the programe it's generate run time to maintain by the datastage it self but u can easy to change own the basis of your requirement (Extraction, Transformation,Loading) .Batch programe are generate depands your job nature either simple job or sequencer job,You can see this programe on job controll option.
nikhilanshuman
- Dec 17th, 2010
A Batch Program is used to run a batch of jobs by writing the Server routine code in the job control section.To generate a batch program,do following:a) Open datastage director.b) Go to Tools->Batch->...
nikhilanshuman
- Dec 17th, 2010
A Batch Program is used to run a batch of jobs by writing the Server routine code in the job control section.To generate a batch program,do following:a) Open datasatge director.b) Go to Tools->Batc...
-
How many places u can call Routines?
Four Places u can call (i) Transform of routine (A) Date Transformation (B) Upstring Transformation (ii) Transform of the Before & After Subroutines(iii) XML transformation(iv)Web base trannsformation
nikhilanshuman
- Dec 16th, 2010
Routines can be called at the following places:a) In the job properties,There is an option to call the Before and After job subroutines.b) In the job sequence,there is an activity called "Routine...
-
Could you please help me with a set of questions on Parallel Extender?
X
-
What are the often used Stages or stages you worked with in your last project?">
What are the often used Stages or stages you worked with in your last project?
A) Transformer, ORAOCI8/9, ODBC, Link-Partitioner, Link-Collector, Hash, ODBC, Aggregator, Sort.
nikhilanshuman
- Dec 16th, 2010
Transformer,Sequential file stage,sort stage,lookup,join,merge,funnel,filter,oracle enterprise stage,Row generator,column generator,pivot,Dataset stage,aggregrator stage etc.
-
Datastage Parallel Jobs Performance
How will the performance affect if we use more number of Transformer stages in Datastage parallel jobs?
nikhilanshuman
- Dec 9th, 2010
Transformer stages compile in C++ whereas other stages compile into OSH (Orchestarte scripting language.).If number of transfomers are more,first thing is the compilation time will be impacted.it will...
-
Flatfiles Validations
When we are extracting the flatfiles, What are the basic required validations?
nikhilanshuman
- Dec 9th, 2010
Folllowing are some common validations performed:a) Check for blank lines and remove them.b) Check the number of column in each row of the file.c) If there is a? trailer line in the flat file contain...
-
Datastage Lookup
By using lookup we join the data from more than one table, we can implement the same using join stage, then what is the need of Lookup stage especially in Datastage?
nikhilanshuman
- Dec 9th, 2010
Datastage lookup has some additional benefits over join stage :a) A lookup stage supports reject link which is not supported by join stage.b) Lookup stage has an option to fail the job if the lookup f...
-
DataStage Job Scheduling
How to schedule a datastage job using cron tab utility?
nikhilanshuman
- Dec 9th, 2010
The datastage jobs can be scheduled by using following steps:a) Write a script say runjob.sh to call the datastage job/sequence.The shell script calls the datastage job by making use of "dsjob -r...
-
Link sort/Stage sort
What is the use of sort stage when you have explicit sort stage?
nikhilanshuman
- Dec 9th, 2010
Link Sort and stage sort,both do the same thing.Only the Sort Stage provides you with more options like the amount of memory to be used,remove duplicates,sort in Ascending or descending order,Create change key columns and etc.These options will not be available to you while using Link Sort.
praveen.sarva
- Dec 1st, 2010
Simple... For huge amount of data we prefer link sorting... Under partitions for small and compatable data we use stage sort(nothing but sort with in data set).
-
Nodes Types
What are the types of nodes in datastage?
nikhilanshuman
- Dec 9th, 2010
The degree of parallellism of parallel jobs depends on the number of nodes you define in your configuration file.Nodes are just the logically created processes by the OS.basically two types of nodes e...
-
How to use database performance tuning and also ds job performance in datastage.
nikhilanshuman
- Nov 30th, 2010
Database performance tunings:Whenever you are firing queries on source databases containing joins, make sure that proper indexes are created for optimizing query performance.Try to partition the tab...
-
What is surrogate key? what is routine and explain the use in datastage parallel server jobs?
nikhilanshuman
- Nov 30th, 2010
A surrogate key is none business key. it can be a sequential number with no business meanings. these are useful for the underlying applications to maintain relationships between tables.Routines are th...
pavan.daddanalla
- Apr 14th, 2008
Surrogate key is a separate key column which is generated by surrogate key generator. routines are nothing but subset of functions
DataStage Interview Questions
Ans