-
What is SQL tuning? how do you do it ?
Nikvik5
- Jun 23rd, 2009
SQL tuning is done by following steps:- Run an Explain plan for SQL statement.- Gather statistics for the tables.- partition the tables when there is huge data.- check for the sort_area_size, buffercache, logbuffer parameters.
vinoth kumar
- Dec 18th, 2006
sql tunning how to per form thisin sql-server... through query analyser is needed and explain brief steps for tunnning
-
How can we remove duplicates using sort stage?
Alex
- Feb 28th, 2007
TreeSet<String> set = new TreeSet<String>(Arrays.asList(names)); for (String name : set) &nb...
-
How many jobs have you created in your last project?">
How many jobs have you created in your last project?
100+ jobs for every 6 months if you are in Development, if you are in testing 40 jobs for every 6 months although it need not be the same number for everybody
Prakash3366
- Jun 17th, 2009
Depends on which type of project you are working. Sometimes in Parallel Jobs we will take more time to finish complex job. If you have 3 years experience then you have to tell more than 100 Jobs, Few jobs in server and few in parallel
Anjan Roy
- Sep 16th, 2005
- I don't think these are the right numbers. Someone creating 100+ jobs in 6 months !! If you do the math - it would be 6 Months = 6 months * 22 Days * 8 Hours = 1056 hours. The above state...
-
Design Phase
How technical design will be prepared in datastage?
k2_swarupa
- Apr 16th, 2009
If you want to prepare a design doc, then you should know the complete flow of your project along with business rule. Technical design doc is nothing but the flow of the process,?to describe in jobs.
-
Low Level Design
How low level design will be prepared in datastage?
devraj26e
- Feb 5th, 2009
Extraction over view (what is the size of the source file, what is the volume of each file, what?type of file it is), how to map the files from source to target, what kind of business logic we have to implement, how to conduct unit testing all these comes under low level designing.?
-
How do we use Job Parameters in datastage jobs.
I know we use them in the project level and also in the job level and also that we can give values at run time(like UN, Pswd etc). Theoratically I understood. But practically unable to implement it. Can somebody explain me in detail with an example. I wud seriously appreciate your help. Thanks Guyz.
Behrouz
- Jan 27th, 2009
For example I create a parameter for my hashfile folder like it : Name: $pHashdir, type:string,def.value: C:DataStageInput DATAHash and when I use my hash file in path file name i use just ...
Fanguna
- Nov 19th, 2007
There is an icon to go to Job parameters in the tool bar. Or you can press Ctrl+J to enter into Job Parameters dialog box. Once you enter, give a parameter name and corresponding default value for it....
-
Differentiate between pipeline and partion parallelism?
vsradha
- Jan 26th, 2009
A job with large quantities of data can be partitioned using partition parallelism not with the pipeline parallelism and at end of the job it could be collected and write as a single data source. The...
manraj
- Oct 25th, 2006
consider three cpu connected in series. When data is being fed into the first one,it start processing, simultaneously is being transferred into the second cpu and so on. u can compare with 3...
-
(The connection was refused or the RPC daemon is not running (81016))" ...
can anyone help me ...
thankx in advance">Hi Everyone, I've loaded datastage 7.5 in my PC running Windows 2000 server. Installation was successful but while running any designer, manager or administrator it is asking hostname, user and password.. I've given hostname : localhost, user : Administrator and password for the same. but it is giving an error in connection "Failed to connect to host: Localhost, project: UV(The connection was refused or the RPC daemon is not running (81016))" ...can anyone help me ...thankx in advance
rohitdagar
- Jan 17th, 2009
Start DataStage Engine Resource Service, DataStage Telnet Service and DSRPC Service in control panel
- Administrative tools - Services or directly run command "services.msc"to open services window.. -
Dataset and Transformers Performance
How can you say that performance will be improve if we make use of a dataset?Why does the performance degrade when we use 4-5 transformers in a single job?
ashokmadduri
- Jan 17th, 2009
Dataset are referring to control file due to this dataset will give fast performance while processing the data, if you use transformers in job, it should compile the C++ backend due to this datastage ...
anurangevk
- Dec 6th, 2008
1. Using Dataset?- The storage method is internal to datastage, hence performance increases as less time is required to read from or write to a dataset2. Transformers are very bulky with lot of functions inbuilt them, so usage of more transformers slows down the speed at which?job executes
-
How do you populate source files?
tisha24
- Dec 29th, 2008
If this question means creating dummy records for parallel jobs, then 1. need to load the proper metadata to the row generator stage 2. and then supply the criteria and conditions like how the data sh...
ETLSafari
- Oct 23rd, 2008
In DW concept, the source file is the one provided by the user or OLTP system and is extracted by scripts, feed in to ETL system for processing. So, it is to be taken as input and to output/populate.
-
How do you eliminate duplicate rows?
tisha24
- Dec 29th, 2008
In server jobs we can make use of HASH FILE stage to eliminate the duplicate rows.In parallel jobs we can use REMOVE DUPLICATE stage to eliminate the duplicates.we can also use sort stage to eli...
madhava1238
- May 5th, 2008
Sql: delete from tablename a where rowid>(select min(rowid) from tablename b) where a'key values=b.key values.datastage server:using sort stage(option:allow duplicates(yes/no))or hash fileparallel: remove duplicate stageRegards,Madhava
-
Other than Round Robin, What is the algorithm used in link collecter? Also Explain How it will works?
vinothkcet
- Dec 17th, 2008
There were two collection algorithm 1. Round robin2. Sort/MergeRound Robin :This is the default method. Using the roundrobinmethod the stage will read a row from each input link inturn.Sort/...
Hari
- Jul 27th, 2006
Other than round robin, the other algorithm is Sort/Merge.Using the sort/merge method the stage reads multiple sorted inputs and writes one sorted output.
-
What are all the third party tools used in DataStage?
Upul
- Apr 24th, 2007
Contl-M job schedular
-
Parameter file usage in Datastage
Can anyone tel me how to use a file to fetch the parameter values for a parallel job in datastage as i don't want it to be hard coded.The format for the file shall be (name,value) pair. please help me...Thanks,Deepa
Abhijain
- Oct 3rd, 2008
In Datastage sequence, there is a stage named "UserVariable_Activity", this can use to fetch the parameter. Create a new user variable in the uservariable_activity stage and for the expression part of it, you can simply give your parameter file path.
-
Remove Duplicate Records
what is process to remove duplicate records using Copy Stage.
Abhijain
- Sep 26th, 2008
In the copy stage, there is an option to sort the input data where you can select the key on the basis of which you can perform the sort operation. There is an option named 'Unique'. Select th...
-
What are the Job parameters?
lakshmib
- Sep 24th, 2008
It is a runtime parameter which allows you to enter the value to restrict the data at the job run time. A job parameter is created with name,promt,data type,default value,and it is reprsented as follows #parameter name#.
mallakishore
- Oct 20th, 2005
These Parameters are used to provide Administrative access and change run time values of the job.EDIT>JOBPARAMETERSIn that Parameters Tab we can define the name,prompt,type,value
-
How can we implement Lookup in DataStage Server jobs?
tanisha11
- Sep 24th, 2008
You can use Transformer stage in server jobs in place of LookUp Stage in PX and Hashfile for reference data set in place of LookUp File stage which was used in PX.
Purnima
- Mar 30th, 2006
In server canvs we can perform 2 kinds of direct lookupsOne is by using a hashed file and the other is by using Database/ODBC stage as a lookup.
-
How can i call a stored procedure only once instead of calling for each and every row?
Abhijain
- Sep 23rd, 2008
There is a stage named Stored Procedure available in Datastage palette under Database category. You can use that stage to call your procedure in Datastage jobs.
-
DataStage Transformer stage Server Jobs and Parallel Jobs
What is the difference between transformer stage in serverjobs and transformer stage in parallel job?
Abhijain
- Sep 19th, 2008
Transformer stage in server jobs vs Transformer stage in Parallel jobs In server jobs, support single input stream link and multiple input reference link where in parallel support only single input st...
-
Data Sets and File Sets
Expalin difference between Data Sets and File Sets? where each one is used and how they are used?What is the size limit?
Abhijain
- Sep 19th, 2008
The dataset and fileset both are file stage. Dataset can have single input link or single output link whereas, Fileset can have single input link or single output link and a single reject link.File se...
DataStage Interview Questions
Ans