-
Difference between Hashfile and Sequential File?
manoharkolukula
- Feb 12th, 2008
1. Hashfile can be used as lookup but not the seq file.2. Hashfile works based on Hashed algorithm.3. The performence is more in Hashfile when it is used as a ref link(for lkp)4. we can eliminate dupl...
Sanj333
- Aug 30th, 2007
Hash file can be stored in DS memory (Buffer) but Sequential file cannot be.. duplicates will be removed in hashfile i.e, No duplicates in Hashfile.
-
How can we improve the performance of the job while handling huge amount of data
manoharkolukula
- Feb 12th, 2008
1. decrease usage of transformer stage.2. use sorted input for aggregator.3. Filter the data in source itself(if it is oracle database, write user def sql)4. use tunables tab in Administrator for cach...
sunayan
- Dec 13th, 2007
this require a job level tuning or server level tuning.in job level we can do the follwing.job level tuninguse Join for huge amount of data rather than lookup.use modify stage rather than transformer ...
-
Explain the best approch to do a SCD type2 mapping in parallel job?
manoharkolukula
- Feb 12th, 2008
use CDC, lookup, trasformer stages to impliment SCD2. In CDC just give the changed values and key column, then capture the changed records, in transformer just give the constraint for 0,1,2,3(del,insert,copy,updated data), u will get inserted data and updated data, copied data, deleted data.
-
Check for Job Errors in datastage
in datastage job successfully finished. but showing errors in director window. How do we fix and find the cause for the errors
manoharkolukula
- Feb 12th, 2008
I think in designer u find the green colour but in Director -> log view --> u find some fatal errors and job is aborted, is it, Means job is successfully completed but the data is not loaded in ...
-
What are the Environmental variables in Datastage?
manoharkolukula
- Feb 12th, 2008
Environmental variables are also called as Global variables. There are two types variables are there.1. Local Variables2.Environmental variables/Global VariablesLocal:- only for perticular job onlyEnv...
sekhar.sanaka
- Feb 3rd, 2008
Basically Environment variable is predefined variable those we can use while creating DS job.we create/declare these variables in DS Administrator.while designing the job we set the properties for the...
-
How to call the stored procedure in datastage??
csri2006
- Jan 31st, 2008
In what database is the stored procedure located. If it is Oracle stored procedure, you can use "stored procedure stage" in DataStage 7.5.Hope this helps. Srinivas
-
Error while connecting to DataStage project-expiry date '-479/1/71379' is unrecognizable Requirement: I have installed datastage7.5 server/client on windows 2003 server, the installation has been done successfully, but later when I login into the projects it is giving an error.Requirement : I have installed on the Windows 2003 server datastage7.5 server/client. the installation has been done successfully. but later when I Login into the projects it is giving an error. Error Description: failed to attach project .project PROJECT_NAME expiryError Description : failed to attach project. PROJECT_NAME expiry project date is expirydate'-479/1/71379' is unrecognisable.Date is expirydate '-479/1/71379' is unrecognizable. I have changed the system date but still I am getting the same problem. The expiry date given with my LISENCE is 'pack'. It is not permitting me to install server/client when I change 'pack' to a dummy date.I have changed the system date but still I am getting the same problem. The expiry date is given with my LISENCE 'pack'. It is not permitting me to install server/client when I change 'pack' to a dummy date. Please help me out to resolve with this issue.Please help me out with this issue to resolve.
nagarajhrr
- Jan 28th, 2008
Hi just u install client/server , after that u install .net to support c++ thats very imp to parallel extender project, after u install vb.net then u try to start , i u run datastage adminstrato...
-
What is the difference between Job Control and Job Sequence
manoharkolukula
- Jan 25th, 2008
Job control specially used to control the job, means through this we can pass the parameters, some conditions, some log file information, dashboard information, load recover etc...,job seq is used to ...
-
Performance in sort stage
i am running huge amount of data through a sort stage and it is very slow. Is there any option which can increase the performance with in the sort stage?
manoharkolukula
- Jan 25th, 2008
See if it is orcle db then u can write user def query for sort and remove duplicates in the source itself. and maintaining some key partition teqniques u can improve the performence. If it is not the ...
-
What is the diffrence between IBM Web Sphere DataStage 7.5 (Enterprise Edition ) & Standard Ascential DataStage 7.5 Version ?
manoharkolukula
- Jan 25th, 2008
I think there is no version like standard Ascential DataStage 7.5, I know only the advanced edition of Datastage i.e., only web sphere Datastage and Quality stage, it is released by IBM itself and giv...
vsingh
- Jan 23rd, 2008
IBM Information Server also known as DS 8 has more features like Quality Stage & MetaStage . It maintains its repsository in DB2 unlike files in 7.5. Also it has stage specifically for SCD 1 & 2.
-
What are the errors you expereiced with data stage
manoharkolukula
- Jan 25th, 2008
Here in datastage there are some warnings and some fatal errors will come in the log file. If there is any fatal error means the job got aborted but if there are any warnings are there mean...
-
What are the main diff between server job and parallel job in datastage
manoharkolukula
- Jan 25th, 2008
Here in server we have to use some stages like link partitioner, link coll, inter process.. to implement ll'lism. And sometimes we have to use lot of stages to implement specific logic bcoz of&nbs...
sanchit_states
- Jan 18th, 2008
Server jobs while using look up converts code into .osh languagewhile Parallel converts the code in C++ code ..leading to the req of VC++ compiler.
-
What is the difference between Squential Stage & Dataset Stage. When do u use them.
manoharkolukula
- Jan 25th, 2008
Sequential file can used as a target file but Dataset can't be used as final target, it can be used as temperary target.Dataset can be used as a hashfile(just like in server hashfile), it improves...
vijaykumar_ads
- Jan 18th, 2008
Parallel jobs use data sets to manage data within a job. You can think of each link in a job as carrying a data set. The Data Set stage allows you to store data being operated on in a persistent form,...
-
Even and Odd Number Nodes
To run Job why do we use only even number nodes like 2,4,6,8.., Why don't we use 1,3,5..,?
anshulsri2
- Jan 23rd, 2008
There are no odd number nodes used in datastage, for the simple reason we are not allowed to configure odd number nodes on the datastage server.
-
Memory allocation while using lookup stage
Hi friends, i know while using lookup stage if the lookup table has huge amount of data we will go for sparse lookup or else will use normal lookup. would anybody explain how the memory will be allocated for both type of lookups?
harishsj
- Jan 22nd, 2008
"Hi friends, i know while using lookup stage if the lookup table has huge amount of data we will go for sparse lookup or else will use normal lookup. would anybody explain how the memory will be ...
-
HI How can we create read only jobs in Datastage.
sunayan
- Dec 13th, 2007
A job can be made read only by the follwing process:Export the job in the .dsx format and change the attribute which store the readonly information from 0 ( 0 refers to editable job) to 1 ( 1 refer to...
Gnaneshwar
- Nov 21st, 2007
By creating Protected Project. In Protected Project all jobs are read only. You cant modify the job. If you modify that job it will not effect the job.
-
How to implement routines in data stage,have any one has any material for data stage pl send to me
Pl send material for data stage
ajaygosh
- Dec 8th, 2007
Here is a good link by Joshy George on this. DataStage Parallel routines made really easyhttp://blogs.ittoolbox.com/dw/soa/archives/datastage-parallel-routines-made-really-easy-20926
sivarao
- Dec 28th, 2005
there are 3 kind of routines is there in Datastage.1.server routines which will used in server jobs. these routines will write in BASIC Language2.parlell routines which will used in ...
-
-
-
DataStage Interview Questions
Ans