-
Feature of DataStage 8.01 Version
What are the main features of DataStage 8.01 Version?
veer.dwh
- Sep 23rd, 2009
There are several new futures includes in DS 8.0.1 compare to 7.5 version.In 8.0.1 IBM included Quality stage, IBM information server (profile stage and audit stage) . these are not available in 7.5...
veer.dwh
- Jul 20th, 2009
Compare to DataStage 7.5 Accential DataStage, with DataStage 8.0 IBM websphere datastage Architecture got changedIn 8.0 IBM included client components of IBM information server which supports profiling stage along with Quality stage features are included in designer client component.
-
SCD2 Parallel Jobs
How to implement SCD2 in parallel jobs?
veer.dwh
- Sep 23rd, 2009
If you are using DS 8.0.1 version, it is very east to implement SCD2 using SCD stage. it supports 2 input links and 2 output links. from the 2 input links. primary Dataset it takes as a current dates...
-
How can we improve the performance of a link collector in the case of handling more than 25000 records?
veer.dwh
- Sep 23rd, 2009
Link partitiner and collecter are used to develop the parallism in server jobs.if source has huge amount of data that situation you can use these stages to perfoem parallism in server job environment....
-
Hashing Algorithm
Explain What is mean by Hashing Algorithm?
veer.dwh
- Sep 23rd, 2009
Hashing alogarithm is used when you create hash files in server jobs. it takes key field and distribute records avilable cpus in DS sercver while running the DS job. the cpu utiliztion in this process may vary based on server configuration.Regards,Veeru.
-
What is SEQ file buffer
veer.dwh
- Sep 23rd, 2009
Deyault buffer size foe seq file is 128MB. if you want increse manually, to to Adminstrator tunable tab--> buffer size option there you can specify if you want increase.regards,Veeru.
-
SQL Sever Stored Procedure
How to call a Stored procedure which is in SQL Server database in Datastage job?
veer.dwh
- Sep 23rd, 2009
You can use strored procedure stage in DS to call the any stored procedures from any Database type.Regards,Veeru.
-
Import Data with More than One Delimiter
DataStage can accept more than one delimiter. How to import data if it contains more than one delimiter?
veer.dwh
- Sep 23rd, 2009
DS supports more than one delimiter, if file has more then one delimiter. to read multiple delimeters from flat file, define flat file type as fixed width.Suppose your flat file has data belowcust_no,...
-
How to eleminate duplicate rows in data stage?
natashajain21
- Sep 22nd, 2009
Some of the methods to remove duplicates -> 1. Remove Duplicate Stages2. Hash File3. In Sort stage there are 3 ways -> a. Set CHANGECAPTURE Property to True . you ha...
ravi
- Dec 11th, 2006
There are two methods for eleminating duplicate rows in datastage1. Using hash file stage (Specify the keys and check the unique checkbox, Unique Key is not allowed duplicate values)2. Using Sort stage by link remove duplicate stageThanx
-
Datastage jobs
if job compiled with "job completed successfully". but The DS director window of Log page shows warning messages.what will we do?giv answer.
veer.dwh
- Sep 19th, 2009
Data Stage job can finish successfully with n no of wrnings in DS. if suppose some records are rejected which are coming from source also DS director give warning message but those records are not mee...
-
-
Datastage Lookups
Please let me know how many lookups is there in Parallel Jobs.
veer.dwh
- Sep 19th, 2009
In DS 7.5 we have 2 types of lookup options are avilable: 1. Normal 2. SparceIn DS 8.0.1 we have 3 types of lookup options are available 1. Normal 2. Sparce 3. RangeRange lookup: this will help you to...
Amritendra kumar
- Feb 21st, 2008
By lookup stage we can perform lookup by 2 ways1. lookup: It is used when the reference table or file contain less data.2. Sparce lookup: It is used when the main table is small and reference table is big.Thanks
-
What is the difference between ODBC and OCI stage in server job?
I am new to data stage, so I am a bit confused when to use ODBC and when OCI.Added to it I saw the question where it was asked how to remove duplicate records in the target and many of them answered that you need to use a aggregator to count on the key if its more than 1 it has a duplicate value then you need to remove that but how can a key have duplicate value?
veer.dwh
- Sep 19th, 2009
The difference b/w ODBC and OCI is, odbc supports to read or write any kind of relational DB but OCI supports only oracle DB.For suppose if you want read a oracle table in DS in that case if you use odbc it wont give you good performance but oci will give good performance.Regards,Veeru.
-
Datastage Job Speed
How we can increase the speed of job in datastage?
veer.dwh
- Sep 19th, 2009
To improve DS job performence we can fallow sertain techniques If it is PX job we can use pipeline or data partition techniques to run single job into multiple instance based on server configuration ...
-
High Level Design
How high level design will be prepared in datastage?
vjrockings
- Sep 14th, 2009
HLD (High Level Design) is the overview of a project in very high level prospectus. Here we have to mention the project definition goal and objective of the project, flow diagram of the process, which functions are in scope and are not etc.
k2_swarupa
- Apr 16th, 2009
HLD (High Level Design) is the overview of a project in very high level prospectus. Here we have to mention the project definition, goal and objective of the project, which functions are in scope and which are not, flow diagram of the process etc.
-
Does the selection of 'Clear the table and Insert rows' in the ODBC stage send a Truncate statement to the DB or does it do some kind of Delete logic.
There is no TRUNCATE on ODBC stages. It is Clear table blah blah and that is a delete from statement. On an OCI stage such as Oracle, you do have both Clear and Truncate options. They are radically different in permissions (Truncate requires you to have alter table permissions where Delete doesn't).
sankarganeshvel
- May 8th, 2008
It just clear the data in the table when each new loop it encounters .it wont send any commands to the database
-
How much would be the size of the database in DataStage ?What is the difference between Inprocess and Interprocess ?
vijaypatiln
- Jul 28th, 2009
In process allows connected active stages to pass data via buffers, rather than row by row.
Inter process enables the job to run using a separate process for each active stage, which will run simultaneously on a separate processor.Daniel
- May 14th, 2006
In-processYou can improve the performance of most DataStage jobs by turning in-process row buffering on and recompiling the job. This allows connected active stages to pass data via buffers rather tha...
-
Data stage Parallel extender
What is data stage parallel extender?
veer.dwh
- Jul 20th, 2009
DataStage jobs are classified into 3 types1.Server job2.Parallel job3.Mainframe job3 types are designed for to do the ETL process. difference among them isServer job: execures sequentiall like row by ...
-
What are validations you perform after creating jobs in designer.what r the different type of errors u faced during loading and how u solve them
qwert123
- Jul 1st, 2009
Hi, I worked on a process which was loading target table after performing email standardization on source files.I performed the following validations:1)all letters should be in smallcase2)email id fie...
sivarao
- Dec 28th, 2005
Check for Parameters.and check for inputfiles are existed or not and also check for input tables existed or not and also usernames,datasource names,passwords like that
-
What is version Control?
qwert123
- Jun 30th, 2009
VERSION CONTROL In addition, DataStage offers version control that saves the history of all the data integration development. It preserves application components such as table definitions, transformat...
vick
- Oct 30th, 2005
Version Controlstores different versions of DS jobsruns different versions of same jobreverts to previos version of a jobview version histories
-
How do you rename all of the jobs to support your new File-naming conventions?
Create a Excel spreadsheet with new and old names. Export the whole project as a dsx. Write a Perl program, which can do a simple rename of the strings looking up the Excel file. Then import the new dsx file probably into a new project for testing. Recompile all jobs. Be cautious that the name of the jobs has also been changed in your job control jobs or Sequencer jobs. So you have to make the...
DatastageDev
- Jun 30th, 2009
If you export the jobs in an XML file you can easily do a find and replace for anything using notepad. So if the standard for master is changed from mst to mstr you simply for a find and replace....
DataStage Interview Questions
Ans