-
How to eleminate duplicate rows in data stage?
natashajain21
- Sep 22nd, 2009
Some of the methods to remove duplicates -> 1. Remove Duplicate Stages2. Hash File3. In Sort stage there are 3 ways -> a. Set CHANGECAPTURE Property to True . you ha...
ravi
- Dec 11th, 2006
There are two methods for eleminating duplicate rows in datastage1. Using hash file stage (Specify the keys and check the unique checkbox, Unique Key is not allowed duplicate values)2. Using Sort stage by link remove duplicate stageThanx
-
Datastage jobs
if job compiled with "job completed successfully". but The DS director window of Log page shows warning messages.what will we do?giv answer.
veer.dwh
- Sep 19th, 2009
Data Stage job can finish successfully with n no of wrnings in DS. if suppose some records are rejected which are coming from source also DS director give warning message but those records are not mee...
-
-
Datastage Lookups
Please let me know how many lookups is there in Parallel Jobs.
veer.dwh
- Sep 19th, 2009
In DS 7.5 we have 2 types of lookup options are avilable: 1. Normal 2. SparceIn DS 8.0.1 we have 3 types of lookup options are available 1. Normal 2. Sparce 3. RangeRange lookup: this will help you to...
Amritendra kumar
- Feb 21st, 2008
By lookup stage we can perform lookup by 2 ways1. lookup: It is used when the reference table or file contain less data.2. Sparce lookup: It is used when the main table is small and reference table is big.Thanks
-
What is the difference between ODBC and OCI stage in server job?
I am new to data stage, so I am a bit confused when to use ODBC and when OCI.Added to it I saw the question where it was asked how to remove duplicate records in the target and many of them answered that you need to use a aggregator to count on the key if its more than 1 it has a duplicate value then you need to remove that but how can a key have duplicate value?
veer.dwh
- Sep 19th, 2009
The difference b/w ODBC and OCI is, odbc supports to read or write any kind of relational DB but OCI supports only oracle DB.For suppose if you want read a oracle table in DS in that case if you use odbc it wont give you good performance but oci will give good performance.Regards,Veeru.
-
Datastage Job Speed
How we can increase the speed of job in datastage?
veer.dwh
- Sep 19th, 2009
To improve DS job performence we can fallow sertain techniques If it is PX job we can use pipeline or data partition techniques to run single job into multiple instance based on server configuration ...
-
High Level Design
How high level design will be prepared in datastage?
vjrockings
- Sep 14th, 2009
HLD (High Level Design) is the overview of a project in very high level prospectus. Here we have to mention the project definition goal and objective of the project, flow diagram of the process, which functions are in scope and are not etc.
k2_swarupa
- Apr 16th, 2009
HLD (High Level Design) is the overview of a project in very high level prospectus. Here we have to mention the project definition, goal and objective of the project, which functions are in scope and which are not, flow diagram of the process etc.
-
Does the selection of 'Clear the table and Insert rows' in the ODBC stage send a Truncate statement to the DB or does it do some kind of Delete logic.
There is no TRUNCATE on ODBC stages. It is Clear table blah blah and that is a delete from statement. On an OCI stage such as Oracle, you do have both Clear and Truncate options. They are radically different in permissions (Truncate requires you to have alter table permissions where Delete doesn't).
sankarganeshvel
- May 8th, 2008
It just clear the data in the table when each new loop it encounters .it wont send any commands to the database
-
How much would be the size of the database in DataStage ?What is the difference between Inprocess and Interprocess ?
vijaypatiln
- Jul 28th, 2009
In process allows connected active stages to pass data via buffers, rather than row by row.
Inter process enables the job to run using a separate process for each active stage, which will run simultaneously on a separate processor.Daniel
- May 14th, 2006
In-processYou can improve the performance of most DataStage jobs by turning in-process row buffering on and recompiling the job. This allows connected active stages to pass data via buffers rather tha...
-
Metdata Data Dependency
Explain how data dependency is studied using Metadata of Datastage?
-
Data stage Parallel extender
What is data stage parallel extender?
veer.dwh
- Jul 20th, 2009
DataStage jobs are classified into 3 types1.Server job2.Parallel job3.Mainframe job3 types are designed for to do the ETL process. difference among them isServer job: execures sequentiall like row by ...
-
What are validations you perform after creating jobs in designer.what r the different type of errors u faced during loading and how u solve them
qwert123
- Jul 1st, 2009
Hi, I worked on a process which was loading target table after performing email standardization on source files.I performed the following validations:1)all letters should be in smallcase2)email id fie...
sivarao
- Dec 28th, 2005
Check for Parameters.and check for inputfiles are existed or not and also check for input tables existed or not and also usernames,datasource names,passwords like that
-
What is version Control?
qwert123
- Jun 30th, 2009
VERSION CONTROL In addition, DataStage offers version control that saves the history of all the data integration development. It preserves application components such as table definitions, transformat...
vick
- Oct 30th, 2005
Version Controlstores different versions of DS jobsruns different versions of same jobreverts to previos version of a jobview version histories
-
How do you rename all of the jobs to support your new File-naming conventions?
Create a Excel spreadsheet with new and old names. Export the whole project as a dsx. Write a Perl program, which can do a simple rename of the strings looking up the Excel file. Then import the new dsx file probably into a new project for testing. Recompile all jobs. Be cautious that the name of the jobs has also been changed in your job control jobs or Sequencer jobs. So you have to make the...
DatastageDev
- Jun 30th, 2009
If you export the jobs in an XML file you can easily do a find and replace for anything using notepad. So if the standard for master is changed from mst to mstr you simply for a find and replace....
-
What is difference between data stage and informatica
qwert123
- Jun 30th, 2009
Automation of loading is supported partly in Informatica so third party tools are needed to achieve this, while data stage supports automation of loading fully.
Jimmy
- Sep 11th, 2005
Here is a very good articles on these differences... whic hhelps to get an idea.. basically it's depends on what you are tring to accomplishwhat are the requirements for your ETL tool? Do you have lar...
-
OCI has fetched truncated data" in DataStage">
How do you fix the error "OCI has fetched truncated data" in DataStage
qwert123
- Jun 29th, 2009
The truncation occurs when data type in database(say Oracle) is of type decimal (10,6). But in data stage it's data type is decimal (10,2)). So we need to increase the precision value in the data stage.
AjaysKumar
- Jun 4th, 2008
This error occurs when Oracle Stage try to fetch a column like 34.55676776... and actually it's data type is decimal(10,2)The solution here is to either truncate or Round the data till 2 decimal positions
-
How do you track performance statistics and enhance it?
qwert123
- Jun 29th, 2009
Partition the table if there is huge data. This will enhance performance statistics.
satya
- Jul 18th, 2007
You can right click on the server job and select the "view performance statistics" option. This will show the output in the number of rows per second format when the job runs.Regards.Satish.
-
Why is hash file is faster than sequential file n odbc stage??
aladap12
- Jun 28th, 2009
Hash file is datastage internal file. Data will be stored on computer memory..and works on key column. So retrieval will be faster when compare to hitting the database.
Lavanya
- Nov 8th, 2006
Hash file is indexed. Also it works under hashing algo. That's why the search is faster in hash file.
-
If the size of the Hash file exceeds 2GB..What happens? Does it overwrite the current rows?
aladap12
- Jun 27th, 2009
When you create hash file, by default in that directory we will have 2 filesdata.30over.30If data has exceed the specified limit, extra data will be written into over.30.
It again depends up on storage capacity.shiva
- Jun 29th, 2006
It overwrites the file
-
What is the meaning of instace in data stage?explain with examples?
aladap12
- Jun 27th, 2009
Instance is nothing but a process that is running on server whenever ds engine starts executing a job.
DataStage Interview Questions
Ans