-
How you will define Global
How you will define global variables in DS?
ketanshah123
- Feb 19th, 2008
The user variable stage allows you to define global variables within a sequence. These variables can then be used elsewhere in the sequence,The values of the user variables are set by expressions in the stage’s properties
-
Abort a job after loading 10 records
How to implement in datastgae like the job should abort after it loads 10 records into the target using lookup?
nagoosk
- Apr 29th, 2008
You can abort a job after n records which is available while you r running the job you can see tha option as "abort job after _____" . there you can specify the number
-
Conductor Node
What is a conductor node?
nagoosk
- Feb 20th, 2008
Actually every process contains a conductor process where the execution was started and a section leader process for each processing node and a player process for each set of combined operators and a ...
-
SCD Type2 in Enterprise Edition
How to implement Slowly changing dimesions Type2 in Parallel jobs . What are the stages we use and How to assign the key?
Abhijain
- Oct 19th, 2009
Datastage Px 8.0.1 is having SCD stage to perform the required operation. Or it can be achived by using lookup/change capture stage in between source and target database.
-
DataStage Transformer stage Server Jobs and Parallel Jobs
What is the difference between transformer stage in serverjobs and transformer stage in parallel job?
Abhijain
- Sep 19th, 2008
Transformer stage in server jobs vs Transformer stage in Parallel jobs In server jobs, support single input stream link and multiple input reference link where in parallel support only single input st...
-
Dataset stage/lookup file stage/file stage
When do one use dataset stage/lookup file stage/file stage in a parallel job?or in other way what is the significance of these files...wat are their differences?
nagoosk
- Feb 28th, 2008
DataSetFile: DataStage PX jobs uses the dataset file to organize the data.Dataset files preserves partitioning means u need not to partition the data when ever u read the data.It maintaines the persis...
-
Job Control and Sequencer
What is the difference between jobcontrol and sequencer?
nagoosk
- Mar 18th, 2008
Jobcontrol: It just inserts the compilation code. Whenever you add the job it just places executable code there. There is no diagrammatical representation here.Sequencer: Sequencer is a diagrammat...
-
Hashing Algorithm
Explain What is mean by Hashing Algorithm?
veer.dwh
- Sep 23rd, 2009
Hashing alogarithm is used when you create hash files in server jobs. it takes key field and distribute records avilable cpus in DS sercver while running the DS job. the cpu utiliztion in this process may vary based on server configuration.Regards,Veeru.
-
Remove Duplicate Records
what is process to remove duplicate records using Copy Stage.
Abhijain
- Sep 26th, 2008
In the copy stage, there is an option to sort the input data where you can select the key on the basis of which you can perform the sort operation. There is an option named 'Unique'. Select th...
-
How to assign the one path of file to PROJDEF using the job parameters?
At the time to incremental loading I need to take the reusable files' path in this situation How to assign the one path of file to PROJDEF using the job parameters?
nikhilanshuman
- Dec 11th, 2009
From your question it seems that you have defined the file path parameter as $PROJDEF in you parallel job.Setting a parameter to projdef :Step 1: Go to datastage adminstrator and set a user defined va...
-
Write the shell script using Unix to run the 2 jobs?
write the shell script using Unix to run the 2 jobs?How to schedule the 2 jobs using Unix crontab to run for particular time?
nikhilanshuman
- Nov 29th, 2009
Inside the shell script, first you have to set the path using "dsenv".Then using following command the datastage job can be run.dsjob -run mode -Normal -jobstatus Projectname JobNameafter typing this in the editor,save file as testrun.sh.Now run the command using bash testrun.sh.
-
Datastage flow of parallel Project
Any body explain the flow of project(parallel) in real time thanx
srikanth.ds
- Oct 30th, 2009
Project flow is nothing but the data flow in your project. For example in many of the projects data is moved from source to staging, and then perfoem ETL and staging to ware house. So here you encountered 2 levels of data flow i.e source to staging and staging to warehouse.
-
What is the use of combinability mode
nikhilanshuman
- Nov 29th, 2009
Combinabilty mode means datastage will combine the operators in a single process.If combinability mode is disabled,the number of Unix processes will increase. It can be set by setting &quo...
-
How the job status changed when the datasets it process is locked by another job
When the data processed by job1 is locked by job2 with higher priority, what will happen about the status of job1, changing from running to aborted , or still running. does it have any relationship with the database
vujjini1974
- Sep 30th, 2009
If its reference dataset and you are doing Lookup then job will run but no records will come from that Dataset, so you should rerun the dataset job and then run the other job to get the records.
-
Debugging Stages
What is the purpose of Debugging stages? In real time Where we will use?
rajul.ds
- Jul 22nd, 2008
Hi the main use of Debugging Stages(row gen,peak,tail,head etc) are they are help full to monitor jobs,and they generate mock data wen we dont have real time data to test
-
SQL Sever Stored Procedure
How to call a Stored procedure which is in SQL Server database in Datastage job?
veer.dwh
- Sep 23rd, 2009
You can use strored procedure stage in DS to call the any stored procedures from any Database type.Regards,Veeru.
-
Datastage job is aborted at any time what we will do
bhanutej
- Jun 26th, 2008
hi,first check in the director's log about the job condition.if you cannot find the errorgo to the input to output datatye conversions.or elsecheck the configiration file APT_CONFIG_FILE
-
Write query for removing duplicates in source stage?
How we import xml files into source stage?
nagakalyan
- Jun 24th, 2008
In source file we write sql queryselect distinct(sal) from customer_tab where Loc = 'Hyderabad',and rcp should be enable
-
What is the difference between ODBC and OCI stage in server job?
I am new to data stage, so I am a bit confused when to use ODBC and when OCI.Added to it I saw the question where it was asked how to remove duplicate records in the target and many of them answered that you need to use a aggregator to count on the key if its more than 1 it has a duplicate value then you need to remove that but how can a key have duplicate value?
veer.dwh
- Sep 19th, 2009
The difference b/w ODBC and OCI is, odbc supports to read or write any kind of relational DB but OCI supports only oracle DB.For suppose if you want read a oracle table in DS in that case if you use odbc it wont give you good performance but oci will give good performance.Regards,Veeru.
-
Fileset
What for exactly fileset is used?
nikhilanshuman
- Mar 10th, 2010
A Fileset can be used to store records(Just like a dataset or sequential file but,the way of storing records is different in filesets,datasets and sequential files.)
DataStage Interview Questions
Ans