-
Datastage flow of parallel Project
Any body explain the flow of project(parallel) in real time thanx
srikanth.ds
- Oct 30th, 2009
Project flow is nothing but the data flow in your project. For example in many of the projects data is moved from source to staging, and then perfoem ETL and staging to ware house. So here you encountered 2 levels of data flow i.e source to staging and staging to warehouse.
-
What is the max capacity of Hash file in DataStage?
Alfons
- May 5th, 2006
Hello,Take a look at the uvconfig file:# 64BIT_FILES - This sets the default mode used to# create static hashed and dynamic files.# A value of 0 results in the creation of 32-b...
-
What is the use and advantage of procedure in datastage?
hemant.agarwal03
- Nov 13th, 2009
If we have a complex business logic and we may need to create mutiple jobs to achive that , then we use procedure in data stage which provide us final output in a single job. It is faster then normal SQL statement also.
Him121
- Jun 22nd, 2007
To trigger Database operations at before or after DB stage access.
-
How do you configure api_dump
nikhilanshuman
- Nov 29th, 2009
It seems you are asking for APT_DUMP_SCORE.It can be configured through datastage administrator->Environment variables.
-
Write the shell script using Unix to run the 2 jobs?
write the shell script using Unix to run the 2 jobs?How to schedule the 2 jobs using Unix crontab to run for particular time?
nikhilanshuman
- Nov 29th, 2009
Inside the shell script, first you have to set the path using "dsenv".Then using following command the datastage job can be run.dsjob -run mode -Normal -jobstatus Projectname JobNameafter typing this in the editor,save file as testrun.sh.Now run the command using bash testrun.sh.
-
What is the use of combinability mode
nikhilanshuman
- Nov 29th, 2009
Combinabilty mode means datastage will combine the operators in a single process.If combinability mode is disabled,the number of Unix processes will increase. It can be set by setting &quo...
-
I am trying to execute batch file which has dsjob command to run data stage job from CLI.I am getting error code = 81011 (project not found but project is there)But I can run other jobs. I am getting into problem for one particular batch.any help
Sabari_Ram
- Nov 30th, 2009
The error code 81011 is related to the fact that the host is not available or the host is invalid.Kindly check whether the host you have chosen is a valid one.Kindly correct me if I am wrong in this view.
-
What is Modulus and Splitting in Dynamic Hashed File?
In a Hashed File, the size of the file keeps changing randomly. If the size of the file increases it is called as "Modulus". If the size of the file decreases it is called as "Splitting".
Santhosh_DataStage
- Dec 2nd, 2009
Modulo is the calculated value which is calculated by using a Hash File Calculator. It tells the optimal number of groups to be created in the hash file to use it effectively. The Input to this Modulo calculation are the approximate number of records and the width of each record.
Milestones
- Sep 22nd, 2005
The modulus size can be increased by contacting your Unix Admin.
-
How to assign the one path of file to PROJDEF using the job parameters?
At the time to incremental loading I need to take the reusable files' path in this situation How to assign the one path of file to PROJDEF using the job parameters?
nikhilanshuman
- Dec 11th, 2009
From your question it seems that you have defined the file path parameter as $PROJDEF in you parallel job.Setting a parameter to projdef :Step 1: Go to datastage adminstrator and set a user defined va...
-
Datastage ETL
What is Datastage ETL?
nikhilanshuman
- Dec 25th, 2009
ETL stands for Extract,transforam and Load.Datastage is an ETL tool which extracts the data from source,applies the necessary transformations on the data and loads the data into target.
-
Configuration File
What is configuration file? What does it contain? What is the use of it in Datastage?
nikhilanshuman
- Dec 25th, 2009
A configuration file contains the information about the nodes,Resource disk and the Resource scratch disk.The datastage parallel jobs run on the basis of the configuration specified in the configurati...
-
Where does director create its log files?
We are spacing a problem of C: getting filled up because of a creation of some file. I think it is because of the director log files.
nikhilanshuman
- Dec 25th, 2009
The log files are stored at server.At the client side(windows) the log files are not stored.The logs are maintained in RT_Logn files on datastage server.Deleting logs:You can set Auto purge of job logs from datastage administrator to delete the log files automatically.
-
Clear logs
How to clear logs after 5 days, by using a routine?
nikhilanshuman
- Dec 25th, 2009
The logs can be cleared by deleting entries from the Universe table RT_LOGn.Here n is the job number.For this you need to go to Datastage Administrator - > Command.Here you can execute the queries on the universe tables.
-
How to run a job using Command line?
nikhilanshuman
- Dec 25th, 2009
The command is "dsjob" and case sensitive.Following is the command :dsjob -run -wait -warn 999 -jobstatus -project name -job name
sai
- Mar 31st, 2007
Dsjobs-run-jobstatus projectname jobname/filename
-
Shell scripts in sequencers
How you will call shell scripts in sequencers in datastage
nikhilanshuman
- Dec 25th, 2009
Tina-Shell scripts can be called from the execute command activity of a job sequence.
nikhilanshuman
- Dec 11th, 2009
"Execute command activity " is used to run a command from Unix.bash /path of script/scriptname.sh is also a unix command.hence it can also be called from Execute command activity of a job sequence.
-
We have the Datastage server7.5 installed on Unix machine. We need to have a DSN to connect to the database which is on some other unix machine.please let me know it is enough if we create a DSN at the client machine or do we have to change the config file in UNIX?It is very urgent for us and we are not able to solve?pls help me in this regard.Madhavi
nikhilanshuman
- Dec 25th, 2009
In UNIX,three files need to be configured.a) uvodbc.configb) odbc.inic) dsenva)uvodbc.config : Here you need to specify the name of data spurce(DSN).Existing configurations in the file can be referred...
ram
- Sep 14th, 2007
You should create DSN in Unix box where datastage server is installed.? Creating at client machine would not be of any use..You need to have database client software installed on the datastage server (Unix box).
-
What is the use of clear status file
What is the use of clear status file in DS?How we will use it?explain with examples?
nikhilanshuman
- Dec 30th, 2009
If status is cleared for a datastage job,all of its instaces will be deleted.I mean if there is a instance say jobname.inst1 or jobname.inst2 these will be deleted.The entries for that particular jobs will be cleared from RT_Status(n) table.Here n is the job number.
ketanshah123
- Feb 19th, 2008
When you clear a job’s status file you reset the status records associated with all stages in that job. You should therefore use this option with great care, and only when you believe a job has ...
-
Pass input parameters using UNIX Shell script
How to pass input parameters using UNIX Shell script to DataStage Director?
nikhilanshuman
- Dec 29th, 2009
From UNIX, Parameters are passed to datastage job while running them.This can be done by passing "-param" paramater to dsjob command.Syntax :dsjob -run mode Normal -param param1=value1 project name jobname
-
What is PROFILE STAGE , QUALITY STAGE,AUDIT STAGE in datastage..please expalin in detail.thanks in adv
hansth
- Jan 12th, 2010
Profile stage: is a profiling tool to investigate data sources to see inherent structures, frequencies of phrases, identify datatypes, etc.. In addition it can, based on the real data, rather than met...
-
In which situation,we are using RUN TIME COLUMN PROPAGATION option?
pankaj.garg026
- Jan 15th, 2010
Run Time Column Propagation can be used with Column Import Stage. If RCP is enabled in our project, we can define only the columns which we are interested in and other rest of the columns datastage wi...
poonam
- Feb 14th, 2007
Run time column propagation is used in case of partial schema usage. when we only know about the columns to be processed and we want all other columns to be propagated to target as they are, we check ...
DataStage Interview Questions
Ans