-
Setting up of node
How do we set up nodes in Datastage?
amitarudra
- Jan 29th, 2010
We can set the nodes in the follwing path C:AscentialDataStageConfigurations, which is a text file containing { node "node1" { &nb...
john_345
- Nov 19th, 2008
Here not the question of admin or developer.For the above question we have provide proper answer, like Go to DS manager and create nodes into Configuaration file according to the requirement. Please if any of DS admin registered expecting step by step process. Mine is also not clear answer.
-
I want to process 3 files in sequentially one by one , how can i do that. while processing the files it should fetch files automatically .
bizzinsights
- Jan 29th, 2010
Append all the source files into a single file in Unix if the metadata is same. Use that file as the input for the DS job.
qwert123
- Jun 30th, 2009
Parameterize the file name.
Build the job using that parameter.
Build job sequencer which will call this job and will accept the parameter for file name.
Write a UNIX shell script which will call the job sequencer three times by passing different file each time. -
Rename Jobs
How will you rename all of the jobs to support your new File-naming conventions?
DatastageDev
- Jan 26th, 2010
More easily you can export to an XML file then simply do a find and replace. You can do this for any changes, job names, parameters, etc. Then import the jobs back to the project.
vkamatag
- Dec 8th, 2009
Create a excel spreadsheet with new and old names. Export the whole project as a .dsx. write a perl program, which can do simple rename of the strings looking looking up the excel file. Then import th...
-
Parallel Processing
How does config file help in Parallel processing?
manisha803
- Jan 20th, 2010
Configuration file provides hardware configuration for supporting such architecture as SMP, Grid or MMP (Multiple CPU, Multiple nodes and dedicated memory per node).Configuration file define all confi...
-
In which situation,we are using RUN TIME COLUMN PROPAGATION option?
pankaj.garg026
- Jan 15th, 2010
Run Time Column Propagation can be used with Column Import Stage. If RCP is enabled in our project, we can define only the columns which we are interested in and other rest of the columns datastage wi...
poonam
- Feb 14th, 2007
Run time column propagation is used in case of partial schema usage. when we only know about the columns to be processed and we want all other columns to be propagated to target as they are, we check ...
-
What is PROFILE STAGE , QUALITY STAGE,AUDIT STAGE in datastage..please expalin in detail.thanks in adv
hansth
- Jan 12th, 2010
Profile stage: is a profiling tool to investigate data sources to see inherent structures, frequencies of phrases, identify datatypes, etc.. In addition it can, based on the real data, rather than met...
-
Pass input parameters using UNIX Shell script
How to pass input parameters using UNIX Shell script to DataStage Director?
nikhilanshuman
- Dec 29th, 2009
From UNIX, Parameters are passed to datastage job while running them.This can be done by passing "-param" paramater to dsjob command.Syntax :dsjob -run mode Normal -param param1=value1 project name jobname
-
What is the use of clear status file
What is the use of clear status file in DS?How we will use it?explain with examples?
nikhilanshuman
- Dec 30th, 2009
If status is cleared for a datastage job,all of its instaces will be deleted.I mean if there is a instance say jobname.inst1 or jobname.inst2 these will be deleted.The entries for that particular jobs will be cleared from RT_Status(n) table.Here n is the job number.
ketanshah123
- Feb 19th, 2008
When you clear a job’s status file you reset the status records associated with all stages in that job. You should therefore use this option with great care, and only when you believe a job has ...
-
We have the Datastage server7.5 installed on Unix machine. We need to have a DSN to connect to the database which is on some other unix machine.please let me know it is enough if we create a DSN at the client machine or do we have to change the config file in UNIX?It is very urgent for us and we are not able to solve?pls help me in this regard.Madhavi
nikhilanshuman
- Dec 25th, 2009
In UNIX,three files need to be configured.a) uvodbc.configb) odbc.inic) dsenva)uvodbc.config : Here you need to specify the name of data spurce(DSN).Existing configurations in the file can be referred...
ram
- Sep 14th, 2007
You should create DSN in Unix box where datastage server is installed.? Creating at client machine would not be of any use..You need to have database client software installed on the datastage server (Unix box).
-
Shell scripts in sequencers
How you will call shell scripts in sequencers in datastage
nikhilanshuman
- Dec 25th, 2009
Tina-Shell scripts can be called from the execute command activity of a job sequence.
nikhilanshuman
- Dec 11th, 2009
"Execute command activity " is used to run a command from Unix.bash /path of script/scriptname.sh is also a unix command.hence it can also be called from Execute command activity of a job sequence.
-
How to run a job using Command line?
nikhilanshuman
- Dec 25th, 2009
The command is "dsjob" and case sensitive.Following is the command :dsjob -run -wait -warn 999 -jobstatus -project name -job name
sai
- Mar 31st, 2007
Dsjobs-run-jobstatus projectname jobname/filename
-
Clear logs
How to clear logs after 5 days, by using a routine?
nikhilanshuman
- Dec 25th, 2009
The logs can be cleared by deleting entries from the Universe table RT_LOGn.Here n is the job number.For this you need to go to Datastage Administrator - > Command.Here you can execute the queries on the universe tables.
-
Where does director create its log files?
We are spacing a problem of C: getting filled up because of a creation of some file. I think it is because of the director log files.
nikhilanshuman
- Dec 25th, 2009
The log files are stored at server.At the client side(windows) the log files are not stored.The logs are maintained in RT_Logn files on datastage server.Deleting logs:You can set Auto purge of job logs from datastage administrator to delete the log files automatically.
-
Configuration File
What is configuration file? What does it contain? What is the use of it in Datastage?
nikhilanshuman
- Dec 25th, 2009
A configuration file contains the information about the nodes,Resource disk and the Resource scratch disk.The datastage parallel jobs run on the basis of the configuration specified in the configurati...
-
Datastage ETL
What is Datastage ETL?
nikhilanshuman
- Dec 25th, 2009
ETL stands for Extract,transforam and Load.Datastage is an ETL tool which extracts the data from source,applies the necessary transformations on the data and loads the data into target.
-
How to assign the one path of file to PROJDEF using the job parameters?
At the time to incremental loading I need to take the reusable files' path in this situation How to assign the one path of file to PROJDEF using the job parameters?
nikhilanshuman
- Dec 11th, 2009
From your question it seems that you have defined the file path parameter as $PROJDEF in you parallel job.Setting a parameter to projdef :Step 1: Go to datastage adminstrator and set a user defined va...
-
What is Modulus and Splitting in Dynamic Hashed File?
In a Hashed File, the size of the file keeps changing randomly. If the size of the file increases it is called as "Modulus". If the size of the file decreases it is called as "Splitting".
Santhosh_DataStage
- Dec 2nd, 2009
Modulo is the calculated value which is calculated by using a Hash File Calculator. It tells the optimal number of groups to be created in the hash file to use it effectively. The Input to this Modulo calculation are the approximate number of records and the width of each record.
Milestones
- Sep 22nd, 2005
The modulus size can be increased by contacting your Unix Admin.
-
I am trying to execute batch file which has dsjob command to run data stage job from CLI.I am getting error code = 81011 (project not found but project is there)But I can run other jobs. I am getting into problem for one particular batch.any help
Sabari_Ram
- Nov 30th, 2009
The error code 81011 is related to the fact that the host is not available or the host is invalid.Kindly check whether the host you have chosen is a valid one.Kindly correct me if I am wrong in this view.
-
What is the use of combinability mode
nikhilanshuman
- Nov 29th, 2009
Combinabilty mode means datastage will combine the operators in a single process.If combinability mode is disabled,the number of Unix processes will increase. It can be set by setting &quo...
-
Write the shell script using Unix to run the 2 jobs?
write the shell script using Unix to run the 2 jobs?How to schedule the 2 jobs using Unix crontab to run for particular time?
nikhilanshuman
- Nov 29th, 2009
Inside the shell script, first you have to set the path using "dsenv".Then using following command the datastage job can be run.dsjob -run mode -Normal -jobstatus Projectname JobNameafter typing this in the editor,save file as testrun.sh.Now run the command using bash testrun.sh.
DataStage Interview Questions
Ans