-
We have the Datastage server7.5 installed on Unix machine. We need to have a DSN to connect to the database which is on some other unix machine.please let me know it is enough if we create a DSN at the client machine or do we have to change the config file in UNIX?It is very urgent for us and we are not able to solve?pls help me in this regard.Madhavi
nikhilanshuman
- Dec 25th, 2009
In UNIX,three files need to be configured.a) uvodbc.configb) odbc.inic) dsenva)uvodbc.config : Here you need to specify the name of data spurce(DSN).Existing configurations in the file can be referred...
ram
- Sep 14th, 2007
You should create DSN in Unix box where datastage server is installed.? Creating at client machine would not be of any use..You need to have database client software installed on the datastage server (Unix box).
-
Shell scripts in sequencers
How you will call shell scripts in sequencers in datastage
nikhilanshuman
- Dec 25th, 2009
Tina-Shell scripts can be called from the execute command activity of a job sequence.
nikhilanshuman
- Dec 11th, 2009
"Execute command activity " is used to run a command from Unix.bash /path of script/scriptname.sh is also a unix command.hence it can also be called from Execute command activity of a job sequence.
-
How to run a job using Command line?
nikhilanshuman
- Dec 25th, 2009
The command is "dsjob" and case sensitive.Following is the command :dsjob -run -wait -warn 999 -jobstatus -project name -job name
sai
- Mar 31st, 2007
Dsjobs-run-jobstatus projectname jobname/filename
-
Clear logs
How to clear logs after 5 days, by using a routine?
nikhilanshuman
- Dec 25th, 2009
The logs can be cleared by deleting entries from the Universe table RT_LOGn.Here n is the job number.For this you need to go to Datastage Administrator - > Command.Here you can execute the queries on the universe tables.
-
Where does director create its log files?
We are spacing a problem of C: getting filled up because of a creation of some file. I think it is because of the director log files.
nikhilanshuman
- Dec 25th, 2009
The log files are stored at server.At the client side(windows) the log files are not stored.The logs are maintained in RT_Logn files on datastage server.Deleting logs:You can set Auto purge of job logs from datastage administrator to delete the log files automatically.
-
Configuration File
What is configuration file? What does it contain? What is the use of it in Datastage?
nikhilanshuman
- Dec 25th, 2009
A configuration file contains the information about the nodes,Resource disk and the Resource scratch disk.The datastage parallel jobs run on the basis of the configuration specified in the configurati...
-
Datastage ETL
What is Datastage ETL?
nikhilanshuman
- Dec 25th, 2009
ETL stands for Extract,transforam and Load.Datastage is an ETL tool which extracts the data from source,applies the necessary transformations on the data and loads the data into target.
-
How to assign the one path of file to PROJDEF using the job parameters?
At the time to incremental loading I need to take the reusable files' path in this situation How to assign the one path of file to PROJDEF using the job parameters?
nikhilanshuman
- Dec 11th, 2009
From your question it seems that you have defined the file path parameter as $PROJDEF in you parallel job.Setting a parameter to projdef :Step 1: Go to datastage adminstrator and set a user defined va...
-
What is Modulus and Splitting in Dynamic Hashed File?
In a Hashed File, the size of the file keeps changing randomly. If the size of the file increases it is called as "Modulus". If the size of the file decreases it is called as "Splitting".
Santhosh_DataStage
- Dec 2nd, 2009
Modulo is the calculated value which is calculated by using a Hash File Calculator. It tells the optimal number of groups to be created in the hash file to use it effectively. The Input to this Modulo calculation are the approximate number of records and the width of each record.
Milestones
- Sep 22nd, 2005
The modulus size can be increased by contacting your Unix Admin.
-
I am trying to execute batch file which has dsjob command to run data stage job from CLI.I am getting error code = 81011 (project not found but project is there)But I can run other jobs. I am getting into problem for one particular batch.any help
Sabari_Ram
- Nov 30th, 2009
The error code 81011 is related to the fact that the host is not available or the host is invalid.Kindly check whether the host you have chosen is a valid one.Kindly correct me if I am wrong in this view.
-
What is the use of combinability mode
nikhilanshuman
- Nov 29th, 2009
Combinabilty mode means datastage will combine the operators in a single process.If combinability mode is disabled,the number of Unix processes will increase. It can be set by setting &quo...
-
Write the shell script using Unix to run the 2 jobs?
write the shell script using Unix to run the 2 jobs?How to schedule the 2 jobs using Unix crontab to run for particular time?
nikhilanshuman
- Nov 29th, 2009
Inside the shell script, first you have to set the path using "dsenv".Then using following command the datastage job can be run.dsjob -run mode -Normal -jobstatus Projectname JobNameafter typing this in the editor,save file as testrun.sh.Now run the command using bash testrun.sh.
-
How do you configure api_dump
nikhilanshuman
- Nov 29th, 2009
It seems you are asking for APT_DUMP_SCORE.It can be configured through datastage administrator->Environment variables.
-
What is the use and advantage of procedure in datastage?
hemant.agarwal03
- Nov 13th, 2009
If we have a complex business logic and we may need to create mutiple jobs to achive that , then we use procedure in data stage which provide us final output in a single job. It is faster then normal SQL statement also.
Him121
- Jun 22nd, 2007
To trigger Database operations at before or after DB stage access.
-
What is the max capacity of Hash file in DataStage?
Alfons
- May 5th, 2006
Hello,Take a look at the uvconfig file:# 64BIT_FILES - This sets the default mode used to# create static hashed and dynamic files.# A value of 0 results in the creation of 32-b...
-
Datastage flow of parallel Project
Any body explain the flow of project(parallel) in real time thanx
srikanth.ds
- Oct 30th, 2009
Project flow is nothing but the data flow in your project. For example in many of the projects data is moved from source to staging, and then perfoem ETL and staging to ware house. So here you encountered 2 levels of data flow i.e source to staging and staging to warehouse.
-
Remove duplicates using transformer
How do you remove duplicates using transformer stage in datastage
Jaimy Chacko
- Oct 26th, 2009
To capture rejected duplicates use a Transformer. Partition and sort on your primary key. In a transformer keep the primary key stored in a Stage Variable. Compare incoming primary key to the stored p...
umamahesh.ds
- Jul 25th, 2008
In that Time double click on transformer stage---> Go to Stage properties(its having in hedder line first icon) ---->double click on stage properties --->Go to inputs ---->go to part...
-
Lookup Stage Partitioning
With a Lookup stage the input stage has 1million records and reference link has 1million records. What is the best Partition method and why?
Kumar Shourav
- Oct 24th, 2009
Better to use JOIN or MERGE stage in place of Lookup. If input data is low in compare to reference data then Lookup is recommendable. Assumption is 1:100 or more.
gopalanrr
- Mar 27th, 2009
When the reference link is too high in terms of records fetched, you should be performing a join instead of performing a lookup
-
Problems with Datastage - Date format & Null Handling of a Date field in a schema file
Hi,I have a .csv file as my source.I am reading the data using asequential file stage.Then I am validating the format of the data using a schema file.The date format of the incoming file is '%dd/%mm/%yyyy'.So the datecolumn has a fixed length 10.Now according to the provided incoming data set the date column shouldbe nullable.Can anybody please provide an idea how to handle a nullable datecolumn using...
Abhijain
- Oct 19th, 2009
Read the date field column as varchar and use transformer to check nullabiltiy and if null found assign some default value say '12-Dec-9999' and use the appropriate conversion function an...
Abhijain
- Oct 19th, 2009
Read date field from sequential file as varchar datatype with nullable yes. Use modify stage or transformer to convert the datatype and also check the nullability of the incoming data and if null foun...
-
SCD Type2 in Enterprise Edition
How to implement Slowly changing dimesions Type2 in Parallel jobs . What are the stages we use and How to assign the key?
Abhijain
- Oct 19th, 2009
Datastage Px 8.0.1 is having SCD stage to perform the required operation. Or it can be achived by using lookup/change capture stage in between source and target database.
DataStage Interview Questions
Ans