-
What is the difference between a Filter and a Switch Stage ?
kaps3157
- Jan 24th, 2012
Both stages functionality and responsibilities is same. But the difference way of execution like.. In filter stage, we have to give the multiple conditions, on multiple columns. But every time data ...
nikhilanshuman
- Dec 25th, 2009
A switch stage can have maximum 128 output links.A filter stage can have any number of output links.
-
What versions of DS you worked with?
DS 7.0.2/6.0/5.2
svr
- Mar 7th, 2012
7.5 is single execute system 8.01 is multiple execute system
file based repository
database repository
it is used in change capture & change apply stages. Here we r using SCDS like 1,2,3 -
What about System variables?
sangam
- May 23rd, 2018
Out of all those , i am not able to find/call them in a transformer , like @LOGNAME , while i use this in a stage variable, it throws error , saying its not defined. I am using Datastage 11.5 version. Any idea how to get this done ?
Thanks !rameshkm
- Apr 15th, 2009
The variables which used in through out the system not in singale project is called System variables .some of the system variables are @FALSE,@PARTITIONNUM ,@NUMPARTITIONS,@TRUE, which are avaialable in Transformer
-
I want to process 3 files in sequentially one by one , how can i do that. while processing the files it should fetch files automatically .
bizzinsights
- Jan 29th, 2010
Append all the source files into a single file in Unix if the metadata is same. Use that file as the input for the DS job.
qwert123
- Jun 30th, 2009
Parameterize the file name.
Build the job using that parameter.
Build job sequencer which will call this job and will accept the parameter for file name.
Write a UNIX shell script which will call the job sequencer three times by passing different file each time. -
What is difference between serverjobs & paraller jobs
bakshtheking
- Jun 16th, 2008
--- Server generates DataStage BASIC, parallel generates Orchestrate shell script (osh) and C++, mainframe generates COBOL and JCL. --- In server and mainframe you tend to do most of the work in Trans...
Sharanu Patil
- Feb 28th, 2006
Server jobs can be run on SMP,MPP machines.Here performance is low i.e speed is lessParallel jobs can be run only on cluster machines .Here performance is high i.e speed is high
-
Explain about Error Handling in Datastage and best practices.
madhavsandireddi
- Feb 25th, 2011
In sequence job we have to run a job and if a job is aborted and if we do not have terminator activity then control goes to the exception handler where it checks for what reason the job is aborted..ThanksMadhav
nikhilanshuman
- Dec 29th, 2009
In datastage sequence,there is "Exception Handler" activity.When you are calling your jobs from a Datastage Sequence you should do following :Step 1: Go to properties of master sequence and ...
-
How can I identify the duplicate rows in a seq or comma delimited file?the case is...> the source has 4 values like, agent id, agent name, etc... our requirement is that the ID shouldn't be repeated. so how can i identify the duplicate rows , set a flag and send the rejects to the specified reject file? the source systems data is directly given to us. tha's why we are getting these duplicates.if it has a primary key set up already then it would have been very easy.thanks in advance.
ds_ng
- Jul 23rd, 2008
If your working server jobs, use Sort stage then use Aggregator stage. Use property like 'Last' or 'First'. Then duplicated rows will be removed
the_xxx
- Jul 3rd, 2007
Hi, if your working on Server jobs. Sort the data first and use Hash file stage which has the property of eliminating duplicates.
-
How to remove the locked jobs using datastage?
SudhirKanojia
- Feb 8th, 2010
Login to Datasatage AdministratorGo to Properties ->go to commandtype LIST.READUYou will find the PID(inode) along with job name in tabular format.Find the job which is lockedthen typeUNLOCK INODE (Inode no xxxxxx) ALLRegardSudhir Kanojia
parvathi
- Oct 8th, 2007
Also find out the PID number from datastage director in cleanup resources link and go to the UNIX server and kill PID number. This way you can easily kill the process and it gets unlocked.
-
1.What is the use of parameters in datastage job?2.What is the difference between datastage 6 and datasttage 7.0?3.Whta is unit testing, system testing and integration testing?4.seheduling the jobs in Datastage?5.What is the difference between datastage 7.1 and datasttage 7.5?6.How to do error handling in datastage?7.how do you remove duplicates in a flatfile?
Sathish123
- Feb 20th, 2007
The main purpose of job parameters in Datastage is to provide the values at job run time.Ex;File Path,File name,database server name,userid,password.
naveen patil
- Nov 28th, 2006
Parameters are helps to enter values at run time. and also makes secure by not to forcing a hard coding.Unit testing is the one mainly deals with a single job.system testing is the one deals wit...
-
How can we generate a surrogate key in server/parallel jobs?
narra satish
- Mar 28th, 2011
Hi,By using transformer we can generate the servgate key.In stagevariablesand write the derviation.
neeraj82
- Jul 3rd, 2009
You can generate through system variable in transformer which is built-in name is keymgt. You don't have remember full name and in parallel you can generate through surrogate key generator.
-
What is an environment variable??
the_xxx
- Mar 21st, 2007
Here is the full FAQ on this topic:Creating project specific environment variables- Start up DataStage Administrator.- Choose the project and click the "Properties" button.- On the General tab click t...
yukthi
- Oct 13th, 2006
Thanx
-
NEED HELP1) I can not get into DataStage Administrator after trying a lot. I give the Host Name or Name of my computer, and I did not give the User Name & Password then I get the error like thisFailed to connect to host: ishaq, project: UV(The host name specified is not valid, or the host is not responding (81011))2)When I give the Host Name User Name & Password then I get the error like this Failed to connect to host: ishaq, project: UV(The host name specified is not valid, or the host is not responding (81011))To solve this problems, I Installed the DataStage 7.5.1, atleast seven times, after this all still I did not get enter into the DataStage Administrator then I format the System, and Re Installed every thing once again from the beginning, then again Installed the DataStage, still I have the same problem, I can not get enter into the DataStage Administrator till now.I am sure, I have Windows XP SP2 Installed on P4 System
sinhasaurabh014
- Apr 9th, 2008
Apart from ensuring that telenet service is running and the option of bypassing,do also make sure that the datastage services(both) are running in services....pretty much the same solution as the firs...
chandrasekarj
- Mar 9th, 2008
There is an option called Bypass......If you select this option.Your problem will be resolved.
-
What is the use of tunnable??
Ravi
- Dec 17th, 2006
Tunable is project property in Datastage Administrator, in that we can change the value of cache size i.e. between 0 to 999 mb,
-
What is the diffrence between IBM Web Sphere DataStage 7.5 (Enterprise Edition ) & Standard Ascential DataStage 7.5 Version ?
manoharkolukula
- Jan 25th, 2008
I think there is no version like standard Ascential DataStage 7.5, I know only the advanced edition of Datastage i.e., only web sphere Datastage and Quality stage, it is released by IBM itself and giv...
vsingh
- Jan 23rd, 2008
IBM Information Server also known as DS 8 has more features like Quality Stage & MetaStage . It maintains its repsository in DB2 unlike files in 7.5. Also it has stage specifically for SCD 1 & 2.
-
What is the difference betwen Merge Stage and Lookup Stage?
veer.dwh
- Oct 7th, 2009
Both stages use for joining the data. using merger you can capture rejected data from N no of update datasets but you can't capture master source data. but using lookup you can capture 1 reject data set from source only not from the refrence datasets.Regards,Veeru.
srinivasguptha
- Jan 29th, 2007
Lookup stage:1. Used to perform lookups.2. Multiple reference links, single input link, single output link, single rejects link, single primary link. 3. Large amount of memory usage. Because paging re...
-
Are there any ways of passing parameters or values across parallel jobs in a sequencer? Scenario: Job 'A' would execute and based on the result of the Job we want either Job 'B' or Job 'C' to execute. Hence the result of Job 'A' would determine the sequence of operation.
Abhijain
- Jul 29th, 2008
Not clear from your question, what do you mean by the result of the job. what I got is- you want to perform the conditional run of the jobs. It can be possible through sequencer.In sequence, You can c...
subrahmanyam sanka
- Aug 2nd, 2007
Please eloborate your question "based on result of job", one techinque is to use the parameter file and set other session based on event wait.
-
How can we remove duplicates using sort stage?
Alex
- Feb 28th, 2007
TreeSet<String> set = new TreeSet<String>(Arrays.asList(names)); for (String name : set) &nb...
-
Why copy stage is better than transformer?
Incase of only dropping columns(without any transformations or business rules), we can go for copy stage instead of transformer.But can anyone tell me exactly why copy stage is better in performance than transformer?
Lalit
- Oct 9th, 2017
Look Copy stage is made up for only copying data and transformer stage is made up for multiple functionalities and also it is made up of c++ code. So if you want to only copy data and rename datatypes...
Atangel
- Oct 12th, 2012
Transformer is a heavier stage as apart from the orchestrate we do have the C++ operators for various derivations. Right from compilation to execution a Transformer will always take more time than a copy stage which is a simple straight forward passive(if we can call) stage
-
What is the necessity to run the datastage job in Unix background?
SudhirKanojia
- Feb 9th, 2010
We need to execute dsenv file, before executing DataSatge job in UNIX background using DsRunJob commandRegard Sudhir Kanojia
veer.dwh
- Sep 23rd, 2009
You can run DS jobs using DS desiner and director client components. but in real time we will have huge no of jobs and those has sequnce of order dependency? to prform client requirment. in that situ...
-
What is the difference between Squential Stage & Dataset Stage. When do u use them.
manoharkolukula
- Jan 25th, 2008
Sequential file can used as a target file but Dataset can't be used as final target, it can be used as temperary target.Dataset can be used as a hashfile(just like in server hashfile), it improves...
vijaykumar_ads
- Jan 18th, 2008
Parallel jobs use data sets to manage data within a job. You can think of each link in a job as carrying a data set. The Data Set stage allows you to store data being operated on in a persistent form,...
DataStage Interview Questions
Ans