Rohan Lopes Blog

In this post will try to show how to connect to Twitter Public Stream API and download live Twits. We can save these Twits in any format like comma or pipe delimited. These Twits can be use for Data Mining or Data Analysis. Have used this Twits to analyse the current News in given region. This program creates files of 50MB each, and keep rotating till the time the stream is running. we can run Map-Reduce program using Hadoop Framework to analysis the data at much faster rate. Prerequisite: 1. Need to have Twitter Application 2. Twitter OAuth Tokens       https://dev.twitter.com/docs/auth/obtaining-access-tokens 3. Twitter4j Libraries      http://twitter4j.org/en/ Below are the twitter4j API used: TwitterStreamFactory  : This API returns the object of type  TwitterStream We need to set below authorization tokens to connect to Twitter Public Stream. You will find below tokens once you create Twitter Application. -Dtwitter4j.oauth...

We can integrate weblogic with IBM MQ over JMS by creating Foreign JMS server with Links in weblogic server. We need to create .binding file which will acts as file based JNDI provider to create JMS binding to MQ resources. Will first explain how to create .binding file and then will configure weblogic to use the same. Steps to create .binding file: Firstly we need to add below jar’s in CLASSPATH jms.jar com.ibm.mq.jar com.ibm.mqjms.jar jta.jar connector.jar jndi.jar providerutil.jar fscontext.jar Create JMSProperties.config file with below properties INITIAL_CONTEXT_FACTORY=com.sun.jndi.fscontext.RefFSContextFactory PROVIDER_URL=file:/tmp/mqm/jndi SECURITY_AUTHENTICATION=none Run below command ./JMSAdmin -v JMSProperties . config InitCtx> def qcf(ForeignCF) TRANSPORT(CLIENT) HOST(localhost) PORT(1414) CHANNEL(MQCHANNEL) QMGR(MQMRG) def q(MQ1) qmgr(MQMRG) queue(MQ1) def q(MQR1) qmgr(MQMRG) queue(MQR1) display ctx ...

Big Data: The term Big Data applies to the information that can't be processed or analyzed using traditional processes. It’s basically processing terabytes of unstructured information to generate insights that are required for the businesses. Three basic characteristics of BigData: 1.     Volume : The data that is to be analyzed is in Terabytes. For example, Twitter alone generates around 7 terabytes (TB) data per day, Facebook around 10 TB/day. Analyzing this volume requires lot of hardware. 2.     Variety : The data is not only organized in traditional table patterns but also raw, semi structured, and unstructured data like weblogs, social media, blogs, sensors, images, videos etc. 3.     Velocity: It requires to analysis or process volume and variety data quickly. The velocity is very important as the data is still in motion, for example analysis real time market data, or analysis customer's browsing pattern while the time...

In this post will show how to configure cluster environment on Oracle Weblogic 11g. We will also create sample Loadbalancer using Oracle Service Bus to test our cluster. The clustered environment provide various benefits like Scalability, Reliability, Performance etc. By running the manageserver on multiple machine we can ensure Reliability i.e. if one machine goes down requests will be processed by another server running on another machine. All the manage server's are controlled by single Admin Server. It provide control to do various activities like start/stop the server, deployment, so on. Prerequisites: Oracle Weblogic is already installed on your system. Below steps shows how to configure the cluster environment on Oracle Weblogic: 1. Open weblogic configuration wizard 2. Select Create a new weblogic domain option. 3. Select the option which you want to be configured in your weblogic domain. 4. Specify the domain name ,say "clus_domain...

On 18th september Oracle Financial Services Launches Oracle Banking Platform . Its now 3 years since I started working on OBP, really feels proud to be the part of this product development. Please refer below press release: http://www.oracle.com/us/corporate/press/1844990 Official page: http://www.oracle.com/us/industries/financial-services/banking/banking-platform/index.html

I tried searching the Hadoop 1.0.3 plugin for Eclipse, but was not able to find it. Apache has remove the plugin from Hadoop installation folder. Instead you can find Eclipse Plugin source code with build.xml file at "${HADOOP_HOME}\hadoop-1.0.3\src\contrib\eclipse-plugin" .  I have build the plugin project and created hadoop-eclipse-plugin-1.0.3.jar. You can simply download ( hadoop-eclipse-plugin-1.0.3.jar ) and use the same. Thanks, Rohan L

In this post we will explain how to create JAX WS client stub to make a web service call from JAVA. First, Use the below command to create JAVA stub from WSDL. wsimport -d $PATH_FOR_JAVA_CLIENT $FULL_WSDL_PATH -keep -Xnocompile -verbose $PATH_FOR_JAVA_CLIENT--Location where the client code will get generated $FULL_WSDL_PATH--Location of the WSDL  To run the above command follow the below steps: 1. open cmd prompt. 2. Goto directory "$MiddlewareHome\user_projects\domains\base_domain\bin" . 3. Run "setDomainEnv.cmd" for windows and "setDomainEnv.sh" for Linux 4. Run the below command wsimport -d C:\wsdl\code http://10.180.90.79:7777/Simple/Porduct/ProductInfo?wsdl -keep -Xnocompile -verbose Note: http://10.180.90.79:7777/Simple/Porduct/ProductInfo?wsdl is the dummy webservice that will return dummy product details. Next, 1. Create new JAVA project say "JAXBClient" in eclipse. 2. Copy entire folder under ' C:\wsdl\code ...