While working on a project where I needed to quickly import 50-100 million records I ended up using Hadoop for the job. Unfortunately the input files I was dealing with were fixed width/length records, hence they had no delimiters which separated records, nor did they have any CR/LFs to separate records. Each record was exactly … Continue reading Reading fixed length/width input records with Hadoop mapreduce
Tag: Java
HBase examples on OS-X and Maven
Ok, so today I needed to get HBase 0.20.0 running on my local os-x box, simply in standalone mode. I am starting a project where I need to manage 50-100 million records and I wanted to try out HBase. Here are the steps I took, the steps below are a consolidation of some pointers found … Continue reading HBase examples on OS-X and Maven
Integrating Restlet with Spring
For those of you out there who would like to get Restlet 2.0 (currently the M5) release up integrated with your existing Spring application, hopefully this post will be of some help. I recently had to do this and unfortunately the documentation related to Spring integration on the Restlet site is scattered across various docs … Continue reading Integrating Restlet with Spring
Book Review: Liferay Portal 5.2 Systems Development
This is a book review of Liferay Portal 5.2 Systems Development by Jonas X. Yuan. Having no previous experience with this platform, I bought this book to try to get an overview of Liferay. The book starts out by giving an overview of Liferay and an overview of JSR-286. The bulk of the book (90%) … Continue reading Book Review: Liferay Portal 5.2 Systems Development
AccessDecisionManager does not support secure object class…
This post will be short and sweet, but for those of you using Spring Security and come across this exception, hopefully this post will be of some help to you. Here is the exception: I received this exception today when I began to add some http/web level security into my application which already had some … Continue reading AccessDecisionManager does not support secure object class…
Add Hibernate 3.3.2 as a dependency in your Maven POM
Recently I had to update a Maven POM to get the latest release of Hibernate (3.3.2) and if you are in this boat as well, here is what you have to do: 1) Ensure that you add the JBoss repository to your <code>repositories</code> section as the latest releases are not in the standard maven repository. … Continue reading Add Hibernate 3.3.2 as a dependency in your Maven POM
Review: RESTful Web Services
This is a book review for "RESTful Web Services" by Leonard Richardson and Sam Ruby If you want to get under the hood and really understand how to properly implement a RESTful web service then this book is for you. The treatment of the topic is excellent. After reading this book, I feel that so … Continue reading Review: RESTful Web Services
Simplified Java encryption with Jasypt
Recently I had to evaluate an older encryption service that existed in an Java app. The service was written in the early days when the JCE was relatively new and it used BouncyCastle as the provider. While coded quite well the service had code which handled all sorts of the low level JCE stuff like … Continue reading Simplified Java encryption with Jasypt
How to read a specific line from a very large file in Java
So the other day I had to write some Java code to read specific lines of text from very large files full of ASCII text records (of a fixed length). The records in the files are generally defined by the the length of a record (no carriage returns, fixed length, i.e. each "record" is 290 … Continue reading How to read a specific line from a very large file in Java
Review: Spring Recipes
This is a review of the book "Spring Recipes" by Gary Mak I picked up this book as a supplement to the "Spring in Action" 1st/2nd editions that I have. This book takes the same approach as the O'Reilly Cookbook series and covers Spring 2.5. Basically it is a task/problem oriented book. Each little section … Continue reading Review: Spring Recipes
bits.of.info 