Testing yas3fs: a distributed S3 FUSE filesystem

I've recently been doing quite a bit of evaluation of  a few S3 filesystems, one in particular is yas3fs which so far is quite impressive. I plan on doing a more detailed post about it later, however for now I'd like to share a little tool I wrote to help me in my evaluation of it. You …

Part 2: Nevado JMS, Ehcache JMS WAN replication and AWS

This post is a followup to what is now part one, of my research into using Ehcache, JMS, Nevado, AWS, SNS and SQS to permit cache events to be replicated across different data-centers. @see https://github.com/bitsofinfo/ehcache-jms-wan-replicator In my first post I was able to successfully get Ehcache's JMS Replication to function using Nevado JMS as the provider after patching the …

Ehcache replicated caching with JMS, AWS, SQS, SNS & Nevado

Read part 2 of this research here Recently I've been researching ways to GSLB a very large app that relies on Ehcache for numerous things internally such as; cached page output, cached lists etc etc. Anyone who has experience getting large scale applications to function active-N in a GSLB'd setup knows the challenges such topologies present. …

Deserializing Modsecurity Audit logs with Apache Flume

This post will be updated in the coming days/weeks, however when looking at using Apache Flume to ingest some ModSecurity Audit logs, it quickly became apparent that Flume's SpoolingDirectorySource lacked the ability to de-serialized "events" from a file that spanned many "new lines" (\n). Lacking this support, and seeing that an outstanding ticket already existed …

Dropwizard Java REST services

To sum it up; Dropwizard rocks. I've done quite a bit of WS development both the on client side and server side; interacting with both SOAP, REST and variants of XML/JSON RPC hybrid services. For my latest project I need to expose a set of REST services to a myriad of clients: phones, fat JS …

Logging in Jboss sucks

This is a venting post. I have a need to do the following. My app uses the Log4J API deployed on JBoss 6.1.x A) Correlate log statements with a given thread of execution, logically identified by an arbitrary generated "request id" that my application sets at the entry point for a request, doing this using …

JBoss and BouncyCastleProvider – SecurityException : “cannot authenticate the provider”

Are you having problems trying to use the BouncyCastleProvider from your app on Jboss 5.x + (i.e. like the errors listed below)? If so and you don't want to spend hours trying to workaround this issue in Jboss, just follow this guy's instructions and get back to business: http://www.randombugs.com/java/javalangsecurityexception-jce-authenticate-provider-bc.html Some background regarding this Jboss issue …

USPS AIS bulk data loading with Hadoop mapreduce

Today I pushed up some source to Github for a utility I was previously working on to load data from USPS AIS data files into HBase/Mysql using Hadoop mapreduce and simpler data loaders. Source @ https://github.com/bitsofinfo/usps-ais-data-loader This project was originally started to create a framework for loading data files from the USPS AIS suite of …

Setting a JAX-WS web service client timeout – why is the answer so dang elusive??

Trying to set a connection/read timeout in a WS client... can't and found this post? Welcome to the club. Does ANYONE OUT THERE have a proven, easy to implement, somewhat universal way, to simple set connect and read timeouts for JAX-WS web-service clients? I can't seem to find them, and neither can tons of others …

Review: Real World Java EE Patterns

I picked this book up a while back after looking for a book on Java EE patterns. The mainstream standard seemed to be the Core J2EE Patterns book, but the more I looked at it it just seemed outdated. So when I found Adam's book just the title looked practical "Rethinking Best Practices". So in …