Clustering Liferay globally across data centers (GSLB) with JGroups and RELAY2

Recently I've have been looking into options to solve the problem of GSLB'ing (global server load balancing) a Liferay Portal instance. This article is a work in progress... and a long one. Jan Eerdekens states it correctly in his article, "Configuring a Liferay cluster is part experience and part black magic" .... however doing it … Continue reading Clustering Liferay globally across data centers (GSLB) with JGroups and RELAY2

Part 2: Nevado JMS, Ehcache JMS WAN replication and AWS

This post is a followup to what is now part one, of my research into using Ehcache, JMS, Nevado, AWS, SNS and SQS to permit cache events to be replicated across different data-centers. @see https://github.com/bitsofinfo/ehcache-jms-wan-replicator In my first post I was able to successfully get Ehcache's JMS Replication to function using Nevado JMS as the provider after patching the … Continue reading Part 2: Nevado JMS, Ehcache JMS WAN replication and AWS

Ehcache replicated caching with JMS, AWS, SQS, SNS & Nevado

Read part 2 of this research here Recently I've been researching ways to GSLB a very large app that relies on Ehcache for numerous things internally such as; cached page output, cached lists etc etc. Anyone who has experience getting large scale applications to function active-N in a GSLB'd setup knows the challenges such topologies present. … Continue reading Ehcache replicated caching with JMS, AWS, SQS, SNS & Nevado

Ideas worth spreading

If you haven't been exposed to Nathan Marz's ideas on Big Data, the following links are definitely worth your time: http://manning.com/marz/ http://www.infoq.com/presentations/Complexity-Big-Data http://nathanmarz.com/speaking/

Processing ModSecurity audit logs with Fluentd

Recently had a need to take tons of raw ModSecurity audit logs and make use of them. First used Logstash and then attempted with Apache Flume (see previous articles). Next in line was Fluentd which is what this article is about, long story short I ended up just having to write a Fluentd output plugin to take the output … Continue reading Processing ModSecurity audit logs with Fluentd

Deserializing Modsecurity Audit logs with Apache Flume

This post will be updated in the coming days/weeks, however when looking at using Apache Flume to ingest some ModSecurity Audit logs, it quickly became apparent that Flume's SpoolingDirectorySource lacked the ability to de-serialized "events" from a file that spanned many "new lines" (\n). Lacking this support, and seeing that an outstanding ticket already existed … Continue reading Deserializing Modsecurity Audit logs with Apache Flume

Logstash for ModSecurity audit logs

Recently had a need to take tons of raw ModSecurity audit logs and make use of them. Ended up using Logstash as a first stab attempt to get them from their raw format into something that could be stored in something more useful like a database or search engine. Nicely enough, out of the box, … Continue reading Logstash for ModSecurity audit logs