stream of engineering
"Hey, we need some kind of a REST API over all our data lakes to let analysts and other integrations query records on demand . Can we please get this done?" That was the use-case laid out that needed a solution. If you've had any experience with data lakes you know that they can be … Continue reading Architecture for a data lake REST API using Delta Lake, Fugue & Spark
This one will be relatively short, figured I'd post this for anyone else who was struggling with use case. Your goal: your application needs to use a Python module that is available in a private Azure Artifact's feed and you want to pip install this module in a Alpine based docker build. Was recently working … Continue reading Using private Python Azure Artifacts feeds in Alpine Docker builds
CI/CD systems, for all their fascinating inner workings, complexity and inordinate amounts of configurability; at the end of the day, are really no different than any other piece of custom software out there. Just like any other software system, logically CI/CD engines are comprised of contracts for inputs, outputs, control flows and error handling etc. … Continue reading CI/CD control flow with Git commit message arguments
If you use Azure DevOps one of their related CI/CD offerings within this service is Azure Pipelines. I've been doing prototyping of various CI/CD offerings on the market and Azure Pipelines was one of them. If you look out into the world of CI/CD it can be a vast, intimidating and confusing array of platforms … Continue reading CI/CD with Azure Pipelines
I've used Hazelcast for years and have generally relied upon the availability of multicast for Hazelcast cluster discovery and formation (within a single data-center). Recently was faced with two things, expand the footprint into a non-multicast enabled data-center and secondly pre-prep the service for containerization where nodes will come and go as scaling policies dictate … Continue reading Hazelcast discovery with Etcd
I've used Hazelcast for years and have generally relied upon the availability of multicast for Hazelcast cluster discovery and formation (within a single data-center). Recently was faced with two things, expand the footprint into a non-multicast enabled data-center and secondly pre-prep the service for containerization where nodes will come and go as scaling policies dictate … Continue reading Hazelcast discovery with Consul
Ahhh, love it! So you need to configure a Windows box to be able to utilize DOS, sorry PowerShell, to remotely manage your Azure AD / o365 / Exchange online services via "cmdlets". You do some searching online and come across a ton of seemingly loosely connected Technet articles, forum questions etc. Well I hope … Continue reading Configuring PowerShell for Azure AD and o365 Exchange management
NOTE: I've since abandoned this avenue to generate pojos for the GraphAPI service. The Restlet Generator simply has too many issues in the resulting output (i.e. not handling package names properly, generics issues, not dealing with Edm.[types] etc). However this still may be of use to someone who wants to explore it further Recently had … Continue reading Generating Java classes for the Azure AD Graph API
bits.of.info 