{"@attributes":{"version":"2.0"},"channel":{"title":"Mark Chmarny","link":"https:\/\/blog.chmarny.com\/","description":"Recent content on Mark Chmarny","generator":"Hugo -- gohugo.io","language":"en","managingEditor":"Mark Chmarny","lastBuildDate":"Mon, 08 Jun 2026 08:00:00 -0700","item":[{"title":"Staying Relevant Through Inflection Points","link":"https:\/\/blog.chmarny.com\/posts\/staying-relevant-through-inflection-points\/","pubDate":"Mon, 08 Jun 2026 08:00:00 -0700","guid":"https:\/\/blog.chmarny.com\/posts\/staying-relevant-through-inflection-points\/","description":"<p>Working for the leading AI company, people tend to ask you what AI means for their careers. Usually, they want to hear one of two extremes: &ldquo;this changes nothing&rdquo; or &ldquo;we&rsquo;re all doomed&rdquo;. To be honest, I appreciate both. A lot of what I have spent learning over two plus decades is now just a prompt away. Hard-earned debugging skills and deep technical knowledge can be generated by a model in seconds. It&rsquo;s uncomfortable to watch. But having your knowledge become cheap doesn&rsquo;t mean <em>you<\/em> become irrelevant. There is a huge gap between those two statements.<\/p>"},{"title":"DevPulse: Community Health Analytics for the Rest of Us","link":"https:\/\/blog.chmarny.com\/posts\/devpulse-community-health-analytics-for-the-rest-of-us\/","pubDate":"Tue, 17 Mar 2026 08:00:00 -0700","guid":"https:\/\/blog.chmarny.com\/posts\/devpulse-community-health-analytics-for-the-rest-of-us\/","description":"<p>If you maintain an open source project, you&rsquo;ve probably wondered: who&rsquo;s actually contributing? Are we retaining contributors or burning through a revolving door? Is one person carrying the whole project? These questions matter.<\/p>\n<p>Commercial platforms answer these questions well. They do come with trade-offs though. Hosted analytics means sending your potentially private repo contributor data to a third party. Pricing models often assume enterprise budgets. And for a maintainer running a project with a handful of repos and no funding, the friction of setting up yet another SaaS integration is enough to never bother.<\/p>"},{"title":"AI Cluster Runtime: Reproducible Configs for GPU-Accelerated Kubernetes Clusters","link":"https:\/\/blog.chmarny.com\/posts\/ai-cluster-runtime-reproducible-configs-for-gpu-accelerated-kubernetes\/","pubDate":"Thu, 12 Mar 2026 09:30:00 -0700","guid":"https:\/\/blog.chmarny.com\/posts\/ai-cluster-runtime-reproducible-configs-for-gpu-accelerated-kubernetes\/","description":"<p>GPU Kubernetes is hard. Aligning kernels, drivers, container runtimes, operators, and Kubernetes versions is a version compatibility minefield. A single misconfigured component can take down an entire GPU fleet, and root cause analysis can take days. Typically, these known-good configurations live as tribal knowledge in &ldquo;runbooks&rdquo; and internal pipelines, not as portable, reproducible artifacts.<\/p>"},{"title":"Reputation scoring for open source contributors: what reputer measures and why","link":"https:\/\/blog.chmarny.com\/posts\/reputer-scoring-contributor-reputation\/","pubDate":"Sat, 21 Feb 2026 00:00:00 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/reputer-scoring-contributor-reputation\/","description":"<p>Every dependency you install, every pull request you merge, carries an implicit trust decision. You trust that the person behind the commit is who they claim to be, that their account hasn&rsquo;t been compromised, and that their contribution is genuine. Most of the time, that trust is warranted. But supply chain attacks like the <a href=\"https:\/\/en.wikipedia.org\/wiki\/XZ_Utils_backdoor\">xz utils backdoor<\/a> remind us that trust without verification is a vulnerability.<\/p>"},{"title":"About Mark Chmarny","link":"https:\/\/blog.chmarny.com\/about\/","pubDate":"Sun, 03 Nov 2024 00:00:00 +0000","guid":"https:\/\/blog.chmarny.com\/about\/","description":"<p>Builder, architect, and strategist dedicated to simplifying how developers interact with complex systems. Currently serving as a Principal Cloud Architect in NVIDIA\u2019s DGX Cloud organization, Mark focuses on bridging the gap between cutting-edge AI hardware and the cloud-native ecosystem. His mission is to enable optimized, validated, and reproducible GPU-accelerated infrastructure in Kubernetes for everyone.<\/p>"},{"title":"Leaving Cruise; why I'm still excited about AI platforms","link":"https:\/\/blog.chmarny.com\/posts\/leaving-cruise\/","pubDate":"Fri, 16 Feb 2024 19:12:38 -0800","guid":"https:\/\/blog.chmarny.com\/posts\/leaving-cruise\/","description":"<p>Today marks a bittersweet moment as I say goodbye to <a href=\"https:\/\/getcruise.com\">Cruise<\/a>. When I joined the company seven months ago, my mission was to scale the AV services worldwide and to modernize the AV and Cloud service developer platforms. Despite the unexpected challenges following the <a href=\"https:\/\/getcruise.com\/news\/blog\/2024\/cruise-releases-third-party-findings-regarding-october-2\/\">October incident<\/a>, my journey at Cruise has been incredibly enriching, teaching me the true essence of resilience, adaptability, and commitment to excellence.<\/p>"},{"title":"Provenance, transparency, and context, the three aspects of software supply chain security you can implement today","link":"https:\/\/blog.chmarny.com\/posts\/provenance-transparency-context-3-aspects-of-s3c-you-can-implement-today\/","pubDate":"Wed, 14 Jun 2023 08:57:57 -0700","guid":"https:\/\/blog.chmarny.com\/posts\/provenance-transparency-context-3-aspects-of-s3c-you-can-implement-today\/","description":"<p>The practice of Secure Software Supply Chain (S3C) can get complex at times. Fortunately though, a large portion of the key things we can do to secure our software delivery pipelines are actually pretty easy. This post covers three concepts you can implement today:<\/p>"},{"title":"Software supply chain data fatigue and what I\u2019ve learned from SBOM, vulnerability reports","link":"https:\/\/blog.chmarny.com\/posts\/automating-software-supply-chain-security\/","pubDate":"Wed, 11 Jan 2023 07:09:34 -0800","guid":"https:\/\/blog.chmarny.com\/posts\/automating-software-supply-chain-security\/","description":"<p>If you are doing any vulnerability detection in your software release pipeline today, you are already familiar with the volumes of data these scanners can generate. That dataset gets significantly larger when you add things like license scanning and <a href=\"https:\/\/www.cisa.gov\/sbom\">Software Bill of Materials<\/a> (SBOM) generation. That volume of data gets further compounded with each highly-automated pipeline you operate. This can quickly lead to what I refer to as a Software Supply Chain Security (S3C) data fatigue, as many vulnerabilities you\u2019ll discover you simply can\u2019t do anything about. There is an actionable signal in there actually, it\u2019s just hard to find it in the midst of all the noise.<\/p>"},{"title":"Twitter follower status monitoring made easy using TweeThingz","link":"https:\/\/blog.chmarny.com\/posts\/twitter-follower-activity-monitoring-using-tweethingz\/","pubDate":"Sun, 30 Jan 2022 09:13:38 -0800","guid":"https:\/\/blog.chmarny.com\/posts\/twitter-follower-activity-monitoring-using-tweethingz\/","description":"<p><img align=\"right\" src=\"https:\/\/blog.chmarny.com\/images\/twitter-api-access.jpeg\" style=\"width:300px; height:auto; margin:20px\" \/>Twitter does provide notifications for when new users start following you. It does now however provide any notifications when users stop following you. Now, there is an ample of web sites out there who do provide that service, in most cases though, they cost money, and ask you for a complete access to your Twitter account.<\/p>"},{"title":"Reproducible OpenID connect to GCR for GitHub Actions workflows using Terraform","link":"https:\/\/blog.chmarny.com\/posts\/reproducible-github-workflow-openid-connect-for-gcp-using-terraform\/","pubDate":"Sat, 29 Jan 2022 16:12:38 -0800","guid":"https:\/\/blog.chmarny.com\/posts\/reproducible-github-workflow-openid-connect-for-gcp-using-terraform\/","description":"<p>The recently introduced by GitHub support for <a href=\"https:\/\/openid.net\/connect\/\">OpenID Connect<\/a> (OIDC) tokens in <a href=\"https:\/\/github.com\/features\/actions\">GitHub Actions<\/a> allows workflows to mint new tokens and then exchange those tokens for short-lived OAuth 2.0 or JWT tokens. These tokens can be used to access and manage Cloud resources. This is all done without the need to store the traditional long-lived service account keys in a form of GitHub secrets.<\/p>"},{"title":"Multi Region REST Service on GCP using GitHub Template","link":"https:\/\/blog.chmarny.com\/posts\/multi-region-rest-service-on-gcp\/","pubDate":"Wed, 05 Jan 2022 15:43:56 -0800","guid":"https:\/\/blog.chmarny.com\/posts\/multi-region-rest-service-on-gcp\/","description":"<p>I learn best by doing. And recently, most of the projects I&rsquo;ve been building are either REST or gRPC-base services deployed as container images into Cloud Run on GCP. That means that I increasingly find myself recreating a lot of the same infra and app deployment flows.<\/p>"},{"title":"Medium to GitHub using Hugo - Why and How I Migrated my Blog","link":"https:\/\/blog.chmarny.com\/posts\/medium-to-hugo-why-and-how\/","pubDate":"Mon, 03 Jan 2022 13:51:00 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/medium-to-hugo-why-and-how\/","description":"<h2 id=\"why-not-medium\">Why not Medium<\/h2>\n<p>My main reason for migrating off Medium was the <a href=\"https:\/\/help.medium.com\/hc\/en-us\/articles\/360017581433-About-the-metered-paywall\">paywall<\/a> Medium introduced while back. I actually understand why they did it. The unlimited access price: $5\/month ($50\/year) is too high, but still, I get it.<\/p>\n<p>For me though, the objective was to allow readers to easily discover and read my posts. I don&rsquo;t want my readers to experience any friction. Forcing the reader to deal with the frustrating Medium up-sell pop-ups just to read my post was just unnecessary.<\/p>"},{"title":"Custom news scraper using free services from GitHub, Firebase, and Sengrid","link":"https:\/\/blog.chmarny.com\/posts\/custom-news-scraper-using-free-services-from-github-firebase-sengrid\/","pubDate":"Mon, 05 Apr 2021 01:09:03 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/custom-news-scraper-using-free-services-from-github-firebase-sengrid\/","description":"<p>Increasing large amount of technical news I read come from the posts shared on Hacker News or on Twitter. While both of these services have <a href=\"https:\/\/help.twitter.com\/en\/using-twitter\/twitter-advanced-search\">search options<\/a>, neither of these seem to be advanced enough to narrow my searches at the desired level or to setup automatic delivery.<\/p>"},{"title":"Complexity can be learned but abstractions come at a long-term cost","link":"https:\/\/blog.chmarny.com\/posts\/complexity-can-be-learned-but-abstractions-come-at-long-term-cost\/","pubDate":"Tue, 30 Mar 2021 19:35:48 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/complexity-can-be-learned-but-abstractions-come-at-long-term-cost\/","description":"<p>All complexity needs to be abstracted, right? This reductionist statements misses nuance around the inherent cost\/benefit tradeoffs, especially when you consider these over time.<\/p>\n<p>Don\u2019t get me wrong, there often are good reasons for additional layers to make things simpler (grow adoption, lowering toil, removing friction, etc.). Still, these layers come at the long-term cost that\u2019s often is not a part of the evaluation process.<\/p>"},{"title":"How I learned Dapr building tweet sentiment processing pipeline","link":"https:\/\/blog.chmarny.com\/posts\/how-i-learned-dapr-building-tweet-sentiment-processing-pipeline\/","pubDate":"Sun, 10 May 2020 00:05:16 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/how-i-learned-dapr-building-tweet-sentiment-processing-pipeline\/","description":"<p>I recently joined the Office of CTO in Azure at Microsoft and wanted to ramp up on one of the open source projects the team has built there called Dapr. Dapr <a href=\"https:\/\/dapr.io\/\">describes itself<\/a> as:<\/p>\n<blockquote>\n<p>A portable, event-driven runtime that makes it easy for developers to build resilient, microservice stateless and stateful applications that run on the cloud and edge and embraces the diversity of languages and developer frameworks.<\/p>"},{"title":"Renaissance of custom vertical solution","link":"https:\/\/blog.chmarny.com\/posts\/renaissance-of-custom-vertical-solution\/","pubDate":"Wed, 19 Feb 2020 18:49:19 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/renaissance-of-custom-vertical-solution\/","description":"<p>We are entering a period where custom, highly-optimized, vertical solutions are becoming viable option again. This is a good news for ISVs with proven domain expertise and skilled development resources.<\/p>\n<p>Why do I think so? We now have:<\/p>\n<ol>\n<li>Plethora of feature-rich developer frameworks, message queues, scalable data stores, and even lower-level components in the OSS community with great documentation and a large number of use-case validation<\/li>\n<li>Growing number of custom solution companies (more than just ISVs) with existing deep vertical\/domain expertise who are also increasingly now investing in hiring and training strong development teams<\/li>\n<li>Virtually every Cloud provider offering either a raw Kubernetes service or managed container execution platform which (regardless how you feel about these technologies) creates ubiquitous surface area that can be addressed with a single solution<\/li>\n<\/ol>\n<p>Yes, there still are many ways in which these custom development efforts can fail. Still, as one who has started their professional career developing custom software, I\u2019m glad to see how these kinds of efforts are becoming cost effective again and increasingly represent a viable option for differentiation and real business value delivery.<\/p>"},{"title":"How to debug container image content","link":"https:\/\/blog.chmarny.com\/posts\/how-to-debug-container-image-content\/","pubDate":"Tue, 27 Aug 2019 22:20:44 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/how-to-debug-container-image-content\/","description":"<p>When dealing with file permissions in a non-root image or building apps that include static content (like css or templates), I sometime get an error resulting from the final image content mismatch with my expectations.<\/p>\n<p>Most of the time the errors are pretty obvious, simple fix and rebuild will do. Sometimes though, you want to take a look into the image and understand what the actual layout looks like in there.<\/p>"},{"title":"How to run containerized workloads in GCE VM","link":"https:\/\/blog.chmarny.com\/posts\/how-to-run-containerized-workloads-in-gce-vm\/","pubDate":"Wed, 21 Aug 2019 22:10:24 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/how-to-run-containerized-workloads-in-gce-vm\/","description":"<p>While the idea of a serverless platform and long running workloads does seem somewhat &ldquo;unnatural&rdquo; at first, smart people are already working on that (looking at you <a href=\"http:\/\/twitter.com\/KnativeProject\">@Knative<\/a> community). In the meantime, a simple approach is sometimes all you may need.<\/p>"},{"title":"Using Flick buttons with Cloud Run on GCP","link":"https:\/\/blog.chmarny.com\/posts\/using-flick-buttons-with-cloud-run-on-gcp\/","pubDate":"Mon, 03 Jun 2019 12:41:23 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/using-flick-buttons-with-cloud-run-on-gcp\/","description":"<p>A co-worker recently told me about <a href=\"https:\/\/flic.io\/\">flic.io<\/a> buttons. These button caught my attention because they can include triggers for single, double, or hold click and can be easily wired up to all kinds of actions.<\/p>\n<p>I instantly thought of of a few really interesting applications. To start with though, I wanted to create a simple service that would allow me to push the custom data defined on each button over HTTP to Cloud PubSub. That in turn would then connect me to the many more actuation options through GCP APIs and services that connect to Cloud PugSub.<\/p>"},{"title":"My Sessions at Google Next 2019","link":"https:\/\/blog.chmarny.com\/posts\/my-sessions-at-google-next-2019\/","pubDate":"Sun, 07 Apr 2019 16:30:01 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/my-sessions-at-google-next-2019\/","description":"<p>Next week, April 9\u201311, Google will be hosting this year\u2019s <a href=\"https:\/\/cloud.withgoogle.com\/next\/sf\"><strong>Cloud Next Conference<\/strong><\/a> in San Francisco. The conference is already sold out, but there will be a <a href=\"https:\/\/youtu.be\/WPfyjzgBEJU%29%20youtu.be\/WPfyjzgBEJU\">livestream<\/a> from keynotes and video available shortly after the sessions.<\/p>\n<p>This year, we have a lot of content to share, and I have the privilege of presenting in <a href=\"https:\/\/cloud.withgoogle.com\/next\/sf\/speakers?speaker=2278AB79A813FD48\">four sessions<\/a>\u200a\u2014\u200aand hope to do at least six live demos.<\/p>"},{"title":"Knative - Serverless on Your Own Terms","link":"https:\/\/blog.chmarny.com\/posts\/knative-serverless-on-your-own-terms\/","pubDate":"Fri, 29 Mar 2019 02:42:02 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/knative-serverless-on-your-own-terms\/","description":"<p>I had a chance to speak at the Cloud Conf 2019 in Turin, Italy. The conference has double its audience from last year, had a spectacular venue, and large selection of topics. I spoke in the #serverless track on using Knative as a means to serverless where you want it and on your own terms. Stressing the importance of portability and demonstrating the key features that the Kantive community has already delivered.<\/p>"},{"title":"Knative momentum continues\u2026","link":"https:\/\/blog.chmarny.com\/posts\/knative-momentum-continues\/","pubDate":"Mon, 10 Dec 2018 19:02:44 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/knative-momentum-continues\/","description":"<img style=\"width:100px; height:100px;\" align=\"right\" src=\"https:\/\/blog.chmarny.com\/images\/kubecon.png\" \/>\n<p>I wrote a <a href=\"https:\/\/opensource.googleblog.com\/2018\/12\/knative-momentum-continues.html\">new post<\/a> on Google blog on the momentum behind the <a href=\"https:\/\/github.com\/knative\">Knative<\/a> project. How it the community reached another adoption milestone, doubling the number of its contributors. Also, another data point underscoring the Knative momentum is the month-over-month contributions which have increased over 45% since the 0.1 release, now representing more than a dozen of different companies.<\/p>"},{"title":"My Keynote at SpringOne","link":"https:\/\/blog.chmarny.com\/posts\/my-keynote-at-springone\/","pubDate":"Sat, 29 Sep 2018 18:59:14 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/my-keynote-at-springone\/","description":"<p>I had an opportunity to keynote at this year\u2019s <a href=\"https:\/\/springoneplatform.io\/2018\/speakers\/mark-chmarny\">SpringOne<\/a> conference in DC on Serverless, <a href=\"https:\/\/kubernetes.io\/\">Kubernetes<\/a>, and more specifically <a href=\"https:\/\/cloud.google.com\/knative\/\">Knative<\/a>.<\/p>\n<iframe width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/EKmp9xbKiso\" title=\"YouTube video player\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<p>I also covered the great work our open source team at Google been doing, making Spring 1st class citizen on <a href=\"https:\/\/cloud.google.com\/\">Google Cloud Platform<\/a>. On a personal level, it was good to reconnect with some old friends from <a href=\"https:\/\/pivotal.io\/\">Pivotal<\/a>, and, community at large.<\/p>"},{"title":"One Platform for Your Functions, Applications, and Containers","link":"https:\/\/blog.chmarny.com\/posts\/one-platform-for-your-functions-apps-and-containers\/","pubDate":"Thu, 16 Aug 2018 22:25:10 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/one-platform-for-your-functions-apps-and-containers\/","description":"<p>Ville and I did a session at Google Cloud Next 2018 in San Francisco.<\/p>\n<iframe width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/F4_2gxTtLaQ\" title=\"YouTube video player\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture\" allowfullscreen><\/iframe>\n<p>I also published the slides as well as the repo containing all the demos I used in this session in my repo <a href=\"https:\/\/github.com\/mchmarny\/next18\">here<\/a>.<\/p>"},{"title":"Build and manage modern serverless workloads using Knative on Kubernetes","link":"https:\/\/blog.chmarny.com\/posts\/build-modern-serverless-workloads-using-knative-on-kubernetes\/","pubDate":"Tue, 24 Jul 2018 16:05:51 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/build-modern-serverless-workloads-using-knative-on-kubernetes\/","description":"<p>By now, <a href=\"https:\/\/kubernetes.io\/\">Kubernetes<\/a> should be the default target for your deployments. Yes, there are still use-cases where Kubernetes is not the optimal choice, but these represent an increasingly smaller number of modern workloads.<\/p>\n<p>The main value of Kubernetes is that it greatly abstracts much of the infrastructure management pain. The broad support amongst virtually all major Cloud Service Providers (CSP) also means that your workloads are portable. Combined with the already vibrant ecosystem of Kubernetes-related tools, means that the experience of the operator, the person responsible for managing Kubernetes, is now pretty smooth.<\/p>"},{"title":"How to use Stackdriver to monitor custom application metrics","link":"https:\/\/blog.chmarny.com\/posts\/how-to-use-stackdriver-to-monitor-custom-application-metrics\/","pubDate":"Wed, 27 Dec 2017 22:08:13 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/how-to-use-stackdriver-to-monitor-custom-application-metrics\/","description":"<p>Google <a href=\"https:\/\/cloud.google.com\/stackdriver\/\">Stackdriver<\/a> has thousands of build-in metrics to monitor everything from Kubernetes cluster to database or storage. Stackdriver is also not just limited to Google Cloud Platform (GCP), it supports a number of AWS-native services and extensive log monitoring capabilities for a wide array of open source software packages, whether they run in the Cloud or in on premises.<\/p>"},{"title":"Using Google Cloud Spanner to measure social media influence over stock market","link":"https:\/\/blog.chmarny.com\/posts\/using-google-cloud-spanner-to-measure-social-media-influence-over-stock-market\/","pubDate":"Tue, 16 May 2017 15:51:12 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/using-google-cloud-spanner-to-measure-social-media-influence-over-stock-market\/","description":"<p>I wanted to use the <a href=\"https:\/\/cloudplatform.googleblog.com\/2017\/05\/Cloud-Spanner-is-now-production-ready-let-the-migrations-begin.html\">now generally available Cloud Spanner<\/a> database to write an app that would track stock prices and social media sentiment to identify potential correlation.<\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/blog.chmarny.com\/images\/1__xGWhGM____d__LluxeXMRBpmg.png\"><\/p>\n<p>To test even the validity of this approach I put together a Go app that subscribes to Twitter stream for all companies defined in the <code>Stocks<\/code> table and scores each event against the <a href=\"https:\/\/cloud.google.com\/natural-language\/\">Google NLP API<\/a> while comparing the user sentiment against the stock ask price against Yahoo API.<\/p>"},{"title":"Twitter Sentiment Analysis in Go using Google NLP API","link":"https:\/\/blog.chmarny.com\/posts\/twitter-sentiment-analysis-in-go-using-google-nlp\/","pubDate":"Fri, 12 May 2017 17:26:11 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/twitter-sentiment-analysis-in-go-using-google-nlp\/","description":"<p>As part of my ramp up on Google APIs I wanted to create a <a href=\"https:\/\/github.com\/mchmarny\/tfeel\">project<\/a> that would allow me some practical exercise in a context of a real application.<\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/blog.chmarny.com\/images\/1__MV8vPEMdz5obDiBmZDECIg.png\"><\/p>\n<p>TFeel (short for Twitter Feeling) is a simple sentiment analyses over tweeter data for specific Twitter search terms using Google Cloud services:<\/p>"},{"title":"Few quick notes from Google Next 2017","link":"https:\/\/blog.chmarny.com\/posts\/notes-from-google-next-2017\/","pubDate":"Fri, 17 Mar 2017 15:45:33 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/notes-from-google-next-2017\/","description":"<p>I had the opportunity to attend Google Next this year. Week after this event I joined Google. Here are some quick notes in no particular order:<\/p>\n<ul>\n<li>Registration was a pain, long lines. My first tech conference where I had to go through a metal detector.<\/li>\n<li>Impressive reminder of the core tech underlining Google Cloud (i.e. <a href=\"https:\/\/static.googleusercontent.com\/media\/research.google.com\/en\/\/pubs\/archive\/43438.pdf\">Borg<\/a>) and Google\u2019s experience in operating at scale.<\/li>\n<li>Serious commitment to ML and Data Science: invest in talent\/community (<a href=\"https:\/\/www.kaggle.com\/\">Kaggle<\/a>), vision\/leadership (<a href=\"https:\/\/www.youtube.com\/watch?v=Rgqgdddl018\">Fei-Fei Li keynote<\/a>), powerful <a href=\"https:\/\/cloud.google.com\/products\/machine-learning\/\">APIs<\/a> (i.e. Label\/Face Detection, OCR, Explicit Content etc.)<\/li>\n<li>Feels like the ease of use for Google is more important than time time market (see the above DS APIs but also Spanner UX).<\/li>\n<li>Clear understanding of data economy\u2019s potential value (goes with the scale comment but the experience was apparent in many sessions\/keynotes)<\/li>\n<li>Open\/partner market makes stronger platform (<a href=\"https:\/\/www.youtube.com\/watch?v=h9FSqVbdHis&amp;index=7&amp;list=PLIivdWyY5sqI8RuUibiH8sMb1ExIw0lAR\">Sam Ramji\u2019s keynote<\/a> drilled on this best), early hints of this were probably the main reason why I wanted to join Google Cloud team.<\/li>\n<li>Size\/quality of the network (both, cables &amp; tech), globally distributed data systems (specifically latency) are perhaps the best example of the user value here.<\/li>\n<\/ul>"},{"title":"Service, not Volume - data explosion and how to amplify its value","link":"https:\/\/blog.chmarny.com\/posts\/service-not-volume-data-explosion-and-how-to-amplify-its-value\/","pubDate":"Thu, 21 Jul 2016 00:46:29 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/service-not-volume-data-explosion-and-how-to-amplify-its-value\/","description":"<p>Data is growing at an <a href=\"https:\/\/web-assets.domo.com\/blog\/wp-content\/uploads\/2015\/08\/15_domo_data-never-sleeps-3_final1.png\">exponential pace<\/a>. Based on recent numbers from <a href=\"http:\/\/www.computerweekly.com\/news\/2240217788\/Data-set-to-grow-10-fold-by-2020-as-internet-of-things-takes-off\">IDC<\/a>, the total amount of data in 2015 (4.4ZB) will grow to 44ZB in 2020. Franky, how much is in <a href=\"https:\/\/en.wikipedia.org\/wiki\/Zettabyte&amp;t=YmJkMzIzNDU5ZWI0ZGQzNWQ3ZTRkNGZlZmJkY2RiZmE4OTk2ZGM2YixtZ05JVTNVbA%3D%3D\">Zettabyte<\/a> is almost inconsequential. It is the fact that all of the data generated since the beginning of time (at least the electronic part), will grow 10x in just the next four years that\u2019s shocking!<\/p>"},{"title":"Data Exchange \u2014 How to Amplify Value of Machine Data","link":"https:\/\/blog.chmarny.com\/posts\/data-exchange-how-to-amplify-value-of-machine-data\/","pubDate":"Tue, 17 May 2016 13:33:17 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/data-exchange-how-to-amplify-value-of-machine-data\/","description":"<blockquote>\n<p>The presentation that goes along with this post is available <a href=\"http:\/\/www.slideshare.net\/MarkChmarny\/machine-data-how-to-realize-and-amplify-its-value\">here<\/a><\/p>\n<\/blockquote>\n<p>In <a href=\"http:\/\/mark.chmarny.com\/post\/139001618764\/service-not-volume-data-explosion-and-how-to\">my last post<\/a> I went over the value <a href=\"http:\/\/mark.chmarny.com\/post\/139001618764\/service-not-volume-data-explosion-and-how-to\">cycle of machine generated data<\/a>. In this post, I want to follow up with a few ideas on how to further amplify value of that data by expanding its context beyond the walls of owning organization, in a construct we came to know as Data Exchange, and list a few innovation opportunities in each one of these areas.<\/p>"},{"title":"How Lufthansa has made me question the value of Star Alliance","link":"https:\/\/blog.chmarny.com\/posts\/how-lufthansa-has-made-me-question-the-value-of-star-alliance\/","pubDate":"Fri, 29 Apr 2016 03:50:02 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/how-lufthansa-has-made-me-question-the-value-of-star-alliance\/","description":"<p>This is one of those posts you write on your phone while getting sprayed for 11+ hours with bathroom chemicals in minimally reclining seat in a second to last row of a transatlantic flight. Still, I\u2019m going to try to be as constructive as my thumbs allow.<\/p>"},{"title":"Vision of smarter thingz - project in adaptive metric flow modeling","link":"https:\/\/blog.chmarny.com\/posts\/vision-of-smarter-thingz-project-in-adaptive-metric-flow-modeling\/","pubDate":"Wed, 27 Apr 2016 00:43:24 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/vision-of-smarter-thingz-project-in-adaptive-metric-flow-modeling\/","description":"<p>Over the holidays, as many of us do, I embarked on a little extra-curriculum development effort I called <a href=\"http:\/\/thingz.io\">thingz.io<\/a>. I was driven by the pattern I\u2019d observed in Data Center (DC) monitoring products; although that pattern also exists in many of today\u2019s Internet of Things (IoT) solutions.<\/p>"},{"title":"My experience with Google Compute Engine","link":"https:\/\/blog.chmarny.com\/posts\/my-experience-with-google-compute-engine\/","pubDate":"Sun, 03 Apr 2016 00:36:38 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/my-experience-with-google-compute-engine\/","description":"<p>As part of my recent solution review, I wanted to compare a few performance metrics specific to multi-node data service deployment on different clouds. This post is about my experience with Google Compute Engine (GCE) as part of that evaluation.<\/p>"},{"title":"Thinking Big about Data at Intel","link":"https:\/\/blog.chmarny.com\/posts\/thinking-big-about-data-at-intel\/","pubDate":"Sun, 03 Apr 2016 00:34:47 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/thinking-big-about-data-at-intel\/","description":"<p>I am excited to share with you today that starting Monday I will be joining the Big Data team at <a href=\"http:\/\/www.intel.com\/&amp;t=YjBkOTU4OTE0ZjlmMGI5YmQ4MTNlMWE0NzUwMGE3MmQwODdmNzRjNCxJVHRWNTZwQw%3D%3D\">Intel<\/a>. Yes, Intel. While not traditionally known for its software offerings, Intel has recently entered the Big Data space by introducing their own, <a href=\"http:\/\/hadoop.intel.com\/&amp;t=OGIwNmNhMjhlMDk1Y2IzODIyMmEyYWZkYjRmMmI4YTFhZjUwN2UyMyxJVHRWNTZwQw%3D%3D\">100% open source Hadoop distribution<\/a> with unique security and monitoring features.<\/p>"},{"title":"HDFS has won, now de facto standard for centralized data storage","link":"https:\/\/blog.chmarny.com\/posts\/hdfs-has-won-de-facto-standard-for-centralized-data-storage\/","pubDate":"Sun, 03 Apr 2016 00:28:41 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/hdfs-has-won-de-facto-standard-for-centralized-data-storage\/","description":"<p>The &ldquo;high-priests&rdquo; of Big Data have spoken. Hadoop Distributed File System (<a href=\"http:\/\/hadoop.apache.org\/docs\/hdfs\/current\/hdfs_design.html&amp;t=ZjcxYWQyNjE5NTI5MjVjMGIyZDlhYTgwZDQ1ZmJkOWNiNjEwMjJiMixOSG5XdzVSRA%3D%3D\">HDFS<\/a>) is now the de facto standard platform for data storage. You may have heard this &ldquo;heresy&rdquo; uttered before. But, for me, it wasn\u2019t until the recent <a href=\"http:\/\/mark.chmarny.com\/2012\/10\/stratahadoop-world-2012-etl-sql-other.html\">Strata conference<\/a> that I began to really understand how prevalent this opinion actually is.<\/p>"},{"title":"Don't use yesterday's database to develop tomorrow's solutions","link":"https:\/\/blog.chmarny.com\/posts\/dont-use-yesterday-database-to-develop-tomorrow-solutions\/","pubDate":"Sun, 03 Apr 2016 00:26:37 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/dont-use-yesterday-database-to-develop-tomorrow-solutions\/","description":"<p>We are in a midst of drastic shift in application development landscape. Developers entering the market today use different tools and follow different patterns.<\/p>\n<p>One of the core patterns of on-line application development today is cloud scale design. While traditionally architectures would rely on more powerful servers, today, that approach simply does not scale. We have reached that point where, in many cases, there are no powerful enough servers, or their cost would be prohibitive. Considering the unpredictable usage patterns today\u2019s on-line applications also must be flexible to address demand spikes and assure efficient service during low utilization.<\/p>"},{"title":"Data-related investments shift from tech to skills \u2014 talent new differentiator","link":"https:\/\/blog.chmarny.com\/posts\/data-related-investments-shift-from-tech-to-skills-talent-new-differentiator\/","pubDate":"Sun, 03 Apr 2016 00:24:48 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/data-related-investments-shift-from-tech-to-skills-talent-new-differentiator\/","description":"<p>Over the last decade, the access to best-of-bread data technologies has become easier. This is due mainly to the increasing popularity of open source software (OSS). While this phenomenon holds true in other areas like operating systems, application servers, development frameworks or even monitoring tools, it is perhaps most prevalent in the area of data.<\/p>"},{"title":"Intel doubles down on open, easier to use, and performance-optimized Hadoop","link":"https:\/\/blog.chmarny.com\/posts\/intel-doubles-down-on-its-vision-of-open-performance-optimized-hadoop\/","pubDate":"Sat, 12 Mar 2016 00:38:02 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/intel-doubles-down-on-its-vision-of-open-performance-optimized-hadoop\/","description":"<p>Over eight months ago, <a href=\"https:\/\/blog.chmarny.com\/posts\/thinking-big-about-data-at-intel.md\">I joined Intel to work on their next-generation data analytics platform<\/a>. In large, my decision was based on Intel\u2019s desire to address the &ldquo;voodoo magic&rdquo; in Big Data: the complexities that require deep technical skills which are preventing domain experts from gaining access to large volumes of data. The idea was that by leveraging the distributed data processing capabilities of <a href=\"http:\/\/hadoop.apache.org\/&amp;t=ODQwMzljZTFhMjE4MzZlNjUxNWQ5ZjFhYjE2Y2MwOGE1OGE4YzFmNSxaVU4zS00wOQ%3D%3D\">Apache Hadoop<\/a>, and combining them with Intel\u2019s breadth of infrastructure experience, we could make Big Data analytics more accessible and therefore more prevalent.<\/p>"},{"title":"Smaller, single-purpose, atomic functions core ingredient of tomorrow\u2019s computing","link":"https:\/\/blog.chmarny.com\/posts\/smaller-single-purpose-atomic-functions-core-ingredient-of-tomorrow-computing\/","pubDate":"Mon, 22 Feb 2016 00:40:14 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/smaller-single-purpose-atomic-functions-core-ingredient-of-tomorrow-computing\/","description":"<p>Last week I had a chance to attend the 3rd AWS re:invent conference in Vegas. I\u2019m not a big fan of that city myself, but, as in previous years, re:invent has not disappointed. Much coverage has been dedicated to the newly introduced services; I won\u2019t bore you with that. Instead, I wanted to share with you a few higher-level thoughts I captured at the event.<\/p>"},{"title":"Time series data management using InfluxDB","link":"https:\/\/blog.chmarny.com\/posts\/time-series-data-management-using-influxdb\/","pubDate":"Fri, 12 Feb 2016 00:41:49 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/time-series-data-management-using-influxdb\/","description":"<p>After a pretty positive experience with <a href=\"http:\/\/influxdb.com&amp;t=MDNmNjA2NmIwNTkxYjUzNDg0YzY2NTUwNmJmMjAzNjkzOGY0ZjFjNCxjclJsVjdENA%3D%3D\">influxdb<\/a> I wanted to create a super simple telemetry producer (this one in Node.js) to spotlight a few types of time series data query supported in influxdb. (Source code available on <a href=\"https:\/\/github.com\/mchmarny\/timeseries-samples&amp;t=Nzk1NjkzYWI3ZDU1OGUzYTg3YmY4MjBkMzE5ZDlmNjk2ODc2NmMzYixjclJsVjdENA%3D%3D\">GitHub<\/a>)<\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/blog.chmarny.com\/images\/0__bqylsNDJDNtWuTyx.png\"><\/p>\n<p>To get live data for this demo, I created a simple script that generates metric data for CPU Utilization and Free Memory on your local machine at 1 sec resolution.<\/p>"},{"title":"Gluttony of great open ML tools too hard for enterprise to use","link":"https:\/\/blog.chmarny.com\/posts\/gluttony-of-open-machine-intelligence-software-enterprise-finds-hard-to-use\/","pubDate":"Mon, 21 Sep 2015 11:40:45 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/gluttony-of-open-machine-intelligence-software-enterprise-finds-hard-to-use\/","description":"<p>Seems like every week we hear about yet another new open source Machine\/Deep Learning library or Analytical Framework.<\/p>\n<p>Talking to people at <a href=\"http:\/\/conferences.oreilly.com\/strata\/hadoop-big-data-eu\">Strata this week<\/a> only confirmed for me that in the midst of what can only be described as virtual gluttony of open-source software, there is massive number of organizations who find it increasingly harder to implement these technologies. Even the task of identifying the right solution can overwhelm many, and result in a tailspin of endless use-case\/feature comparison.<\/p>"},{"title":"Federated not Balkanized - The Future of Data and Its Short-term Cloud Challenges","link":"https:\/\/blog.chmarny.com\/posts\/federated-not-balkanized-future-of-data-and-cloud-challenges\/","pubDate":"Tue, 21 Jul 2015 00:06:55 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/federated-not-balkanized-future-of-data-and-cloud-challenges\/","description":"<p>As a long-term Cloud storage user I recently wanted to re-evaluate my options. New content management providers became available and I wanted to make sure I wasn\u2019t missing on the new shinny tech out there.<\/p>\n<p>As I was considering the pros and cons of each option, I realized the apparent shift in my personal attitude towards cloud data storage over last few years. My concerns used to be solely with security. Now, while the data security is still critical, I am much more interested in data access, ownership, integration and its control.<\/p>"},{"title":"Data Opportunities, 3 Areas to Focus Innovation","link":"https:\/\/blog.chmarny.com\/posts\/data-opportunities-3-areas-to-focus-innovation\/","pubDate":"Sat, 21 Feb 2015 00:33:24 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/data-opportunities-3-areas-to-focus-innovation\/","description":"<p>About a year and a half ago, I wrote about <a href=\"https:\/\/blog.chmarny.com\/posts\/3-killer-big-data-app-opportunities.md\">Big Data Opportunities<\/a>, focusing primarily on Leveraging Unused Data, Driving New Value From Summary Data and Harnessing Heterogeneous Data Sensors (more recently known as <a href=\"https:\/\/en.wikipedia.org\/wiki\/Internet_of_things\">Internet of Things<\/a>).<\/p>\n<p><img loading=\"lazy\" src=\"https:\/\/blog.chmarny.com\/images\/0__FnPtGrT0LSmX6DBG.jpg\"><\/p>\n<p>Since that post, data space has exploded with numerous solutions addressing many of these areas. These solutions while mostly based on batch operations and limited to serial MapReduce jobs against frequently off-line, inadequately secured, Hadoop cluster, they do allow access to previously inaccessible data.<\/p>"},{"title":"PaaS not just about runtime, data services are the next differentiator","link":"https:\/\/blog.chmarny.com\/posts\/paas-not-just-about-runtime-data-services-are-the-next-differentiator\/","pubDate":"Mon, 05 Jan 2015 00:30:56 +0000","guid":"https:\/\/blog.chmarny.com\/posts\/paas-not-just-about-runtime-data-services-are-the-next-differentiator\/","description":"<p>In general, Platform as a Service (<a href=\"http:\/\/en.wikipedia.org\/wiki\/Platform_as_a_service&amp;t=YzdiYWU1Yjc0MTdkMzZiMzM3N2NjN2I0MTNmMDk0ZDhlYTBiNzk1YixZY0ltODJRaQ%3D%3D\">PaaS<\/a>) is developed by developers for developers. Of course <a href=\"http:\/\/www.informationweek.com\/cloud-computing\/platform\/vmwares-cloud-foundry-ranked-top-develop\/232200211&amp;t=ZTE3MjQyYzA0ODc4ZTQ2M2ExZjRmZGYwODJiNWJlN2M3OGY1ZWE1YyxZY0ltODJRaQ%3D%3D\">they\u2019re going to love it<\/a>.<\/p>\n<blockquote>\n<p>It enables them to focus on the nuances of their applications \u2014 not on the day-to-day pointless activities that so often take their time away from solving real problems.<\/p>"},{"title":{},"link":"https:\/\/blog.chmarny.com\/imprint\/","pubDate":"Mon, 01 Jan 0001 00:00:00 +0000","guid":"https:\/\/blog.chmarny.com\/imprint\/","description":"<h1 id=\"legal-disclosure\">Legal Disclosure<\/h1>\n<p>Information in accordance with the applicable law<\/p>\n<p>Mark Chmarny<\/p>"},{"title":"Archives","link":"https:\/\/blog.chmarny.com\/archives\/","pubDate":"Mon, 01 Jan 0001 00:00:00 +0000","guid":"https:\/\/blog.chmarny.com\/archives\/","description":"archives"},{"title":"Search","link":"https:\/\/blog.chmarny.com\/search\/","pubDate":"Mon, 01 Jan 0001 00:00:00 +0000","guid":"https:\/\/blog.chmarny.com\/search\/","description":{}}]}}