Kubernetes Minikube #5 – Jenkins for CI/CD
DevOps / Kubernetes / MLOps

Kubernetes Minikube #5 – Jenkins for CI/CD

We are on a journey here to operationalise machine learning using Kubernetes.  Call it MLOps, DataOps, DevOps as you will.  Next stop is to lay the foundation for implementing CI/CD pipelines to move our assets safely through development, canary testing and production environments.  Let’s show that here by laying out a build/tag/promote cycle with Kubernetes, … Continue reading

Kubernetes Minikube #4 – R/RStudio Server with Tensorflow on (external) GPU
Data Science / GPU / Kubernetes / Machine Learning / MLOps / R / tensorflow

Kubernetes Minikube #4 – R/RStudio Server with Tensorflow on (external) GPU

As a Data Scientist, I want to work on an RStudio Server image managed by Kubernetes with GPU capability. The motivation for doing this is that I can then access a machine learning rig that is 1) scale invariant (same from desktop to Cloud), 2) leverages Kubernetes for scheduling and 3) taps me into the … Continue reading

Kubernetes Minikube #3 – Jupyter, Tensorflow with (external) GPU
Data Science / GPU / Kubernetes / Machine Learning / MLOps / tensorflow

Kubernetes Minikube #3 – Jupyter, Tensorflow with (external) GPU

Kubernetes scheduling a pod to a node with GPU resources to run a Jupyter notebook container demonstrating a python/tensorflow-gpu based application. All from a local Intel NUC machine using an eGPU. Yeah, we can do that. In this blog we take the NUC with eGPU – a Big Little ML Rig which we built earlier to the … Continue reading

SparkR with OpenShift
Data Science / DevOps / OpenShift / R

SparkR with OpenShift

Let’s set up a data science workbench on OpenShift (docker/kubernetes). The components will be an RStudio Server executing SparkR instructions to a remote Apache Spark instance, all hosted within a local OpenShift cluster instance. Examples include processing AWS S3 Bucket hosted data from Spark. So saddle up and ride ole’ Roxy all the way! This lab is another in … Continue reading