Published inInfraCloud TechnologiesRunning Phi 3 with vLLM and Ray ServeHow to deploy the Phi-3 model using vLLM with Ray Serve on Kubernetes and understand the key differences between inference and serving.Nov 8Nov 8
Published inInfraCloud TechnologiesPrimer on Distributed Parallel Processing with Ray using KubeRayWhat is Distributed Parallel Processing? How to achieve it with Ray using KubeRay in Kubernetes to handle large-scale, resource-intensive…Nov 8Nov 8
Published inInfraCloud Technologies10 Feature Flag Tools to Confidently Release New FeaturesFeature flags offer an excellent way to quickly turn off and on product changes by enabling you to remove and add the code in the software…Jul 12Jul 12
Published inInfraCloud TechnologiesGitOps using Flux and FlaggerGitOps as a practice has been in use since 2017 when Alexis Richardson coined the term. It transformed DevOps and automation. If you look…Oct 17, 2022Oct 17, 2022
Get Your hands Dirty in these Before approaching Machine Learning fieldAs I always have a keen interest in computers, it made me think of other possibilities we could have. Not just if-else code far more…May 25, 2020May 25, 2020