I'm a Lead Engineer at Salesforce specializing in AI/ML infrastructure, Kubernetes-based model serving, and high-reliability distributed systems.
I spend most of my time:
- 🚀 Building large-scale AI platforms that power millions of predictions
- ⚡ Designing high-performance model execution runtimes
- 🛰️ Improving service mesh, observability, caching & traffic reliability
- 📚 Writing educational content that helps engineers solve complex infra problems
- 🤝 Supporting the developer community through clear examples, diagrams, and tutorials
I believe complex infrastructure concepts should be simple, accessible, and enjoyable for every developer.
My work focuses on:
- Teaching Kubernetes, Istio, Redis, and AI inference in a hands-on, practical way
- Breaking down advanced systems into clear, visual explanations
- Sharing reusable patterns for scaling distributed systems reliably
- Helping teams adopt MLOps, LLM runtimes, and agentic AI
- Building knowledge that benefits entire engineering communities, not just one team
- 🔧 18+ years building production systems across Salesforce, Home Depot, Bank of America, Morgan Stanley
- 📦 Architected multi-tenant cache systems, high-scale model serving, and execution graphs
- 📘 Published technical articles for DZone
- 🧭 Known for creating practical tutorials on Istio, Kubernetes traffic, Ollama, Redis, and AI infra
- 🛠️ Contributor & supporter of the Kubernetes ecosystem and related infra tooling
- 🧠 Active member of IEEE & ACM, passionate about developer education
- Agentic AI systems & distributed runtimes
- Green DevOps (energy-aware autoscaling, Kepler, Scaphandre)
- Local LLMs & hybrid inference strategies
- AI traffic management with Istio + Envoy
- Developer-first education for Kubernetes & AI infra
I regularly publish deep-dive articles on:
- Kubernetes traffic engineering
- AI/ML model serving
- Local LLMs & inference optimization
- Service mesh reliability (Istio/Envoy)
- Distributed caching strategies
- AI infrastructure sustainability
If you’re building production systems, I write for you.
- Twitter/X: https://twitter.com/nitinware
- LinkedIn: https://www.linkedin.com/in/nitinware/
- GitHub: https://github.com/nitinware