About Mark Chmarny
Builder, architect, and strategist dedicated to simplifying how developers interact with complex systems. Currently serving as a Principal Cloud Architect in NVIDIA’s DGX Cloud organization, Mark focuses on bridging the gap between cutting-edge AI hardware and the cloud-native ecosystem. His mission is to enable optimized, validated, and reproducible GPU-accelerated infrastructure in Kubernetes for everyone.
Mark’s work spans the entire lifecycle of large-scale AI/ML platforms, including GPU runtime, networking, storage, and performance validation across heterogeneous, multi-cloud environments used for training and inference. Throughout a distinguished career at Google Cloud, Apple, and Microsoft Azure OCTO, Mark has championed “developer-first” platforms, leading engineering efforts in Kubernetes control-planes, software supply chain security, and distributed workload management.
Core Expertise:
- AI/ML Infrastructure: Architecting large-scale Kubernetes-based platforms for GPU clusters, including Blackwell-class compute infrastructure. Led GB200 enablement efforts on Kubernetes across AWS, GCP, and OCI, working closely with each CSP to ensure an optimized experience for their users.
- Cloud-Native Strategy: Steering the technical direction for serverless computing, multi-cloud deployment frameworks, CI/CD, and secure software supply chains.
- Platform Engineering: Transforming internal technical expertise into public-facing, machine-consumable runtime data and validated recipes to reduce duplication and improve consistency across the ecosystem.
- Open Source Leadership: Deeply committed to the open-source community through leadership in projects like Knative, Tekton, and Dapr, as well as broader industry initiatives like NVSentinel to improve GPU fleet health and remediation.
You can find me on Bluesky (@chmarny.com), Mastodon (@mchmarny@fosstodon.org), and my open source contributions on GitHub (@mchmarny)
Note: All posts in this blog represent Mark’s personal opinions.