karpenter How H2O.ai optimized and secured their AI/ML infrastructure with Karpenter and Bottlerocket

[Amazon Web Services]

H2O.ai is a visionary leader in democratizing artificial intelligence (AI) by rapidly provisioning AI platforms that help businesses make better decisions. Our company’s SaaS platform, built on AWS, H2O AI Managed Cloud, enables businesses to build productive models and gain insights from their data quickly and easily.

H2O.ai’s platform uses data and technology to improve:

• Speed: Our platform helps businesses to quickly develop and deploy AI/ML models, which leads to faster time to market and improved decision-making.
• Accuracy: Our platform uses a variety of techniques to improve the accuracy of AI/ML models, including automatic feature engineering and model selection.
• Scalability: Our platform can be scaled to handle large datasets and complex problems.
• Explainability: Our platform provides insights into how AI/ML models make decisions, which can help businesses to trust and adopt these models.

This post demonstrates how we used Karpenter, an AWS open-sourced just-in-time Kubernetes autoscaler, and Bottlerocket, a secure, lightweight, purpose-built Linux-based operating system to run containers in the Amazon Elastic Kubernetes Service (Amazon EKS) clusters. This combined functionality, along with prefetching container images, helped us improve the compute provisioning and configuration time for our ML workloads by 100-fold...

View the full article