Use cases
Self-hosting is designed for organizations with specific requirements:- Data residency and compliance: Meet regulatory or contractual obligations by keeping all data within your own cloud account and region.
- Security posture and isolation: Deploy the platform behind your firewall or VPN, using your own IAM policies, encryption keys, and audit trails. This ensures sensitive data never traverses external networks.
- Access to private resources: Connect to internal LLM models, proprietary tools, or private APIs that are not accessible from the public internet. The platform runs within your network and can access resources in your VPC or private network.
How it works
Nebuly deploys as a single unified platform within your infrastructure. You own and operate the entire stack. The deployment process has two steps:- Provision infrastructure using the Nebuly Terraform module for your cloud provider. This creates all required cloud resources (for details, look at the Terraform module for your cloud provider) and outputs a set of Helm values.
- Install the platform using the Nebuly Helm chart, passing the values produced by Terraform.
Deployment options
Nebuly provides official Terraform modules for self-hosting on major cloud providers:- AWS: Terraform with EKS and Helm
- GCP: Terraform with GKE and Helm
- Azure: Terraform with AKS and Helm
Shared responsibility
When you self-host, uptime is a shared responsibility between your team and Nebuly:- Nebuly is responsible for responding quickly when you have issues, collaboratively resolving them with you, and releasing fixes to improve quality.
- Your team is responsible for following the documentation, assigning infrastructure resources, and ensuring that in the event of an incident, you have staff familiar with the platform who can work with the Nebuly team to share context and resolve issues.
Monitoring
By default, the platform collects anonymous telemetry to help Nebuly monitor platform health and improve the product. This includes:- Health check information
- Aggregate usage metrics