DeepSparse Inference Runtime
Neural Magic
Price: Typical Total Price$0.277/hrTotal pricing per instance for services hosted on m7a.xlarge in US East (N. Virginia). View Details
Free TrialProduct Overview
Neural Magic's DeepSparse AMI is an inference runtime that allows you to create an EC2 instance capable of running state-of-the-art machine learning models with GPU-class performance on x86 instance types. This allows you to run your machine learning workloads without concern for specific hardware accelerators. Simply select from a broad range of instance types based on the performance and cost requirements of your use case and deploy.The deployed DeepSparse instance also comes with built-in benchmarking capabilities to help you assess the performance and cost benefits of your deployed model in a variety of scenarios.This AMI contains the DeepSparse Enterprise Cloud Distribution which allows for commercial deployments.
Version: 1.6.1
By: Neural Magic
Categories: ML Solutions
Application Development
Operating System
Linux/Unix, Ubuntu 22.04
Delivery Methods
Amazon Machine Image
Related ProductsTagbotMysql 5.7 on CentOS7.9 with support by FleximgCentOS Stream 8 + AWS CLI 2 with support by AskforCloud LLCWordpress on Ubuntu 16.04
Highlights: Run ML models on a broad range of x86 instances without the need for hardware acceleration High performance and low-cost ML inferencing of popular SOTA models Simple APIs for easy integration into existing applications
Category: DevOps
Delivery Method: Amazon Machine Image
Company Information
Company Name: Neural Magic
About Company: Neural Magic enables customers to accelerate machine learning model performance on commodity CPUs, while reducing operational costs and complexity typically associated with deploying AI, in production and at scale.