Deci Inference Performance Simulator

How well will your deep learning models perform in production?

Choose an off-the-shelf model, or upload your own and receive a cross-hardware performance analysis to your inbox, for free!

Throughput
Latency
Memory
Cloud Cost

Complete this simple wizard to get a full report of your deep learning model’s inference performance, completely free and secure.

Your framework isn’t supported? Let us know!
Interested in another hardware? Let us know!
?

The methods to grant us secure access to benchmark your model:

We respect your privacy and confidentiality:
Model weights can be random.
We never keep a copy of the model after analysis

The inference performance of your deep learning model will determine the viability of your solution in a production environment. An inefficient and uneconomical model could determine the entire fate of your product. That said, estimating the performance impact is far from simple. The hardware's compute power in your production environment, as well as the influence of inefficient code, can obscure this critical estimation process.

Get Your Free Model Analysis

  • Measure latency & throughput

  • Compare across multiple HW & throughput

  • Check model size compatibility

  • Calculate computing costs

Frequently Asked Questions

What analysis will I get in my report?

We currently analyze model latency, throughput, cost per 100K samples on the cloud, and memory usage — all compared across multiple batch sizes and hardware types.

How are the measurements made?

During our analysis, the DIPS engine runs a forward pass of the model and automatically checks its performance on several environments. It then provides you with a comprehensive analysis of the model’s performance along with actionable insights and recommendations. In the report, we specify the exact conditions of all measurements to ensure standardization and provide reproducible results.

What frameworks are supported?

We currently support:

  • Pytorch 1.4 – The checkpoint file should be a serialized nn.Module .pth file
  • TensorFlow 1.15 – frozen graph only – The checkpoint file should be a .pb file of a frozen graph
  • TensorFlow 2 – frozen graph only – The checkpoint file should be a .pb file of a frozen graph.
  • ONNX 1.6 – The checkpoint file should be a .onnx file (version 1.6). It should support inferencing with various batch sizes

Your framework isn’t listed? Let us know.

What hardware and cloud providers are supported?

We currently support the following AWS instances:

  • K80 – p2.xlarge
  • V100 – p3.2xlarge
  • T4 – g4dn.2xlarge
  • CPU – c5.4xlarge

Interested in a different cloud provider or other hardware? Let us know

How long will it take?

Completing this wizard will take less than 2 minutes and you’ll get the report by mail within 24 hours.

Is it totally free?

Yes. This service and all costs associated with model inferencing are absorbed by Deci.

 

What do I need to send you in order to get the analysis?

Just send the model file (no weights needed!). You can send us an open link, upload the model or choose to be contacted by one of our specialists.

Is it secure? What about data privacy?

Absolutely! All the data and model weights are yours; we do not need them. As for the model file, we use it for the analysis and then immediately delete it from our server. We never save a copy of your model. You can read more in our terms & conditions.

Deci Inference Performance Simulator (DIPS) – Terms of Use

Last updated: March, 15, 2020

DECI.AI LTD. (“DECI”, “We“, “Us” or “Our“) WELCOMES YOU (“CUSTOMER”) TO OUR SERVICE.  THE FOLLOWING TERMS (THE “AGREEMENT”) STIPULATE THE TERMS AND CONDITIONS OF YOUR USE OF THE SERVICE. THE SERVICE IS PROVIDED SOLELY FOR USE IN YOUR OWN BUSINESS. BY ACCESSING OR USING OUR SERVICE, YOU AGREE TO THESE TERMS. IF YOU ARE ENTERING INTO THESE TERMS ON BEHALF OF A COMPANY OR ANOTHER LEGAL ENTITY, YOU AFFIRM THAT YOU HAVE THE AUTHORITY TO BIND SUCH ENTITY AND ITS AFFILIATES TO THESE TERMS, IN WHICH CASE THE TERM “YOU” OR “CUSTOMER” WILL REFER TO SUCH ENTITY AND ITS AFFILIATES. IF THE LEGAL ENTITY THAT YOU REPRESENT DOES NOT AGREE WITH THESE TERMS, YOU MUST NOT ACCEPT THESE TERMS OR USE THE SERVICE.

  1. Definitions
    1. Model” refers to any files, data, material, and information submitted, uploaded, and stored by you through the Service.
    2. Results” refers to any content and data provided by DECI to Customer in connection with a Model.
    3. Service” refers to DECI’s proprietary technology model assessment solution as hosted on a third party cloud service and made available through DECI’S website, including any accompanying applications, documentation, and software made available through the Service.
    4. Third Party Products” refers to any service, product, software, or application that is provided with a third party and interoperates with a Service. Such Third Party Products may be offered on a dedicated website.
    5. You” or “Customer” refers to the company or other legal entity and its affiliates for which you are accepting these Terms.
  2. Your Model
    1. All rights in and to the Model are reserved by you and your licensors. We claim no rights, title, or interest to the Model or any of the intellectual property rights therein. The Terms do not grant us an interest in or to your intellectual property rights. Nothing in the Terms constitutes a waiver of your Intellectual Property Rights under any law.
    2. You grant us a worldwide, non-exclusive license to host, copy, and use your Model solely to the extent required by us to provide you with the Services, until Results have been provided. DECI will delete the Model after Results have been provided, and in any event no longer than a period of 72 hours from upload of the Model to the Service. Subject to this limited license, we do not acquire any right to your Model. You or your licensors retain all rights and ownership to your Model.
    3. The Services are not intended to be used as storage, backup, or archiving services. It is your responsibility to back up your Model and you are responsible if your Model is lost or unrecoverable.
    4. You warrant that you have full rights to provide to us any Model that you share through the Services.
  3. The Services
    1. Following the acceptance of these terms, you will have the ability to access the Service and use the Services solely for the purpose of your business activity. We may update the Services from time to time, including adding or removing functions.
    2. We may use third parties in the operation of our Services or to perform any of our obligations (each a “Service Provider“), including using Service Providers for cloud infrastructure and hosting services. In order for our Service Providers to provide you with certain aspects of the Services, we may store the Model with such Service Provider for the duration of the Services. Our agreements with Service Providers outline the appropriate use and handling of this information and prohibit the Service Provider from using any of your information for purposes unrelated to the Services. We and our Service Providers do not retain your Model after completing the Service and providing you with the Results.
  4. OTHER PRODUCTS AND SERVICES
    1. We or a third party may make available Third Party Products. DECI will not be responsible for any act or omission of the third party that provides the Third Party Products, including the third party’s access to or use of the Model. We do not warrant or support any Third Party Products.
  5. Use Obligations and Restrictions
    1. Customer agrees to comply with all applicable laws, rules, and regulations, including those regarding data privacy, intellectual property rights, and export control.
    2. You are not permitted to misuse the Services. For example, you may not, whether by yourself or through anyone acting on your behalf (a) sell, resell, or lease the Services, or access or attempt to access the Services by any means other than the interface we provided or authorized; (b) circumvent any access or use restrictions put into place to prevent certain uses of the Services; (c) use the Services to store, share, or transmit content that is unlawful, infringing, or harmful, or that violates any person’s rights, including privacy rights and intellectual property rights; (d) attempt to disable, impair, or destroy the Services; or (e)  reverse engineer or decompile the Services, attempt to do so, or assist anyone in doing so.
  6. Data Protection and Privacy
    1. DECI shall process personal data as necessary to perform the Services, in accordance with the terms of the Privacy Policy available at https://deci.ai/privacy-policy/.
  7. Intellectual Property Rights
    • All rights not expressly granted to you under these Terms are reserved by DECI and its licensors. We and our licensors reserve all rights, title, and interest to the Services and any of their related intellectual property rights. The Terms do not impart to you an interest in or to DECI’s intellectual property rights. Nothing in the Terms constitutes a waiver of DECI’s Intellectual Property Rights under any law.
    • To the extent you provide us with any feedback, comments or suggestions (“Feedback“), you grant us a royalty-free, fully paid up, worldwide, perpetual, and irrevocable license to incorporate the Feedback into the Services or any of our current or future products or services.
  8. Indemnification
    1. You will indemnify, defend, and hold harmless DECI, its affiliates, resellers, employees, and agents (the “Indemnified Parties“) from and against all liabilities, damages, and costs (including reasonable attorneys’ fees) arising out of any claim, demand, suit or proceeding by a third party alleging that your Model or your use of the Services infringes or misappropriates a third party’s intellectual property rights or violates applicable law or that your use of the Services is in violation of these Terms.
  9. Disclaimers of Warranties
    1. THE SERVICES ARE PROVIDED ON AN “AS IS”, AND “AS AVAILABLE” BASIS, AND DECI, DISCLAIMS ALL WARRANTIES OF ANY KIND, EXPRESS, IMPLIED, OR STATUTORY, INCLUDING BUT NOT LIMITED TO RELIABILITY OF SERVICE, WARRANTIES OF NON-INFRINGEMENT OR IMPLIED WARRANTIES OF USE, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE OR USE. WE DISCLAIM ALL LIABILITY AND ANY OBLIGATIONS FOR ANY HARM OR DAMAGE CAUSED BY ANY THIRD PARTY HOSTING PROVIDERS.
    2. WE DO NOT WARRANT THAT THE SERVICES WILL BE SECURE, UNINTERRUPTED, WITHOUT ERROR, OR FREE OF DEFECTS.
  10. Limitation of Liability
    1. IN NO EVENT WILL DECI BE LIABLE FOR (I) INCIDENTAL, SPECIAL, INDIRECT, OR CONSEQUENTIAL DAMAGES OR (II) LOSS OF PROFITS OR REVENUE, LOSS OF DATA, BUSINESS INTERRUPTION, OR LOSS OF GOODWILL, IN EACH CASE ARISING OUT OF OR RELATED TO YOUR USE OR INABILITY TO USE THE SERVICES, HOWEVER CAUSED, REGARDLESS OF THE THEORY OF LIABILITY (CONTRACT, TORT, OR OTHERWISE) AND EVEN IF DECI HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
    2. IN NO EVENT WILL DECI’S TOTAL LIABILITY TO YOU FOR ALL DAMAGES ARISING OUT OF OR RELATED TO THESE TERMS OR TO THE SERVICES EXCEED AN AMOUNT OF US$100.00.
    3. THESE LIMITATIONS WILL NOT APPLY TO THE EXTENT PROHIBITED BY LAW.
  11. General
    1. The Services may be subject to export laws and regulations of the United States and other jurisdictions. You will not access or use the Services in any country that is subject to an embargo by the United States and shall not use the Services in violation of any other export restriction. In addition, you shall not provide the Services to persons on the United States Table of Denial Orders, the Entity List, or the List of Specially Designated Nationals.
    2. DECI may change the Terms from time to time, and such change will become effective upon the date when it is posted on the website. You are responsible for checking the website regularly for such changes. By continuing to access or use the Services you agree to be bound by the revised Terms.
    3. If any part of these Terms will be deemed unlawful, void, or for any reason unenforceable, then that provision shall be deemed to be severable from the rest of these Terms and shall not affect the validity and enforceability of any of the remaining provisions of these Terms. In such cases, the part deemed invalid or unenforceable shall be construed in a manner consistent with applicable law to reflect, as closely as possible, the original intent of the parties.
    4. No waiver by us of a breach of any of the provisions of terms of these Terms shall be construed as a waiver of any preceding or succeeding breach of any of the provisions of these Terms.
    5. Nothing in these Terms shall be construed as creating any agency, partnership, trust arrangement, fiduciary relationship, or any other form of joint enterprise between you and DECI.
    6. These Terms contain the entire agreement between DECI and you relating to your use of the Services and supersedes any and all prior agreements between DECI and you in relation to the same. You confirm that, in agreeing to accept these Terms, you have not relied on any representation except as has expressly been made by DECI in these Terms.
    7. You may not assign your rights or delegate your obligations under these Terms without DECI’s prior written consent. Any purported assignment contrary to this section will be null and void.
    8. There are no third-party beneficiaries to these Terms. Without limiting this section, employees of the Customer are not third-party beneficiaries to Customer’s rights under these Terms.
    9. DECI may issue publicity or general marketing communications concerning its involvement with the Customer. In addition, DECI may use Customer’s logo in publications of DECI’s customers.
    10. This Agreement is governed by the laws of the State of Israel, without regards to its conflict of laws principles, and any dispute arising from this Agreement shall be brought exclusively before the courts of Tel Aviv, Israel.