Models#

Browsing models#

Anaconda hosts a repository of open-source and partner models that you can explore and use to test and develop your applications.

Tip

Use the search function to locate models by name.

Contact us if you are interested in specific models or use cases.

Filtering models#

You can apply filters to help you efficiently locate the models that you want to use.

To apply a filter:

  1. From the Models page, click Filter.

  2. Open a filter dropdown and select a filter option.

  3. Repeat as necessary to filter down to only the models you want.

Model filters:
  • Purpose - Currently, the only field in this category is text generation. Future releases will expand on this category, allowing you to filter models by the specific types of tasks they excel at.

  • Language - Filter models by which spoken languages they can understand.

  • License - Filter models based on their usage permissions and restrictions, such as permissive, non-commercial, or specific distribution terms.

  • Date Published - Filter models based on the date they were published to AI Navigator. Click to reset the currently applied date filter.

Click the beside any filter to remove it, or click Clear in the All Filters panel to clear all filters at once.

Downloading models#

Anaconda provides a variety of LLM models for you to work with, constructed at various levels of quantization.

To download a model:

  1. Select Models from the left-hand navigation.

  2. Locate a model you want to download.

  3. Open the Quantization Method dropdown and select a file quantization level, then click Download to Use to download the model locally.

    Note

    Models that show a Downloaded tag on their tile indicate that you have downloaded at least one file for that model.

Managing downloads#

Pause, Resume, or Cancel a download by using the buttons below the progress bar at the bottom of the model’s tile, or by navigating to the Downloaded Models page and using the pause , play , or cancel icons beside the progress bar.

Note

A download’s status is displayed on the tile below the progress bar. Downloads automatically pause if you exit the application for any reason.

Viewing model details#

Click on a model’s tile to view its details. From here, you can read a brief description of the model and see important information about it, such as its file size at each quantization level, parameter count, the quality you can expect from the model’s output, how much resource usage can be expected by the model, and its intended purpose (for use in either development or production).

Tip

  • Hover over a tooltip icon to view detailed information about the various aspects of a model.

  • Click Learn more to visit the Huggingface webpage of the organization that built the model.