Conda Repositories

Overview

From version 6.3,Artifactory natively supports Conda repositories forPython, R, Ruby, Lua, Scala, Java, JavaScript, C/ C++, FORTRAN and additionalprogramming languages, giving you full control of your deployment and resolution process of Conda packages.

Conda repositories in Artifactory offer the following benefits:

Secure and private local Conda repositories with fine-grained access control.
The ability to proxy remote Conda resources and cache downloaded Conda packages to keep you independent of the network and the remote resource.
Virtual Conda repositories that support a single URL through which to manage the resolution and deployment of all your Conda packages.
Metadata calculation of the Conda packages hosted in the Artifactory local repositories.
Version management: Archiving older versions of the packages uploaded to local repositories.

Minimal supported Conda client version

Artifactory supports Conda Client version 4.3.0 and above. We recommend using the latest version.

Page Contents

Configuration

局部存储库

To enable calculation of Conda metadata, selectCondaas thePackage Typewhen you create your local repository.

Local Repository Layout

The local Conda repository in Artifactory gives you the flexibility of deploying your packages in a layout of your choice. When deploying Conda binaries into nested paths, it is important to ensure that the channel URL inside your.condarcfile correctly reflects the path of the packages. The Conda client automatically appends the host machine platform as a subdirectory in the channel URL. When you deploy these packages, you need to meet this requirement and upload your packages into the relevant subdirectories. For example, consider the following valid package path in Artifactory:

conda-local/osx-64/my-conda-package.tar.bz2

Based on this layout, the corresponding channel URL in your.condarcfile is:

/artifactory/api/conda/conda-local

In the above example, Conda will be appending the platform automatically (i.e osx-64).

Another example shows a more detailed deployment path such as:

/artifactory/conda-local/my/own/layout/osx-64/my-conda-package.tar.bz2

在这个例子中,你的频道L should be set as follows:

/artifactory/api/conda/conda-local/my/own/layout

Best Practice for Scaling Up

The Conda repository metadata is maintained on the package level, meaning that the parent directory of a Conda package is also the parent of the Condarepodata.jsonmetadata file. To scale with maximum efficiency, refrain from deploying large amounts of packages into a single parent directory when possible. Toenable Artifactory metadata calculation processes to provide maximal performance, try to plan your local repository layouts in a way that supports modularity by avoiding directories with large amounts of artifacts as their direct children.

Remote Repositories

You can create a Conda remote repository to proxy and cache remote repositories or other Artifactory instances.

Note that the index files for remote Conda repositories are stored and renewed according to theRetrieval Cache Periodsetting on your remote repository.

Virtual Repositories

A virtual repository in Artifactory aggregates packages from both local and remote repositories allowing you to access both locally hosted Conda packages and remote proxied Conda libraries from a single URL defined for the virtual repository.

To create a virtual Conda repository, setCondaas thePackage Type,and select the underlying local and remote Conda repositories to include under theRepositoriessection.

Virtual Repository Metadata

Artifactory maintains your aggregated virtual repository metadata in a clever way that keeps your metadata up-to-date by reflecting changes in the aggregatedlocalrepositories in real-time. For aggregatedremoterepositories, the virtual repository metadata is renewed on-demand, in minimal intervals of 10 minutes by default. The renewal period is controlled using theRetrieval Cache Periodparameter of your virtual repository.

Resolving Conda Packages

Resolving Conda Packages in the UI

When a Conda repository is selected in the Artifacts Tree Browser, clickSet Me Upto view the code snippets you can use to publish a Conda package or to configure your Conda client to resolve artifacts using the selectedrepository.

Resolving Conda Packages using the Conda Client

1. Perform the process of settings up your.condarcfile according to the instructions in theSET ME UPscreen for Conda.

2. Install a package from your Artifatory Conda repository:

conda install

3. Install a package from a specific sub-channel inside your Conda repository:

conda install -c

4. Search for a package in your Artifactory Conda repository:

conda search

Deploying Conda Packages

You can deploy packages to a local or virtual Conda repository using theDeployfeature in the UIor using an HTTP client of your choice.

Metadata Updates

The Conda metadata is automatically calculated and updated when adding, removing, copying or moving Conda packages. The calculation is only invoked after a package-related action is completed.
It may sometimes take up to 30 seconds to completeas the process is asynchronous and its performance depends on the overall system load.
Although rarely required, you may wish to invoke metadata calculation on the entire repository. This can be done using theRecalculate Indexoption after you right-click the repository in the Tree Browser, or via theREST API.

Setting the Default Deployment Repository

To deploy Conda packages to a virtual Conda repository, make sure you have set theDefault Deployment Repository.

Deploying a package using the UI

You can drag and drop, or select a Conda package to upload in Deploy in the UI.

Deploying a Source Package

When deploying sources, the Target Path is automatically displayed and we recommendnot changing this path.Changing the 'src/contrib' path will result in Artifactory not identifying the package as a Conda package since Artifactory will not be able to index it.

Deploying a Binary Package

When deploying binaries, you'll need to configure the settings in the Conda Artifact section.

In the Conda Artifact section, configure these fields when deploying the Conda packages. It is mandatory to set these fields which are used to create the destinationpath of the deployed binary package.

Distribution: Specifies the operating system.
R Version: Indicates theRversion used.

Target Path

The Target path is updatedafterthe file is deployed and there is no need to change it.

Deploying a Package using cURL

You can deploy a Conda package using cURL:

Deploy source package

curl -XPUT -uadmin:password "http://localhost:8081/artifactory/conda-local/" -T my-package-1.0.0.tar.gz

Viewing Individual Conda Package Information

Artifactory supports viewing selected Conda package metadata directly from the UI.

In theTree Browser,select your virtual Conda repository and scroll down to find and select the package you want to inspect. The metadata is displayed in theConda Infotab.

Reindexing a Conda Repository

You can trigger asynchronous reindexing of a local Conda repository either through the UI or using the REST API.
通过UI,选择在th Conda存储库eTree Browserand selectRecalculate Indexfrom the right-click menu as shown below. This requires Admin permissions.

To reindex a Conda repository through the REST API, please refer toCalculate Conda Repository Metadata.

Tuning Metadata Worker Threads

Conda Metadata Workers

Conda calculates metadata asynchronously based on repository storage events. The number of total worker threads that handle metadata calculation in parallel (specifically for Conda tasks) defaults to 5. In larger scales, you may modify this parameter by editing your $ARTIFACTORY_HOME/etc/artifactory.system.properties file and adding the following parameter:

artifactory.conda.metadata.calculation.workers=