Frequently Asked Questions#
This page answers common questions about Kolena and how to use it to test ML models.
If you don't see your question here, please reach out to us on Slack or at firstname.lastname@example.org!
What data types does Kolena support?
Testing in Kolena is fully customizable and supports computer vision, natural language processing, and structured data (tabular, time series) machine learning models. This includes images, documents, videos, 3D models and point clouds, and more.
We're constantly adding new data types and annotation types — if you don't see what you're looking for, reach out to us and we'll happily extend our system to support your use case.
Do I have to upload my images, documents, or files to Kolena?
No. Kolena doesn't store your data (images, videos, documents, 3D assetes, etc.) directly, only URLs pointing to the right location in a cloud bucket or internal infrastructure that you own.
While onboarding your team, we'll discuss what access restrictions are necessary for your data and select the right integration solution. As one example, as a part of the integration we might restrict access to files registered with Kolena to only users on your corporate VPN.
We support a variety of integration patterns depending on your organization's requirements and security stance. Get in touch with us to discuss details!
Do I have to upload my models to Kolena?
No. Tests are always run in your environment using the
kolena Python client, and you never
have to package or upload models to Kolena.
Where does Kolena fit into the MLOps development life cycle?
Kolena is primarily a testing (or "offline evaluation") platform, coming after training and before deployment. We believe that increased emphasis on this offline evaluation segment of the model development life cycle can save effort upstream in the data collection and training process as well as prevent headaches downstream in deployment.
How do I generate an API token?
Generate an API token by visiting the
page, located at the bottom of the lefthand sidebar, then copy/paste the shell snippet to set this token as
KOLENA_TOKEN in your environment.
How many API tokens can I generate?
API tokens are scoped to your username. Each user is limited to one valid token at a time — generating a new token on the Developer page invalidates any previous token generated for your user.
To retrieve a service user API token that is not scoped to a specific username, please reach out to us on Slack or at email@example.com.
My data is being ingested in the wrong format for a CSV exported using
pandas.DataFrame.to_csv does not always handle object serialization seamlessly. Please reference
dataframe_to_csv for a drop-in replacement.
Does Kolena support file versioning?
If you are using Amazon S3 or Google Cloud Storage, Kolena supports file versioning for any linked
This includes test samples, assets, as
well as certain annotation types. Simply enable bucket versioning on your
GCS bucket and make sure to pass the
generation (GCS) as part of the
For more information, see the examples in
How can I add new users to my organization?
Administrators for your organization can add new users and grant users administrator privileges by visiting the Organization Settings page and adding entries to the Authorized Users table.
Note that this page is only visible for organization administrators.
Who are administrators for my organization?
Certain members of each organization have administrator privileges. These administrators can manage users access and privileges, as well as configure Integrations.
You may become an administrator by having an existing administrator grant you privileges using the Organization Settings page.
I'm new to Kolena — how can I learn more about the platform and how to use it?
On each page, there is a button with the icon next to the page title. Click on this button to bring up a detailed tutorial explaining the contents of the current page and how it's used.
How can I report a bug?
If you encounter a bug when using the
kolena Python client or when using app.kolena.io,
message us on Slack, email your support representative or firstname.lastname@example.org, or
open an issue on the
kolena repository for Python-client-related
Please include any relevant stacktrace or platform URL when reporting an issue.