Skip to content

Testing with Kolena

metrics

Initializing search

kolenaIO/kolena

Developer Guide
API Reference
Metrics Glossary
Help & FAQ
Sign in ↗

Testing with Kolena

kolenaIO/kolena

Developer Guide
Developer Guide
- Installing kolena
- Datasets
  Datasets
  - Quickstart
  - Dataset Formatting
  - Core Concepts
    
    Core Concepts
    
    Dataset
    
    Quality Standard
  - Advanced Usage
    
    Advanced Usage
    
    Extracting Metadata from Text Fields
    
    Setting Up Natural Language Search
- Workflows
  Workflows
  - Quickstart
  - Core Concepts
    
    Core Concepts
    
    Workflow
    
    Test Case & Test Suite
    
    Model
  - Building a Workflow
  - Advanced Usage
    
    Advanced Usage
    
    Packaging for Automated Evaluation
    
    Nesting Test Case Metrics
    
    Uploading Activation Maps
    
    Setting Up Natural Language Search
- Connecting Cloud Storage
  Connecting Cloud Storage
API Reference
API Reference
- kolena.annotation
- kolena.asset
- kolena.errors
- kolena.initialize
- kolena.io
- kolena.metrics
- kolena.dataset
  kolena.dataset
- kolena.workflow
  kolena.workflow
  - TestSample
  - GroundTruth
  - Inference
  - Evaluator
  - TestCase
  - TestSuite
  - Model
  - test
  - Utilities
    Utilities
    
    Annotations
    
    Assets
    
    Plots
    
    define_workflow
    
    metrics
    
    ThresholdedMetrics
    
    visualization
    
    IO
- Pre-built Workflows
  Pre-built Workflows
  - Object Detection (2D)
  - Classification
Metrics Glossary
Metrics Glossary
- Accuracy
- Average Precision
- Averaging Methods
  Macro, Micro, Weighted
- Coefficient of Determination (R²)
- Cohen's Kappa
- Confusion Matrix
- F₁-score
- False Positive Rate (FPR)
- Mean Absolute Error (MAE)
- Mean Squared Error (MSE)
- Precision
- Precision-Recall (PR) Curve
- Recall (TPR, Sensitivity)
- ROC Curve
  AUC ROC
- Root Mean Squared Error (RMSE)
- Specificity (TNR)
- TP / FP / FN / TN
- Computer Vision
  Computer Vision
  - Geometry Matching
  - Intersection over Union (IoU)
- Large Language Models
  Large Language Models
- Natural Language Processing
  Natural Language Processing
- Kolena Insights
  Kolena Insights
  - Statistical Significance
Help & FAQ
Help & FAQ
Sign in ↗

API Reference
kolena.workflow
Utilities

`kolena.workflow.metrics`#

Deprecated

This page has been migrated to kolena.metrics

January 19, 2024 GitHub

define_workflow

ThresholdedMetrics

Copyright © 2021-2024 Kolena