Skip to content

You're not viewing the latest version of the documentation. Click here to go to latest.

Hopsworks Documentation

hopsworks.core

Initializing search

logicalclocks/hopsworks-api

Home
Getting Started ↗
Tutorials
Concepts
Guides
Setup and Administration
Python API
Java API
Community ↗

Hopsworks Documentation

logicalclocks/hopsworks-api

Home
Getting Started ↗
Tutorials
Tutorials
Concepts
Concepts
- Hopsworks Platform
- MLOps Dictionary ↗
- Feature Store
  Feature Store
  - Feature Groups
    Feature Groups
    
    Overview
    
    Write APIs
    
    Feature Pipelines
    
    External Feature Groups
    
    Spine Group
    
    Data Validation/Stats/Alerts
    
    Feature Monitoring
    
    Versioning
    
    On-Demand Feature
  - Feature Views
    Feature Views
    
    Overview
    
    Offline API
    
    Online API
    
    Consistent Transformations
    
    Statistics
    
    Feature Monitoring
    
    Versioning
- Projects
  Projects
- MLOps
  MLOps
- Development
  Development
  - Outside Hopsworks
  - Inside Hopsworks
Guides
Guides
- Feature Store
  Feature Store
  - Data Source
    
    Data Source
    
    Configuration and Creation
    Configuration and Creation
    
    JDBC
    
    Snowflake
    
    Kafka
    
    HopsFS
    
    S3
    
    Redshift
    
    ADLS
    
    BigQuery
    
    GCS
    
    SQL
    
    Usage
  - Feature Group
    
    Feature Group
    
    Create
    
    Create External
    
    Create Spine
    
    Deprecate
    
    Data Types and Schema management
    
    Statistics
    
    Data Validation
    Data Validation
    
    Getting started
    
    Advanced guide
    
    Best practices
    
    Feature Monitoring
    Feature Monitoring
    
    Getting started
    
    Advanced guide
    
    Notification
    
    On-Demand Transformations
    
    Online Ingestion Observability
    
    Time-To-Live (TTL)
  - Feature View
    
    Feature View
    
    Overview
    
    Training data
    
    Batch data
    
    Feature vectors
    
    Feature server
    
    Query
    
    Helper Columns
    
    Model-Dependent Transformation Functions
    
    Spines
    
    Feature Monitoring
    Feature Monitoring
    
    Getting started
    
    Advanced guide
    
    Feature Logging
  - Vector Similarity Search
  - Transformation Functions
  - Compute Engines
  - Client Integrations
    
    Client Integrations
    
    Python / SageMaker / Kubeflow
    
    AWS EMR
    AWS EMR
    
    Networking
    
    Configure EMR for Hopsworks
    
    Azure HDInsight
    
    Azure Machine Learning
    Azure Machine Learning
    
    Designer
    
    Notebooks
    
    Apache Spark
    
    Apache Flink
    
    Apache Beam
    
    Java
  - Sharing
  - Tags
  - Provenance
  - Feature Monitoring
    
    Feature Monitoring
    
    Scheduled Statistics
    
    Statistics Comparison
    
    Interactive Graph
- Projects
  Projects
  - Authentication
    Authentication
    
    Registration
    
    Login
    
    Password Recovery
    
    OAuth2 Authentication
    
    LDAP Authentication
    
    Kerberos Authentication
    
    Update Profile
  - Projects
    Projects
    
    Create Project
    
    Manage Members
  - Python
    Python
    
    Environments Overview
    
    Clone Environment
    
    Install Library
    
    Export Environment
    
    Custom Commands
    
    Environment History
  - Jupyter
    Jupyter
    
    Run Python Notebook
    
    Run PySpark Notebook
    
    Run Ray Notebook
    
    Remote Filesystem Driver
  - Jobs
    Jobs
    
    Run Python Job
    
    Run Jupyter Notebook Job
    
    Run PySpark Job
    
    Run Spark Job
    
    Run Ray Job
    
    Scheduling
  - Kubernetes Scheduling
    Kubernetes Scheduling
    
    Base
    
    Kueue
  - Airflow
  - OpenSearch
    OpenSearch
    
    Connect
    
    KNN
  - Kafka
    Kafka
    
    Create Schema
    
    Create Topic
    
    Produce messages
    
    Consume messages
  - Git
    Git
    
    Configure Git Provider
    
    Clone Repository
    
    Repository Actions
  - Secrets
    Secrets
    
    Create Secret
  - Api Keys
    Api Keys
    
    Create API Key
  - AWS IAM Roles
  - Query Engine
  - Python Deployment
    Python Deployment
    
    Deployment Creation
    
    REST API
    
    Troubleshooting
- MLOps
  MLOps
  - Model Registry
    
    Model Registry
    
    Frameworks
    Frameworks
    
    TensorFlow
    
    Torch
    
    Scikit-learn
    
    LLM
    
    Python
    
    Model Schema
    
    Input Example
    
    Model Evaluation Images
  - Model Serving
    
    Model Serving
    
    Model Deployment
    Model Deployment
    
    Deployment Creation
    
    Deployment State
    
    Predictor (KServe)
    
    Transformer (KServe)
    
    Inference Logger
    
    Inference Batcher
    
    Resources
    
    Autoscaling
    
    Scheduling
    
    API Protocol
    
    REST API
    
    Troubleshooting
    
    External Access
  - Vector Similarity Search
  - Provenance
- Migration
  Migration
  - 3.X to 4.0
Setup and Administration
Setup and Administration
- Client Installation
  Client Installation
- Cloud Installation
  Cloud Installation
- On-Prem
  On-Prem
  - Background
  - External Kafka cluster
- Administration
  Administration
  - Cluster Configuration
  - User Management
  - Project Management
  - Configure Alerts
  - IAM Role Chaining
  - Configure Project Mapping
  - Monitoring
    Monitoring
    
    Services Dashboards
    
    Export metrics
    
    Services Logs
  - Authentication
    Authentication
    
    Configure Authentication
    
    Configure OAuth2
    Configure OAuth2
    
    Register an Identity Provider
    
    Create Okta Client
    
    Create Azure Client
    
    Configure Project Mapping
    
    Configure LDAP/Kerberos
    Configure LDAP/Kerberos
    
    Configure LDAP
    
    Configure Kerberos
    
    Configure server for LDAP and Kerberos
    
    Configure Project Mapping
  - High availability / Disaster Recovery
    High availability / Disaster Recovery
    
    Overview
    
    High Availability
    
    Disaster Recovery
  - Audit
    Audit
    
    Access Audit Logs
    
    Export Audit Logs
  - Service Operations
  - Query Engine
- ArrowFlight Server with DuckDB
Python API
Python API
- hopsworks
  hopsworks
  - alert
  - alert_receiver
  - client
    client
    
    exceptions
  - core
    core
    
    hopsworks.core hopsworks.core
    Table of contents
    
    FeatureColumnMapping
    
    FullLoadConfig
    
    LoadingConfig
    
    SinkJobConfiguration
    
    alerts_api
    
    dataset_api
    
    environment_api
    
    flink_cluster_api
    
    git_api
    
    job_api
    
    job_configuration
    
    kafka_api
    
    opensearch
    
    opensearch_api
    
    rest_endpoint
    
    search_api
    
    secret_api
  - environment
  - execution
  - flink_cluster
  - git_commit
  - git_file_status
  - git_provider
  - git_remote
  - git_repo
  - job
  - job_schedule
  - kafka_schema
  - kafka_topic
  - project
  - secret
  - tag
  - triggered_alert
  - user
- hsfs
  hsfs
  - constructor
    constructor
    
    filter
    
    join
    
    query
  - core
    core
    
    data_source
    
    data_source_data
    
    explicit_provenance
    
    feature_descriptive_statistics
    
    feature_logging
    
    feature_monitoring_config
    
    feature_monitoring_result
    
    monitoring_window_config
    
    online_ingestion
    
    online_ingestion_result
  - embedding
  - expectation_suite
  - feature
  - feature_group
  - feature_logger
  - feature_logger_async
  - feature_store
  - feature_view
  - ge_expectation
  - ge_validation_result
  - hopsworks_udf
  - online_config
  - serving_key
  - split_statistics
  - statistics
  - statistics_config
  - storage_connector
  - training_dataset
  - training_dataset_feature
  - transformation_function
  - transformation_statistics
  - validation_report
- hsml
  hsml
  - core
    core
    
    explicit_provenance
  - deployable_component
  - deployment
  - inference_batcher
  - inference_logger
  - model
  - model_registry
  - model_schema
  - model_serving
  - predictor
  - predictor_state
  - predictor_state_condition
  - resources
  - scaling_config
  - schema
  - transformer
Java API
Community ↗

Table of contents

FeatureColumnMapping
FullLoadConfig
LoadingConfig
SinkJobConfiguration

hopsworks.core #

FeatureColumnMapping #

Returned by

FullLoadConfig #

Returned by

LoadingConfig #

Returned by

SinkJobConfiguration #

Returned by

FeatureGroup.sink_job_conf