Package com.logicalclocks.hsfs

Class StorageConnector.BigqueryConnector

java.lang.Object

com.logicalclocks.hsfs.StorageConnector

com.logicalclocks.hsfs.StorageConnector.BigqueryConnector

Enclosing class:

StorageConnector

public static class StorageConnector.BigqueryConnector
extends StorageConnector

Nested Class Summary

Nested classes/interfaces inherited from class com.logicalclocks.hsfs.StorageConnector

StorageConnector.AdlsConnector, StorageConnector.BigqueryConnector, StorageConnector.GcsConnector, StorageConnector.GlueConnector, StorageConnector.HopsFsConnector, StorageConnector.JdbcConnector, StorageConnector.KafkaConnector, StorageConnector.MongoDbConnector, StorageConnector.RedshiftConnector, StorageConnector.S3Connector, StorageConnector.SapHanaConnector, StorageConnector.SnowflakeConnector, StorageConnector.SqlConnector

Field Summary

Fields

Modifier and Type	Field	Description
protected List<Option>	arguments
protected String	dataset
protected String	keyPath
protected String	materializationDataset
protected String	parentProject
protected String	queryProject
protected String	queryTable

Fields inherited from class com.logicalclocks.hsfs.StorageConnector

description, featurestoreId, id, LOGGER, name, storageConnectorApi, storageConnectorType

Constructor Summary

Constructors

Constructor	Description
BigqueryConnector()

Method Summary

Modifier and Type	Method	Description
String	getPath(String subPath)
Map<String,String>	sparkOptions(DataSource dataSource)	Set spark options specific to BigQuery.

Methods inherited from class com.logicalclocks.hsfs.StorageConnector

refetch, sparkOptions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

keyPath

protected String keyPath

parentProject

protected String parentProject

queryProject

protected String queryProject

dataset

protected String dataset

queryTable

protected String queryTable

materializationDataset

protected String materializationDataset

arguments

protected List<Option> arguments

Constructor Details

BigqueryConnector

public BigqueryConnector()

Method Details

sparkOptions

public Map<String,String> sparkOptions(DataSource dataSource)

Set spark options specific to BigQuery.

Specified by:

sparkOptions in class StorageConnector

Returns:

Map

getPath

public String getPath(String subPath)

Specified by:

getPath in class StorageConnector